Principal Data Engineer
Tasks
- Architect data platform components
- Assess data quality and schema evolution
- Break requirements into engineering tasks
- Collaborate with data science leads
- Define data models
- Define testing philosophy
- Design ingestion pipelines
- Design transformation frameworks
- Document design decisions
- Ensure production data reliability
- Establish engineering best practices
- Evaluate and adopt data tooling
- Identify downstream dependency risks
- Implement data orchestration
- Implement data validation
- Implement pipeline testing
- Instrument data systems for observability
- Lead architecture reviews
- Manage backlogs and planning
- Manage schema lifecycle
- Mentor and grow engineers
- Set SLAs for data freshness completeness accuracy
- Set code review standards
- Set data platform technical roadmap
- Translate data platform decisions to stakeholders
Perks/Benefits
- Dental insurance
- Employer-matched 401k
- Flexible paid time off
- Health insurance
- Remote work
- Vision insurance
Skills/Tech-stack
AWS | Apache Spark | Batch Processing | Cloud Data | Cloud Data Infrastructure | Cloud platform | Data Contracts | Data Engineering | Data Infrastructure | Data Modeling | Data Observability | Data Pipelines | Data Quality | Data Transformation | Data Validation | Data orchestration | Delta Live Tables | Delta Live) | Feature Engineering | Feature Stores | Google Cloud | Google Cloud Platform | Great Expectations | Ingestion pipelines | Kafka | Machine Learning | Microsoft Azure | Schema evolution | Streaming processing | Structured Streaming | Testing
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Data Modeling | Data Visualization401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, Los Angeles, CA; San … R7h ago
-
Autonomy | C++ | Data Ingestion | Data Ingestion Pipelines | Deployment401k | Health insurance | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R9h ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R10h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R10h ago
-
Senior-level Full TimeCanada R10h ago
-
Sr. AI Engineer (Applied AI & ML Systems) USD 132K-165KAgentic AI | Context engineering | Continuous Improvement | Data Engineering | Data PipelinesE learning license | Hackathons | Healthcare benefits | Home office setup allowance | Identity theft protectionSenior-level Full TimeUnited States R11h ago
-
Data Engineer USD 95K-140KApache Spark | Automated testing | Azure Databricks | CI/CD | Data ModelingMid-level Full TimeUS Remote R12h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R14h ago
-
Associate AI Engineer USD 144K-180K.NET | APIs | ASPNet | AWS | Azure401k matching | Dental insurance | Hybrid work model | Medical insurance | Paid time offMid-level Full TimeIrving, TX R16h ago
-
Agentic AI Engineer USD 130K-170KAgentic AI | Concurrency | Context engineering | Data Compression | Data IngestionCareer growth | Health and well-being programs | Remote work | Supportive teamMid-level Full TimeRemote - United States R16h ago
-
ACME | AWS CloudHSM | AWS KMS | Asymmetric Cryptography | Azure Key Vault401k plan with company matching | Bereavement leave | Employee assistance program | Employee discount program | Health, dental, and vision careSenior-level Full TimeRemote - Nationwide, United States R17h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R17h ago
-
Senior Lead AI/ML and Full Stack Engineer - R01567102 USD 150K-237KAccess Control | Agent systems | Azure | CMDB | Context ManagementHybrid work environmentSenior-level Full TimeMiami, Florida, US R17h ago
-
Senior Healthcare Data Engineer USD 104K-199KConditional Aggregation | Data Modeling | Data Quality | Data Reconciliation | Data Validation401k matching | Employee assistance program | Family building benefits | Flexible spending accounts | HolidaysSenior-level Full TimeSeattle, Washington, United States R17h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Curation401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States; Remote U.S. R19h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Drift401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Remote U.S. R19h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus | Collaborative culture | Distributed-first environmentMid-level Full TimeCanada R21h ago
-
IT Data Engineer USD 60K-65KANSI X12 | AWS | Azure | Azure Data | Azure Data Factory401k retirement plan | Disability coverage | Employee assistance program | Flexible spending account | Medical/Dental/Vision insuranceMid-level Full TimeUS - Remote R21h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic AI | Auditability | CI/CD | Cloud platform401k | Dental insurance | Expense reimbursement for internet costs | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R22h ago
-
APIs | CI/CD | Cloud platform | Compliance | ContainersAnnual leave | Dental coverage | Health coverage | High autonomy | Home office setup supportSenior-level Full TimeCanada R22h ago
-
Edge AI Engineer USD 100K-150KBenchmarking | Bias Evaluation | C++ | Core ML | Data PrivacyCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAgent systems | Computer Vision | Data Quality | Data quality monitoring | Deep learningMid-level Full TimeUnited States - Remote R1d ago
-
LLM Fine-Tuning Engineer USD 100K-150KAdapter methods | Attention Optimization | Benchmarking | Dataset Quality Assurance | Dataset curationCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer, Global Operations USD 107K-143KArtificial Intelligence | ETL | Langchain | Machine Learning | PythonContinuous learning | Flexible work options | Health, wellness, and retirement plans | Professional growth opportunitiesMid-level Full TimeCalifornia - Remote, United States R1d ago
-
AWS | Access Control | Apache Spark | Azure | CI/CD401k retirement plan | Comprehensive benefits | Dental insurance | Employee assistance program | Medical insuranceSenior-level Full TimeUSA, TX, Work-at-Home, United States R1d ago