Principal Data Engineer
Tasks
- Architect data platform components
- Assess data quality and schema evolution
- Break requirements into engineering tasks
- Collaborate with data science leads
- Define data models
- Define testing philosophy
- Design ingestion pipelines
- Design transformation frameworks
- Document design decisions
- Ensure production data reliability
- Establish engineering best practices
- Evaluate and adopt data tooling
- Identify downstream dependency risks
- Implement data orchestration
- Implement data validation
- Implement pipeline testing
- Instrument data systems for observability
- Lead architecture reviews
- Manage backlogs and planning
- Manage schema lifecycle
- Mentor and grow engineers
- Set SLAs for data freshness completeness accuracy
- Set code review standards
- Set data platform technical roadmap
- Translate data platform decisions to stakeholders
Perks/Benefits
- Dental insurance
- Employer-matched 401k
- Flexible paid time off
- Health insurance
- Remote work
- Vision insurance
Skills/Tech-stack
AWS | Apache Spark | Batch Processing | Cloud Data | Cloud Data Infrastructure | Cloud platform | Data Contracts | Data Engineering | Data Infrastructure | Data Modeling | Data Observability | Data Pipelines | Data Quality | Data Transformation | Data Validation | Data orchestration | Delta Live Tables | Delta Live) | Feature Engineering | Feature Stores | Google Cloud | Google Cloud Platform | Great Expectations | Ingestion pipelines | Kafka | Machine Learning | Microsoft Azure | Schema evolution | Streaming processing | Structured Streaming | Testing
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R5h ago
-
Principal Applied AI Scientist - Agentic AI USD 190K-210KAgentic Systems | Autogen | Cloud Computing | Data Quality | Data Systems401k match | Flexible schedule | Health insurance | Paid parental leave | Paid time offSenior-level Full TimeWork From Home, United States R6h ago
-
Principal Applied AI Scientist - Predictive AI USD 190K-210KAnomaly Detection | Big Data | Cloud Computing | Data Quality | Data quality assurance401k match | Disability insurance | Employee assistance program | Flexible schedules | Health insuranceSenior-level Full TimeWork From Home, United States R6h ago
-
Principal Applied AI Scientist - Agentic AI USD 190K-210KAccuracy testing | Agentic Systems | Autogen | Cloud Computing | CrewAI401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible schedulingSenior-level Full TimeWork From Home, United States R6h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R8h ago
-
Software Engineer, Machine Learning USD 213K-293KAPI Design | Agent Orchestration | Artificial Intelligence | Bias Mitigation | C++Senior-level Full TimeSunnyvale, CA | Remote, US | … R11h ago
-
Senior AI Data Engineer USD 155K-185KApache Airflow | Apache Spark | Azure Synapse | BigQuery | ClickHouseEmployer paid Medical Dental Vision Insurance | Flexible paid time off | Manager check ins | Paid cell phone and service | Paid parental leaveSenior-level Full TimeRemote - United States R20h ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS Glue | AWS IAM | Amazon EMR | Amazon S3 | AmundsenDevelopment dollars | Employee stock purchase program | Family-forming benefits | Financial coaching | Flexible time offSenior-level Full TimeRemote, USA R21h ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS EMR | AWS Glue | AWS IAM | AWS S3 | Apache AirflowDevelopment dollars | Financial coaching | Flexible remote work | Flexible time off | Free therapy sessionsSenior-level Full TimeRemote, USA R21h ago
-
Staff Machine Learning Engineer USD 189K-389KCalibration | Contextual Bandits | Contextual Decisioning | Data Validation | EmbeddingsEquity eligible | In Office 1 Day Per WeekSenior-level Full TimeSan Francisco, CA, US; Remote, US R22h ago
-
Senior-level Full TimeUS - Remote R23h ago
-
Agile | C++ | Deep learning | Distributed Computing | GPU ComputingDiscretionary bonus | Flexible time off | Healthcare | Leave benefits | Retirement benefitsExecutive-level Full TimeNY7 - 50 Hudson Yards, New … R23h ago
-
Lead Data Engineer USD 224KApache Airflow | Apache Beam | BigQuery | CI/CD | CMEK401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R23h ago
-
Senior Software Engineer, AI USD 171K-210KAirflow | Amazon Web Services | Apache Hive | Apache Impala | C#Career development access | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-California-Remote, United States R23h ago
-
Senior Software Engineer USD 144K-192KAWS | Angular | Apache Spark | Azure | BuildahCareer development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R23h ago
-
Staff Backend AI Engineer, Remote USD 140K-215KAPI Gateway | AWS CDK | AWS ECS | AWS EKS | AWS Fargate401k matching | Dental insurance | Flexible time off | Flexible work schedule | Medical insuranceSenior-level Full TimeUnited States, UNITED STATES, United States R23h ago
-
Data Engineer USD 160K-210KAPI Integration | AWS | Amazon Kinesis | Artificial Intelligence | CI/CDSenior-level Full TimeUS - Remote R23h ago
-
Principal Data Analyst - Revenue Cycle - Remote USD 108K-170KBusiness Intelligence | Data Modeling | Database performance | EPIC Clarity | Epic systems401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeIrvine, CA, United States R23h ago
-
API Integration | Agile Scrum | Apache Spark | Azure | Azure DataFlexible work from home | Hybrid workMid-level Full TimeHybrid - US R23h ago
-
Senior Machine Learning Engineer, Agentic USD 163K-245KA/B | A/B Testing | B testing | Collaborative Filtering | Content-Based Filtering401-K matching | Fertility benefits | Health insurance | Life and disability insurance | Mental health benefitsSenior-level Full TimeBellevue, WA; Menlo Park, CA R1d ago
-
Data Engineer (Remote) USD 155K-180KAzure DevOps | Bash | Cloud Storage | Cloud platform | Compute EngineFully remote | W2 employmentMid-level Full TimeRochester, MN R1d ago
-
Senior Data Engineer (AI Native) USD 103K-192KAWS EMR | Amazon Kinesis | Amazon MWAA | Amazon S3 | Apache Airflow401k company match | Employee assistance program | Equipment and tools support | Flexible PTO | Learning and developmentSenior-level Full TimeRemote, USA ; Remote, Canada R1d ago
-
Principal Snowflake Data Platform Engineer USD 165K-216KAWS | Agile | Ansible | Backup and Resiliency | BashFlexible hybrid work model | Health and life insurance | Paid time off | Retirement benefitsSenior-level Full TimeTX, United States R1d ago
-
Senior Data Engineer (Remote) USD 108K-160KAkamai | Apigee hybrid | Argo CD | Azure AKS | Batch ProcessingFully remote | W2 Candidates OnlySenior-level Full TimeRochester, MN R1d ago
-
AWS RDS | Agile | Amazon S3 | Dashboards | Data PipelinesMust reside in PST time zone | Remote workMid-level Full TimeSan Jose, CA R1d ago