Principal Data Engineer
Tasks
- Assess and mitigate risks
- Build dimensional models and data warehouse designs
- Coordinate across engineering and product teams
- Decompose strategic direction into projects
- Define strategic outcomes and influence roadmaps
- Design scalable cost effective data solutions
- Develop data pipelines using infrastructure as code and CI CD
- Drive data engineering best practices
- Escalate issues while solving in parallel
- Estimate work with unknowns and coach estimation best practices
- Implement data quality frameworks and validation testing
- Improve customer end to end experience
- Integrate BI platforms for business insights
- Lead data projects and set technical direction
- Manage stakeholders and negotiate in complex scenarios
- Mentor and develop engineers and leaders
- Migrate production systems to ELT platforms
- Orchestrate workflows with Airflow Dagster or Databricks Workflows
- Plan communicate and execute challenging problems
- Process data at scale with Apache Spark
- Propose organization processes to improve throughput and engagement
- Set codebase health standards
- Simplify complex high ambiguity problems
- Translate business needs into data projects
- Use Git branching strategies for collaborative development
Perks/Benefits
- 401k matching
- Access to Perks at Work program
- EAP
- EAP health advocacy program
- Education budget
- Flexible spending account
- Group life disability and AD and D insurance
- Health savings account
- Health, dental, and vision insurance
- Paid Holidays
- Paid time off
Skills/Tech-stack
AWS | Airflow | Apache Spark | Azure | CI/CD | Dagster | Data Quality | Data Validation | Data Vault | Data Warehouse | Databricks | Databricks Workflows | Dimensional Modeling | GCP | Git | Go | Infrastructure as Code | Kafka | Looker | Pulumi | Python | Snowflake | Tableau | Terraform | Version control | “as-code”
Education
N/A
Related jobs
-
Sr Data Platform Engineer - MongoDB USD 114K-152KAWS | Aggregation Pipeline | Ansible | Backup and Recovery | Bash401k matching | Accident and life insurance | Dental insurance | Education reimbursement | Health insuranceSenior-level Full TimeOffice Location or Remote - USA R7h ago
-
Associate Data Scientist - Originations USD 85K-115KData pipeline | Machine Learning | PyTorch | Python | SQL401k match | Company equipment provided | Company in person events | Company-paid medical, dental & vision | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R7h ago
-
Senior AI/ML Engineer USD 125K-157KAWS | Access Controls | Agent Orchestration | Audit trails | CI/CD401k | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R9h ago
-
Bioinformatics Production Analyst/Production Engineer USD 102K-128KData Visualization | Genomics | HIPAA | Health information | Linux401k benefits | Commuter benefits | Disability insurance | Employee referral program | Fertility care benefitsEntry-level Full TimeUS Remote R11h ago
-
Staff Data Engineer USD 130K-150KAWS | Apache Spark | Batch Processing | Data Architecture | Data Lake401k match | Bereavement leave | Cell phone reimbursement | Company equipment reimbursement | Dental insuranceSenior-level Full TimeUnited States - Remote Flexibility R15h ago
-
IT Data Engineer USD 117K-124KANSI X12 | ARM Templates | Automl | Azure | Azure DataBackground screening provided | Flexible work hours | Mentorship | Professional development opportunitiesSenior-level Full TimeUS - Remote R18h ago
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Data Modeling | Data Visualization401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, Los Angeles, CA; San … R1d ago
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | Critical Systems401k | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | Data Ingestion | Data Ingestion Pipelines | Deployment401k | Health insurance | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R1d ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Data Quality | Data labeling100 percent remote work | Career growth opportunities | Visa transfer support for qualified candidatesMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseLong-term career growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | CachingBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Software Engineer (Remote) USD 50K-130KAgile | ETL | Git | Google BigQuery | Google DataformRemote workEntry-level Full TimeTEXAS - VIRTUAL - TX01, United … R1d ago
-
Sr Staff - Data Platform Engineer USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Airflow | Apache HudiDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Automated benchmarking | DPO | Dataset curation | Direct Preference OptimizationCareer growth potential | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Data & Integrations Engineer USD 100K-100KAPI Gateway | API Management | AWS API | AWS API Gateway | AWS LambdaCareer development | Fully remoteSenior-level Full TimeRemote Ohio, United States R1d ago
-
ML Platform Engineer USD 100K-150KAPI Gateway | Abuse detection | Automated rollback | Autoscaling | C++100 percent remote | Career growth | H1B transfer supportSenior-level Full TimeUnited States - Remote R1d ago
-
Audio Machine Learning | Audio Separation | Cloud Computing | Fine Tuning | Language ModelsAviation immersion opportunities | Equity upside | Free flight training | Remote work | Technical leadership opportunitySenior-level Full TimeSan Francisco, CA; Onsite R1d ago
-
Senior MLOps & Generative AI Engineer - Remote USD 91K-152KAWS | Alerting | Azure | CI/CD | Deep learningAdoption reimbursement | Emergency backup care | Fertility and surrogacy reimbursement | Long-term disability | Medical/Dental/VisionSenior-level Full TimeCorp Facilities MPB - 350 Centre … R1d ago
-
Manager, Applied AI Engineer USD 171K-375KAI/ML | ASR | CRM Integration | Go | GuardrailsHybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (US), United States R1d ago
-
Deep learning | Distributed Computing | JAX | Machine Learning | PyTorch401k match | Dental insurance | Employee assistance program | Flexible work schedules | HolidaysSenior-level Full TimeUS-CT-EAST HARTFORD-ETC ~ 400 Main St … R1d ago