Director, Data Engineering
Tasks
- Automate ingestion transformation orchestration deployment monitoring recovery
- Build trusted data products for analytics and machine learning
- Define Databricks development best practices
- Define engineering KPIs
- Design cloud-native data pipelines
- Embed data governance metadata lineage and data quality
- Establish CI/CD and automated testing
- Establish engineering standards and delivery frameworks
- Implement Infrastructure as Code and DevOps practices
- Implement enterprise information models and integration patterns
- Improve observability and monitoring
- Lead data engineering organization
- Migrate ETL to ELT with Databricks
- Modernize legacy data platforms
- Optimize performance scalability reliability and cloud costs
- Perform root cause analysis and continuous improvement
- Serve as technical leader for Databricks lakehouse
Perks/Benefits
- Dental insurance
- Disability insurance
- Life insurance
- Medical insurance
- PTO
- Retirement savings
- Vision insurance
Skills/Tech-stack
Apache Spark | Azure | CI/CD | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | DevOps | Dimensional Modeling | Git | Infrastructure as Code | Lakeflow | Medallion Architecture | PySpark | Python | SQL | SQL Dimensional Modeling | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Manager, Data Engineering USD 104K-123KAgile | Alerting | Azure DevOps | CI/CD | Cause analysisSenior-level Full TimeN/A, N/A, United States R15h ago
-
Senior, Engineering Manager - Perception & Auto-Tagging USD 195K-234K2D Object Detection | 3D Object Detection | AWS | Auto-labeling | Cloud infrastructure401k employer match | Accidental death insurance | Dental insurance | Flexible schedule | Health insuranceSenior-level Full TimeAnn Arbor, MI, Remote - US R1d ago
-
Data Engineering Director - Hybrid USD 138K-214KAudit Logging | Big Data | Cloud Platforms | Data Architecture | Data Catalog401k match | Adoption Assistance | Commuter benefits | Dental insurance | Employee stock purchase planExecutive-level Full TimeOH Richfield-3250 Interst, United States R1d ago
-
APIs | Business Intelligence | Change Management | Confluence | Dashboard DevelopmentHybrid option | Remote work | Travel for business occasionallyExecutive-level Full TimeRemote - New York, United States R1d ago
-
Manager, Enterprise Data Engineer USD 125K-225KADLS | AI Search | Azure AI | Azure AI Search | Azure DataTelecommuting | Travel 25 percentMid-level Full TimeManhattan, United States R1d ago
-
Lead Data Migration - Archival - DR Engineer USD 128K-173KAWS Backup | AWS DMS | Audit Trail | Automated failover | Data GovernanceSenior-level Full TimeUSA DC Home Office (DCHOME), United … R1d ago
-
Director of AI Engineering USD 180K-240KAPI Development | Agent systems | Deployment | JavaScript | Langchain401k | Annual bonus | Dental insurance | Equity incentive plan | Flexible vacationExecutive-level Full TimeU.S. Remote R1d ago
-
Senior Director, Revenue Analytics USD 203K-345KBusiness Intelligence | Churn Prediction | Claude | Customer Analytics | Data GovernanceEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Team member resource groupsSenior-level Full TimeRemote, United States R1d ago
-
Manager II, Data Platform USD 154K-234KAWS | AWS DMS | AWS Fargate | Amazon DynamoDB | Amazon ECSComprehensive health insurance | Flexible remote work | Parental leave | Professional development stipendMid-level Full TimeRemote - US R1d ago
-
Manager - Data Engineering USD 75K-100KAgile methodology | Airflow | Automated testing | BigQuery | Campaign Performance401(k) retirement benefits | Casual dress code | Company events | Employee discount | Health benefitsMid-level Full TimePittsburgh, PA, United States R1d ago
-
Dashboards | Data Modeling | Data Visualization | Data Warehousing | Database DesignHealth insurance | Job security | Loan forgiveness | Pension plan | Tax Deferred Savings PlanExecutive-level Full TimeNew York City, NY, United States R1d ago
-
Associate Director, Data Engineering & Architecture USD 152K-220KAI/ML | AWS | Analytics | Cloud Data | Cloud Data Platforms401k matching | Employee Resource Groups participation | Employee stock purchase plan | Fitness reimbursement | Life insuranceMid-level Full TimeRemote, USA, United States R2d ago
-
Senior Data Engineer (Microsoft Fabric / Financial Data) USD 100K-170KAzure Data | Azure Data Factory | Data Factory | Data Governance | Data ModelingSenior-level Full TimeUSA - IL (Remote), United States R2d ago
-
Associate Director, Advanced Analytics USD 155K-170KA/B | A/B Testing | Attribution Modeling | B testing | CRM AnalyticsChildcare resources | Disability insurance | Fertility assistance program | Fitness reimbursement | Health insuranceMid-level Full TimeLos Angeles, California, United States R2d ago
-
API Integration | AWS Athena | Agent-based | Agent-based AI | Apache Cloudera401k plan | Employee assistance program | Flexible time off | Health coverage | Paid time offSenior-level Full TimeSeattle 1616 Eastlake - WA, United … R2d ago
-
Engineer III - Platform Data Engineer (Remote) USD 120K-180KAWS | Access Control | Apache Airflow | Apache Superset | AzureCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks and volunteer opportunities | Great Place to Work certified | Paid parental leaveSenior-level Full TimeUSA NY Remote, United States R2d ago
-
Azure Synapse | Coupa | Data Governance | Data Lineage | Data Management401k match | Life insurance | Medical/Dental/Vision insurance | Paid time offExecutive-level Full TimeRemote - CO, United States R2d ago
-
Data Architect, Lead USD 99K-225KAWS | AWS Glue | AWS Lake | AWS Lake Formation | AWS S3Dependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, VA, Charlottesville (2055 Boulders Rd), … R2d ago
-
Manager, Data Engineering USD 140K-185KAzure Data | Azure Data Bricks | Boome | CI/CD | DBT401k match | Dental insurance | Dependent care spending account | EAP | Flexible Friday early log offMid-level Full TimeRemote (United States) R2d ago
-
Director Data Science and Optimization USD 109K-168KAutomation | Code review | Data Science | Engineering Fundamentals | ExperimentationEmployee discounts | Employee recognition and rewards program | Employee referral bonuses | Medical, dental, and vision benefits | Paid time offExecutive-level Full TimeHouston, Texas, United States R2d ago
-
Executive-level Full TimeRemote, United States R2d ago
-
Director, Healthcare Analytics USD 170K-200KAI analytics | Data Governance | Data Pipelines | Data Visualization | Data analyticsBest places to work recognition | Innovation culture | Professional development opportunitiesExecutive-level Full TimeRemote (United States) R2d ago
-
Senior Data Engineering & Analytics Lead USD 133K-170KBusiness Intelligence | Data Governance | Data Modeling | Data Pipelines | Data Quality401k match | Health insurance | Periodic in person team meetings | Profit sharing | Remote work flexibilitySenior-level Full TimePomona, California, United States - Remote R2d ago
-
Head of AI/ML (Director/VP) - VC Backed Startups USD 250K-300KAWS | Airflow | Artificial Intelligence | Azure | Data EngineeringExecutive-level Full TimeNYC - Hybrid R2d ago
-
AI Engineering Manager USD 500KAI Agents | APIs | Amazon Web Services | Artificial Intelligence | Azure401k match | Back up child adult and elder care | Family support programs | Fertility assistance | In office work with possible hybrid optionMid-level Full TimePlano, TX, United States R3d ago