Director, Data Engineering
Tasks
- Automate ingestion transformation orchestration deployment monitoring recovery
- Build trusted data products for analytics and machine learning
- Define Databricks development best practices
- Define engineering KPIs
- Design cloud-native data pipelines
- Embed data governance metadata lineage and data quality
- Establish CI/CD and automated testing
- Establish engineering standards and delivery frameworks
- Implement Infrastructure as Code and DevOps practices
- Implement enterprise information models and integration patterns
- Improve observability and monitoring
- Lead data engineering organization
- Migrate ETL to ELT with Databricks
- Modernize legacy data platforms
- Optimize performance scalability reliability and cloud costs
- Perform root cause analysis and continuous improvement
- Serve as technical leader for Databricks lakehouse
Perks/Benefits
- Dental insurance
- Disability insurance
- Life insurance
- Medical insurance
- PTO
- Retirement savings
- Vision insurance
Skills/Tech-stack
Apache Spark | Azure | CI/CD | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | DevOps | Dimensional Modeling | Git | Infrastructure as Code | Lakeflow | Medallion Architecture | PySpark | Python | SQL | SQL Dimensional Modeling | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Director for Accounting, Data Analytics and Business Intelligence - School of Medicine USD 100K-149KBudgeting | Business Intelligence | Dashboarding | Data Governance | Data QualityCommuting flexibility based on business needs | Residency in Georgia | Work from home regularlyExecutive-level Full TimeEmory Campus-Clifton Corridor R1d ago
-
Director, Data Engineering USD 195K-220KAgile | Airflow | Amazon Web Services | Analysis Services | Apache Hive401k match | Bonus opportunity | Dental insurance | Direct Deposit | Employee assistance programExecutive-level Full TimePennsauken, NJ 08109 | 39.950866919 | … R1d ago
-
Senior Manager, Data Engineering USD 104K-123KAgile | Azure DevOps | Business Intelligence | CI/CD | Cause analysisSenior-level Full TimeN/A, N/A, United States R1d ago
-
Director, Enterprise Analytics USD 171K-185KConfound Control | Experimentation | Incrementality Measurement | Performance Marketing | Power analysisHealth benefits | Hybrid work scheduleExecutive-level Full TimeCambridge, Massachusetts, United States R2d ago
-
Director of Analytics, Merchant Ecosystem USD 135K-230KA/B | A/B Testing | AI Agents | Airtight Governance | B testing401k matching | Cell phone stipend | Health insurance | Parental leave | Unlimited PTOExecutive-level Full TimeLos Angeles, CA, US R2d ago
-
Senior-level Full TimeMiami, United States R2d ago
-
Director for Accounting, Data Analytics and Business Intelligence - School of Medicine USD 100K-149KBudgeting | Business Intelligence | Compliance reporting | Dashboard Development | Data GovernanceFlexible commuting schedule | Residency in Georgia required | Work from home flexibilityExecutive-level Full TimeAtlanta, GA, United States R2d ago
-
Manager, Data Engineering USD 200K-335KApache Airflow | Apache NiFi | Apache Spark | BigQuery | Cloud platformSenior-level Full TimeUS - San Francisco R2d ago
-
Data Engineering Lead USD 174K-220KAmazon Redshift | BI reporting | DBT | Data Modeling | Data Monitoring401k | Health coverage | Hybrid work environment | Paid parental leave | Paid time offSenior-level Full TimeNew York R2d ago
-
Data Engineering Specialist – AI USD 100K-150KApache Beam | Data Lineage | Data Quality | Java | PythonCareer growth potential | Full-time employment | Remote work | W2 employmentMid-level Full TimeUnited States - Remote R2d ago
-
Executive-level Full TimeRemote - Ohio, United States R2d ago
-
Head of AI & Program Technology Engineering USD 185K-200KAgentic Systems | Artificial Intelligence | Azure | Backup and Recovery | CI/CDSenior-level Full TimeNew York, NY HQ USA, United … R2d ago
-
Engineering Manager, Data Transformation USD 214K-321KAirflow | Amazon S3 | Flink SQL | GRPC | HiveMid-level Full TimeUS-SEA, US-SF, US-NYC, US-Remote R2d ago
-
Director of Analytics, Merchant Ecosystem USD 180K-220KA/B | A/B Testing | Accuracy evaluation | Agentic Analytics | B testing401k matching | Cell phone stipend | EAP | FSA | HSAExecutive-level Full TimeLos Angeles, CA, US R2d ago
-
Engineering Manager, Data Platform USD 290K-330KAWS | Apache Airflow | Apache Spark | DBT | Data Ingestion401k | Commuter benefits | Employee assistance program | Free Lunches | Medical/Dental/Vision insuranceMid-level Full TimeSan Francisco, CA R2d ago
-
Senior Manager, AI Software Engineering USD 177K-220KAWS | Agile | Automated testing | CI/CD | Claude401k match | Dental insurance | Family benefits | Flexible time off | Hybrid work modelSenior-level Full TimeAtlanta, GA R3d ago
-
Director, People Analytics USD 141K-204KAnalytics | Data Integrity | Data Management | Data reporting | Hypothesis Testing401k match | Backup child and elder care | Dental insurance | EAP counseling | Family ResourcesExecutive-level Full Time09510 - Washington Remote, United States R3d ago
-
Director of Analytics and Business Intelligence - Apexus USD 135K-236KAgile methodology | Azure Cloud | Azure Data | Azure Data Factory | Azure DevOpsCertificate program | Professional trainingExecutive-level Full TimeIrving, TX, US R3d ago
-
Data Engineering & Analytics Intern USD 40K-72KAWS | Agile | Confluence | Docker | ElasticsearchOn-site workEntry-level Full Time Internship6971 DISA Scott Air Force Base … R3d ago
-
12127 Sr Mgr AI Engineering & Platform Delivery USD 137K-224KAI Services | API | AWS Bedrock | Agile | Artificial Intelligence401k company match | Family leave | Hybrid work schedule | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeNewark, NJ, US, 07101 R3d ago
-
Associate Director, AI Software Security Engineer USD 157K-298KAI Assurance | Amazon Web Services | Azure | Cloud Security | Cloud platformRelocation eligibilityMid-level Full TimeUS-TX-MCKINNEY-513WM ~ 2501 W University Dr … R3d ago
-
Engineer II, Reliability Data Analyst (Hybrid) USD 86K-165KAgile | Data Management | Data Normalization | Data Quality | Data Visualization401k match | Counseling sessions | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeUS-PR-AGUADILLA-110 ~ Rd 110 N Km … R3d ago
-
Senior Data Engineer - Azure USD 133K-150KAmazon Redshift | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBCompany-Paid Holidays | Disability insurance | Employee assistance program | Life insurance | Medical, dental, and vision coverageSenior-level Full TimeSan Francisco, CA, US R3d ago
-
AWS EMR | AWS Glue | Apache Airflow | Apache Flink | Apache IcebergCareer development | Employee resource groups | Flexible work from home | Generous PTO | Mental and physical wellness programsSenior-level Full TimeUS-Nevada-Remote, United States R3d ago
-
VP, Data Architecture & Engineering USD 173K-231KAI Assisted Development | AI Governance | API | Artificial Intelligence | Automated testingHybrid work | Remote work optionExecutive-level Full TimeUnited States, United States R3d ago