Director of Data Engineering
Chicago - Illinois - Wacker, United States
USD 132K-165K Executive-level Full Time
Tasks
- Conduct structured code reviews
- Configure match and merge workflows
- Create data quality framework
- Enforce data lineage tracking and access governance
- Enforce data quality enforcement
- Establish Software Development Lifecycle
- Hire mentor and develop data engineers and contractors
- Implement CI/CD pipelines
- Implement master data management entity resolution
- Integrate golden record into gold layer
- Lead employee and contractor onboarding process
- Manage contractor staffed project delivery pods
- Manage version control code review testing
- Optimize master data management performance
- Orchestrate data pipelines
- Own medallion architecture implementation
- Provide technical oversight for data engineers
- Transform raw ingested data into clean data assets
- Translate requirements into Azure and Databricks platform specifications
Perks/Benefits
- Holiday pay
- Mental health services
- Paid parental leave
- Paid time off
- Personal days
- Sick days
- Vacation days
Skills/Tech-stack
ADLS Gen2 | Access Audit Logs | Audit Logs | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Key Vault | CI/CD | Cluster management | Data Factory | Data Lake | Data Lake Architecture | Data Lineage | Data Management | Data Quality | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Encryption | Entity Resolution | Golden record | Infrastructure as Code | Jobs Workflows | Key Vault | Master Data | Master Data Management | Match and merge | Pandas | PySpark | Python | Slowly Changing Dimensions | Spark SQL | Star Schema | Unity Catalog | “as-code”
Education
Related jobs
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States14h ago
-
Data Engineering Manager USD 150K-185KAccess Control | CI/CD | Data Classification | Data Governance | Data Lineage401k match | Company funded HSA contributions | Flexible PTO | Life insurance | Medical, dental, and vision insuranceSenior-level Full TimeRemote (United States) R14h ago
-
Databricks Senior Consultant USD 113K-188KAWS | Azure | Business Intelligence | Cloud platform | Data EngineeringSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …20h ago
-
Software Engineering Manager II, Embedded Systems/Firmware, Platforms Infrastructure Engineering USD 207K-300KC# | C++ | Code review | Embedded operating systems | JavaSenior-level Full TimeSunnyvale, CA, USA21h ago
-
AWS | Anomaly Detection | Apache Spark | Azure | BI IntegrationSenior-level Full TimeUnited States1d ago
-
Director, Discovery Bioinformatics Oncology USD 193K-338KAPIs | AWS | Active Learning | Adapters | CI/CDExecutive-level Full TimeUS: South San Francisco Haskins, United …1d ago
-
Director, Data Scientist USD 269K-335KAmazon Web Services | Apache Spark | Computer Vision | Dialog Systems | Generative AIExecutive-level Full TimeMcLean, VA, United States1d ago
-
Director, Analytics USD 173K-216KExperimentation Design | Hypothesis Testing | Looker | Predictive Modeling | PythonExecutive-level Full TimeRemote - US, United States R1d ago
-
Associate Director - AI Engineering USD 150K-190KAI Governance | AWS | Agentic Frameworks | Agentic framework | Amazon SageMakerCompany-matched student loan contribution | Continuous learning | Family-friendly benefits | Financial wellness programs | Flexible time offMid-level Full TimeUS - NY NYC - 55 …1d ago
-
Director of Data Science, Actuarial Modeling USD 138K-207KAgile | Cloud Computing | Git | MLOps | Machine LearningAutonomous work | Cross-functional collaboration | Hybrid work schedule | Professional developmentExecutive-level Full TimeHartford CT- Home Office, United States1d ago
-
Director and Group Head, Applied AI USD 194K-361KComputational Chemistry | Data readiness | Deep learning | Distributed Training | Foundation Models401k | Disability coverage | Health insurance | Holidays | Life insuranceExecutive-level Full TimeCambridge (USA), United States1d ago
-
Director Data Engineering USD 176K-294KAnomaly Detection | Azure Synapse | BigQuery | CCPA | DAG401k matching | Medical/Dental/Vision insurance | Paid Holidays | Paid caregiver leave | Paid parental leaveExecutive-level Full TimeUSA - NY - Headquarters, United …1d ago
-
Data Platform Architect USD 210K-245KAI architecture | Architecture Compliance | Architecture Compliance Checking | Automated Impact Analysis | Capacity Planning401k match | Flexible time off | Health and wellness programs | Paid parental leave | Relocation assistanceSenior-level Full TimeSan Francisco, United States1d ago
-
Director of Data Engineering & Data Science - IAA USD 175K-272KApache Airflow | Azure | Azure Event | Azure Event Hubs | Azure SynapseExecutive-level Full TimeChicago, IL (Hybrid) R1d ago
-
Senior GCP Data Engineer USD 120K-160KApache Airflow | Apache Spark | Batch Processing | BigQuery | Cloud ComposerSenior-level Full TimeUnited States1d ago
-
AI Governance | AWS | Analytics architecture | BI | Data Architecture401k match | Dental insurance | Employee assistance program | Employer HSA Options | Flexible work scheduleExecutive-level Full TimeTamarac, Florida, United States R1d ago
-
Sr. Manager Business Intelligence & Data Analytics USD 100K-142KAWS | Agile | Apache Airflow | Azure | BigQuery401k match | Business resource groups | Employee discounts | Flexible PTO | Health and wellness programsSenior-level Full TimeFramingham, MA, United States1d ago
-
Senior Director, Protein Analytics & Biophysics USD 210K-290KAI machine learning | Assay Statistics | Automation | BLI | BiochemistryCareer development | Cross-functional collaboration | Inclusive culture | People leadershipSenior-level Full TimeSomerville, MA1d ago
-
Tech Lead, Data Engineering USD 159K-191KAWS | AWS CDK | AWS Glue | Airflow | Amazon AthenaFlexible work options | Give back day | Global wellness program | Wellbeing paid day off | Wellness sessionsSenior-level Full TimeChicago, IL1d ago
-
Director, Biostatistics USD 230K-250KADaM | Adaptive trial design | Analysis Plan | Bayesian Methods | CDISCExecutive-level Full TimeBoston, MA1d ago
-
Spare Parts Optimization Strategy Intern USD 50K-60KAPIs | Azure Blob | Azure Blob Storage | Blob Storage | Data ModelingFundraising | Hybrid work schedule | Mentorship programs | Volunteering | Workforce trainingEntry-level InternshipSan Francisco, CA1d ago
-
Senior Manager, Data Engineering USD 149K-222KAWS | Automation | DBT | Data Governance | Data LineageEnhanced health and wellness benefits through One Medical | Flexible PTO | Gympass | Home internet subsidy | Hybrid work policySenior-level Full TimeNew York, New York1d ago
-
Director for Accounting, Data Analytics and Business Intelligence - School of Medicine USD 100K-143KBudgeting | Business Intelligence | Dashboarding | Data Governance | Data QualityCommuting flexibility based on business needs | Residency requirement GA | Work from home flexibilityExecutive-level Full TimeAtlanta, GA, United States2d ago
-
Director, Data Governance & Security USD 140KAccess Control | Access Management | CRM | Data Access Management | Data GovernanceExecutive-level Full TimePrinceton, NJ, United States2d ago
-
Senior Director, Data Analytics & AI Engineering USD 105K-155KArchitecture | Artificial Intelligence | Budgeting | Cloud enablement | ComplianceHealth benefits | Hybrid work | Professional developmentSenior-level Full TimeHYBRID - BLOM ADMINISTRATIVE CAMPUS, United … R2d ago