Director of Data Engineering
Chicago - Illinois - Wacker, United States
USD 132K-165K Executive-level Full Time
Tasks
- Build engineering standards and patterns
- Conduct structured code reviews
- Design match and merge workflows
- Enforce data lineage with Unity Catalog
- Enforce data quality rules
- Establish standardized software development lifecycle
- Execute testing for data engineering changes
- Govern contractor access
- Hire mentor and assess data engineers
- Implement data quality framework
- Integrate golden record into gold layer
- Lead master data management technical implementation
- Maintain engineering documentation
- Manage access audit logs
- Manage employee onboarding process
- Manage version control and code reviews
- Optimize MDM performance
- Orchestrate data pipelines
- Own medallion architecture
- Plan contractor staffed delivery pods
- Provide technical oversight
- Run CI CD pipelines for data
- Transform raw data to silver and gold layers
- Verify encryption compliance
Perks/Benefits
Skills/Tech-stack
ADLS Gen2 | Access Control | Alerting | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Key Vault | CI/CD | Cluster management | Data Factory | Data Governance | Data Lake | Data Lake Architecture | Data Lineage | Data Management | Data Quality | Data Quality Gates | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Encryption | Entity Resolution | Fact Table | Fact Table Design | Golden record | Infrastructure as Code | Jobs Workflows | Key Vault | MDM | Master Data | Master Data Management | Match and merge | Monitoring | Pandas | PySpark | Python | Quality gates | SQL | Slowly Changing Dimensions | Spark SQL | Star Schema | Table design | Unity Catalog | “as-code”
Education
Related jobs
-
Project Manager/Scrum Master – Data & Analytics USD 110K-145KAgile | Automated testing | Backlog Refinement | CI/CD | Cycle timeContinuous Education Investments | Dental insurance | Health insurance | Holidays | PTOMid-level Full TimeSan Diego, CA4h ago
-
Associate Director, Business Analytics USD 110K-135KAttribution | Audience Analytics | Business Intelligence | Campaign Measurement | Digital optimization401k plan | Dental coverage | Disability insurance | Employee discount program | Employee stock purchase programMid-level Full TimeNew York, New York, United States11h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States12h ago
-
Senior Marketing Operations - US USD 145K-155KAI tools | Analytics | Attribution | Attribution Models | AutomationSenior-level Full TimeNew York City, NY, US16h ago
-
Global Field Quality Performance & Analytics Manager USD 117K-162KAutomotive Quality | Data Quality | Data Visualization | Data analytics | KPI governanceSenior-level Full TimeAuburn Hills, MI, United States17h ago
-
Operate Manager USD 147K-174KJira | MySQL | Python | R | TableauMentoring | Professional development | Remote work flexibilitySenior-level Full TimeJersey City, New Jersey, United States17h ago
-
Databricks Senior Consultant USD 113K-188KAWS | Azure | Business Intelligence | Cloud platform | Data EngineeringSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …17h ago
-
Software Engineering Manager II, Embedded Systems/Firmware, Platforms Infrastructure Engineering USD 207K-300KC# | C++ | Code review | Embedded operating systems | JavaSenior-level Full TimeSunnyvale, CA, USA19h ago
-
Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache SparkSenior-level Full TimeSunnyvale, CA, USA19h ago
-
Global Product Lead, Global Business Applied AI USD 178K-258KArtificial Intelligence | Business Intelligence | CRM | Customer satisfaction | Data AnalysisSenior-level Full TimeMountain View, CA, USA19h ago
-
AWS | Anomaly Detection | Apache Spark | Azure | BI IntegrationSenior-level Full TimeUnited States1d ago
-
Manager, Commercial Operations & Analytics USD 150K-240KBusiness Intelligence | Client Relationship Management | Client relationship | Commercial Analytics | Data Management401k match | AD and D insurance | Charitable donation match | Childcare Account | Commuter benefitsMid-level Full TimeSan Diego, California1d ago
-
Manager, Solutions Engineering USD 280K-345KCloud Architecture | Generative AI | JavaScript | Machine Learning | Network ArchitectureHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
Sales Operations, Manager USD 120K-160KAI workflow | AI workflow automation | BI reporting | CRM | ClaudeMid-level Full TimeSF | Boston1d ago
-
Manager, Data & Analytics, In-Store USD 141K-208KAPIs | Analytics engineering | BigQuery | DBT | Data Modeling401k match | Commuter benefits match | Medical, dental, and vision benefits | Paid parental leave | Paid sick leaveSenior-level Full TimeNew York, NY1d ago
-
Director, Discovery Bioinformatics Oncology USD 193K-338KAPIs | AWS | Active Learning | Adapters | CI/CDExecutive-level Full TimeUS: South San Francisco Haskins, United …1d ago
-
Senior Director, Head of AI Governance & Enablement USD 176K-265KAI Governance | AI Governance Measurement | AI Lifecycle | AI Lifecycle Management | AI Model Monitoring401k retirement plan | Medical, dental, and vision coverage | Paid leaves | Paid vacation and holidaysSenior-level Full TimeUS - Gaithersburg - MD, United …1d ago
-
Product Manager, Data & Analytics USD 97K-133KAcceptance criteria | Agile | CI/CD | Dashboarding | Data EngineeringDisability insurance | Education programs | Family support programs | Health insurance | Life insuranceMid-level Full TimeRemote Worker - New Jersey, USA, … R1d ago
-
Senior Manager, Data Analytics & Insights USD 97K-185KAlation | Alteryx | Data Governance | Data Preparation | Data VisualizationSenior-level Full Time900 Salem St, Smithfield RI, United …1d ago
-
Senior Product Manager - Pharma Analytics Products USD 106K-284KAgile | Analytics architecture | Confluence | Data Science | Data Science ConceptsDental insurance | Medical insurance | Other Resources | Paid time off | Retirement savings optionsSenior-level Full TimeNew York-161 Ave of the Americas, …1d ago
-
Director, Data Scientist USD 269K-335KAmazon Web Services | Apache Spark | Computer Vision | Dialog Systems | Generative AIExecutive-level Full TimeMcLean, VA, United States1d ago
-
Director, Analytics USD 173K-216KExperimentation Design | Hypothesis Testing | Looker | Predictive Modeling | PythonExecutive-level Full TimeRemote - US, United States R1d ago
-
Associate Director - AI Engineering USD 150K-190KAI Governance | AWS | Agentic Frameworks | Agentic framework | Amazon SageMakerCompany-matched student loan contribution | Continuous learning | Family-friendly benefits | Financial wellness programs | Flexible time offMid-level Full TimeUS - NY NYC - 55 …1d ago
-
Manager-Pro Finance & Analytics USD 50K-67KAccounting | Budgeting | Data analytics | Financial Analysis | Financial ReportingMid-level Full TimePENNANT PARK, ATLANTA - 9141, United …1d ago
-
Manager, Marketing Data Analytics USD 88K-150KCRM | DAX | Data Governance | Data Modeling | Data QualitySenior-level Full TimeRemote - NC, United States R1d ago