Director of Data Engineering
Chicago - Illinois - Wacker, United States
USD 132K-165K Executive-level Full Time
Tasks
- Build engineering standards and patterns
- Conduct structured code reviews
- Design match and merge workflows
- Enforce data lineage with Unity Catalog
- Enforce data quality rules
- Establish standardized software development lifecycle
- Execute testing for data engineering changes
- Govern contractor access
- Hire mentor and assess data engineers
- Implement data quality framework
- Integrate golden record into gold layer
- Lead master data management technical implementation
- Maintain engineering documentation
- Manage access audit logs
- Manage employee onboarding process
- Manage version control and code reviews
- Optimize MDM performance
- Orchestrate data pipelines
- Own medallion architecture
- Plan contractor staffed delivery pods
- Provide technical oversight
- Run CI CD pipelines for data
- Transform raw data to silver and gold layers
- Verify encryption compliance
Perks/Benefits
Skills/Tech-stack
ADLS Gen2 | Access Control | Alerting | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Key Vault | CI/CD | Cluster management | Data Factory | Data Governance | Data Lake | Data Lake Architecture | Data Lineage | Data Management | Data Quality | Data Quality Gates | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Encryption | Entity Resolution | Fact Table | Fact Table Design | Golden record | Infrastructure as Code | Jobs Workflows | Key Vault | MDM | Master Data | Master Data Management | Match and merge | Monitoring | Pandas | PySpark | Python | Quality gates | SQL | Slowly Changing Dimensions | Spark SQL | Star Schema | Table design | Unity Catalog | “as-code”
Education
Related jobs
-
Senior Product Manager - AI Data and Safety USD 228K-492KArtificial Intelligence | Bias Mitigation | Data Annotation | Data Quality | Language ModelsSenior-level Full TimeSan Jose, California, United States13h ago
-
Senior Manager, Nodal Markets & Quantitative Analysis USD 112K-157KAlgorithms | BID3 | Data Modeling | ERCOT | Economics401k matching | Comprehensive health insurance | Dental insurance | Disability insurance | Educational assistanceSenior-level Full TimeHOUSTON-LOUISIANA STREET(USA), HOUSTON, United States / …13h ago
-
Data Science Manager, Analytics USD 206K-281KBias Mitigation | Data Modeling | Data Visualization | Ethical AI | ExperimentationCareer growth opportunitiesMid-level Full TimeSunnyvale, CA14h ago
-
AI Solutions Lead, Sales Workflows, Devices and Services USD 192K-278KAdvanced Analytics | Application Programming | Application Programming Interfaces | Apps Script | Business ProcessSenior-level Full TimeMountain View, CA, USA15h ago
-
AI | Agent systems | Context engineering | Data Sovereignty | Data readinessSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …15h ago
-
Director of AI Analytics USD 115K-200KAdvanced Analytics | Artificial Intelligence | Conversion Rate | Conversion rate optimization | Customer AnalyticsExecutive-level Full TimeRemote - US R1d ago
-
Staff, Advanced Analytics, Global Markets and Policy USD 180K-221KA/B | A/B Testing | AI | Airflow | Attribution ModelingSenior-level Full TimeUnited States1d ago
-
AI & Insights - Sr. Manager USD 132K-299KArtificial Intelligence | Data Science | Data analytics | Machine Learning | Model DeploymentSenior-level Full TimeSouth San Francisco, United States1d ago
-
Portfolio Analytics, Associate Director USD 105K-125KData Automation | Data Cleansing | Data Management | Data Quality | Data Transformation401k match | Commuter reimbursement program | Dental insurance | Education assistance program | Employee assistance programMid-level Full TimeUS - NC - CHARLOTTE - …1d ago
-
Applications Development Technology Lead Analyst USD 142K-213KApache Hive | Apache Iceberg | Apache Spark | Automated testing | Autosys401k matching | Health, dental, vision insurance | Paid time off | Wellness programsSenior-level Full Time480 WASHINGTON BOULEVARD JERSEY CITY, United …1d ago
-
Manager Data and Analytics Engineering-1 USD 30K-44KAirflow | Alation | BigQuery | CI/CD | Cause analysis401k employer contributions | Flexible spending account | Medical/Dental/Vision insurance | Opportunities for career growth | Paid time offMid-level Full TimeHeadquarters, United States1d ago
-
Manager, Data Analytics USD 113K-180KAlteryx | Analytical Procedures | Audit planning | AuditBoard | Control environmentMid-level Full Time(USA) Maverick Building AR Bentonville Home …1d ago
-
(USA) Manager, Advanced Analytics USD 113K-155KAlteryx | Big Data | CI/CD | Cloud platform | ConfluenceMid-level Full Time(USA) Change Building AR Bentonville Home …1d ago
-
Surveillance Data Engineering Manager USD 77K-133KAgile | Big Data | Cloud Native | Cloud-native computing | Contract testingMid-level Full Time142019-NC-300 South Brevard, Charlotte, United States1d ago
-
AI Process Innovation USD 160K-220K5 Whys | AI Concepts | Acceptance criteria | Automation | Azure DevOpsExecutive-level Full TimeCentral Tech Unit Plymouth MI, United …1d ago
-
Senior Director, Data & AI Platform Engineering USD 136K-230KAI personalization | Bash | BigQuery | CI/CD | Cloud DataSenior-level Full TimeFlorida Remote Worker, United States R1d ago
-
Director, Data & Analytics Engineering USD 159K-159KApache Hive | Apache Spark | Data Modeling | Data profiling | Database performanceTelecommuting up to 3 days per weekExecutive-level Full TimeAlpharetta GA 1 Edison, United States R1d ago
-
Manager, Provider Analytics USD 90K-140KAWS | Analytics | Azure | Azure DevOps | CI/CD401k match | Community giveback paid time off | Employee assistance program | Employee discounts | FSAMid-level Full TimeUnited States - Remote R1d ago
-
Generative AI Executive Director USD 150K-210KComputer Vision | DAG | Data parallelism | Deep learning | DeepSpeedBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeNew York, NY, United States1d ago
-
People Analytics Manager USD 150K-180KData Quality | Data Visualization | Data reporting | Greenhouse | People AnalyticsSenior-level Full TimeSan Jose, California, United States1d ago
-
Full Lifecycle AI/ML Engineering Lead USD 129K-244KAWS | Agile | Automated testing | Azure | CI/CDEmployee resource groups | Flexible family care days | Medical, dental & vision coverage | Paid Holidays | Paid parental leaveSenior-level Full TimeRedford, MI, United States1d ago
-
AWS | Azure | Causal Inference | Cloud Native | Cloud-Native DeploymentBackup childcare | Competitive total rewards package | Comprehensive health care coverage | Financial coaching | Mental health supportExecutive-level Full TimeNew York, NY, United States1d ago
-
Business Analytics Senior Manager (Product) USD 150K-180KA/B | A/B Testing | B testing | Causal Inference | DBTSenior-level Full TimeBoston, MA1d ago
-
Tech Lead, Embedded Systems Engineering USD 191K-253KAgile | Architecture | C++ | CI/CD | Code reviewCaregiver and wellness leave | Commuter benefits | Family planning and parenting support | Generous time off | Healthcare benefitsSenior-level Full TimeSeattle, Washington, United States1d ago
-
Engineering Manager, Embedded Systems Engineering USD 191K-253KAgile | C++ | CI/CD | Concurrency | Device DriversCommuter benefits | Comprehensive medical, dental, vision | Generous PTO | Life and disability insurance | Mental health resourcesMid-level Full TimeSeattle, Washington, United States1d ago