Director of Data Engineering
Chicago - Illinois - Wacker, United States
USD 132K-165K Executive-level Full Time
Tasks
- Conduct structured code reviews
- Configure match and merge workflows
- Create data quality framework
- Enforce data lineage tracking and access governance
- Enforce data quality enforcement
- Establish Software Development Lifecycle
- Hire mentor and develop data engineers and contractors
- Implement CI/CD pipelines
- Implement master data management entity resolution
- Integrate golden record into gold layer
- Lead employee and contractor onboarding process
- Manage contractor staffed project delivery pods
- Manage version control code review testing
- Optimize master data management performance
- Orchestrate data pipelines
- Own medallion architecture implementation
- Provide technical oversight for data engineers
- Transform raw ingested data into clean data assets
- Translate requirements into Azure and Databricks platform specifications
Perks/Benefits
- Holiday pay
- Mental health services
- Paid parental leave
- Paid time off
- Personal days
- Sick days
- Vacation days
Skills/Tech-stack
ADLS Gen2 | Access Audit Logs | Audit Logs | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Key Vault | CI/CD | Cluster management | Data Factory | Data Lake | Data Lake Architecture | Data Lineage | Data Management | Data Quality | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Encryption | Entity Resolution | Golden record | Infrastructure as Code | Jobs Workflows | Key Vault | Master Data | Master Data Management | Match and merge | Pandas | PySpark | Python | Slowly Changing Dimensions | Spark SQL | Star Schema | Unity Catalog | “as-code”
Education
Related jobs
-
Director, AI Solutions Architect USD 139K-225KAPI Gateway | Agent Orchestration | BigQuery | CI/CD | Cloud MicroservicesAfter-hours support | Occasional overtime | Occasional travelSenior-level Full TimeOak Brook, IL, United States7h ago
-
Associate Director, Computational Biology USD 180K-240KAgent-based | Agent-based modeling | Bioinformatics Databases | Cell biology | D3JS401k | Dental insurance | ESPP | Employee wellness | Medical insuranceMid-level Full TimeSilver Spring, MD, United States23h ago
-
AI Engineering Sr Director or VP, Data Science USD 128K-175KAI Platform | AWS SageMaker | Agent systems | Agentic AI | Azure MLCollaborative culture | Growth opportunities | Impactful technical work | Professional developmentSenior-level Full TimeColumbia, MD, United States23h ago
-
Director, R&D Data Governance USD 195K-210KAccess Control | Compliance Management | Controlled vocabulary | Data Catalog | Data GovernanceExecutive-level Full TimeWaltham, MA, United States1d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
AWS | Airflow | Artificial Intelligence | Azure | CDISCExecutive-level Full TimeNorth Chicago, IL, United States1d ago
-
Director, Analytics Engineering USD 270K-330KAggregation | Airflow | BigQuery | DBT | Data Governance401k plan | Commuter benefits | Employee assistance program | Fitness benefits | Flexible time offExecutive-level Full TimeNew York, NY1d ago
-
Director of Engineering, AI & Computer Vision USD 200K-231KAWS | Call Management | Cloud Architecture | Computer Vision | Data EngineeringExecutive-level Full TimeAlpharetta, GA1d ago
-
Director of Embedded Software USD 192K-280KBluetooth Low Energy | C# | C++ | Embedded Systems | Firmware DevelopmentExecutive-level Full TimeBoston MA1d ago
-
Director, Analytics USD 139K-160KArtificial Intelligence | Data Analysis | Data Manipulation | Data Visualization | Excel401k | Hybrid work | Medical, dental, and vision insurance | Paid time offExecutive-level Full TimeGA, United States1d ago
-
Director, R&D Data Science, MDM Products USD 164K-282KAdvanced Analytics | Data Governance | Data Management | Data Privacy | Data Quality401k | Dental insurance | Health insurance | Hybrid work | Life insuranceExecutive-level Full TimeUS063 NJ Raritan - 920 US …1d ago
-
VP, Remediation Analytics & Standards USD 170K-290KAgile | Audit Trail | Auditability | Automation | Controls DesignEmployee resource groups | Flexible location requirements | Relocation not specified | Work from home optionExecutive-level Full TimeCincinnati West Chester Site, United States1d ago
-
Biochemistry | Bioinformatics | Biomarkers | Biomedical Data | Biomedical Data ModelsMid-level Full TimeUS159 NJ Titusville - 1125 Trenton-Harbourton …1d ago
-
Director, AI Engineering and Enablement USD 193K-233KAWS | Agentic AI | Artificial Intelligence | Automated testing | Azure401k plan | Employee assistance program | Flexible time off | Life insurance | Paid HolidaysExecutive-level Full TimePrinceton LVL - NJ, United States1d ago
-
AWS | AWS Bedrock | AgentCore) | Automated retraining | AzureFlexible work from home one day per week | In office collaboration four days per weekSenior-level Full Time08579 Minneapolis Headquarters 901, United States1d ago
-
AVP Data Engineering & Analytics, Employee Benefits USD 182K-273KActuarial Science | Actuarial pricing | Actuarial valuation | Analytics | AutomationHybrid work scheduleExecutive-level Full TimeHartford CT- Home Office, United States1d ago
-
Mid-Level or Senior Engineering Data Scientist USD 137K-234KC# | Dashboards | Data Governance | Data Quality | Data VisualizationRelocation assistanceMid-level Full TimeUSA - Everett, WA, United States1d ago
-
Mid-Level or Senior Engineering Data Scientist USD 137K-234KAnomaly Detection | C# | Data Analysis | Data Governance | Data ModelingOnsite work | Relocation assistanceMid-level Full TimeUSA - Everett, WA, United States1d ago
-
Director, Finance Analytics & Reporting USD 160K-213KAccess Management | Analytics | Business Intelligence | Change Management | Data Modeling401k matching | Dental insurance | Employee stock purchase program | Flexible time off | Health insuranceExecutive-level Full TimeUSA Remote, United States R1d ago
-
Senior-level Full TimeBethesda, MD R1d ago
-
Apache Airflow | Apache Hive | Apache Spark | BigQuery | Cloud platformMid-level Full TimeSunnyvale, CA2d ago
-
Access Analytics | Alteryx | Call planning | Claims data | Commercial Model Design401k | Bonus | Collaborative culture | Restricted stock units | Training programsSenior-level Full TimeBoston, Massachusetts2d ago
-
API Integration | Agile | Amazon Web Services | Ansible | AuroraSenior-level Full TimeBoston, MA2d ago
-
Associate Director, AI Solutions USD 80K-105KAWS | AWS Bedrock | Azure | Azure OpenAI | CI/CDHybrid work | Professional developmentMid-level Full TimeUnited States2d ago
-
Director, AI Solutions & Integration USD 149K-228KAWS | Agentic Workflows | Agile | Alerting | Artificial IntelligenceExecutive-level Full TimeUS - NY NYC - 55 …2d ago