Director of Data Engineering
Chicago - Illinois - Wacker, United States
USD 132K-165K Executive-level Full Time
Tasks
- Conduct structured code reviews
- Configure match and merge workflows
- Create data quality framework
- Enforce data lineage tracking and access governance
- Enforce data quality enforcement
- Establish Software Development Lifecycle
- Hire mentor and develop data engineers and contractors
- Implement CI/CD pipelines
- Implement master data management entity resolution
- Integrate golden record into gold layer
- Lead employee and contractor onboarding process
- Manage contractor staffed project delivery pods
- Manage version control code review testing
- Optimize master data management performance
- Orchestrate data pipelines
- Own medallion architecture implementation
- Provide technical oversight for data engineers
- Transform raw ingested data into clean data assets
- Translate requirements into Azure and Databricks platform specifications
Perks/Benefits
- Holiday pay
- Mental health services
- Paid parental leave
- Paid time off
- Personal days
- Sick days
- Vacation days
Skills/Tech-stack
ADLS Gen2 | Access Audit Logs | Audit Logs | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Key Vault | CI/CD | Cluster management | Data Factory | Data Lake | Data Lake Architecture | Data Lineage | Data Management | Data Quality | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Encryption | Entity Resolution | Golden record | Infrastructure as Code | Jobs Workflows | Key Vault | Master Data | Master Data Management | Match and merge | Pandas | PySpark | Python | Slowly Changing Dimensions | Spark SQL | Star Schema | Unity Catalog | “as-code”
Education
Related jobs
-
Senior Engineering Manager - Infrastructure USD 223K-300KAWS | Availability | Azure | Cloud Security | Cloud platform401k match | Healthcare | Home office stipend | Paid parental leave | Unlimited vacationSenior-level Full TimeUS - Remote R11h ago
-
Insights & Integrations Consultancy Data Scientist USD 116K-150KAPIs | Airflow | Big Data | Data Modeling | Data VisualizationBaby bonus | Competitive medical and dental benefits | Electric vehicle purchase incentive program | Flex working arrangements | Home office reimbursement programMid-level Full TimeAtlanta, Georgia - USA; Las Vegas, …17h ago
-
Data Engineer - Level III USD 127K-135KAWS | AWS Bedrock | AWS DMS | AWS DataZone | AWS Glue401k matching | Dental insurance | Long-term disability | Medical insurance | Paid vacationSenior-level Full TimeHerndon, VA, US18h ago
-
Category Management | Claims data | Contract Negotiation | Cost Reduction | Data Governance401k | Dental insurance | Holiday pay | Medical insurance | Paid time offMid-level Full TimeMettawa, IL, United States18h ago
-
Senior Analytics Engineering Manager USD 181K-277KAgile | Alerting | Cause analysis | Dashboarding | Data GovernanceHealth plan coverage | Hybrid work model | OneMedical membershipSenior-level Full TimeSan Francisco, CA19h ago
-
AI | Agent systems | Context engineering | Data Sovereignty | Data readinessSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …1d ago
-
Manager, Engineering (Software & AI) USD 127K-165KAI Model Evaluation | AI model | Data Governance | Data Lineage | Data Quality401k | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeUrbandale, IA, United States1d ago
-
Director of AI Analytics USD 115K-200KAdvanced Analytics | Artificial Intelligence | Conversion Rate | Conversion rate optimization | Customer AnalyticsExecutive-level Full TimeRemote - US R1d ago
-
Applications Development Technology Lead Analyst USD 142K-213KApache Hive | Apache Iceberg | Apache Spark | Automated testing | Autosys401k matching | Health, dental, vision insurance | Paid time off | Wellness programsSenior-level Full Time480 WASHINGTON BOULEVARD JERSEY CITY, United …1d ago
-
Manager Data and Analytics Engineering-1 USD 30K-44KAirflow | Alation | BigQuery | CI/CD | Cause analysis401k employer contributions | Flexible spending account | Medical/Dental/Vision insurance | Opportunities for career growth | Paid time offMid-level Full TimeHeadquarters, United States1d ago
-
Surveillance Data Engineering Manager USD 77K-133KAgile | Big Data | Cloud Native | Cloud-native computing | Contract testingMid-level Full Time142019-NC-300 South Brevard, Charlotte, United States1d ago
-
Senior Director, Data & AI Platform Engineering USD 136K-230KAI personalization | Bash | BigQuery | CI/CD | Cloud DataSenior-level Full TimeFlorida Remote Worker, United States R1d ago
-
Director, Data & Analytics Engineering USD 159K-159KApache Hive | Apache Spark | Data Modeling | Data profiling | Database performanceTelecommuting up to 3 days per weekExecutive-level Full TimeAlpharetta GA 1 Edison, United States R1d ago
-
Director of Data Engineering USD 132K-165KADLS Gen2 | Access Control | Alerting | Azure | Azure DataMental health services | Paid parental leave | Paid time off | Paid vacation | Personal daysExecutive-level Full TimeChicago - Illinois - Wacker, United …1d ago
-
Director, Data & Analytics Strategy USD 149K-298KData Engineering | Data Governance | Data Management | Data Science | Data SecurityEducation benefit | Free medical coverage | Health insurance | Retirement plan | Tuition reimbursementExecutive-level Full TimeUnited States - Columbus : 2900 …1d ago
-
Software Engineering Lead – Financial Data Engineering, VP - State Street Investment Management USD 110K-188KAWS | Agile | Apache Spark | Cause analysis | Data ModelingEmployee assistance program | Flexible work/life support | Insurance benefits | Paid time off | Paid volunteer daysSenior-level Full TimeBOSTON, United States1d ago
-
Data Modeling | Excel | Forecasting | Market Research | Power BI401k matching | Annual bonus | Annual equity awards | Commuting subsidy | Educational assistanceExecutive-level Full Time5000 - Vertex US - Fan …1d ago
-
Director, Analytics & Insights USD 170K-289KAnalytics Strategy | Attribution Modeling | Business Intelligence | Dashboarding | Data GovernanceHealthier work environment | Mobility | Networking | Work-life balanceExecutive-level Full TimeDuluth, GA, United States, Georgia1d ago
-
Databricks Architect USD 180K-248KAWS | AWS Lambda | Access Control | Amazon EMR | Amazon S3Career development opportunities | High degree of individual responsibility | Remote work flexibilitySenior-level Full TimeUnited States - Remote R1d ago
-
Access Control | Data Architecture | Data Engineering | Data Governance | Data ModelingSenior-level Full TimeFort Detrick, Maryland, United States1d ago
-
Generative AI Executive Director USD 150K-210KComputer Vision | DAG | Data parallelism | Deep learning | DeepSpeedBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeNew York, NY, United States1d ago
-
AWS | Azure | Causal Inference | Cloud Native | Cloud-Native DeploymentBackup childcare | Competitive total rewards package | Comprehensive health care coverage | Financial coaching | Mental health supportExecutive-level Full TimeNew York, NY, United States1d ago
-
Engineering Manager, Embedded Systems Engineering USD 191K-253KAgile | C++ | CI/CD | Concurrency | Device DriversCommuter benefits | Comprehensive medical, dental, vision | Generous PTO | Life and disability insurance | Mental health resourcesMid-level Full TimeSeattle, Washington, United States1d ago
-
Director, Data Science USD 235K-307KBioinformatics | Cloud Computing | Computational Biology | Deep learning | Graph DatabasesExecutive-level Full TimeBoston, MA; New York, NY R1d ago
-
GenAI Engineering - Executive Director USD 150K-210KAWS | Algorithms | Azure | Cloud Architecture | Data MiningBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeJersey City, NJ, United States1d ago