Lead Data Engineer (Databricks)
Chicago - Illinois - Wacker, United States
USD 112K-140K Senior-level Full Time
Tasks
- Configure and manage Profisee MDM
- Develop and optimize Databricks notebooks
- Drive automation and CI/CD pipelines with Azure DevOps
- Enhance and support BI reporting and dashboards
- Implement data cataloging and governance with Azure Purview
- Implement data storage solutions in Azure Data Lake
- Implement new technologies in data engineering
- Lead SQL Server database optimization
- Lead data architecture and engineering
- Manage and optimize ETL processes and data pipelines
- Mentor data engineers and team
- Set up Change Data Capture processes
Perks/Benefits
Skills/Tech-stack
Automation | Azure Data | Azure Data Factory | Azure Data Lake | Big Data | Big data analytics | CI/CD | Data Factory | Data Governance | Data Lake | Data Modeling | Data Processing | Data Warehousing | Data analytics | Database Management | Databricks | Delta Parquet | ETL Processes | Leadership | Machine Learning | Predictive Analysis | Profisee MDM | SQL Server | SQL Server Management | Server management | Tableau
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Architect USD 135K-165KAPI Integration | API Keys | API Management | Amazon Kinesis | Amazon Web ServicesHighly cleared team support | Security-focused environmentSenior-level Full TimeOther, VA10h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States11h ago
-
Mid-level Full TimeAuburn Hills, MI, United States12h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence12h ago
-
Cause analysis | Cloud Computing | Data Enrichment | Data Monitoring | Data Processing401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York12h ago
-
Senior-level Full TimeDallas, Texas, United States12h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …13h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA13h ago
-
Research Scientist, Biomedical AI, DeepMind USD 147K-211KArtificial Intelligence | Benchmarking | Computational pipeline | Data Analysis | EvaluationMid-level Full TimeMountain View, CA, USA13h ago
-
C# | C++ | Co-design | Compiler technology | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA13h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R16h ago
-
AI Data Platform Lead USD 164K-229KAWS | Airflow | Audit Logging | DBT | Data GovernanceFloating holidays | Wellness daySenior-level Full TimeUnited States19h ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R1d ago
-
Principal Big Data Software USD 178K-261K3GPP | 5G | Agile | Ansible | Apache NiFi401k plan | Adoption reimbursement | Employee assistance programs | Employee discounts | Employee wellness programsSenior-level Full TimeUSA:TX:Plano / W Plano Pkwy - …1d ago
-
Agile | CSS | Cloud Computing | DBT | Data LakesRelocation eligibleMid-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …1d ago
-
Agile | CSS | DBT | Data Lakes | Data Modeling401k match | Dental insurance | Employee assistance program | Employee scholar program | Flexible spending accountsSenior-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …1d ago
-
Staff Data Engineer USD 106K-284KAWS | Alerting | Amazon SNS | Apache Kafka | Argo CDMedical, dental, and vision coverage | Paid time off | Retirement savings options | Wellness programsSenior-level Full TimeWork At Home-Texas, United States1d ago
-
Mid-level Full TimeNew York, NY1d ago
-
TAMIDS Senior AI Engineer / Lead AI Engineer USD 50K-55KArtificial Intelligence | Backend Development | Data Governance | Data Pipelines | Database ManagementSenior-level Full TimeCollege Station, TX, United States1d ago
-
Lead AI Software Engineer- AI Enablement USD 140K-231KAI Agents | AWS | AWS CDK | Agile Scrum | Amazon BedrockSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States1d ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R1d ago
-
AWS | Agent Frameworks | Agent Orchestration | Amazon Kinesis | Amazon SageMaker401k plan | Dental insurance | Long-term disability | Medical insurance | Paid time offMid-level Full TimeCharlotte, 1120 S Tryon St., Corp, …1d ago
-
Quality Automation Engineer (SDET) - Career USD 95K-130KAirflow | Apache Beam | BigQuery | Bigtable | CI/CD401k matching | Career growth | Healthcare benefits | Online learning platform | Paid time offMid-level Full TimeUSA - Georgia - Alpharetta - …1d ago
-
Principal ML Ops Engineer USD 117K-201KAWS | Access Control | Amazon SageMaker | Auditability | Azure401k retirement plan | Holiday pay | Paid vacation | Parental leave | Pension planSenior-level Full TimeUS076 FL Jacksonville - 7500 Centurion …1d ago
-
AI Software Solutions Architect Engineer USD 130K-205KArtificial Intelligence | C++ | Cloud Computing | Data Science | DevOpsDental insurance | Disability insurance | Employee assistance program | Flexible spending account | Health insuranceSenior-level Full TimeTEX01 - Houston, Texas (TEX01), United …1d ago