Lead Data Engineer (Databricks)
Chicago - Illinois - Wacker, United States
USD 112K-140K Senior-level Full Time
Tasks
- Configure and manage Profisee MDM
- Develop and optimize Databricks notebooks
- Drive automation and CI/CD pipelines with Azure DevOps
- Enhance and support BI reporting and dashboards
- Implement data cataloging and governance with Azure Purview
- Implement data storage solutions in Azure Data Lake
- Implement new technologies in data engineering
- Lead SQL Server database optimization
- Lead data architecture and engineering
- Manage and optimize ETL processes and data pipelines
- Mentor data engineers and team
- Set up Change Data Capture processes
Perks/Benefits
Skills/Tech-stack
Automation | Azure Data | Azure Data Factory | Azure Data Lake | Big Data | Big data analytics | CI/CD | Data Factory | Data Governance | Data Lake | Data Modeling | Data Processing | Data Warehousing | Data analytics | Database Management | Databricks | Delta Parquet | ETL Processes | Leadership | Machine Learning | Predictive Analysis | Profisee MDM | SQL Server | SQL Server Management | Server management | Tableau
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R5h ago
-
Lead Applied Scientist USD 150K-170KAgentic AI | Autogen | CrewAI | Data Quality | Deep learning401k match | Dental insurance | Employee assistance program | Employee recognition | Employee stock purchase planSenior-level Full TimeWork From Home, United States R5h ago
-
AWS Data | AWS Data Warehouse | Amazon Web Services | Data Warehouse | SQLContract role | On site 3 days per weekMid-level Full TimeHouston, TX, United States7h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States9h ago
-
Data Engineer (Multiple Positions) USD 145K-250KBig Data | Data Pipelines | Fault Tolerance | Third Party | Third party integrationsMid-level Full TimeSeattle, Washington, United States10h ago
-
Data Engineer (Multiple Positions) USD 145K-250KBig Data | Data Pipelines | Fault Tolerance | Third Party | Third party integrationsMid-level Full TimeSan Jose, California, United States10h ago
-
CV | Computer Vision | Deep learning | Language Processing | Machine LearningSenior-level Full TimeSan Jose, California, United States10h ago
-
Lead Data Architect USD 173K-276KAI metadata | Cloud Platforms | Data Architecture | Data Governance | Data Lakes401k | Dental insurance | Health insurance | Paid time off | Vision insuranceExecutive-level Full TimeFoster City, CA, United States10h ago
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationEntry-level Full TimeSeattle, WA10h ago
-
Software Engineer, Machine Learning USD 185K-200KClassification | Computer Vision | Data Mining | Data Regression | Deep learningMid-level Full TimeMenlo Park, CA10h ago
-
Data Engineer (Analytics) USD 191K-235KBig Data | Data Modeling | Data Warehousing | Data integration | Dimensional ModelingDomestic and international travel | TelecommutingMid-level Full TimeMenlo Park, CA | Remote, US R10h ago
-
Robotics Manipulation Engineer USD 157K-240KAdaptive Control | C plus plus | Control Systems | Deep learning | GPUSenior-level Full TimeFremont, CA10h ago
-
Robotics Engineer - Logistics and Material Flow USD 170K-240KAGV | Automation | C++ | Cause analysis | Computer VisionTravel to data centers for engineering studiesSenior-level Full TimeFremont, CA10h ago
-
Ad Ranking | Algorithms | C++ | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA11h ago
-
AI Engineer, Professional Services, Google Cloud USD 183K-265KApache Beam | Apache Spark | C++ | Data Validation | Data WarehousingTechnical workshops | Travel opportunitiesSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA11h ago
-
Senior Software Engineer, AI/ML GenAI, Core USD 174K-252KAlgorithms | C++ | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA11h ago
-
Software Engineer III, AI/ML, Core USD 147K-211KAlgorithms | Data Processing | Data Storage | Data Structures | DebuggingSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Software Engineer III, AI/ML, Google Workspace USD 147K-211KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeBoulder, CO, USA11h ago
-
Automation | C++ | CSS | Database Design | HTMLMid-level Full TimeAnn Arbor, MI, USA11h ago
-
Software Engineering - DataStage Developer USD 112K-129KAxway | Axway Secure SFTP | Azure | Azure DevOps | CA7 SchedulerHybrid work schedule | Remote workMid-level Full TimeSyracuse, New York, United States14h ago
-
Mid-level Full TimeFlorida, United States15h ago
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco18h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R18h ago
-
Robotics Application & Product Security Engineer USD 90K-300KAPI Security | Adversarial analysis | Application Security | Artifact signing | AuthenticationHybrid or remote optionSenior-level Full TimeIrvine, CA18h ago
-
Senior Computational Fluid Dynamics (CFD) Engineer USD 168K-205KAerodynamic Database | Aerodynamics | Aeromechanics | Automation | CAMRAD IIBonus | On-site work 5 days a week | Relocation assistance | Travel reimbursementSenior-level Full TimeIrvine, CA20h ago