Lead Data Engineer (Databricks)
Chicago - Illinois - Wacker, United States
USD 112K-140K Senior-level Full Time
Tasks
- Automate data processes
- Build and optimize data pipelines
- Configure data storage solutions
- Design and develop data architecture
- Develop big data analytics
- Develop data cataloging and lineage
- Enhance reporting dashboards
- Ensure data quality and governance
- Implement data solutions
- Implement real-time data synchronization
- Integrate master data management tools
- Lead database optimization
- Lead projects and mentor staff
- Manage ETL processes
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Purview | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Warehousing | Databricks | Delta Parquet | ETL Processes | Programming Languages | SQL Server | Tableau
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Software Engineer, BigQuery, Agentic AI USD 174K-252KCloud services | Data Warehousing | Distributed Systems | Generative AI | GoBenefitsSenior-level Full TimeNew York, NY, USA3h ago
-
Senior Analytical Engineer USD 149K-240KAWS | Airflow | Azure | Databricks | Generative AI401k | Dental | FSA/HSA | Life insurance | MedicalSenior-level Full TimeSan Francisco, CA, United States11h ago
-
Data Engineer USD 155K-200KBigQuery | Cloud Computing | Cloud platform | DBT | Data ArchitectureFlexible time off | Health and wellbeing support | Learning and development budget | Parental leave | Team eventsSenior-level Full TimeAustin, Texas; San Francisco Bay Area, …12h ago
-
Staff Data Engineer USD 131K-210KAWS | Apache Spark | Azure | CI/CD | Data Governance401k | Dental insurance | FSA | HSA | Hybrid workSenior-level Full TimeBellevue, WA, United States14h ago
-
Sr. Software Dev Engineer, Leo AI Foundations USD 168K-227KAWS | Automated testing | Data Ingestion | Data Lakehouse | Data ModelingSenior-level Full TimeRedmond, Washington, USA14h ago
-
AWS | Big Data | Data Governance | Distributed Systems | Server-lessFlexible work hours | Inclusive culture | MentorshipSenior-level Full TimeEast Palo Alto, California, USA14h ago
-
Sr. Data Platform Engineer I (6366) USD 170K-239KAgile | Backup & Recovery | CI/CD | Database security | Kubernetes401k plan | Flexible work | Health, dental, vision insurance | Paid time off | Parental leaveSenior-level Full TimeHybrid - Local to D.C. metro … R17h ago
-
Data Engineer USD 129K-186KAWS | CI/CD | Cloud Data | Cloud data platform | DBTBenefits package | Collaborative environment | On-site position in Charlotte | Professional development supportMid-level Full TimeCharlotte, North Carolina, United States18h ago
-
Cloud Data Engineer USD 122K-160KAzure | Azure Data | Azure Data Factory | Data Architecture | Data FactoryMid-level Full TimeSouthfield, Michigan, United States18h ago
-
Mid-level Full TimeWoodinville, Washington, United States18h ago
-
Database Engineer (TS/SCI with Poly Required) USD 142K-238KAWS | Amazon RDS | Azure SQL | Azure SQL Database | Backup & RecoverySenior-level Full TimeTysons Corner, Virginia, United States19h ago
-
Director of Data Engineering USD 165K-184KAI enablement | Azure Data | Azure Data Services | Cloud Platforms | Data ArchitectureEducational assistance | Flexible schedule | Performance bonus | Remote work | Volunteer opportunitiesExecutive-level Full TimeAtlanta, Georgia or Gainesville, Florida19h ago
-
Enterprise Data & AI Intern USD 86K-116KBI tools | Data Modeling | Data Pipelines | Generative AI | NumPyHybrid work | Internship experience | Learning opportunityEntry-level InternshipSan Francisco, CA19h ago
-
Senior Data Engineer USD 150K-175KAWS | Airflow | BigQuery | CI/CD | Cloud infrastructureFlexible time off | Health insurance | Learning and development | Mental health support | Paid HolidaysSenior-level Full TimeRemote - US R19h ago
-
Data Governance Lead - Hybrid USD 140K-185KAudit Coordination | Data Governance | Data Risk | Process Design | Program ManagementFlexible work arrangements | Professional development opportunitiesSenior-level Full TimeCharlotte, NC, United States19h ago
-
Senior Machine Learning Engineer USD 138K-173KAirflow | Amazon Bedrock | Amazon SageMaker | Arize | Data Structures401k matching | Bonus opportunities | Commuter benefits | Health insurance | Paid time offSenior-level Full TimeAtlanta20h ago
-
Senior Machine Learning Engineer USD 138K-173KAWS | Airflow | Autocomplete | Automation | Azure401k matching | Bonus opportunities | Career development | Health insurance | Inclusive cultureSenior-level Full TimeNew York City20h ago
-
Senior Data/ML Engineer USD 151K-205KDBT | Data Architecture | Data Governance | Data Quality | EmbeddingsDental | Flexible vacation | Health insurance | Learning and development | Life insuranceSenior-level Full TimeRemote - USA R20h ago
-
Software Engineer, Data (L1) USD 70K-100KAPI | Airflow | Azure | BigQuery | Cloud GCP401k | Calm app | Career growth | Dental insurance | Disability insuranceMid-level Full TimeAustin, TX21h ago
-
Database Administrator / Data Engineer – AWS Migration USD 120K-140KAWS | AWS DMS | Data Modeling | DynamoDB | GlueMid-level Full TimeRichmond, VA, United States21h ago
-
Senior Machine Learning Engineer USD 150KAzure | CI/CD | CosmosDB | Data Pipelines | DatabricksCompany-sponsored 401k | Flexible work culture | Health insurance | Learning stipend | Paid parental leaveSenior-level Full TimeUnited States R21h ago
-
Senior Software Engineer, Data USD 145K-200KAPI Design | Cloud Data | Cloud Data Warehouses | Data Modeling | Data Warehouses401k | Dental insurance | Disability insurance | Employee Emergency Fund | Flexible workSenior-level Full TimeAlpharetta, GA21h ago
-
Data Engineer II USD 104K-130KAWS | Apache Airflow | Data Modeling | Data Pipelines | Data WarehousingCreative culture | Dental insurance | Disability Leave | Disability insurance | FSAMid-level Full TimeMurray, Utah, United States21h ago
-
Senior Data Engineer - Managed Services USD 96K-144KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | CI/CDDiscretionary bonus | Employee assistance program | FSA | Flexible work location | HSASenior-level Full TimeRemote - US R22h ago
-
Data Analysis | Data Modeling | Data Visualization | ETL | Power BIFlexible schedule | Remote workEntry-level Full Time InternshipRancho Cordova, CA, United States23h ago