Lead Data Engineer (Databricks)
Chicago - Illinois - Wacker, United States
USD 112K-140K Senior-level Full Time
Tasks
- Automate data processes
- Build and optimize data pipelines
- Configure data storage solutions
- Design and develop data architecture
- Develop big data analytics
- Develop data cataloging and lineage
- Enhance reporting dashboards
- Ensure data quality and governance
- Implement data solutions
- Implement real-time data synchronization
- Integrate master data management tools
- Lead database optimization
- Lead projects and mentor staff
- Manage ETL processes
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Purview | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Warehousing | Databricks | Delta Parquet | ETL Processes | Programming Languages | SQL Server | Tableau
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AWS Data | AWS Data Warehouse | Amazon Web Services | Data Warehouse | SQLContract role | On site 3 days per weekMid-level Full TimeHouston, TX, United States2h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States5h ago
-
Lead Data Architect USD 173K-276KAI metadata | Cloud Platforms | Data Architecture | Data Governance | Data Lakes401k | Dental insurance | Health insurance | Paid time off | Vision insuranceExecutive-level Full TimeFoster City, CA, United States5h ago
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationEntry-level Full TimeSeattle, WA6h ago
-
Data Engineer (Analytics) USD 191K-235KBig Data | Data Modeling | Data Warehousing | Data integration | Dimensional ModelingDomestic and international travel | TelecommutingMid-level Full TimeMenlo Park, CA | Remote, US R6h ago
-
AI Engineer, Professional Services, Google Cloud USD 183K-265KApache Beam | Apache Spark | C++ | Data Validation | Data WarehousingTechnical workshops | Travel opportunitiesSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA6h ago
-
Software Engineering - DataStage Developer USD 112K-129KAxway | Axway Secure SFTP | Azure | Azure DevOps | CA7 SchedulerHybrid work schedule | Remote workMid-level Full TimeSyracuse, New York, United States9h ago
-
Mid-level Full TimeFlorida, United States10h ago
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco14h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R14h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R17h ago
-
Data Engineer II USD 63K-114KSQL Server | SSIS401k | Flexible work schedule | Health insurance | Paid time off | Stock purchase planMid-level Full TimeRemote-MI, United States R17h ago
-
Lead, Data Platform Engineer USD 132K-150KApache Airflow | DBT | Data Pipeline Monitoring | Data Quality | Data Transformation401k retirement plan | Dental insurance | Health insurance | Holiday pay | Parental leaveSenior-level Full TimeUS063 NJ Raritan - 920 US …17h ago
-
Data Warehouse Engineer USD 46K-60KCorepoint | Data Modeling | Data Quality | Data Validation | Data Warehousing401k match | Dental insurance | Discount programs | Employee counseling | FSAEntry-level Full TimeRemote, United States R19h ago
-
Principal Engineer, Data & ML Platform USD 119K-180KAPIs | Automated testing | Cloud Native | Cloud platform | Continuous DeploymentSenior-level Full TimeScottsdale, AZ20h ago
-
Data Engineer USD 129K-178KApache Kafka | Apache Spark | Cloud Platforms | Data Compliance | Data GovernanceMid-level Full TimeUS - Remote R20h ago
-
Lead Data Scientist USD 225K-275KA/B | A/B Testing | API Integration | B testing | DBTCollaborative work environment | Dental insurance | Education Impact | Health insurance | Hybrid work modelSenior-level Full TimeSan Francisco R20h ago
-
Data Analytics Engineer USD 150K-160KAmazon Redshift | BI | DBT | Data Marts | Data ModelingEquity package | Flexible working environment | Learning and development stipend | Paid Maternity Leave | Paid paternity leaveMid-level Full TimeNew York, NY21h ago
-
Sr. Data Engineer USD 145K-160KAPI Development | AWS | AWS Glue | AWS Lambda | Amazon AthenaComplimentary club membership | Personal training | Pilates | Shop discounts | SpaßSenior-level Full TimeNew York, NY, United States21h ago
-
Senior AI/ML Engineer USD 99K-192KA/B | A/B Testing | Agentic Workflows | Anomaly Detection | Artificial IntelligenceAdoption and surrogacy expense reimbursement | Employee resource groups | Fertility treatments | Flexible family care days | Medical, dental & vision coverageSenior-level Full TimeUnited States21h ago
-
Senior Customer Solutions Engineer - US USD 111K-176KAPI Scripting | Access Tokens | Active Directory | Airflow | Azure Active Directory401k plan | Flexible stipends | Health and wellness stipend | Healthcare coverage | Home office setup stipendSenior-level Full TimeUS - Remote R21h ago
-
Treasury Deposit Analytics & Liquidity Vice President USD 175K-235KAlteryx | Capital management | Data Wrangling | Deposit pricing | ExcelBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site wellness centersExecutive-level Full TimeColumbus, OH, United States21h ago
-
Analytics Engineer USD 125K-150KAmazon Redshift | Business Intelligence | DBT | Data Modeling | Data VisualizationCaregiver support | Company holidays | Dental insurance | Fertility benefits | Flexible PTOMid-level Full TimeRemote - USA R22h ago
-
Big Data Engineer USD 100K-145KAPI Development | Amazon EMR | Apache Spark | Azure HDInsight | CassandraMid-level Full TimeUnited States22h ago
-
Senior Data Engineer - Snowflake USD 165K-216KAWS | Azure | Cloud platform | Data Governance | Data IntegrityFlexible work arrangements | Onsite collaboration in Manhattan New York | Professional development opportunitiesSenior-level Full TimeNew York, New York, United States22h ago