Lead Azure Databricks Data Engineer
Carmel - Indiana, United States
USD 112K-140K Senior-level Full Time
Tasks
- Automate data processes
- Build and optimize data pipelines
- Configure data governance tools
- Design data architecture
- Develop Databricks notebooks
- Develop data cataloging and lineage
- Enhance BI reporting
- Implement data solutions
- Implement data storage solutions
- Lead database optimization
- Manage ETL processes
- Mentor junior staff
- Set up data synchronization processes
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Purview | Big Data | Big data analytics | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Warehousing | Data analytics | Database Management | Databricks | Delta Parquet | ETL Processes | Machine Learning | Predictive Analysis | Profisee | SQL Server | Tableau
Education
Roles
Related jobs
-
Data Architect USD 135K-165KAPI Integration | API Keys | API Management | Amazon Kinesis | Amazon Web ServicesHighly cleared team support | Security-focused environmentSenior-level Full TimeOther, VA9h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States11h ago
-
Mid-level Full TimeAuburn Hills, MI, United States11h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence11h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States12h ago
-
Senior-level Full TimeDallas, Texas, United States12h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …13h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA13h ago
-
Research Scientist, Biomedical AI, DeepMind USD 147K-211KArtificial Intelligence | Benchmarking | Computational pipeline | Data Analysis | EvaluationMid-level Full TimeMountain View, CA, USA13h ago
-
C# | C++ | Co-design | Compiler technology | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA13h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R16h ago
-
Principal Big Data Software USD 178K-261K3GPP | 5G | Agile | Ansible | Apache NiFi401k plan | Adoption reimbursement | Employee assistance programs | Employee discounts | Employee wellness programsSenior-level Full TimeUSA:TX:Plano / W Plano Pkwy - …1d ago
-
Agile | CSS | Cloud Computing | DBT | Data LakesRelocation eligibleMid-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …1d ago
-
Agile | CSS | DBT | Data Lakes | Data Modeling401k match | Dental insurance | Employee assistance program | Employee scholar program | Flexible spending accountsSenior-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …1d ago
-
Staff Data Engineer USD 106K-284KAWS | Alerting | Amazon SNS | Apache Kafka | Argo CDMedical, dental, and vision coverage | Paid time off | Retirement savings options | Wellness programsSenior-level Full TimeWork At Home-Texas, United States1d ago
-
Mid-level Full TimeNew York, NY1d ago
-
TAMIDS Senior AI Engineer / Lead AI Engineer USD 50K-55KArtificial Intelligence | Backend Development | Data Governance | Data Pipelines | Database ManagementSenior-level Full TimeCollege Station, TX, United States1d ago
-
Lead AI Software Engineer- AI Enablement USD 140K-231KAI Agents | AWS | AWS CDK | Agile Scrum | Amazon BedrockSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States1d ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R1d ago
-
AWS | Agent Frameworks | Agent Orchestration | Amazon Kinesis | Amazon SageMaker401k plan | Dental insurance | Long-term disability | Medical insurance | Paid time offMid-level Full TimeCharlotte, 1120 S Tryon St., Corp, …1d ago
-
Principal ML Ops Engineer USD 117K-201KAWS | Access Control | Amazon SageMaker | Auditability | Azure401k retirement plan | Holiday pay | Paid vacation | Parental leave | Pension planSenior-level Full TimeUS076 FL Jacksonville - 7500 Centurion …1d ago
-
AI Software Solutions Architect Engineer USD 130K-205KArtificial Intelligence | C++ | Cloud Computing | Data Science | DevOpsDental insurance | Disability insurance | Employee assistance program | Flexible spending account | Health insuranceSenior-level Full TimeTEX01 - Houston, Texas (TEX01), United …1d ago
-
Healthcare Data Engineer USD 88K-168KAmazon Web Services | CI/CD | Cloud Computing | Cloud platform | Data LakesDiscretionary bonus | Flexible schedule | Travel as neededMid-level Full TimeUSA-TX-Dallas-13155 Noel Road, United States1d ago
-
AI/ML Engineer II USD 100K-145KAPI Design | AWS | Anomaly Detection | Azure | CI/CD401k match | Dental insurance | Health Savings Account match | Medical insurance | Paid caregiver leaveMid-level Full TimeCorp-Main - Diamond Bar, CA, United …1d ago
-
AI Software Engineer - Search Infrastructure USD 151K-332KAPI Design | AWS | Docker | Elasticsearch | Embedding ModelsHybrid work | Remote workMid-level Full TimeSeattle (WA), United States1d ago