Lead Azure Databricks Data Engineer
Carmel - Indiana, United States
USD 112K-140K Senior-level Full Time
Tasks
- Build and optimize data pipelines
- Configure MDM tools and data governance
- Develop scalable data architectures
- Drive automation and CI/CD pipelines
- Implement data cataloging and lineage
- Implement data solutions
- Lead projects and mentor staff
- Manage data integration and ETL processes
- Manage data storage with Delta Parquet
- Optimize sql server databases
- Set up Change Data Capture processes
- Support BI reporting and dashboards
- Use Azure Data Factory and Databricks
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Purview | Big Data | Big data analytics | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Warehousing | Data analytics | Database Management | Databricks | Delta Parquet | ETL Processes | Profisee MDM | Programming | SQL Server | Tableau
Education
Roles
Related jobs
-
Data Architect USD 135K-165KAPI Integration | API Keys | API Management | Amazon Kinesis | Amazon Web ServicesHighly cleared team support | Security-focused environmentSenior-level Full TimeOther, VA11h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States12h ago
-
Mid-level Full TimeAuburn Hills, MI, United States12h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence13h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States13h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R17h ago
-
Principal Big Data Software USD 178K-261K3GPP | 5G | Agile | Ansible | Apache NiFi401k plan | Adoption reimbursement | Employee assistance programs | Employee discounts | Employee wellness programsSenior-level Full TimeUSA:TX:Plano / W Plano Pkwy - …1d ago
-
Agile | CSS | Cloud Computing | DBT | Data LakesRelocation eligibleMid-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …1d ago
-
Agile | CSS | DBT | Data Lakes | Data Modeling401k match | Dental insurance | Employee assistance program | Employee scholar program | Flexible spending accountsSenior-level Full TimeUS-IN-INDIANAPOLIS-206 ~ 3939 Priority Way S …1d ago
-
Staff Data Engineer USD 106K-284KAWS | Alerting | Amazon SNS | Apache Kafka | Argo CDMedical, dental, and vision coverage | Paid time off | Retirement savings options | Wellness programsSenior-level Full TimeWork At Home-Texas, United States1d ago
-
Mid-level Full TimeNew York, NY1d ago
-
TAMIDS Senior AI Engineer / Lead AI Engineer USD 50K-55KArtificial Intelligence | Backend Development | Data Governance | Data Pipelines | Database ManagementSenior-level Full TimeCollege Station, TX, United States1d ago
-
Lead AI Software Engineer- AI Enablement USD 140K-231KAI Agents | AWS | AWS CDK | Agile Scrum | Amazon BedrockSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States1d ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R1d ago
-
AWS | Agent Frameworks | Agent Orchestration | Amazon Kinesis | Amazon SageMaker401k plan | Dental insurance | Long-term disability | Medical insurance | Paid time offMid-level Full TimeCharlotte, 1120 S Tryon St., Corp, …1d ago
-
Principal ML Ops Engineer USD 117K-201KAWS | Access Control | Amazon SageMaker | Auditability | Azure401k retirement plan | Holiday pay | Paid vacation | Parental leave | Pension planSenior-level Full TimeUS076 FL Jacksonville - 7500 Centurion …1d ago
-
Healthcare Data Engineer USD 88K-168KAmazon Web Services | CI/CD | Cloud Computing | Cloud platform | Data LakesDiscretionary bonus | Flexible schedule | Travel as neededMid-level Full TimeUSA-TX-Dallas-13155 Noel Road, United States1d ago
-
Technology Engineer Sr., Data Analytics Lead USD 65K-149KData Visualization | Machine Learning | Power BI | Python | R401k match | Dental coverage | Educational assistance | Medical coverage | Paid time offSenior-level Full TimeFirstside Center Bldg (PA373), United States1d ago
-
Mid-level Full Time9638 Reston VA Non-specific Customer Site, …1d ago
-
AWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon KinesisSenior-level Full TimeNY New York 30 Hudson Yards, …1d ago
-
Senior-level Full Time9638 Reston VA Non-specific Customer Site, …1d ago
-
API Development | Apache Airflow | Apache Spark | Azure | Business Intelligence401k match | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeRedmond, WA, United States1d ago
-
Apache Airflow | Apache Spark | Cloud Computing | Data Modeling | Data PipelinesDental insurance | Employer-matched 401k | Health insurance | Hybrid schedule | Life insuranceSenior-level Full TimeRedmond, WA, United States1d ago
-
API Development | AWS | Azure | Cloud platform | Compliance401k plan | Childcare discounts | Commuter benefits | Discounts at Marriott properties | Employee assistance planSenior-level Full TimeBethesda, MD, United States1d ago
-
Data Scientist Lead USD 175K-210KAWS | Apache Spark | Data Governance | Data Modeling | DatabricksBackup childcare | Financial coaching | Health care coverage | Mental health support | Onsite wellness centersSenior-level Full TimeOH, United States1d ago