Lead Azure Databricks Data Engineer
Carmel - Indiana, United States
USD 112K-140K Senior-level Full Time
Tasks
- Automate data processes
- Build and optimize data pipelines
- Configure data governance tools
- Design data architecture
- Develop Databricks notebooks
- Develop data cataloging and lineage
- Enhance BI reporting
- Implement data solutions
- Implement data storage solutions
- Lead database optimization
- Manage ETL processes
- Mentor junior staff
- Set up data synchronization processes
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Purview | Big Data | Big data analytics | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Warehousing | Data analytics | Database Management | Databricks | Delta Parquet | ETL Processes | Machine Learning | Predictive Analysis | Profisee | SQL Server | Tableau
Education
Roles
Related jobs
-
Senior Data Engineer USD 120K-142KApache Airflow | C# | Continuous integration | DBT | Data Modeling401b retirement savings program | Dental insurance | Dependent Care Account | Employer match | Flexible spending accountsSenior-level Full TimeNew York, NY, United States12h ago
-
Technical Support Engineer USD 90K-125KBusiness Intelligence | CTE | Data Modeling | Data Visualization | Database401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA13h ago
-
Technical Support Engineer USD 90K-125KAWS | Amazon Redshift | Business Intelligence | CTE | Cloud Computing401k | Annual bonus | Commuter benefits | Dog-friendly office | EquitySenior-level Full TimeNew York City, NY13h ago
-
AI Research Engineer USD 190K-280KAgentic AI | Clinical data | Data Pipelines | Data integration | Deep learningDiversity and inclusion initiatives | Flexible work environment | Friendly work environment | Professional developmentMid-level Full TimeSeattle, Washington, United States; South San …13h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI Inference | AI Training | Batch Processing | Compliance | Data InfrastructureExecutive-level Full TimeMountain View, CA, United States14h ago
-
Senior Machine Learning Engineer USD 108K-160KA/B | A/B Testing | AWS Lambda | Algolia | Amazon OpenSearch401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeRemote US R14h ago
-
Senior-level Full TimeMorristown, NJ, United States15h ago
-
Staff AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA15h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY15h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud Computing | Cloud platform | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeNew York City, NY15h ago
-
Data Engineer I USD 85K-100KAWS Glue | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k match | Direct student loan payment program | Employee recognition rewards | Flexible vacation | HRAMid-level Full TimeUnited States15h ago
-
Senior AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA15h ago
-
Staff Data Engineer - Information Security USD 152K-248KAzure | Big Data | C# | C++ | Data PipelinesHealth and wellness programs | Time away from workSenior-level Full TimeSunnyvale, CA, United States16h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R16h ago
-
Senior Software Engineer - Data Platform USD 150K-195KAPIs | BigQuery | C++ | CI/CD | Cloud Storage401k company contribution | Disability insurance | Fertility and infertility benefits | Industry competitive PTO | Learning and development opportunitiesSenior-level Full TimeUnited States R16h ago
-
AI Search | API Development | AWS | AWS Bedrock | Azure401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States16h ago
-
Senior Data Engineer (Remote, US) USD 140K-211KAirflow | Aiven | Apache Spark | BigQuery | CI/CD401k company contribution | Annual professional development fund | Be Well program | Paid volunteer service hours | Parental leaveSenior-level Full TimeRemote - United States R17h ago
-
Machine Learning Engineer USD 155K-228KAirflow | Amazon SageMaker | Apache Spark | Argo CD | Artificial IntelligenceHealthcare insurance | Paid parental leave | Paid personal time off | Paid sick time | Paid time offMid-level Full TimeRemote - US R18h ago
-
Staff Software Engineer, Data USD 270KApache Flink | Apache Kafka | Apache Spark | Cloud Data | Cloud data warehousing401k matching | ADND Insurance | Company holidays | Extended parental leave | Flexible spending accountSenior-level Full TimeUSA, Palo Alto18h ago
-
Sr Data Quality Engineer - SDET USD 140KAPI Testing | Apache Airflow | Cloud infrastructure | Data Lineage | Data Pipelines401k | Catered lunches | Commuter benefits | Continued education benefit | Equity compensationSenior-level Full TimeNew York, New York, United States19h ago
-
Sr Data Quality Engineer - SDET USD 140KAPI Testing | Airflow | Alerting | Cloud Databases | Data Lineage401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeLos Angeles, California, United States19h ago
-
Sr Data Quality Engineer - SDET USD 140KAPI Testing | Airflow | Cloud Databases | Data Lineage | Data Quality401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeSan Francisco, California, United States19h ago
-
Communication optimization | Data parallelism | Deep learning | Distributed Training | GPU AccelerationMid-level Full TimeSeattle, Washington, United States20h ago
-
Mid-level Full TimeGreenwich, CT20h ago
-
Content Safety | Data Modeling | Feature Engineering | Graph Databases | Information RetrievalSenior-level Full TimeSan Jose, California, United States20h ago