Lead Azure Databricks Data Engineer
Carmel - Indiana, United States
USD 112K-140K Senior-level Full Time
Tasks
- Build and optimize data pipelines
- Configure MDM tools and data governance
- Develop scalable data architectures
- Drive automation and CI/CD pipelines
- Implement data cataloging and lineage
- Implement data solutions
- Lead projects and mentor staff
- Manage data integration and ETL processes
- Manage data storage with Delta Parquet
- Optimize sql server databases
- Set up Change Data Capture processes
- Support BI reporting and dashboards
- Use Azure Data Factory and Databricks
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Purview | Big Data | Big data analytics | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Warehousing | Data analytics | Database Management | Databricks | Delta Parquet | ETL Processes | Profisee MDM | Programming | SQL Server | Tableau
Education
Roles
Related jobs
-
Finance Analytics Engineer USD 76K-95KAI | Data Modeling | Data Quality | Data Transformation | Data WarehouseHealth benefits | Paid time off | Retirement plan | Wellness programSenior-level Full TimeRemote - Nationwide, United States R5h ago
-
Senior Database Engineer – Azure Data Platform USD 117K-250KAzure | Bitbucket | Data Migration | Data Recovery | Data SecuritySenior-level Full TimeSeattle8h ago
-
AWS | Data Lake | Data Modeling | DynamoDB | ETLMid-level ContractRichmond, United States8h ago
-
Associate GenAI Engineer USD 85K-142K.Net Core | AWS | Agile | Angular | AzureFlexible work hours | Inclusive culture | Remote work options | Training and development opportunitiesMid-level Full TimeJersey City, New Jersey, United States9h ago
-
Developer Support Solutions Engineer USD 173K-238KAI | Automation | Cross-Functional Collaboration | Cross-functional | Customer supportSenior-level Full TimeMenlo Park, CA10h ago
-
Software Engineer III, AI/ML, Ads USD 147K-211KAlgorithms | Data Processing | Data Structures | Machine Learning | Model DeploymentBenefits | Bonus | EquitySenior-level Full TimeMountain View, CA, USA10h ago
-
Business Intelligence | Business Intelligence Tools | Data Modeling | Data Pipeline Development | Data ValidationBenefits | Career development | Work-life balanceMid-level Full TimeSan Bruno, CA, USA; Mountain View, …10h ago
-
Data & Analytics Lead Data Engineer USD 150K-170KAWS RDS | Azure Data | Azure Data Factory | C# | Data Architecture401k | Culture and community activities | Employee discounts | Medical/Dental/Vision | PTOSenior-level Full TimePeachtree Corners, GA, US15h ago
-
Senior SAP Datasphere Engineer USD 135K-165KAI Automation | APIs | Automation Scripting | BI platforms | BW on HANA401k | Dental benefits | Disability insurance | Life insurance | Medical benefitsSenior-level Full TimeMinneapolis, MN, United States17h ago
-
Senior Software Engineer (US) USD 185K-200KAI tools | AWS | Big Data | Big data analytics | Data analytics401k match | Flexible hours | Flexible vacation | Learning reimbursement | Parental leaveSenior-level Full TimeNew York R18h ago
-
Senior Principal Software Engineer, AI Infra Compute USD 96K-251KAPI Design | API Security | Bash | C# | C++401k | Adoption Assistance | Dental insurance | Disability insurance | Flexible spending accountsSenior-level Full TimeAustin, TX, United States19h ago
-
Senior Data Engineer/Architect - Databricks USD 150K-170KAI Pipelines | Azure Data | Azure Data Factory | Azure Data Lake | Azure EventCharitable giving | Competitive package | Employee assistance | Health insurance | Legal plansSenior-level Full TimeRemote South Carolina, Remote South Carolina, … R22h ago
-
RWD Data Engineer USD 102K-181KAI tools | Data Modeling | Data Pipeline Development | Data Quality | Data TransformationFlexible remote work | Professional development opportunitiesMid-level Full TimeUnited States-North Carolina-Remote, United States R22h ago
-
Senior Data Engineer, VP USD 110K-207KAWS Azure | Batch Processing | Big Data | Big data processing | CICDEmployee assistance program | Insurance coverage | Paid time off | Performance-Based Incentives | Retirement planSenior-level Full TimeBOSTON, United States22h ago
-
Lead Gen AI Data Engineer USD 135K-202KAI Pipelines | AWS | AWS Bedrock | Azure | Data GovernanceCareer growth opportunities | Hybrid workSenior-level Full TimeHartford CT- Home Office, United States22h ago
-
AWS Glue | Bit Bucket | CICD | Control-M | DB2Comprehensive employee benefits | Diversity and inclusion programsExecutive-level Full TimeAlpharetta GA 6655, United States22h ago
-
Data Engineer USD 77K-176KAWS | Agile | Azure | Cassandra | DatabricksDisability benefits | Health benefits | Life insurance | Paid leave | Professional developmentSenior-level Full TimeUSA, NC, Fayetteville (4200 Morganton Rd …22h ago
-
Data Engineer USD 90K-135KAWS | Airflow | Azure | Azure Data | Azure Data FactoryFlexible schedule | Healthcare benefits | Professional development opportunitiesMid-level Full TimeBusiness Office - Benson Tower, United …22h ago
-
Sr Systems Analyst USD 92K-167KCloud Platforms | Control-M | Data Governance | Denodo | ELT401k plan | Employee assistance | Health benefits | Paid time off | Tuition reimbursementSenior-level Full TimeChicago Illinois HQ (300 E. Randolph …22h ago
-
Machine Learning Engineer USD 160K-200KAgent Frameworks | BigQuery | Cloud Functions | Cloud GCP | Cloud RunFlexible hours | Health insurance | Remote work | Skill development opportunitiesMid-level Full TimeLos Angeles, CA; Remote (United States) R22h ago
-
Staff Analytics Engineer, Corporate USD 120K-140KCommunication | Dashboard Development | Data Management | Data Modeling | Data Pipeline DevelopmentSenior-level Full TimeSan Francisco, CA22h ago
-
Staff Analytics Engineer, Business Solutions USD 105K-140KAgile | Data Architecture | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimeSan Francisco, CA22h ago
-
Data Governance | Data Modeling | Data Warehousing | MPP | MigrationCommunity involvement | Professional training | Remote work flexibilitySenior-level Full TimeIllinois; Massachusetts; New York; North Carolina; …1d ago
-
Senior Software Engineer, Data Platform USD 190K-240KCost Optimization | Data Lakehouse | Data Modeling | Data Quality | Distributed SystemsCareer development | Flexible working | Inclusive cultureSenior-level Full TimeNew York, United States1d ago
-
Data Engineer USD 102K-138KAPI Development | Agile Principles | Big Data | Big Data Analysis | CD pipelinesProfessional growth opportunities | Supportive environmentSenior-level Full TimeBoston, MA1d ago