Lead Azure Databricks Data Engineer
Carmel - Indiana, United States
USD 112K-140K Senior-level Full Time
Tasks
- Build and optimize data pipelines
- Configure MDM tools and data governance
- Develop scalable data architectures
- Drive automation and CI/CD pipelines
- Implement data cataloging and lineage
- Implement data solutions
- Lead projects and mentor staff
- Manage data integration and ETL processes
- Manage data storage with Delta Parquet
- Optimize sql server databases
- Set up Change Data Capture processes
- Support BI reporting and dashboards
- Use Azure Data Factory and Databricks
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Purview | Big Data | Big data analytics | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Warehousing | Data analytics | Database Management | Databricks | Delta Parquet | ETL Processes | Profisee MDM | Programming | SQL Server | Tableau
Education
Roles
Related jobs
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco8h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R8h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R11h ago
-
Data Engineer II USD 63K-114KSQL Server | SSIS401k | Flexible work schedule | Health insurance | Paid time off | Stock purchase planMid-level Full TimeRemote-MI, United States R11h ago
-
Data Warehouse Engineer USD 46K-60KCorepoint | Data Modeling | Data Quality | Data Validation | Data Warehousing401k match | Dental insurance | Discount programs | Employee counseling | FSAEntry-level Full TimeRemote, United States R13h ago
-
Principal Engineer, Data & ML Platform USD 119K-180KAPIs | Automated testing | Cloud Native | Cloud platform | Continuous DeploymentSenior-level Full TimeScottsdale, AZ14h ago
-
Data Engineer USD 129K-178KApache Kafka | Apache Spark | Cloud Platforms | Data Compliance | Data GovernanceMid-level Full TimeUS - Remote R14h ago
-
Lead Data Scientist USD 225K-275KA/B | A/B Testing | API Integration | B testing | DBTCollaborative work environment | Dental insurance | Education Impact | Health insurance | Hybrid work modelSenior-level Full TimeSan Francisco R14h ago
-
Data Analytics Engineer USD 150K-160KAmazon Redshift | BI | DBT | Data Marts | Data ModelingEquity package | Flexible working environment | Learning and development stipend | Paid Maternity Leave | Paid paternity leaveMid-level Full TimeNew York, NY14h ago
-
Sr. Data Engineer USD 145K-160KAPI Development | AWS | AWS Glue | AWS Lambda | Amazon AthenaComplimentary club membership | Personal training | Pilates | Shop discounts | SpaßSenior-level Full TimeNew York, NY, United States15h ago
-
Senior Customer Solutions Engineer - US USD 111K-176KAPI Scripting | Access Tokens | Active Directory | Airflow | Azure Active Directory401k plan | Flexible stipends | Health and wellness stipend | Healthcare coverage | Home office setup stipendSenior-level Full TimeUS - Remote R15h ago
-
Analytics Engineer USD 125K-150KAmazon Redshift | Business Intelligence | DBT | Data Modeling | Data VisualizationCaregiver support | Company holidays | Dental insurance | Fertility benefits | Flexible PTOMid-level Full TimeRemote - USA R16h ago
-
Machine Learning Engineer USD 217K-260KAWS | Cloud platform | Dash | Database Management | Docker401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeSan Francisco, CA16h ago
-
Senior Data Engineer - Snowflake USD 165K-216KAWS | Azure | Cloud platform | Data Governance | Data IntegrityFlexible work arrangements | Onsite collaboration in Manhattan New York | Professional development opportunitiesSenior-level Full TimeNew York, New York, United States16h ago
-
Data/Analytics Engineering Co-op USD 67K-67KApache Airflow | Cloud infrastructure | Dagster | Looker | PowerBIHybrid workEntry-level Full TimeBoston or NYC17h ago
-
Data Developer USD 109K-147KConditional logic | Data Governance | Data Lake | Data Mart | Data Quality401k employer match | Business Casual Work Environment | Dental insurance | Long-term disability | Medical insuranceEntry-level Full TimeGreenville, South Carolina17h ago
-
Data & Analytics Engineer USD 115K-150KCI/CD | CTE | Clustering | DBT | Data Lineage401k matching | Birthday time off | Cell phone reimbursement | Childcare expense reimbursement | Company-Paid HolidaysMid-level Full TimeUnited States17h ago
-
Sr. Staff Software Engineer, Data Product Platform USD 208K-429KAI coding | AI coding tools | AI-assisted analytics | Apache Airflow | Apache SupersetEquity | Flexible work modelSenior-level Full TimeSan Francisco, CA, US; Remote, US R17h ago
-
Staff Analytics Engineer USD 138K-221KBigQuery | CI/CD | DBT | Data Governance | Data ModelingHybrid work modelSenior-level Full TimeBoston, MA18h ago
-
Staff Data Engineer USD 138K-221KAmazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | BigQueryHybrid work modelSenior-level Full TimeBoston, MA18h ago
-
Data Engineer (remote) USD 85K-100KAgile | Apache Hive | Apache Impala | Apache Spark | Artificial Intelligence401k match | Employee assistance program | Flexible schedule | Health insurance | Life insuranceMid-level Full TimeWork From Home, United States R19h ago
-
Senior Forward Deployed AI Engineer (Remote Eligible) USD 227K-245KAWS Bedrock | Agent Framework | Agent Orchestration | Cloud infrastructure | Databricks401k match | Dental insurance | Flexible time off | Health insurance | Life insuranceSenior-level Full Time-REMOTE, USA- R19h ago
-
Senior Data Engineer USD 121K-170KAccess Control | Azure Data | Azure Data Factory | Azure SQL | CDC401k match | Dental insurance | Disability insurance | Educational assistance program | Employee assistance programSenior-level Full TimeRemote (United States) R20h ago
-
Data Engineer USD 125K-163KAWS | Apache Airflow | Azure | CI/CD | DBT401k match | Commuter benefits | Dental insurance | Disability insurance | Family planning benefitsSenior-level Full TimeNew York City20h ago
-
Senior Data Engineer USD 138K-181KAWS | Apache Airflow | Apache Kafka | Apache Spark | Azure401k match | Commuter benefits | Dental insurance | Disability insurance | Fitness benefitsSenior-level Full TimeNew York City20h ago