Databricks Lead (Data Migration Lead)
Detroit, MI, United States
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Apply DevOps and DataOps patterns
- Architect Databricks data platforms
- Build secure cost optimized Databricks infrastructure
- Contribute to MLOps and advanced operations frameworks
- Design batch and streaming pipelines
- Develop PySpark reusable frameworks
- Establish CI CD and development best practices
- Lead Oracle to Databricks migration
- Orchestrate pipelines with Databricks Workflows
- Provide technical mentorship and training plans
- Replace ODI jobs
- Translate schemas and migrate ETL ELT logic
- Write Spark SQL transformations
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Batch Processing | CI/CD | Data Governance | Data Vault | Data Warehousing | Data mesh | DataOps | Databricks | Databricks Workflows | Delta Lake | DevOps | ELT | ETL | MLOps | ODI | Oracle | PLSQL | PySpark | Scrum | Spark SQL | Streaming | Unity Catalog
Education
N/A
Related jobs
-
Ansible | Cloud Native | Cloud-native software | Configuration Management | DevOps401k match | ESPP | Family leave | Flexible spending accounts | Flexible time awaySenior-level Full TimeChicago, Illinois, United States9h ago
-
Lead AI Engineer USD 128K-188KAWS SageMaker | Agentic AI | AutoGPT | Azure Machine Learning | CI/CD401k match | Childcare benefits | Health, dental, vision coverage | Life and disability coverage | Onsite gymSenior-level Full TimeQuincy, MA, United States12h ago
-
Senior Cloud Data Ops Engineer USD 97K-199KAWS Aurora | AWS RDS | Backup and Restore | Bash Scripting | BigQueryChildcare benefits | Onsite gym | Tuition assistanceSenior-level Full TimeQuincy, MA, United States12h ago
-
Data Engineer - Supply Chain USD 120K-164KApache Spark | CI/CD | Data Governance | Data Lineage | Data ModelingSenior-level Full TimeAuburn Hills, MI, United States14h ago
-
Senior Data Engineer USD 131K-220KApache Spark | Data Migration | Data Visualization | Data Warehouse | Database DesignBest place to work recognition | Employee development | Fastest Growing company recognition | High employee moraleSenior-level Full TimeHuntsville, United States15h ago
-
API | Axon | Customer360 | Data Governance | Data ManagementSenior-level ContractAustin, United States16h ago
-
Mid-level Full TimeSan Diego, California, United States16h ago
-
Data Engineer USD 62K-62KAzure Data | Azure Data Factory | DBT | Data Factory | Data Modeling401k matching | Dental insurance | Disability insurance | Flexible spending account | Internal promotion opportunitiesEntry-level Full TimeKS, Leawood16h ago
-
Data Engineers - Senior #IN1265 USD 108K-133KAccess Control | Agile | Cloud Platforms | Data Governance | Data IntegritySenior-level Full TimeColumbus, IN, United States19h ago
-
Data Engineer Principals #IN1214 USD 127K-155KAgile | Apache HBase | Apache Hive | Apache Kafka | Apache SparkSenior-level Full TimeColumbus, IN, United States19h ago
-
Staff Data Engineer USD 114K-171KCloud Platforms | Data Modeling | Data Pipelines | Data Warehousing | Data integrationDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US21h ago
-
Staff Partner Engineer, Azure USD 150K-206KAI Platform | AI Platform Integration | API Integration | Apache Spark | Architecture DiagramsAnnual performance bonus | EquitySenior-level Full TimeNew York City, New York; San …1d ago
-
Fabric - Sr Data Engineer USD 112K-185KAPI-based integration | Access Control | Active Directory | Azure | Azure Active DirectorySenior-level Full TimeUnited States1d ago
-
Agile | Algorithms | CI/CD | Data Engineering | Data Structures401k plan | Accident insurance | Dependent care FSA plan | HSA and FSA | Hospital indemnity insuranceSenior-level Full TimeAustin, Texas or Remote R1d ago
-
GCP Data Engineer USD 68K-168KBigQuery | CI/CD | Cloud Storage | Cloud platform | ComposerCompany-Paid Holidays | Employee assistance program | Hybrid work | Life and disability insurance | Medical, dental, and vision coverageMid-level Full TimeNashville, TN, US1d ago
-
GCP Data Engineer USD 53K-122KAirflow | Apache Beam | BigQuery | CI/CD | Cloud StorageCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeNashville, TN, US1d ago
-
GCP Associate Data Engineer USD 43K-105KAI machine learning | Airflow | Apache Beam | BigQuery | CI/CD401k retirement savings | Company holidays | Disability insurance | Employee assistance program | Life insuranceMid-level Full TimeBridgewater, NJ, US1d ago
-
Data Engineer - Production Support USD 74K-99KADLS | Azure | Azure Data | Azure Data Factory | Azure Databricks401k match | Employee assistance program | Employee stock purchase plan | Health and wellness allowance | Hybrid work environmentMid-level Full TimeIrving - 6011 Connection, United States1d ago
-
Data Engineer, Integrations USD 140K-177KAWS | Airflow | Azure | Boomi | CCPA401k match | Dental insurance | Life insurance | Medical insurance | Tuition reimbursementMid-level Full TimeWaltham Office, United States1d ago
-
Airflow | Apache Spark | CI/CD | Data Lakehouse | Data ModelingMid-level ContractATLANTA, GA1d ago
-
Senior Data Engineer USD 162K-242KCloud Platforms | Data Lakes | Data Modeling | Data Pipelines | Data Transformation401k match | Company holidays | Dental insurance | Life insurance | Long-term disabilitySenior-level Full TimeUSA - MA - Cambridge, United … R1d ago
-
Senior Applied ML Engineer USD 180K-200KAWS | Amazon Web Services | Computer Vision | Distributed Systems | Docker401k match | Disability Leave | Family building benefits | Health benefits | Life insuranceSenior-level Full Time06083 GameChanger, United States R1d ago
-
Senior Data Engineer-Batch Processing USD 97K-185KAWS Batch | AWS IAM | Agile | Amazon S3 | BashHybrid work scheduleSenior-level Full Time500 Salem St, Smithfield RI, United …1d ago
-
Data Expert - Data, Model & Analytics USD 63K-152KApache Spark | Consent Management | Data Automation | Data Consistency | Data GovernanceSenior-level Full TimeOne PNC Plaza (PA370), United States1d ago
-
Data Engineer I USD 30K-36KACID | Apache Spark | Azure | Azure DevOps | Batch Data Processing401k match | Community giveback paid time off | Employee assistance program | Employee discounts | FSAEntry-level Full TimeUnited States - Remote R1d ago