Azure Databricks Engineer
Tasks
- Build scalable data ingestion workflows
- Collaborate on architecture design patterns
- Conduct code reviews for coding standards
- Create reusable Databricks notebooks and jobs
- Design and optimize ETL pipelines
- Develop Delta Lake medallion architecture layers
- Implement DevOps processes with Git and CI CD
- Implement data governance security and access control
- Implement data transformation and data quality logic
- Integrate Databricks with Azure services
- Optimize Spark compute clusters and autoscaling
- Orchestrate pipelines with Azure Data Factory
- Prepare technical documents and runbooks
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS | Access Control | Autoscaling | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Access Control | Data Engineering | Data Factory | Data Governance | Data Processing | Data Security | Data access | Delta Lake | Distributed data | Distributed data processing | ETL | Event Hubs | Git | Key Vault | Medallion Architecture | PySpark | Synapse Analytics
Education
N/A
Related jobs
-
Senior-level Full TimeUS-IN-Indianapolis3h ago
-
Tech Lead - Machine Learning Platform Engineer USD 244K-450KData Engineering | Data Processing | Deep learning | Distributed Training | Feature EngineeringSenior-level Full TimeSan Jose, California, United States3h ago
-
Data Scientist - Platform Infrastructure USD 127K-202KDashboarding | Data Governance | Data Modeling | Data Quality | Data ValidationMid-level Full TimeSan Jose, California, United States4h ago
-
Software Engineer, Systems USD 203K-240KArtificial Intelligence | C# | C++ | Computer Graphics | Data ProcessingEntry-level Full TimeNew York, NY5h ago
-
Data Engineer USD 209K-235KDashboards | Data Governance | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimeAustin, TX5h ago
-
Data Engineer, Analytics USD 199K-235KData Warehousing | Data integration | Dimensional Modeling | ETL | MPPEntry-level Full TimeNew York, NY5h ago
-
Mid-level Full TimeNew York, NY5h ago
-
Software Engineer III, AI/ML, Platforms and Devices USD 147K-211KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSan Jose, CA, USA5h ago
-
Senior ML Ops Engineer - Dallas, TX USD 48K-168KApache Spark | Big Data | CI/CD | Containerization | Data analytics401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States14h ago
-
Data Engineer USD 113K-160KAzure Data | Azure Data Factory | Azure Synapse | CI/CD | DBT99.5 percent pipeline uptime focus | HIPAA training | Hybrid work | Mentorship | Remote work optionsMid-level Full TimeChesterfield, MO, US14h ago
-
Lead ML Ops - Dallas, TX, United States USD 48K-168KAWS | Apache Spark | Azure | CI/CD | Cloud platform401k retirement plan | Dental benefits | Medical benefits | Paid Holidays | Paid time offSenior-level Full TimeUnited States14h ago
-
Senior Data Engineer USD 114K-140KAgile | Ataccama ONE | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIrving, Texas, United States17h ago
-
Senior Data Engineer USD 114K-140KAgile | Ataccama ONE | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePomona, California, United States18h ago
-
Agile | Algorithms | CI/CD | Cloud Computing | Data Engineering401k plan | Dental insurance | FSA Plan | HSA plan | Health insuranceMid-level Full TimeAustin, Texas, United States18h ago
-
Legal AI Engineer (Contractor) USD 300K-300KAPI Integration | Agentic Workflows | Artificial Intelligence | Claude | Data SecurityHybrid workSenior-level ContractSan Francisco, CA - Hybrid; Denver, … R19h ago
-
Senior Analytics Engineer II, AI Native USD 148K-216KA/B | A/B Testing | Amazon Redshift | B testing | BigQuery401k company match | Employee assistance program | Equipment tools and reimbursement support | Flexible PTO | Flexible work environmentSenior-level Full TimeRemote, USA ; Remote, Canada R19h ago
-
Applied AI Engineer USD 129K-185KAWS | Ansible | Artifactory | CI/CD | DockerMedical, dental & vision coverage | Nutritionist | PTO paid by company | Paid time off | Volunteer PTOSenior-level Full TimeRaleigh, NC19h ago
-
Senior Data Platform Engineer USD 160K-200KAirbyte | Alerting | Amazon Redshift | Bash | BigQuery401k matching | Commuter benefits | Health, dental & vision plans | In office Lunch Snacks and Coffee | Learning and development opportunitiesSenior-level Full TimeSan Francisco, CA, Washington, D.C., New …19h ago
-
AI code generation | API Design | Artificial Intelligence | C# | CI/CDConfidential per EEO guidelines | W2 employment onlyMid-level Contract Full TimeAustin, TX, United States19h ago
-
Data Engineer II - AWS/PySpark/ETL USD 170K-201KAWS | Airflow | Automation | CI/CD | Continuous DeliveryBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersMid-level Full TimeOH, United States19h ago
-
Sr. Business Intelligence Engineer USD 118K-150KAzure Data | Azure Data Lake | Azure DevOps | CI/CD | DAXEmployee discounts | Employee recognition rewards | Employee referral bonuses | Medical, dental, vision benefits | Paid time offSenior-level Full TimeHouston, Texas, United States19h ago
-
Sr. Business Intelligence Engineer USD 118K-150KAzure Data | Azure Data Lake | Azure DevOps | CI/CD | DAXEmployee discounts | Employee recognition rewards | Employee referral bonuses | Medical, dental, vision benefits | Paid time offSenior-level Full TimeHouston, Texas, United States19h ago
-
Software Engineer III - Agentic AI Engineer USD 173K-185KAWS | Agent systems | Agile methodologies | Amazon Neptune | Application ResiliencyBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeOH, United States20h ago
-
Data Science Principal USD 176K-282KAI Assisted Development | Anomaly Detection | Audit Trail | Business Intelligence | Code generationEmployee resource groups | Employee wellbeing support | Fitness programs | Learning and development programs | Medical, dental, vision plansSenior-level Full TimeBoston, Massachusetts, United States20h ago
-
Data Science Principal USD 176K-282KAnomaly Detection | Audit Trail | Automation | Data Cleansing | Data Governance401k employer match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeNew York, New York, United States20h ago