Azure Databricks Engineer
Tasks
- Build scalable data ingestion workflows
- Collaborate on architecture design patterns
- Conduct code reviews for coding standards
- Create reusable Databricks notebooks and jobs
- Design and optimize ETL pipelines
- Develop Delta Lake medallion architecture layers
- Implement DevOps processes with Git and CI CD
- Implement data governance security and access control
- Implement data transformation and data quality logic
- Integrate Databricks with Azure services
- Optimize Spark compute clusters and autoscaling
- Orchestrate pipelines with Azure Data Factory
- Prepare technical documents and runbooks
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS | Access Control | Autoscaling | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Access Control | Data Engineering | Data Factory | Data Governance | Data Processing | Data Security | Data access | Delta Lake | Distributed data | Distributed data processing | ETL | Event Hubs | Git | Key Vault | Medallion Architecture | PySpark | Synapse Analytics
Education
N/A
Related jobs
-
Software Engineer, Systems USD 203K-240KArtificial Intelligence | C# | C++ | Computer Graphics | Data ProcessingEntry-level Full TimeNew York, NY3h ago
-
Data Engineer USD 209K-235KDashboards | Data Governance | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimeAustin, TX3h ago
-
Data Engineer, Analytics USD 199K-235KData Warehousing | Data integration | Dimensional Modeling | ETL | MPPEntry-level Full TimeNew York, NY3h ago
-
Mid-level Full TimeNew York, NY3h ago
-
Software Engineer III, AI/ML, Platforms and Devices USD 147K-211KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSan Jose, CA, USA4h ago
-
Data Engineer USD 113K-160KAzure Data | Azure Data Factory | Azure Synapse | CI/CD | DBT99.5 percent pipeline uptime focus | HIPAA training | Hybrid work | Mentorship | Remote work optionsMid-level Full TimeChesterfield, MO, US12h ago
-
Senior Data Engineer USD 114K-140KAgile | Ataccama ONE | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIrving, Texas, United States16h ago
-
Senior Data Engineer USD 114K-140KAgile | Ataccama ONE | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePomona, California, United States16h ago
-
Agile | Algorithms | CI/CD | Cloud Computing | Data Engineering401k plan | Dental insurance | FSA Plan | HSA plan | Health insuranceMid-level Full TimeAustin, Texas, United States17h ago
-
Legal AI Engineer (Contractor) USD 300K-300KAPI Integration | Agentic Workflows | Artificial Intelligence | Claude | Data SecurityHybrid workSenior-level ContractSan Francisco, CA - Hybrid; Denver, … R17h ago
-
Senior Analytics Engineer II, AI Native USD 148K-216KA/B | A/B Testing | Amazon Redshift | B testing | BigQuery401k company match | Employee assistance program | Equipment tools and reimbursement support | Flexible PTO | Flexible work environmentSenior-level Full TimeRemote, USA ; Remote, Canada R17h ago
-
Applied AI Engineer USD 129K-185KAWS | Ansible | Artifactory | CI/CD | DockerMedical, dental & vision coverage | Nutritionist | PTO paid by company | Paid time off | Volunteer PTOSenior-level Full TimeRaleigh, NC18h ago
-
Senior Data Platform Engineer USD 160K-200KAirbyte | Alerting | Amazon Redshift | Bash | BigQuery401k matching | Commuter benefits | Health, dental & vision plans | In office Lunch Snacks and Coffee | Learning and development opportunitiesSenior-level Full TimeSan Francisco, CA, Washington, D.C., New …18h ago
-
AI code generation | API Design | Artificial Intelligence | C# | CI/CDConfidential per EEO guidelines | W2 employment onlyMid-level Contract Full TimeAustin, TX, United States18h ago
-
Sr. Business Intelligence Engineer USD 118K-150KAzure Data | Azure Data Lake | Azure DevOps | CI/CD | DAXEmployee discounts | Employee recognition rewards | Employee referral bonuses | Medical, dental, vision benefits | Paid time offSenior-level Full TimeHouston, Texas, United States18h ago
-
Sr. Business Intelligence Engineer USD 118K-150KAzure Data | Azure Data Lake | Azure DevOps | CI/CD | DAXEmployee discounts | Employee recognition rewards | Employee referral bonuses | Medical, dental, vision benefits | Paid time offSenior-level Full TimeHouston, Texas, United States18h ago
-
Data Science Principal USD 176K-282KAI Assisted Development | Anomaly Detection | Audit Trail | Business Intelligence | Code generationEmployee resource groups | Employee wellbeing support | Fitness programs | Learning and development programs | Medical, dental, vision plansSenior-level Full TimeBoston, Massachusetts, United States18h ago
-
Data Science Principal USD 176K-282KAnomaly Detection | Audit Trail | Automation | Data Cleansing | Data Governance401k employer match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeNew York, New York, United States18h ago
-
Data Science Principal USD 176K-282KAnomaly Detection | Audit trails | Business Intelligence | Data Cleansing | Data Governance401k match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimePhoenix, Arizona, United States18h ago
-
Senior Data Platform Engineer USD 154K-220KData Contracts | Data Modeling | Data Quality | Disaster Recovery | ELT401k match | Dental insurance | Flexible time off | Health insurance | Mental health supportSenior-level Full TimeArlington, VA18h ago
-
Senior Data Platform Engineer USD 168K-227KAirflow | Amazon Bedrock | Amazon S3 | Apache Iceberg | Cloud Pub/SubAnnual bonus | Equity grants | Health insurance | Retirement benefits | Sales incentiveSenior-level Full TimePleasanton, California, USA HQ18h ago
-
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON USD 130K-270KAnomaly Detection | Apache Airflow | Apache Spark | Bash | CSV401k contribution | AD and D insurance | Dental insurance | Health Savings Account contribution | Life insuranceMid-level Full TimeAnnapolis Junction, MD19h ago
-
Apache Airflow | Apache Spark | Bash | Confluence | Git401k contribution | AD and D insurance | Health Savings Account contribution | Life insurance | Long-term disability insuranceMid-level Full TimeAnnapolis Junction, MD19h ago
-
Staff Data Engineer USD 200K-325KClassification | Cloud Storage | Data Governance | Data Modeling | Data ObservabilitySenior-level Full TimeCambridge, Massachusetts, United States, New York, …19h ago
-
Senior-level Full TimeWashington, DC20h ago