Azure Databricks Engineer
Tasks
- Build scalable data ingestion workflows
- Collaborate on architecture design patterns
- Conduct code reviews for coding standards
- Create reusable Databricks notebooks and jobs
- Design and optimize ETL pipelines
- Develop Delta Lake medallion architecture layers
- Implement DevOps processes with Git and CI CD
- Implement data governance security and access control
- Implement data transformation and data quality logic
- Integrate Databricks with Azure services
- Optimize Spark compute clusters and autoscaling
- Orchestrate pipelines with Azure Data Factory
- Prepare technical documents and runbooks
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS | Access Control | Autoscaling | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Access Control | Data Engineering | Data Factory | Data Governance | Data Processing | Data Security | Data access | Delta Lake | Distributed data | Distributed data processing | ETL | Event Hubs | Git | Key Vault | Medallion Architecture | PySpark | Synapse Analytics
Education
N/A
Related jobs
-
AWS | Alteryx | Amazon SageMaker | Azure | Azure DataMid-level Full TimeNew York, NY, United States2h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Data Processing | Data Storage | Data Structures | Data Structures and Algorithms | Distributed SystemsSenior-level Full TimeMountain View, CA, USA4h ago
-
Senior-level Full TimeRaleigh, NC, US14h ago
-
AI Innovation Analyst - Internal USD 65K-80KAI Governance | AI Services | Authentication | Automation | AzureEntry-level Full TimeMiami, FL15h ago
-
Senior AI Engineer USD 107K-199KAKS | API Design | Alerts | Anomaly Detection | Apache SparkHybrid work environment | Inclusion support | Learning opportunities | Well-being supportSenior-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …15h ago
-
Associate AI Engineer USD 80K-134KAPI Development | Azure | Cloud Platforms | Data Preparation | DocumentationFlexible work environment | Hybrid work arrangement | Inclusion programs | Paid time off | Wellness benefitsMid-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …15h ago
-
Entry-level Full TimeUnited States - Remote R15h ago
-
CI/CD | Docker | Drift Detection | Embeddings | Experiment trackingMentorship | Remote workSenior-level Full TimeUnited States - Remote R15h ago
-
Lead Data Engineer USD 316K-506KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakesLearning and development programs | Mentorship | Remote workSenior-level Full TimeChicago, Illinois, USA R16h ago
-
Senior Data Engineer USD 117K-162KAWS | Azure | BigQuery | DBT | Data Architecture401k | Annual wellness stipend | Cell phone reimbursement | Coaches and therapists access | Collective Pause DaysSenior-level Full TimeRemote - US R17h ago
-
Embedded Software Engineer II USD 115K-140KBash | C plus plus | C# | CI/CD | D-busERGs | Family Caregiver Support | Flexible PTO | HSA match | Health benefitsMid-level Full TimeRemote - USA R18h ago
-
Embedded Software Engineer 3 USD 105K-115KAUTOSAR | CAN | CANape | Classic Platform | Compilers401k matching | Dental insurance | Disability coverage | Life insurance | Medical insuranceSenior-level Full TimeChillicothe, IL18h ago
-
Data Analyst, Data Cloud Intelligence USD 85K-95KAWS | Attribution | Business Intelligence | Data Modeling | Data pipelineEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Stock purchase planMid-level Full TimeRemote - US R18h ago
-
Senior Embedded Software Engineer USD 145K-220KAgile | Buildroot | C# | C++ | CI/CD401k match | Casual dress code | Dental benefits | FSA | Free daily lunchSenior-level Full TimeSan Diego, California, United States19h ago
-
Data Engineer, Marketing Data Operations USD 95K-130KAPI | AWS EC2 | AWS Redshift | AWS S3 | BigQueryMid-level Full TimeOrlando19h ago
-
AI Engineer USD 115K-192KAWS | Azure | BigQuery | CI/CD | Cloud ComputingChild care assistance | Employee resource groups | Flexible work schedule | Medical dental prescription coverage | Paid HolidaysMid-level Full TimeDearborn, MI, United States19h ago
-
Senior Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Architecture | Data Lake | Data WarehouseSenior-level Full TimeUS-CA-Bay Area-Remote R19h ago
-
Senior Software Engineer USD 140K-185KAWS | Automated testing | Azure | C++ | Git401K company matching | Dental insurance | Dependent care benefits | Flexible spending account | Health insuranceSenior-level Full TimeBoulder, CO R20h ago
-
Data Engineer USD 120K-164KAzure Data | Azure Data Factory | Azure Functions | Azure Storage | Azure SynapseSenior-level Full TimeLouisville, Kentucky, United States20h ago
-
Senior Data Engineer USD 106K-198KAI tools | AWS | Amazon S3 | Apache Airflow | Argo401k match | Company bonus | Dental insurance | Health insurance | Unlimited paid time offSenior-level Full TimeFramingham, MA21h ago
-
Machine Learning Engineer USD 140K-220KAWS SageMaker | Airflow | Apache Flink | Apache Spark | Azure Machine Learning401k plan | Comprehensive medical and dental coverage | Flexible hybrid work schedule | Flexible time off | Life and disability benefitsMid-level Full TimeSunnyvale, CA21h ago
-
Senior Platform Engineer - Databricks Integration USD 180K-247KAPI Integration | AWS GovCloud | Agile Development | Auto Scaling | CI/CDSenior-level Full TimeFalls Church, VA, United States22h ago
-
Senior Data Engineer USD 179K-255KAWS | AWS DMS | Agile | Amazon DynamoDB | Amazon EC2401k | Accident insurance | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeAustin, Texas23h ago
-
Analytics Engineer USD 220K-335KData Analysis | Data Pipelines | Data cleaning | ETL | LookerHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco23h ago