Azure Databricks Engineer
Tasks
- Build scalable data ingestion workflows
- Collaborate on architecture design patterns
- Conduct code reviews for coding standards
- Create reusable Databricks notebooks and jobs
- Design and optimize ETL pipelines
- Develop Delta Lake medallion architecture layers
- Implement DevOps processes with Git and CI CD
- Implement data governance security and access control
- Implement data transformation and data quality logic
- Integrate Databricks with Azure services
- Optimize Spark compute clusters and autoscaling
- Orchestrate pipelines with Azure Data Factory
- Prepare technical documents and runbooks
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS | Access Control | Autoscaling | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Access Control | Data Engineering | Data Factory | Data Governance | Data Processing | Data Security | Data access | Delta Lake | Distributed data | Distributed data processing | ETL | Event Hubs | Git | Key Vault | Medallion Architecture | PySpark | Synapse Analytics
Education
N/A
Related jobs
-
Senior-level ContractAustin, United States2h ago
-
AI Search | Agile | Angular | Azure AI | Azure AI Search100 percent onsite | Public trust clearance requiredSenior-level ContractWoodlawn, United States2h ago
-
Senior Software Engineer - DevOps & Data Engineering USD 140K-190KAgentic Workflows | Automation | CI/CD | Claude | Cloud infrastructureSenior-level ContractChandler, United States3h ago
-
Azure Databricks Developer USD 125K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States3h ago
-
Entry-level Full TimeUS-Kansas-Wichita3h ago
-
Mid-level Full TimeUS-Kansas-Wichita4h ago
-
Data Engineer II USD 101K-176KAWS | Agile | Airflow | Azure | Azure DevOps401k matching | Health & dental insurance | Onsite fitness center | Time off | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence4h ago
-
Staff Research Engineer, MRS AI USD 146K-208KA/B | A/B Testing | Alignment techniques | B testing | BenchmarkingSenior-level Full TimeBellevue, WA5h ago
-
Senior Software Developer, Computer Vision, XR USD 100K-253KAr | Augmented Reality | C++ | Computer Vision | Data ProcessingSenior-level Full TimeSan Jose, CA, USA; Waterloo, ON, …5h ago
-
Senior Staff Software Engineer, AI/ML, Google Cloud USD 262K-365KAlgorithms | Data Processing | Data Structures | Debugging | Distributed SystemsSenior-level Full TimeSeattle, WA, USA5h ago
-
Senior Software Engineer, AI/ML, Google Cloud Platforms USD 174K-253KC++ | Code Reviews | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeKirkland, WA, USA5h ago
-
Senior Software Engineer, AI/ML, Google Cloud USD 174K-253KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-253KAlgorithms | C++ | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA5h ago
-
C++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeSan Diego, CA, USA5h ago
-
AI Engineer, Advanced Solutions Lab, Google Cloud USD 152K-222KApache Beam | Artificial Intelligence | Cloud platform | ELT | ETLSenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA5h ago
-
Technical Lead, Storage Distributed and Sovereign Cloud USD 207K-301KAI/ML | AI/ML Workloads | Access Control | Automated remediation | Block StorageSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA5h ago
-
Senior Embedded Flight Software Engineer USD 160K-240KAMD Xilinx | AMD Xilinx FPGAs | AMD/Xilinx SoC | Agile | Aircraft systems401k | Casual dress code | Dental insurance | FSA | Free daily lunchSenior-level Full TimeHawthorne, CA13h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R14h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA14h ago
-
AI Engineer USD 125K-201KAWS | Agent Frameworks | Agent SDK | Agent coordination | Claude Agent SDKCollaboration with little supervision | Startup environment | Work on cutting-edge AIEntry-level Full TimePittsburgh, Pennsylvania, United States15h ago
-
Mid-level Full TimeSan Francisco15h ago
-
Mid-level Full TimeSan Francisco16h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 9150516h ago
-
Sr. Software Engineer, Data Streaming Systems USD 130K-195KAutoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems401k plan | Dental insurance | Disability benefits | Life insurance | Medical insuranceSenior-level Full TimeBurbank, CA, US, 9150516h ago
-
Senior Analytics Engineer, GTM USD 176K-265KAPI Integration | CI/CD | DBT | Data Modeling | Data QualityCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeSanta Clara, California17h ago