Azure Databricks Engineer
Tasks
- Build scalable data ingestion workflows
- Collaborate on architecture design patterns
- Conduct code reviews for coding standards
- Create reusable Databricks notebooks and jobs
- Design and optimize ETL pipelines
- Develop Delta Lake medallion architecture layers
- Implement DevOps processes with Git and CI CD
- Implement data governance security and access control
- Implement data transformation and data quality logic
- Integrate Databricks with Azure services
- Optimize Spark compute clusters and autoscaling
- Orchestrate pipelines with Azure Data Factory
- Prepare technical documents and runbooks
- Troubleshoot production issues and perform root cause analysis
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
ADLS | Access Control | Autoscaling | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Access Control | Data Engineering | Data Factory | Data Governance | Data Processing | Data Security | Data access | Delta Lake | Distributed data | Distributed data processing | ETL | Event Hubs | Git | Key Vault | Medallion Architecture | PySpark | Synapse Analytics
Education
N/A
Related jobs
-
Staff Research Engineer, MRS AI USD 146K-208KA/B | A/B Testing | Alignment techniques | B testing | BenchmarkingSenior-level Full TimeBellevue, WA4h ago
-
Senior Embedded Flight Software Engineer USD 160K-240KAMD Xilinx | AMD Xilinx FPGAs | AMD/Xilinx SoC | Agile | Aircraft systems401k | Casual dress code | Dental insurance | FSA | Free daily lunchSenior-level Full TimeHawthorne, CA11h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R13h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA13h ago
-
AI Engineer USD 125K-201KAWS | Agent Frameworks | Agent SDK | Agent coordination | Claude Agent SDKCollaboration with little supervision | Startup environment | Work on cutting-edge AIEntry-level Full TimePittsburgh, Pennsylvania, United States14h ago
-
Mid-level Full TimeSan Francisco14h ago
-
Mid-level Full TimeSan Francisco15h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 9150515h ago
-
Sr. Software Engineer, Data Streaming Systems USD 130K-195KAutoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems401k plan | Dental insurance | Disability benefits | Life insurance | Medical insuranceSenior-level Full TimeBurbank, CA, US, 9150515h ago
-
Senior Analytics Engineer, GTM USD 176K-265KAPI Integration | CI/CD | DBT | Data Modeling | Data QualityCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeSanta Clara, California16h ago
-
ETL Engineer_Woonsocket, RI USD 44K-154KAWS | Apache Spark | CI/CD | CloudFormation | Data Quality401k retirement plan | Dental benefits | Medical benefits | Paid Holidays | Paid time offSenior-level Full TimeUnited States16h ago
-
Machine Learning Engineer USD 140K-190KApache Flink | Apache Kafka | Apache Spark | Bigtable | CI/CDMid-level Full TimeRemote - USA R16h ago
-
VP, Embedded Software USD 290K-350KBLE | CI/CD | Controls engineering | Device Software | Device to Cloud401k matching | Company holidays | Dental insurance | Employee stock purchase program | Flexible spending accountsExecutive-level Full TimeNeedham, MA, United States17h ago
-
Embedded Device Firmware Engineer USD 145K-195KAutomated testing | C# | C++ | CI/CD | Circuit debuggingMid-level Full TimeSanta Clara, CA17h ago
-
Software Engineer, Storage USD 153K-196KAlertmanager | As-a-Service | Availability | C++ | CassandraEquity compensation | Onsite optionSenior-level Full TimeSan Mateo, CA, United States R18h ago
-
Data Implementation Engineer USD 95K-115KAWS | Amazon Web Services | Cycle management | Data Integrity | Data Mapping401k match | Dental insurance | Flexible spending account | Health savings account | Internal growth opportunitiesMid-level Full TimeRemote, United States R18h ago
-
Embedded Software Engineer II USD 140K-200KBootloader | C# | C++ | CI/CD | Device DriversDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeEl Segundo, CA18h ago
-
Senior Software Engineer - Data Platform USD 130K-220KAWS Lambda | AWS RDS | Airflow | Amundsen | Apache HiveHealth insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R18h ago
-
Embedded Software Engineer II USD 140K-200KBootloader | C# | C++ | CI/CD | Device Driver DevelopmentDental insurance | Health insurance | Retirement plan | Stock options | Vision insuranceSenior-level Full TimeAustin, TX18h ago
-
Embedded Software Engineer II USD 140K-200KC# | C++ | CI/CD | Device Drivers | Embedded LinuxDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeWestminster, CO18h ago
-
Data Engineer, Palo Alto USD 110K-180KAWS | Data Modeling | Data Pipelines | DynamoDB | ETL401k matching | Dental insurance | Flexible spending accounts | Health insurance | HolidaysMid-level Full TimePalo Alto, California, United States19h ago
-
Robotics Systems Software Engineer USD 141K-224KAlgorithms | C++ | CI/CD | Collision detection | Computer VisionCompany holidays | Health insurance | Learning and development reimbursement | Life insurance | Long-term disabilityMid-level Full TimeTorrance, California, United States19h ago
-
Industrial Robotics Engineer USD 141K-224KAlgorithms | C++ | CI/CD | Collision detection | Computer VisionCompany holidays | Health insurance | Hybrid work | Learning and development reimbursement | Life insuranceMid-level Full TimeTorrance, California, United States19h ago
-
Ai Engineer USD 100K-150KAI Agents | API Development | AWS | AWS Bedrock | Agentic Workflows401k | Commuter benefits | Dental insurance | Disability coverage | EAPMid-level Full TimeColumbia, MD, United States19h ago
-
Senior Software Engineer, OCI Data Analytics USD 79K-209KApplication Programming | Application Programming Interface | Application Programming Interface (API) | Automation | CI/CD401k match | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid HolidaysSenior-level Full TimeNashville, TN, United States20h ago