Senior Databricks Data Engineer
Tasks
- Apply source control testing deployment and monitoring best practices
- Build batch and near real time data processing solutions on Microsoft Azure
- Collaborate with product managers architects data engineers and business stakeholders
- Design data pipelines using Databricks and PySpark
- Develop Delta Lake based data architectures
- Develop scalable data products and data platform components
- Ensure data quality observability monitoring security and operational reliability
- Implement CI/CD automation for data solutions
- Participate in technical design discussions and solution architecture decisions
- Support Infrastructure as Code and environment standardisation
- Support platform governance cost optimisation and technical documentation
Perks/Benefits
Skills/Tech-stack
Access Management | Azure | Azure Data Platform | Azure DevOps | CI/CD | Data Governance | Data Modelling | Data Warehousing | Data platform | Databricks | Databricks SQL | Delta Lake | Git | Infrastructure as Code | Microsoft Azure | Microsoft Azure Data | Microsoft Azure Data Platform | Monitoring and observability | Performance Tuning | PySpark | Python | SQL | Security and access | Security and access management | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
Software Engineer, In-Cabin Perception JPY 3876K-5880KAWS | Agile | C++ | CAN | CI/CDHybrid work policy Google Meet interviewsMid-level Full TimeTokyo R8h ago
-
Data Engineer, AI & Analytics EUR 49K-60KAPI Integration | CI/CD | DBT | Data Modeling | Data QualityMid-level Full TimeRemote - Spain R13h ago
-
Mid-level Full TimeRemote - Ecuador R13h ago
-
Mid-level Full TimeRemote - Brazil R13h ago
-
Data Engineer, AI & Analytics USD 115K-152KAPI Integration | CI/CD | DBT | Data Modeling | Data WarehousingMid-level Full TimeRemote - Peru R13h ago
-
Mid-level Full TimeRemote - Argentina R13h ago
-
Mid-level Full TimeRemote - Mexico R13h ago
-
AI Solutions Lead - Marketing & Content USD 131K-180KAI architecture | AI platforms | API Development | AWS | AzureRemote work flexibilitySenior-level Full TimeIloilo City R1d ago
-
APIs | CRM | Call Routing | Evaluation | GraphQL401k match | Childcare reimbursement | Commuter reimbursement | Dental insurance | Health insuranceEntry-level Full TimeNew York Office R1d ago
-
APIs | BigQuery | CRM automation | Data Structures | Evaluation401k matching | Childcare reimbursement | Generous parental leave policy | Internet reimbursement | Medical/Dental/Vision insuranceEntry-level Full TimeSeattle Office R1d ago
-
Amazon Web Services | Continuous Deployment | Continuous integration | Couchbase | Distributed SystemsEquipment program | Flexible scheduling | Paid time off | Remote work | Sponsorship for trainingMid-level Full TimeRemote job R1d ago
-
Mid-level Full TimeLondon R1d ago
-
Senior-level Contract Full TimeRemote job R1d ago
-
Machine Learning Engineer USD 139K-209KData Analysis | Deep learning | Java | Large Scale Data | Large-scaleSenior-level Full TimeRemote job R1d ago
-
Natural Language Processing (NLP) Engineer USD 110K-215KC++ | Data Analysis | Java | Language Processing | Machine LearningMid-level Contract Full TimeRemote job R1d ago
-
Senior Data Engineer EUR 70K-86KCI/CD | ClickHouse | Docker | Elasticsearch | GitHubCareer development training and coaching | Flexible working hours | Learning time | Location Based Social Benefits | Remote-firstSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Aggregations | Angular | Auditability | Authentication | AuthorizationRemote workSenior-level Full TimeGuatemala, Guatemala (Remote) R1d ago
-
Software Engineer (potential for telework) USD 135K-220KAWS | Accumulo | Angular | Bash | Chat Completions API401k Company Contributions | Career development | Company funded HRA | Employer paid group term life insurance | Long-term disabilityMid-level Full TimeLaurel, MD R1d ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Image SegmentationFlexible schedule | Mentorship | Professional growth | TechtalksSenior-level Full TimeMiami, United States R1d ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Image SegmentationFlexible schedule | Mentorship | Professional growth | TechtalksSenior-level Full TimeJacksonville, United States R1d ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Computer vision hardware | Data AnalysisFlexible schedule | Mentorship | Personalized growth roadmaps | Tech talksSenior-level Full TimeBaltimore, United States R1d ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Data Science | Edge ComputingFlextime | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeOrlando, United States R1d ago
-
Senior Computer Vision Engineer ID72408 USD 170K-240KAnomaly Detection | Clustering | Computer Vision | Edge Computing | Fine TuningFlextime | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeTallahassee, United States R1d ago
-
Senior-level Full TimeCiudad de México, CDMX, MX R1d ago
-
API | Authentication | Cloud Architecture | Deployment | LLMFlexible work setup | Relocation support | Remote work | Travel cost coverageEntry-level Full TimeBerlin, Germany R2d ago