Senior Databricks Data Engineer
Tasks
- Apply source control testing deployment and monitoring best practices
- Build batch and near real time data processing solutions on Microsoft Azure
- Collaborate with product managers architects data engineers and business stakeholders
- Design data pipelines using Databricks and PySpark
- Develop Delta Lake based data architectures
- Develop scalable data products and data platform components
- Ensure data quality observability monitoring security and operational reliability
- Implement CI/CD automation for data solutions
- Participate in technical design discussions and solution architecture decisions
- Support Infrastructure as Code and environment standardisation
- Support platform governance cost optimisation and technical documentation
Perks/Benefits
Skills/Tech-stack
Access Management | Azure | Azure Data Platform | Azure DevOps | CI/CD | Data Governance | Data Modelling | Data Warehousing | Data platform | Databricks | Databricks SQL | Delta Lake | Git | Infrastructure as Code | Microsoft Azure | Microsoft Azure Data | Microsoft Azure Data Platform | Monitoring and observability | Performance Tuning | PySpark | Python | SQL | Security and access | Security and access management | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R4h ago
-
Senior-level Full TimeDeerfield, IL, United States R7h ago
-
Ego-Centric 视觉感知算法工程师- Genie业务部 CNY 144K-240K3D Gaussian Splatting | 3D Pose Estimation | 3D point cloud | 6D Pose Estimation | Bundle adjustmentMid-level Full Time上海 R8h ago
-
2027届实习-算法数据开发工程师 CNY 96K-144KData Validation | Data Warehousing | Database fundamentals | Distributed Systems | ETLGlobal exposure | Hands-on projects | Learning opportunities | Technical mentorshipEntry-level Internship上海 R8h ago
-
Mid-level Full Time北京 R10h ago
-
Mid-level Full Time北京 R10h ago
-
AWS | AWS Config | Checkov | CloudTrail | CloudWatchDomestic travel up to 100 percent | On-call support | Remote workMid-level Full TimeRemote - USA R10h ago
-
Machine Learning Engineer PhD USD 116K-160KAWS | Azure | C++ | CI/CD | Cloud NativeDirect impact on client projects | Flexible working hours | High-end hardware | Remote work | Training budgetMid-level Full TimeRemote R13h ago
-
CI/CD | Dataiku | GitLab CI | HDFS | HiveEmployee committee benefits | Health insurance | Meal vouchers | Performance bonus | TeleworkSenior-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R15h ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1400K-2000KApache Airflow | Apache Beam | Auditability | Batch Processing | CI/CDMid-level Full TimeHyderabad, Telangana, India R16h ago
-
Ansible, Jira, Confluence, Hadoop / Consultant Specialist INR 800K-1700KAmazon S3 | Ansible | CI/CD | Confluence | DevSecOpsContinuous professional development | Flexible working | Inclusive work environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R16h ago
-
Machine Learning Lead Programmer INR 3500K-5000KAPIs | AWS | Big Data | CI/CD | ContainerizationHybrid work arrangement | On site start period | Reasonable accommodationsSenior-level Full TimeMalaysia R17h ago
-
Backend Machine Learning Programmer CAD 120K-150KAPI | AWS | Automated testing | CI/CD | DockerHybrid work arrangement | On-site onboarding | Remote not offeredMid-level Full TimeMalaysia R17h ago
-
API Integration | FastAPI | Flask | Git | HTTPRemote-friendlyMid-level Contract Full TimePoland, Remote, Poland R18h ago
-
Senior AI Engineer | Freelance EUR 39K-48KADK | API Design | Agent systems | CI/CD | Cloud RunRemote work in UKSenior-level FreelanceFully Remote R18h ago
-
AI Engineer (m/w/d) // Remote möglich EUR 47K-47KAI monitoring | Agent systems | Automation | Cloud Computing | Cloud platformAdditional vacation days | Company bike option | Employee discount | Paid vacation and holiday bonus | Remote work optionsSenior-level Full TimeStuttgart, Germany R19h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R20h ago
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCollaborative environment | Continuous learning | Fully remote work | Professional growth opportunitiesMid-level Full TimeBrazil R22h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R23h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R23h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R1d ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R1d ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R1d ago
-
Senior AI/LLM Data Scientist in Agentic AI TRY 840K-1080KAPI Integration | Embeddings | Evaluation | Fine Tuning | Generative AIEnglish Language Development Support | Hybrid work | Meal card | Multisport membership | Private health insuranceSenior-level Full TimeIstanbul (VADI ISTANBUL PARK), Türkiye R1d ago