Senior Databricks Data Engineer
Tasks
- Apply engineering best practices
- Build CI CD automation for data solutions
- Build Delta Lake data architectures
- Collaborate with product and business stakeholders
- Create technical documentation
- Design data pipelines
- Develop data processing solutions
- Develop data products
- Ensure data quality
- Ensure data security and access management
- Implement deployment pipelines
- Implement source control
- Implement testing
- Optimize batch data processing
- Optimize near real time processing
- Participate in technical design discussions
- Perform cost optimization
- Set up monitoring and observability
- Support infrastructure as code
- Support platform governance
Perks/Benefits
Skills/Tech-stack
Access Management | Azure | Azure DevOps | Batch Processing | CI/CD | Data Governance | Data Modeling | Data Warehousing | Databricks | Delta Lake | Git | Infrastructure as Code | Monitoring | Near-real-time | Near-real-time Processing | Observability | Performance Tuning | PySpark | Python | Real-time Processing | SQL | Security Access | Security access management | Time processing | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
AIML - Applied ML Engineer, Responsible AI EUR 78K-103KData Processing | Data Processing Pipelines | Diffusion Models | Fine Tuning | JAXSenior-level Full TimeBarcelona3h ago
-
AI Engineer Senior EUR 39K-48KAPI Integration | Agents | Automated testing | CI/CD | CachingAccess to certifications | Childcare tickets | Events meetups techdays | Extra days off | Flexible compensation planSenior-level Full TimeMadrid, Spain R7h ago
-
Senior Data Engineer EUR 70K-90KCI/CD | Claude Code | ClickHouse | Docker | ElasticsearchFlexible working hours | Learning time | Location Based Social Benefits | Regular team events | Remote-firstSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Staff AI Software Engineer EUR 80K-120KAI Agents | AWS Lambda | Agentic AI | Amazon EKS | Amazon Web ServicesFast-learning environment | Team spirit | Work-life balanceSenior-level Full TimeMadrid Office1d ago
-
AWS | Agentic Engineering | Apache Spark | CI/CD | ClaudeSenior-level Full TimeMollet del Valles, Barcelona, ES, 081002d ago
-
(Senior) Software Engineer (all genders) EUR 70K-90KAWS | Apache Spark | Automated testing | CI/CD | ComplianceSenior-level Full TimeMollet del Valles, Barcelona, ES, 081002d ago
-
Senior AI Engineer 🇪🇺 EUR 50K-79KA/B | A/B Testing | AWS | Agentic Systems | Anti Prompt InjectionCompany equipment provided | Company shares | Coworking allowance | Fitness membership access | Home office setup budgetSenior-level Full TimeAll France (remote) R3d ago
-
Senior AI/ML Engineer EUR 36K-45KAnomaly Detection | Artificial Intelligence | Cause analysis | Data Pipelines | Deep learningCertifications | Company events | English classes | Flexible compensation | Flexible work hoursSenior-level Full TimeMálaga, Spain3d ago
-
Dagster | Data Exploration | Data Processing | Deep learning | FionaFlexible work locations | Fully remote | Inclusive culture | International team collaboration | Mission-driven environmentSenior-level Full TimeSpain R3d ago
-
Software/Data Engineer EUR 40K-55KAWS Redshift | Amazon Web Services | Apache Airflow | Apache Flink | Apache KafkaGym discounts | Hybrid work | Learning resources | Mental health support | MentorshipMid-level Full TimeMadrid R3d ago
-
AI red teaming | Agent systems | Artificial Intelligence | Audit Logging | Automated testingFlexible work arrangement | In-person collaborationSenior-level Full TimeSpain - Barcelona3d ago
-
Senior Product Engineer / AI Solution Architect EUR 75K-95KAPIs | AWS | Agents | Authentication | AutogenChildcare support | Family-friendly programs | Flexible hours | Hybrid work model | Learning coursesSenior-level Full TimeSANTA BARBARA 1-PLANTA SEGUNDA, Spain3d ago
-
Senior-level Full TimeMadrid, Spain3d ago
-
C++ | Compute Optimization | Data Analysis | Deep learning | Embedded LinuxBenefits platform | Career development | Company mobile phone | Employee parking | Flexible work practicesSenior-level Full TimeSant Quirze del Valles, Barcelona, Spain R3d ago
-
Robotics Visual SLAM Software Engineer EUR 39K-39KC++ | Computer Vision | Data Analysis | Debugging | Integration TestingCareer development | Company mobile phone | Employee Share Acquisition Plan | Employee discounts | Flexible work practicesMid-level Full TimeSant Quirze del Valles, Barcelona, Spain R3d ago
-
Robotics Calibration Software Engineer EUR 39K-39KARM64 | Algorithm Design | C++ | Cause analysis | Code reviewBenefits platform | Career development | Company mobile phone | Flexible work practices | Home office flexibilityMid-level Full TimeSant Quirze del Valles, Barcelona, Spain R3d ago
-
Data Engineer EUR 68K-79KAccess Control | Alerting | BigQuery | Cloud Composer | Cloud FunctionsGrowth opportunities | International company culture | Learning and development opportunitiesSenior-level Full TimeBarcelona, B, ES, 089023d ago
-
Agent systems | Artificial Intelligence | Audit Logging | Automated testing | Bias monitoringSenior-level Full TimeSpain - Barcelona3d ago
-
Senior AI Engineer – Notebooks EUR 70K-90KBackend Development | Evaluation | Go | LLM | Language ModelsEmployee stock purchase plan | Global health benefits | Hybrid workplace | Inclusive community culture | Mentor/Buddy programSenior-level Full TimeBordeaux, France; Dublin, Ireland; France, Remote; … R3d ago
-
AWS | AWS CloudFormation | AWS Database | AWS Database Migration Service | AWS GlueCollaborative Agile environment | Flexible work schedule | Fully remote work | Technical autonomySenior-level Contract Full TimeSpain R4d ago
-
Data Engineer EUR 35K-42KAmazon Web Services | Data Modeling | Data Warehouse | Lakehouse | SQLChildcare card | Employee discount portal | Fitness membership | Flexible compensation | Health insuranceMid-level Full TimeBarcelona, Spain R4d ago
-
APIs | CI/CD | Distillation | Distributed Systems | Evaluation FrameworksCareer growth opportunities | Collaborative international teams | Continuous learning support | Flexible working environment | Inclusive workplaceSenior-level Full TimeSpain4d ago
-
AKS | Alerting | Application Insights | Azure Monitor | CI/CDCareer development | Flexible working environment | International team collaboration | Learning opportunities | Ownership and autonomySenior-level Full TimeSpain4d ago
-
CI/CD | Computer Vision | Control Systems | Deep learning | Distributed TrainingAutonomy and ownership | Career growth opportunities | Continuous learning support | Flexible work environment | International collaborationSenior-level Full TimeSpain4d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Contract opportunity | Enterprise data strategy influence | Fully remote | International collaboration | OwnershipSenior-level Contract Full TimeSpain R4d ago