Senior Databricks Data Engineer
Tasks
- Apply engineering best practices
- Build CI CD automation for data solutions
- Build Delta Lake data architectures
- Collaborate with product and business stakeholders
- Create technical documentation
- Design data pipelines
- Develop data processing solutions
- Develop data products
- Ensure data quality
- Ensure data security and access management
- Implement deployment pipelines
- Implement source control
- Implement testing
- Optimize batch data processing
- Optimize near real time processing
- Participate in technical design discussions
- Perform cost optimization
- Set up monitoring and observability
- Support infrastructure as code
- Support platform governance
Perks/Benefits
Skills/Tech-stack
Access Management | Azure | Azure DevOps | Batch Processing | CI/CD | Data Governance | Data Modeling | Data Warehousing | Databricks | Delta Lake | Git | Infrastructure as Code | Monitoring | Near-real-time | Near-real-time Processing | Observability | Performance Tuning | PySpark | Python | Real-time Processing | SQL | Security Access | Security access management | Time processing | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
Senior Data Engineer EUR 55K-74KAmazon Web Services | Apache Airflow | Apache Iceberg | Apache Spark | Argo WorkflowsEducational budget | Flexible remuneration | Flexible working hours | Hybrid work | Language classesSenior-level Full TimeDonostia, Spain6h ago
-
Senior Knowledge & AI Architect EUR 60K-86KAgent Orchestration | Autogen | Cypher | DCAT | ETL PipelinesDental benefits | Hybrid work organization | Learning and development | Life and accident insurance | Meals and transportation vouchersSenior-level Full TimeBarcelona, CT, Spain9h ago
-
A/B | A/B Testing | AWS | Autoscaling | B testingEquity package | Fully remote work Europe | Healthcare coverage | Paid parental leave | Professional growthMid-level Full TimeSpain R13h ago
-
AWS | Big Data | C++ | Computer Vision | CryptographyDiversity | International collaborationEntry-level Full Time InternshipMARTOS - MAS1, Spain16h ago
-
Concurrency | Data Structures | Database systems | Distributed Systems | ElasticsearchDonation matching | Flexible work schedules | Health coverage | Parental leave | Vacation daysSenior-level Full TimeSpain R23h ago
-
Senior AI Engineer – GenAI & Agentic Systems EUR 54K-75KAWS Bedrock | AWS Lambda | Agentic Systems | Amazon ECR | Amazon EMRProfessional growth and developmentSenior-level Full TimeSpain23h ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R1d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami1d ago
-
Senior Python Engineer, DataFeed Team EUR 75K-99KAPIs | Alerting | Apache Kafka | Async Processing | AsyncioOn-call rotationSenior-level Contract Full TimeBarcelona1d ago
-
Machine Learning Engineer EUR 78K-90KAWS | Amazon SageMaker | Artifact management | Azure | CI/CDEmployee stock-option | Flexible paid time off | Hybrid work options | Paid family leave | Remote work up to 30 daysMid-level Full TimeMadrid, Spain R1d ago
-
AI Software Crafter EUR 54K-73KAI Agents | API Integration | Agent Orchestration | Architecture Decision | Architecture Decision RecordsAfter-work events | Diversity and inclusion | Exclusive employee discounts | Family-friendly policies | Flexible working hoursSenior-level Full TimeBarcelona, Spain1d ago
-
Analytics Engineer USD 100KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data LineageEnglish as office language | In person work 3 days per week | Relocation supportMid-level Full TimeBarcelona R1d ago
-
Data Engineer - AWS & Snowflake - Pharma sector EUR 65K-88KAWS | Apache Airflow | CI/CD | DBT | Data ModelingEmotional support | Family support | Flexible benefits | Free language courses | Full sick leave coverageSenior-level Full TimeBarcelona, Spain1d ago
-
Alerting | Amazon Redshift | Aurora PostgreSQL | Batch Processing | CI/CDCollaboration with cross-functional teams | Fully remote | Opportunity for continuous improvement | Ownership over data reliability strategySenior-level Full TimeSpain R1d ago
-
Senior Data Engineer EUR 70K-90KCI/CD | ClickHouse | Docker | Elasticsearch | KafkaFlexible working hours | Learning time | Location Based Social Benefits | Remote-first | Team eventsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Entry-level Full TimeMadrid, Spain1d ago
-
Algorithm Optimization | Data analytics | Machine Learning | Python | Scalable systemsEntry-level InternshipMadrid, Spain1d ago
-
Senior Machine Learning Engineer EUR 64K-85KData Preparation | Deep learning | GPU Computing | JAX | Machine LearningSenior-level Full TimeSpain2d ago
-
Member of Technical Staff, Machine Learning EUR 55K-79KData Pipelines | Deep learning | Fine Tuning | GPU Computing | JAXSenior-level Full TimeSpain2d ago
-
Full Stack Engineer, AI systems EUR 54K-75KAnthropic | Docker | JavaScript | Kubernetes | LLM integrationSenior-level Full TimeSpain2d ago
-
Applied AI Engineer EUR 54K-75KAgent workflows | Inference Optimization | JAX | Language Models | Language ProcessingSenior-level Full TimeSpain2d ago
-
Staff/Lead Python Engineer (FastAPI, Orchestration) EUR 82K-112KAsynchronous programming | Cloud platform | Concurrent programming | FastAPI | GenAIAnnual learning and development budget | Co-working budget | Company laptop | Enhanced parental leave | Flexible scheduleSenior-level Full TimeRemote Anywhere R2d ago
-
Staff AI Software Engineer EUR 80K-120KAWS | Agentic AI | Autogen | DynamoDB | EKSCompetitive benefits package | Learning opportunities | On-call pay | Work-life balanceSenior-level Full TimeMadrid Office2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeMadrid, Spain2d ago
-
Data Engineer EUR 60K-85KAmazon Web Services | Apache Airflow | Apache Kafka | CI/CD | ClickHouseBirthday off | Flexible-hybrid work | Global get-togethers | Internal training | Learning budgetMid-level Full TimeMadrid4d ago