Senior Databricks Data Engineer
Tasks
- Apply engineering best practices
- Build CI CD automation for data solutions
- Build Delta Lake data architectures
- Collaborate with product and business stakeholders
- Create technical documentation
- Design data pipelines
- Develop data processing solutions
- Develop data products
- Ensure data quality
- Ensure data security and access management
- Implement deployment pipelines
- Implement source control
- Implement testing
- Optimize batch data processing
- Optimize near real time processing
- Participate in technical design discussions
- Perform cost optimization
- Set up monitoring and observability
- Support infrastructure as code
- Support platform governance
Perks/Benefits
Skills/Tech-stack
Access Management | Azure | Azure DevOps | Batch Processing | CI/CD | Data Governance | Data Modeling | Data Warehousing | Databricks | Delta Lake | Git | Infrastructure as Code | Monitoring | Near-real-time | Near-real-time Processing | Observability | Performance Tuning | PySpark | Python | Real-time Processing | SQL | Security Access | Security access management | Time processing | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
AI Engineer - Agentic Systems EUR 50K-60KAPI Integration | Agentic Systems | CI/CD | Database Integration | DockerAnnual leave | Commuting allowance | Home working allowance | Life insurance | Medical insuranceEntry-level Full TimeBarcelona, Spain2d ago
-
AI Engineer - AWS Bedrock - Generative AI EUR 40K-60KAPI Gateway | AWS Bedrock | AWS CDK | AWS Lambda | Amazon APICertification support | Emotional support | Family support | Flexible time off | Gym discountsMid-level Full TimeMadrid, Spain2d ago
-
Automation | Bash | Block Storage | CSI | Distributed File SystemCareer growth potential | Flexible work model | Inclusive environment committed to equal opportunity | International diverse working environment | Remote friendly work modelSenior-level Full TimeSpain R2d ago
-
Senior Data Engineer EUR 70K-86KApache Kafka | Apache Kafka Streams | CI/CD | ClickHouse | Distributed SystemsCareer development and coaching | Flexible working hours | Learning time | Remote-first environment | Team events and social benefitsSenior-level Full TimeGermany /Spain / Romania (Remote) R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeValencia, Spain2d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous work culture | Flexible management approach | Impactful product mission | Supportive team environmentMid-level Full TimeMalaga, Spain2d ago
-
Amazon Web Services | Angular | CI/CD | Clean architecture | Data CatalogsAgile culture | Autonomy and ownership | Continuous learning | Flexible working hours | Hybrid workMid-level Full TimeSpain2d ago
-
Lead AI Engineer EUR 64K-78K.NET | AIOps | Agentic AI | BMC CMDB | DockerBe Well programs | Certification support | Coaching | Continuous feedback | Flexible work environmentSenior-level Full TimeMadrid HQ (KES51610), Spain R2d ago
-
Data Engineer II EUR 50K-74KAWS | Amazon Athena | Amazon Redshift | Apache Airflow | Apache IcebergMid-level Full TimeSpain2d ago
-
Data Engineer III EUR 799KAWS | Airflow | Amazon Athena | Amazon Redshift | Data ModelingFlexible work environment | MentorshipSenior-level Full TimeSpain2d ago
-
Senior AI Engineer EUR 46K-75KAPI Development | AWS | Agentic Workflows | Azure | CI/CDFlexible working conditions | Gym membership discounts | Health insurance | Learning and development investment | Life and accident insuranceSenior-level Full TimeSant Cugat del Vallès, Spain, Barcelona2d ago
-
Mid-level Full TimeMadrid, Community of Madrid, Spain - … R2d ago
-
Azure Data Engineer - Ingles – Remoto EUR 35K-40KABAC | Azure | Azure Data | Azure Data Factory | Azure Data Lake23 days vacation | Employee benefits discounts | Flexible compensation | Indefinite contract | Remote workMid-level Full TimeSpain - Remote R2d ago
-
Senior Engineer - Embedded software EUR 56K-86KARM Cortex | ARM Cortex-M | Abstraction layer | Agile methodology | Automated testingTravel up to 10 percentSenior-level Full TimeSpain, Valencia, Cortes Valencianas2d ago
-
AWS Lambda | Alerting | Amazon Athena | Amazon Redshift | Amazon S3Mid-level Full TimeMadrid, Community of Madrid, ESP2d ago
-
AI Engineer EUR 54K-75KAgent Orchestration | Embeddings | Generative AI | Node.js | ObservabilityCoaching and Mentorship | Equity participation program | Health benefits | Hybrid work location | Language trainingSenior-level Full TimeValencia, Spain (Hybrid) R2d ago
-
Senior AI Engineer – Notebooks EUR 56K-85KBackend Services | Evaluation | Go | LLM | Machine LearningCommunity guilds | Employee stock purchase plan | Hybrid workplace | Inclusion talks | Mentor programSenior-level Full TimeBordeaux, France; Dublin, Ireland; France, Remote; … R2d ago
-
Data Engineer EUR 36K-36KApache Spark | Big Data | Cloud platform | Data Architecture | Data ModelingContinuous training | Flexible schedule | Hybrid work model | Life and accident insuranceMid-level Full TimeSpain R2d ago
-
Entry-level Full TimeMadrid, Spain2d ago
-
Algorithm Design | Data analytics | Development Life Cycle | Machine Learning | PythonClient exposure | Internship experience | MentorshipEntry-level InternshipMadrid, Spain2d ago
-
Data Engineer (Madrid based) EUR 43K-52KApache Airflow | CloudFormation | Continuous Delivery | Continuous integration | DBTFlexible work arrangements | Free learning resources | Generous paid time off | Gym or fitness allowance | Hybrid workMid-level Full TimeMadrid, ES2d ago
-
AI Engineer EUR 50K-80KArtificial Intelligence | Data Engineering | Language Processing | MLOps | Machine LearningErgonomic setup | Full remote from Europe | Hybrid work model | Inclusive work environment | Learning opportunitiesMid-level Full TimeVillafranca del Castillo, Spain R3d ago
-
AI Engineer EUR 50K-80KAgentic AI | Data Engineering | Language Processing | MLOps | Machine LearningCompany events | Full remote from Europe | Hybrid work model | Learning opportunities | Modern office equipment providedMid-level Full TimeAustria; Germany; Italy; Spain R3d ago
-
Access Control | Anomaly Detection | CI/CD | Classification | Data GovernanceCollaborative stakeholder engagement | Competitive salary | Hands on exposure to LLMs RAG MLOps and Kubernetes | Remote working model | Work on cutting-edge AI solutionsSenior-level Full TimeSpain3d ago
-
API Gateway | AWS Lambda | Agentic AI | Amazon Bedrock | Amazon DynamoDBCareer development support | Childcare allowance | Flexible vacation days | Flexible working hours | Inclusive workplaceSenior-level Full TimeMadrid, Spain R3d ago