Data Engineer Databricks - H/F
EUR 52K-55K (estimate) Mid-level Full Time
Tasks
- Build delta lake medallion layers
- Deliver and support production deployments
- Design Lakehouse architecture on Databricks
- Develop batch and streaming pipelines with Spark
- Document technical and functional solutions
- Govern data with Unity Catalog access and lineage
- Implement DataOps and MLOps workflows with MLflow
- Implement data ingestion from Kafka and Airbyte
- Implement data quality tests and expectations
- Model data with Kimball and dimensional modeling
- Optimize Spark performance and clustering
- Orchestrate workflows with Databricks Workflows and Airflow
- Prepare features and RAG pipelines for ML and generative AI
- Set up CI CD with GitHub Actions and GitLab CI
Perks/Benefits
Skills/Tech-stack
Airbyte | Airflow | Apache Spark | Asset bundles | Auto Loader | Auto Scaling | CI/CD | DBT | Data Vault | Data Vault 2.0 | DataOps | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | FinOps | Git | GitHub Actions | GitLab CI | Great Expectations | Kafka | Kimball | Liquid clustering | MLOps | MLflow | Partitioning | Photon | Power BI | PySpark | Python | SQL | Spark SQL | Spark Structured Streaming | Structured Streaming | Tableau | Terraform | Unity Catalog | Z-ordering
Education
Roles
Regions
Countries
States
Related jobs
-
Apache Airflow | Apache Flink | DBT | Debezium | KafkaAgile/Scrum environment | Team collaborationMid-level Full TimeBoulogne-Billancourt, IDF, France16h ago
-
Applied AI - Senior Data Engineer EUR 70K-80KAPI Development | AWS | Artificial Intelligence | Azure | Backend DevelopmentSenior-level Full TimePUTEAUX - La Défense, FR, 9280019h ago
-
Senior-level Full TimePUTEAUX - La Défense, FR, 9280019h ago
-
Data Engineer H/F EUR 53K-61KAWS | Airflow | CI/CD | DBT | DockerAfterworks | Diversity and inclusion | Employee events | Equality of opportunities | Internal mobilitySenior-level Full TimeValbonne, Provence-Alpes-Côte d'Azur, France20h ago
-
Consultant(e) Data Science - Bureau de Lyon EUR 28K-28KBig Data | C++ | Data Processing | Econometrics | ForecastingEntry-level Full TimeLyon, Auvergne-Rhône-Alpes, France1d ago
-
C# | Data Modeling | ETL | JSON | JavaBike parking | Discretion and operational availability | On-site cafeteria | Required clearance | Sustainable mobility allowanceEntry-level ContractEurope, France, Ile-de-France, Hauts-de-Seine (92)1d ago
-
Senior GenAI / Agentic Engineer – Enabling Team EUR 70K-80KAgentic AI | Compliance | Devcontainers | Error Handling | EvaluationCooptation bonus | Onboarding program | Technical communities | Telework agreement | Training programsSenior-level Full TimeParis / Île-de-France, France1d ago
-
Artificial Intelligence | Data Processing | Data acquisition | English | Power BIInternal training | Training programNone Full TimePAU-CSTJF(FRA), PAU, France1d ago
-
Analytics Software Engineer EUR 55K-72KAPI Development | CI/CD | Cube.js | DBT | Data ModelingContinuous learning culture | Hybrid work | Remote-friendlyMid-level Full TimeParis R1d ago
-
Senior AI Software Engineer EUR 50K-60KAgent Framework | Artificial Intelligence | CI/CD | Context engineering | DebuggingEnglish classes | Extra Time Off for Sick Child | Meal vouchers | Private healthcare | Public transport reimbursementSenior-level Full TimeParis, France R1d ago
-
Ingénieur de Données - CAT Analytics EUR 40K-49KAutomation | Dashboards | Data Engineering | Data Visualization | GISHybrid work | International environment | Reforestation initiative | Training opportunitiesMid-level Full TimeMATIGNON GIE AXA1d ago
-
Analytics Engineer EUR 60K-72KDBT | Data Modeling | Dimensional Modeling | Omni | SQLMentoring and standards ownership | Room for internal mobility | Unlimited access to AI toolsSenior-level Full TimeParis1d ago
-
Applied Machine Learning Internship EUR 14K-19KData Visualization | Feature Engineering | Git | Gradient descent | Machine LearningEntry-level InternshipParis1d ago
-
AI Engineer F/H EUR 59K-70KAI Evaluation | AI Pipelines | AI vector search | API Integration | AlloyDBSenior-level Full TimeToulouse, France2d ago
-
Ingénieur(e) Automatisation et Robotique (H/F) EUR 40K-48KAllen Bradley | Analog signals | Artificial Intelligence | Autodesk Inventor | C++Senior-level Full TimeBourogne, France2d ago
-
Autodesk Inventor | C# | C++ | DeviceNet | EmersonSenior-level Full TimeBourogne, France2d ago
-
Allen Bradley | Analog signals | Autodesk Inventor | C# | Cause analysisSenior-level Full TimeBourogne, France2d ago
-
Ingénieur(e) Automatisation et Robotique (H/F) EUR 40K-48KAllen Bradley | Analog signals | Artificial Intelligence | Autodesk Inventor | C++Senior-level Full TimeBourogne, France2d ago
-
Snowflake Senior Data Engineer H/F EUR 47K-55KApache Airflow | Apache Spark | Docker | Git | GitLab CIContinuous learning | Learning cultureSenior-level Full TimeNantes, Pays de la Loire, France2d ago
-
Stage - Data Engineering & Analyse Système (H/F) EUR 15K-15KBig Data | Data Engineering | Data Science | Power BI | PythonFast responsibility | Personalized mentoring | Potential full time offer CDIEntry-level Full Time InternshipToulouse, Occitanie, France2d ago
-
Analytics Engineer, Finance and Modeling EUR 55K-70KARR | CAC | Churn | Cohort Analysis | DBTRemote workMid-level Full TimeRemote - Paris, France R2d ago
-
Senior AI Engineer (AI Enablement) EUR 50K-75KAPI Design | API Integration | AWS | Access Control | Agent FrameworksSenior-level Full TimeParis2d ago
-
API Development | AWS | Azure | Cloud platform | Computer VisionEntry-level InternshipParis, IDF, France2d ago
-
Cybersecurity & AI Engineer Automation (F/H) EUR 45K-60KAWS | Application Security | Cloud Security | Compliance Automation | CybersecurityMid-level Full TimeParis, France2d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3Fully remote work | Remote work flexibility | Remote working opportunitySenior-level Full TimeFrance R2d ago