Data Engineer Databricks - H/F
Boulogne-Billancourt, France
EUR 52K-55K (estimate) Mid-level Full Time
Tasks
- Build delta lake medallion layers
- Deliver and support production deployments
- Design Lakehouse architecture on Databricks
- Develop batch and streaming pipelines with Spark
- Document technical and functional solutions
- Govern data with Unity Catalog access and lineage
- Implement DataOps and MLOps workflows with MLflow
- Implement data ingestion from Kafka and Airbyte
- Implement data quality tests and expectations
- Model data with Kimball and dimensional modeling
- Optimize Spark performance and clustering
- Orchestrate workflows with Databricks Workflows and Airflow
- Prepare features and RAG pipelines for ML and generative AI
- Set up CI CD with GitHub Actions and GitLab CI
Perks/Benefits
Skills/Tech-stack
Airbyte | Airflow | Apache Spark | Asset bundles | Auto Loader | Auto Scaling | CI/CD | DBT | Data Vault | Data Vault 2.0 | DataOps | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | FinOps | Git | GitHub Actions | GitLab CI | Great Expectations | Kafka | Kimball | Liquid clustering | MLOps | MLflow | Partitioning | Photon | Power BI | PySpark | Python | SQL | Spark SQL | Spark Structured Streaming | Structured Streaming | Tableau | Terraform | Unity Catalog | Z-ordering
Education
Roles
Regions
Countries
States
Related jobs
-
Mid-level Full TimeLa Garenne Colombes, FR, 922509h ago
-
Stage Innovation : Ingénieur Intelligence Artificielle NLP / Traitement de données audio EUR 14K-14KAudio Processing | Data analytics | FFT | Language Models | Language ProcessingMeal tickets | Transportation coverageEntry-level Full Time InternshipToulouse, Occitanie, France9h ago
-
Data Analysis | Deep learning | Generative AI | Hugging Face | Image ProcessingPotential full-time offer | Restaurant tickets | Transportation coverage | Work on innovation projectsEntry-level Full Time InternshipToulouse, Occitanie, France9h ago
-
C++ | Computer Vision | Convolutional Neural Network | Deep learning | Image ProcessingMeal tickets | Transport coverageEntry-level Full Time InternshipToulouse, Occitanie, France9h ago
-
Apache Airflow | Artificial Intelligence | Business Intelligence | CRM | Customer DataCollaborative culture | Continuous learning | Exposure to cutting edge AI and data engineering | Flexible work location | Globally distributed teamSenior-level Full TimeFrance13h ago
-
Apps Script | Data Automation | Data Transformation | Excel | Google AppsCareer mentoring | Employee share plan | Flexible work arrangements | Paid training | Partially reimbursed vacationsEntry-level Full TimeAix-en-Provence, FR R16h ago
-
Data Engineer Snowflake (AWS) - H/F EUR 46K-52KAWS | Airbyte | Apache Airflow | Apache Kafka | CI/CDAgile team environment | Hybrid work | Supportive managementMid-level Full TimeBoulogne-Billancourt, France1d ago
-
Senior Data Engineer Snowflake F/H EUR 46K-57KAWS | Apache Airflow | Azure | CI/CD | DBTAgile/Scrum environment | Continuous learning | Professional development | Team collaborationSenior-level Full TimeLyon, Auvergne-Rhône-Alpes, France1d ago
-
Senior-level Full TimeParis, France1d ago
-
AI Engineer – Consultant·e confirmé·e / senior EUR 55K-60KAzure | Bash | Cloud platform | Generative AI | Google CloudCareer development | Certification budget | Coach support | Holiday bonus | Meal ticketsSenior-level Full TimeParis, France1d ago
-
Mid-level Full TimeSophia-Antipolis, France1d ago
-
Mid-level Full TimeSophia-Antipolis, France1d ago
-
Ingénieur Big Data H/F EUR 50K-52KAnsible | Artifactory | Cloud Observability | Cloud platform | DockerAutonomy | Career development opportunities | Teamwork cultureSenior-level Full TimeMontpellier, Occitanie, France1d ago
-
API Design | Agent systems | Automated testing | Bash | CI/CDContinuous learning | Flexible schedule | Global Time Zone Flexibility | Professional network growth | RecognitionSenior-level Contract FreelanceFrance R1d ago
-
Data Engineer - Dataiku Expert H/F/NB EUR 55K-70KAWS | Apache Spark | Azure | Cloud platform | Data GovernanceSenior-level Full TimeBordeaux, France1d ago
-
Data Engineer - Dataiku Expert H/F/NB EUR 55K-70KAWS | Apache Spark | Azure | Cloud Computing | Cloud platformSenior-level Full TimeBordeaux, France1d ago
-
AWS | Asynchronous programming | Data Preprocessing | Databases | FastAPIAsynchronous work environment | Autonomy | Company-provided hardware | Remote-first | Work-life balanceMid-level Full TimeFrance1d ago
-
C plus plus | C# | CAD | Computational Geometry | Delaunay MeshingFinancial benefits | Health insurance | Wellness benefitsSenior-level Full TimeMontigny le Bretonneux, France2d ago
-
AWS | Amazon Redshift | BigQuery | DBT | Data ModelingCompany offsites | Home-office equipment | Inclusive culture | Paid time off | Pension contributionSenior-level Full TimeFrance2d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly team | Laid-back atmosphere | Remote-friendly environmentMid-level Full TimeParis, France2d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingAsynchronous work culture | Flexible remote distributed settingMid-level Full TimeNantes, France2d ago
-
Data Engineer H/F EUR 42K-49KAWS | Apache Airflow | Apache Spark | Databricks | DockerAI training | Career development | English interview support | Learning opportunitiesEntry-level Full TimeNantes, Pays de la Loire, France3d ago
-
CI/CD | Dataiku | GitLab CI | HDFS | HiveEmployee committee benefits | Health insurance | Meal vouchers | Performance bonus | TeleworkSenior-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R3d ago
-
Alternant·e Data Engineer H/F (Toulouse) EUR 38K-38KApache Airflow | Database Administration | Dataiku | Generative AI | GitEntry-level Full TimeToulouse3d ago
-
AWS | Azure | Cloud Computing | Dash | Data LakeKnowledge sharing | RnD opportunities | Technology learningMid-level Full TimeParis, France3d ago