Data Engineer, Data Core
Tasks
- Build in app reporting on OLAP database
- Compute on large scale using Spark
- Create data contracts and conventions
- Define technical reporting contract for front end team
- Instrument systems for cost and latency regressions
- Lead incident response
- Maintain alerts and runbooks
- Monitor scaling limits to prevent outages
- Optimize pipelines and queries for cost and latency
- Orchestrate batch and real-time data pipelines
- Own data platform tooling and services
- Provide on call support for owned systems
- Run SQL analytics on DuckDB
- Run distributed queries with Trino
- Store and access petabyte scale event data
- Translate product ML and finance requests into deliverables
Perks/Benefits
- Annual offsite
- Employee stock ownership plan
- Health insurance
- Hybrid flexibility
- Meal vouchers
- Tech syncs
- Variable pay
Skills/Tech-stack
Apache Airflow | Apache Hudi | Apache Iceberg | Apache Spark | ClickHouse | Dagster | Data Contracts | Data orchestration | Delta Lake | DuckDB | Incident Response | Lakehouse | OLAP | On-Call | Prefect | Trino
Education
N/A
Roles
Related jobs
-
Data Engineer, Measurement & Reporting EUR 88K-120KApache Airflow | ClickHouse | DBT | Dagster | Data ModelingAnnual offsite | Equity plan | Health insurance | Hybrid work flexibility | Meal vouchersSenior-level Full TimeParis22h ago
-
Backfilling | Cloud | Cloud Data | Cloud Data Warehouse | Data ContractsFlexible working arrangements | Fully remote across Europe | High autonomy | Meaningful overlap with international teams | Professional growth opportunitiesSenior-level Full TimeFrance R1d ago
-
Consultant MLOps & IA (H/F) - secteur Télécom EUR 41K-49KAWS EKS | AWS Lambda | AWS SageMaker | Apache Spark | Argo CDEntry-level Full TimeBoulogne-Billancourt, IDF, France1d ago
-
Apache Airflow | Apache Kafka | Apache NiFi | Apache Spark | CloudCoop bonus | Employee benefits | Health insurance | Meal vouchers | Performance bonusEntry-level Apprenticeship Full TimeNantes, Pays de la Loire, France R1d ago
-
API | AWS | AWS Lambda | Amazon RDS | Amazon S3Collaborative team culture | Continuous learning opportunities | Flexible work environment | High ownership autonomy | Merit driven cultureSenior-level Full TimeFrance2d ago
-
Consultant Data Expert Databricks (F/H) EUR 50K-55KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataEmployee stock ownership | Health insurance paid | Return To Work After Maternity Reduced Schedule | Training courses | Vacations bonusSenior-level Full TimeNantes, Pays de la Loire, France2d ago
-
API | Apache Spark | CI/CD | Databricks | DataikuCertified training organization support | Mobility support | Relocation assistance | Training opportunitiesEntry-level Apprenticeship Full TimeLe Puy, France2d ago
-
Ingénieur Big Data (F/H) EUR 50K-70KApache Kafka | Apache Spark | Big Data | Data Ingestion | Distributed ComputingFlexible internal work modes | Parental leave support | Telework 3 days per week | Training and ASI AcademyMid-level Full TimeRennes, Brittany, France R3d ago
-
Mid-level Full TimeParis, France3d ago
-
Airbyte | DBT | DBT Cloud | Data Modeling | Data WarehousingRemote work 3 days per week | Structured onboardingExecutive-level Full TimeParis, France R3d ago
-
Ingénieur Databricks Confirmé (F/H) EUR 45K-50KAWS | Apache Spark | CI/CD | DataOps | DatabricksCareer growth | Certification support | Hybrid work | TrainingSenior-level Full TimeBezons, FR R3d ago
-
Senior SWE / ML Engineer - Identity & Audience EUR 75K-125KClustering | Cost Management | Dagster | Data Pipelines | Data orchestrationAnnual offsite | Health insurance | Hybrid work flexibility | Meal vouchers | Tech syncsSenior-level Full TimeParis3d ago
-
3NF | Apache Airflow | Azure | Azure Data | Azure Data FactoryAssurance santé | Participation et intéressement | Tickets restaurant | Transport public remboursé | TélétravailSenior-level Full TimeSaint-Priest, France R3d ago
-
Apache Iceberg | Apache Kafka | Cloud Cost Optimization | Cost Optimization | Data LakeHybrid work | On-call rotations | Technical documentation supportMid-level Full TimeMarcq-en-Barœul, Hauts-de-France, France R3d ago
-
AWS CloudTrail | AWS CloudWatch | AWS EMR | Apache Beam | Apache SparkCooptation bonuses | Disability support | Employee stock ownership | Equipment allowance | Great Place to Work certificationSenior-level Full TimeLyon, Auvergne-Rhône-Alpes, France R4d ago
-
Apache Airflow | Apache Flink | Apache Kafka | DBT | DebeziumSenior-level Full TimeBoulogne-Billancourt, IDF, France4d ago
-
AWS | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkCareer Development Programs | Employee representatives council | Health insurance | Meal vouchers | MentorshipSenior-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R4d ago
-
Apache Spark | Cluster management | Data Engineering | Data Pipelines | DatabricksCoaching and mentoring | Employee stock purchase plan | Health insurance | International mobility | Meal vouchersMid-level Full TimeLyon, Auvergne-Rhône-Alpes, France R4d ago
-
Data Engineer Modern Data Stack F/H EUR 45K-52KAWS | AWS CDK | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeLYON 2E ARRONDISSEMENT, FRA4d ago
-
Data & AI Engineer EUR 54K-72KAWS | Apache Airflow | CI/CD | DBT | Data ModelingGroup savings plan | Health insurance | Hybrid work | Learning and development | Paid time offSenior-level Full TimeParis, France4d ago
-
AWS | Apache Airflow | Cloud platform | Data Pipelines | Deep learningAccess to modern development tools | Collaborative team environment | Continuous learning culture | Equity opportunities | Medical, dental, and vision benefitsMid-level Full TimeFrance R7d ago
-
AWS | Amazon Web Services | Apache Spark | Big Data | Data AnalysisRemote workSenior-level Full TimeParis, France R7d ago
-
Entry-level Full TimeParis, IDF, France7d ago
-
Data Engineer Databricks EUR 46K-52KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Batch ProcessingContinuous learning resources | Technical training platformsSenior-level Full TimeLyon, FR7d ago
-
Data Engineer Confirmé H/F EUR 45K-53KApache Hadoop | Apache Kafka | Apache Spark | CI/CD | ClouderaBike allowance | Commute reimbursement | Health insurance | Paid time off | Reduced work time offSenior-level Full TimeNantes, Pays de la Loire, France R7d ago