Data Engineer Big Data (F/H)
Tasks
- Build batch data pipelines
- Build real-time streaming pipelines
- Identify bottlenecks and optimize performance
- Implement Apache Kafka ingestion and messaging
- Manage Hadoop clusters
- Monitor data pipelines
- Optimize distributed processing jobs
- Query and evolve HDFS Hive HBase
Perks/Benefits
Skills/Tech-stack
Apache Kafka | Apache Spark | HBase | HDFS | Hadoop | Hive | Java | Python | SQL | Scala
Education
N/A
Roles
Related jobs
-
Data Engineer H/F EUR 46K-53KAWS | Airflow | CI/CD | DBT | Data ObservabilityInclusion and diversity | Internal mobility | Team events | Training opportunities | Udemy accessSenior-level Full TimeValbonne, Provence-Alpes-Côte d'Azur, France7h ago
-
Machine Learning Engineer (H/F) EUR 47K-55KBigQuery | CI/CD | Cloud Storage | Cloud platform | Data VersioningSenior-level Full TimeLille, Hauts-de-France, France7h ago
-
Generative AI | Machine Learning | Microsoft Fabric | Python | SQLAnnual bonus | Cooptation bonus | Employee benefits program | Health insurance | Meal vouchersEntry-level Apprenticeship Full TimeAubière, Auvergne-Rhône-Alpes, France R11h ago
-
Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | Azure HDInsightCivic engagement platform | Conference and tech community | Continuous training | Employee incentives | Employee representative council CSESenior-level Full TimeNantes, Pays de la Loire, France R11h ago
-
Testeur / Ingénieur QA algorithmie EUR 40K-46KAgile | CI/CD | Data Processing | Functional testing | Performance TestingHealth insurance coverageMid-level Full TimeCesson-Sévigné, Ille-et-Vilaine, Bretagne, FR R1d ago
-
Embedded Software Engineer II EUR 31K-36KARM | Bluetooth | C plus plus | C# | CI/CDBoard games | E-learning access | Employee discount | Fitness facilities | Foosball tableEntry-level Contract Full TimeLyon, Auvergne-Rhône-Alpes, France1d ago
-
Senior-level Full TimeBordeaux, France1d ago
-
Senior-level Full TimeParis, France1d ago
-
Apache Spark | Azure | Azure HDInsight | Batch Processing | CI/CDEmployee Council | Employee referral bonus | Health insurance | Meal vouchers | Paid time off bonusSenior-level Full TimeNantes, Pays de la Loire, France R1d ago
-
Data Analytics Engineer intern EUR 14K-19KCI/CD | DBT | Data Modeling | Data Visualization | DatabricksCSE discounts | Gym pass access | Meal vouchers | Onboarding program | Sports and yoga classesEntry-level InternshipParis, France1d ago
-
Data Engineer GCP (F/H) EUR 42K-50KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud DataflowAgile methodologies | DataOps | DevOps environment | FinOps | International projectsEntry-level Full TimeParis, IDF, France1d ago
-
Attention Mechanism | CI/CD | CUDA | Custom Kernel | Distributed TrainingCareer development | Collaborative engineering culture | Continuous learning | Flexible work environment | High autonomySenior-level Full TimeFrance1d ago
-
Experienced Data Engineer - Streaming Platform EUR 55K-75KAlerting | Amazon Kinesis | Amazon Web Services | Apache Beam | Apache FlinkChild day care facilities | Gym membership | Lunch vouchers | Premium healthcare coverage | Relocation supportMid-level Full TimeParis R1d ago
-
Accelerator Data & AI Engineer (Lyon) EUR 48K-64KAWS | Airflow | CI/CD | DBT | Data GovernanceEmployer retirement plan matching | Extended parental leave | Group savings plan | Health insurance | Hybrid workSenior-level Full TimeLyon, France1d ago
-
Analytics Engineer EUR 54K-67KAgile | Azure Data | Azure Data Factory | Azure DevOps | CI/CDHybrid workMid-level Full TimeFRA HQ Issy, France1d ago
-
Senior-level Full TimeNantes, FR1d ago
-
Applied AI Software Engineer - France EUR 70K-80KData Pipelines | Evaluation | Fine Tuning | LLM | Machine LearningClient site visits | Flexible work location | Hybrid workSenior-level Full TimeParis, Île-de-France, France1d ago
-
Senior Applied AI Software Engineer - France EUR 70K-80KData Engineering | Data Pipelines | Evaluation | Fine Tuning | LLMClient site flexibility | Hybrid work | Up to 3 days per week onsiteSenior-level Full TimeParis, Île-de-France, France1d ago
-
CI/CD | Generative AI | Machine Learning | PyTorch | PythonContinuous learning | Inclusive work culture | MentorshipEntry-level Apprenticeship Full TimeParis - 52 Av. Champs Elysées, …1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Diverse and inclusive workplace | Remote-friendly environmentMid-level Full TimeParis, France2d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPMid-level Full TimeNantes, France2d ago
-
Member of Technical Staff, Data Analysis and Evaluation USD 150K-175KData collection | Distributed Training | Experimental Design | JAX | Machine LearningCo working Benefit | Community events | Daily lunch program | Remote-friendly | SnacksSenior-level Full TimeLondon2d ago
-
AI Engineer (GenAI & LLM) – Practice IA MARGO EUR 70K-80KAPI Development | Agent systems | Agentic AI | Arize | AutogenConference participation | Continuous learning | Professional workshopsSenior-level Contract Full TimeParis2d ago
-
Machine Learning Engineer – Practice IA MARGO EUR 70K-80KAWS | Airflow | Azure | CI/CD | Cloud platformSenior-level Contract Full TimeParis2d ago
-
Data Engineer GCP (F/H) EUR 50K-55KAPI Development | Agile | BigQuery | Cloud Build | Cloud RunCareer growth | Supportive management | Telework | Training platformMid-level Full TimeParis, Île-de-France, France R2d ago