Data Engineer Big Data (F/H)
Tasks
- Build batch data pipelines
- Build real-time streaming pipelines
- Identify bottlenecks and optimize performance
- Implement Apache Kafka ingestion and messaging
- Manage Hadoop clusters
- Monitor data pipelines
- Optimize distributed processing jobs
- Query and evolve HDFS Hive HBase
Perks/Benefits
Skills/Tech-stack
Apache Kafka | Apache Spark | HBase | HDFS | Hadoop | Hive | Java | Python | SQL | Scala
Education
N/A
Roles
Related jobs
-
Administrateur Modern Data Platform (H/F) EUR 39K-48KAirbyte | Batch Processing | DBT | Data Lake | Data ModelingFlexible career paths | Learning community events | Mentoring | Training opportunitiesMid-level Full TimeAix-en-Provence, Provence-Alpes-Côte d'Azur, France6h ago
-
Administrateur Modern Data Platform (H/F) EUR 39K-48KAirbyte | Batch Processing | DBT | Data Lake | Data PipelinesCommunity events | E-learning | Mentoring | Team building | Training budgetMid-level Full TimeAix-en-Provence, Provence-Alpes-Côte d'Azur, France6h ago
-
Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCooptation bonus | Employee equity | Equipment bonus | Health insurance | Mobility supportSenior-level Full TimeParis, IDF, France R7h ago
-
Data Analytics Engineer - H/F - CDI EUR 50K-60KApache Spark | Azure | BI Semantic Model | CI/CD | DAXCode reviews | Internal training | Knowledge sharing | Rapid recruitment processSenior-level Full TimeParis, IDF, France8h ago
-
Data Engineer Databricks (H/F) EUR 40K-46KApache Airflow | Cloud platform | Data Pipelines | Databricks | Google CloudCareer development | Community events | E-learning | Flexible mission selection | MentoringMid-level Full TimeLille, Hauts-de-France, France10h ago
-
AWS | Azure | Cloud platform | Computer Vision | Deep learningInternship with possible full time offerEntry-level InternshipParis, IDF, France12h ago
-
Data Analytics Engineer (F/H/X) EUR 45K-60KBigQuery | Cloud platform | Data Modeling | Data analytics | DockerHealth insurance | Meal vouchers | Performance bonuses | TrainingMid-level Full TimeLille19h ago
-
API Integration | Agent systems | Autogen | Automated testing | Autonomous AgentsHybrid work | Inclusive workplace | International team | Professional development | Remote workMid-level Full TimeFrance1d ago
-
Automated testing | CI/CD | Clean architecture | Docker | Fine TuningCareer development | Continuous learning | Hybrid work option | Professional growth | Remote work optionSenior-level Full TimeFrance1d ago
-
Airflow | Angular | Argo CD | CI/CD | DockerCareer development opportunities | Inclusion and diversity commitment | Remote work eligibilityMid-level Full TimeEurope, France, Ile-de-France, 92 - Hauts-De-Seine R1d ago
-
Data Engineer confirmé(e) - Assurance - Lille EUR 45K-45KAWS | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkEmployee Committee | Health insurance | Meal tickets | Profit-sharing bonus | Referral bonusMid-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R1d ago
-
AWS | Azure | CI/CD | Cloud Computing | Data EngineeringCareer growth | International projects | Mentorship | Training opportunitiesEntry-level Full TimeNantes, Pays de la Loire, France1d ago
-
Analytical Chemistry | CO2 Quantification | Chemometrics | Data Analysis | ExcelEqual opportunity employment | Professional development | Training providedEntry-level Full TimePAU-CSTJF(FRA), PAU, France1d ago
-
Senior Analytics Engineer - Finance & Risk EUR 34K-38KA/B | A/B Testing | Artificial Intelligence | B testing | Cloud DataAdditional paid time off | Capital Incentive | Flexible office | Health insurance | Mobility allowanceSenior-level Full TimeParis (FR)1d ago
-
Senior Consultant.e - Data & AI engineer (H/F) EUR 50K-60KAI Agents | AWS | Azure | Bicep | Cloud platformFlexible work | Mobile work | Training budgetSenior-level Full TimePuteaux, IDF, France1d ago
-
API Integration | Access Control | Airflow | Amazon Redshift | Automated testingCollaborative product culture | Flexible working hours | Fully remote | Modern engineering environment | Ownership and influenceSenior-level Full TimeFrance R1d ago
-
DATA Engineer H/F - Lille EUR 36K-36KApache Airflow | Apache Spark | Azure | Azure Synapse | BigQueryHealth insurance | Meal tickets | Paid vacation bonus | Transport reimbursementMid-level Full TimeLille, France1d ago
-
Senior Data Engineer (H/F) EUR 48K-53KAmazon EC2 | Amazon RDS | Amazon S3 | Amazon Web Services | AnsibleEmployee savings plan | Family healthcare coverage | Group savings plan matching | Meal card support | TeleworkSenior-level Full TimeParis R1d ago
-
AI Engineer (H/F/NB) EUR 70K-80KAPI Integration | Anthropic API | BigQuery | CRM Integration | Cache optimizationCareer growth | International projects | Technical documentation support | Training and upskilling opportunitiesEntry-level Full TimeVilleurbanne, France1d ago
-
Mid-level Full TimeVilleurbanne, France1d ago
-
Mid-level Full TimeNantes, France1d ago
-
AI Engineer (H/F/NB) EUR 70K-80KAPIs | Anthropic API | BigQuery | CRM | ChromaProfessional documentation support | Training and upskillingMid-level Full TimeNantes, France1d ago
-
Mid-level Full TimeParis, IDF, France1d ago
-
Data Engineer (H/F) EUR 45K-52KApache HBase | Apache Hadoop | Apache Hive | Apache Kafka | Apache SparkAssociate opportunity | Associative projects | Learning and development support | Parental policySenior-level Full TimeNantes, France1d ago
-
Data Engineer / DataOps (H/F) EUR 43K-43KAgile | Amazon S3 | Apache Iceberg | Apache Kafka | Apache SparkGreat place to work | Professional development | RSE engagement programs | Work-life balanceMid-level Full TimeParis, France1d ago