Lead Data Engineer H/F
Tasks
- Automate workflows and maintain documentation
- Build ETL workflows with orchestration tools
- Define data architecture and pipeline best practices
- Define team goals roadmaps and delivery timelines
- Design build and maintain scalable data infrastructure
- Develop data lake and data warehouse strategy
- Implement batch and real-time data processing pipelines
- Implement data governance policies for security and privacy
- Improve data reliability quality and accessibility
- Monitor and log data pipeline performance
- Optimize data ingestion transformation and activation
- Optimize infrastructure costs with high availability
- Research and implement emerging data technologies
- Use cloud services for scalable processing and storage
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Apache Airflow | Apache Spark | Batch Processing | CI/CD | Cloud Computing | Continuous Deployment | DBT | Data Governance | Data Lake | Data Modeling | Data Monitoring | Data Pipelines | Data Quality | Data Warehouse | ETL | GDPR | Logging | ML | Machine Learning | PostgreSQL | Python | Real Time | Real-time Processing | SQL | Snowflake | Terraform | Time processing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Engineer – Plateforme Data Engineering EUR 48K-52KApache Airflow | Apache Flink | Apache Kafka | DBT | DebeziumAgile scrum teamworkSenior-level Full TimeVitrolles, Provence-Alpes-Côte d'Azur, France8h ago
-
Manager - Lead Data Scientist (H/F) EUR 50K-60KAmazon SageMaker | Apache Spark | Data Pipelines | Databricks | Deep learningCareer development support | Flexible work | Great Place to Work recognition | Mobile work | Training opportunitiesSenior-level Full TimePuteaux, IDF, France8h ago
-
API | AWS | Apache Kafka | Azure | Data GovernanceFlexible work | Further training | Mentorship | Mobile work | SmartworkingEntry-level Full TimePuteaux, IDF, France8h ago
-
3D simulation | Artificial Intelligence | C++ | CE | Computer VisionContinuous training | Innovative projects | Stimulation environmentSenior-level Full TimeToulouse, Occitanie, France9h ago
-
AI | APIs | AWS | CircleCI | DynamoDBHealth insurance | Hybrid working | International team events | Meal card | Paid leaveSenior-level Full TimeParis, France10h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Friendly atmosphere | Handsoff management | Portfolio feedback | Remote-friendly environmentMid-level Full TimeLyon, France12h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Career growth opportunities | Impactful product mission | Remote-friendly environment | Supportive teamMid-level Full TimeLille, France12h ago
-
Senior Data Engineer - F/H EUR 45K-55KAirflow | Batch Processing | Cloud | DBT | Data ModelingAfterworks | Conferences | Flexible hours | Health insurance | Holiday bonusSenior-level Full TimeWasquehal, France1d ago
-
Data analyst Sénior H/F EUR 45K-46KAPI | BigQuery | Data Governance | Data Transformation | Data WarehouseCommunity events | Company phone | Meetups | Mobile stipend | TrainingMid-level Full TimeParis, IDF, France1d ago
-
Senior-level Full TimeBORDEAUX, FRA1d ago
-
Azure OpenAI | Cloud platform | Evaluation metrics | FastAPI | Google CloudMid-level Full TimeParis, France1d ago
-
Agentic AI | Amazon Web Services | Cloud platform | Dash | Data LakeMid-level Full TimeParis, France1d ago
-
Airbyte | DBT | DBT Cloud | Data Modeling | Data WarehousingRemote work days | Structured onboardingExecutive-level Full TimeParis, France1d ago
-
Algorithm Engineer EUR 51K-76KCI/CD | Data Curation | Data labeling | Deep learning | Device validationIn person office hubs Boston New York City Paris | PTO | Remote workMid-level Full TimeParis, France / Remote R3d ago
-
AI Foundry | AWS | AWS Bedrock | Agentic AI | Amazon SageMaker401k match | Career development | Dental insurance | Flexible work arrangements | Health insuranceSenior-level Full TimeFrance3d ago
-
Lead Data Scientist (H/F) EUR 46K-60KAgentic Workflows | Azure | Benchmarks | Docker | GitCSE access | Commuting support | Health insurance | Meal tickets | TeleworkSenior-level Full TimeCourbevoie, La Défense, Île-de-France, France3d ago
-
Data engineer (H/F) EUR 28K-30KApache Spark | CI/CD | Data Lake | Data Modeling | Data WarehouseCollaborative work mode | Professional growth opportunitiesMid-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France3d ago
-
AI Research Engineer - GPU Simulation GBP 80K-105KC++ | CUDA | Domain Randomization | Flight Dynamics | GPU ProgrammingEnhanced parental leave | Health and wellness gym membership | Learning allowance | Mental health support | Paid Family Emergency LeaveSenior-level Full TimeMunich - Berlin - London - … R3d ago
-
Azure | CI/CD | DAX | Data Contracts | Data GovernanceCollaboration and inclusion culture | Continuous learning | Flexible work approach | Fully Remote Working Environment | High autonomySenior-level Full TimeFrance R3d ago
-
Apache Spark | Big Data | Cluster management | Data Engineering | Data GovernanceEmployee share ownership | Great Place to Work certification | Health insurance | Meal vouchers | Mentoring programMid-level Full TimeLyon, Auvergne-Rhône-Alpes, France3d ago
-
Data Scientist Senior H/F EUR 45K-55KAWS | Bash | CI/CD | Data Engineering | Data TableCommunity groups | Company phone | Meetups | Mobility allowance | Sports and eventsSenior-level Contract Full TimeParis, IDF, France3d ago
-
API Development | Backup and Restore | Cause analysis | Disaster Recovery | ElasticsearchRemote-firstMid-level Full TimeParis R3d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Exposure to large scale security telemetry | Professional growth | Remote work opportunityMid-level Full TimeFrance R3d ago
-
API Integration | Computer Vision | Hugging Face | Langchain | Language ModelsEmployee Committee | Health insurance | Meal vouchers | Referral bonusEntry-level Full TimeNantes, Pays de la Loire, France4d ago
-
AI Agents | Data Science | Generative AI | Language Models | Large Language ModelsCoaching and mentoring | Employee committee benefits | Health insurance | Paid vacation bonus | Referral bonusSenior-level Full TimeStrasbourg, Grand Est, France4d ago