Data Engineer GCP H/F
Tasks
- Automate event based ingestion with PubSub
- Build data ingestion pipelines
- Deploy data transformation pipelines
- Design event-driven data flows
- Ensure system high availability
- Implement data transformation in BigQuery
- Implement error-handling mechanisms
- Implement logging strategy
- Improve CI/CD pipeline
- Manage data processing workflows
- Optimize data ingestion pipelines
- Orchestrate data and machine learning workflows
- Secure production deployments
- Set up monitoring for data pipelines
Perks/Benefits
Skills/Tech-stack
Airflow | BigQuery | CI/CD | Cloud Run | Cloud Workflows | Cloud platform | Dataflow | Dataform | Docker | Eventarc | GKE | Google Cloud | Google Cloud Platform | Kubeflow | Logging | Monitoring | Observability | Pub/Sub | Python | SQL | Shell
Education
N/A
Related jobs
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract opportunity | Fully remote | High ownership | Influence on enterprise data strategy | International collaborationSenior-level Contract Full TimeFrance R9h ago
-
AI Foundry | AKS | Azure AI | Azure AI Foundry | Azure DevOpsCareer growth | Collaborative engineering culture | Continuous learning | High level of ownership | International work environmentSenior-level Full TimeFrance R9h ago
-
Data Engineer Databricks (H/F) EUR 46K-55KAmazon Web Services | Apache Spark | Azure | Azure DevOps | Batch ProcessingCareer development plan | Flexible telework | Meal vouchers | Paid time off | Training and certificationsSenior-level Full TimeSAINT OUEN, France R18h ago
-
AWS | Airflow | Azure | Backtesting | CI/CDEmployee ownership | Equipment choice | Flexible work location and schedule | Internal and external training | Monthly bonuses and quarterly bonusesMid-level Full TimeParis, Paris, France R18h ago
-
Data Engineer (Detect & Track Distillation) CHF 146K-240KData Curation | Data Ingestion | Data Lineage | Data Processing | Data labelingSenior-level Full TimeParis19h ago
-
Apache Airflow | Apache Spark | Data Lake | Data Quality | Data VisualizationCoaching | Company events | Equipment budget | Gym membership | Health insuranceSenior-level Full TimeParis1d ago
-
AI Engineer EUR 54K-75KAPI Integration | Artificial Intelligence | Generative AI | LLM orchestration | Language ModelsSenior-level Full TimeLibourne, Gironde, France; LIBOURNE HEADQUARTER1d ago
-
AWS | Amazon SageMaker | Azure | CI/CD | DatabricksCareer Development Programs | Employee benefit plan | Health insurance | Holiday bonuses | Individual coachingSenior-level Full TimeCourbevoie, IDF, France R1d ago
-
AWS | Apache Hadoop | Apache Kafka | Apache Spark | AzureCooptation bonus | Employee benefits | Healthcare insurance | Meal vouchers | MentorshipSenior-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R2d ago
-
Data Engineer confirmé(e) - Assurance - Lille EUR 45K-48KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | AzureEmployee benefits committee | Health insurance | Meal vouchers | Profit sharing | Referral bonusMid-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R2d ago
-
BigQuery | Cloud platform | DBT | Data Quality | DatabricksEntry-level Full Time InternshipParis, Île-de-France, France2d ago
-
APIs | Access Control | Audit Logging | CI/CD | Cloud DataAnnual offsite | Coworking support | Dependent coverage support | Employee equity ownership | Flexible, asynchronous workMid-level Full TimeFrance R2d ago
-
AI Engineer EUR 29K-40KAWS | Azure | CI/CD | Continuous integration | DockerAccess to training hours | Annual bonus | Career development plan | Certification panel | Employee savings plan with employer matchEntry-level Full TimeParis, Issy Bords de Seine 1, … R2d ago
-
AI Engineer EUR 29K-40KAWS | Azure | CI/CD | Docker | EmbeddingsBonus annual | Career development plan | Certification panel access | Health and wellness benefits | High tech equipment budgetEntry-level Full TimeParis, Issy Bords de Seine 1, … R2d ago
-
C# | Error Compensation | Error budget | GNSS | Integrity monitoringInclusive workplace | Learning & development opportunities | Work-life balance supportEntry-level Full TimeToulouse Champollion, France2d ago
-
Senior Data Platform Engineer (FP&A Solutions) EUR 40K-64KAzure Data | Azure Data Lakehouse | Data Lakehouse | Data Modeling | Data StandardsSenior-level Full TimeLocation Grenoble, France2d ago
-
Data Engineer And Business Tool Developer F/H EUR 40K-42KAzure Databricks | Azure DevOps | Power BI | PySpark | PythonEntry-level Full TimeFrance, Ile-de-France, Hauts-de-Seine (92)2d ago
-
Stage d’Exploration en Generative AI - H/F EUR 15K-15KAPI Integration | Algorithmic bias | Data Analysis | Database Integration | Ethical AIInternational experience | Internship | Professional learning opportunitiesEntry-level Full TimeAubervilliers, IDF, France2d ago
-
Consultant.e Data Engineer Microsoft Fabric EUR 50K-60KAzure Data | Azure Data Factory | BigQuery | Data Factory | Data FusionAgile work environment | Flexible recruitment process | Hybrid work | Meal voucher | RTTSenior-level Full TimeNantes, Loire-Atlantique, Loire-Atlantique, FR R3d ago
-
Lead AI engineer IAOps F/H EUR 70K-80KAWS | AWS Bedrock | Autogen | CI/CD | CMDBInternal mobility | Training opportunitiesSenior-level Full TimeIle-de-France, Hauts-de-Seine (92)3d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous culture | Inclusive workplace | Laid-back atmosphere | Portfolio supportMid-level Full TimeBordeaux, France3d ago
-
Senior-level Full TimeParis, France3d ago
-
stage 6 mois – data science et développement EUR 38K-51KAI Assisted Development | CSS | Cursor IDE | Data Analysis | Data ModelingEmployee restaurant access | Flexible work environment | MentorshipEntry-level Full TimeGentilly, France3d ago
-
CS27 BAC+5 - Développeur / Data engineer (H/F) EUR 10K-21KAWS | AWS Glue | Angular | Azure | Azure DataFlexible work hours | Internal mobility | Parental support | Training supportEntry-level Full TimeFR REN RSAS - Guyancourt, France3d ago
-
Amazon QuickSight | Automation | Chi-squared) | Data Integrity | Data ModelingSenior-level Full TimeClichy, Ile-de-France, FRA3d ago