GCP Data Engineer | BPCE-SI
Tasks
- Automate migration and data transformation scripts with Python
- Collaborate with SQL Server teams and analysts
- Design BigQuery data schemas
- Develop and optimize BigQuery ETL ELT pipelines
- Implement data quality and integrity checks
- Migrate ETL processes from SQL Server to GCP
- Monitor debug and resolve pipeline incidents
- Optimize BigQuery queries for performance and cost
- Orchestrate and schedule data pipelines
- Perform code reviews and testing
Perks/Benefits
- Electric bikes
- Flexible work policy
- Green transportation budget
- Hybrid work policy
- Inclusive DEI strategy
- Wellbeing programs
Skills/Tech-stack
Apache Airflow | BigQuery | Cloud APIs | Cloud Composer | Cloud platform | Data Integrity | Data Migration | Data Modeling | Data Quality | Data pipeline | ELT | ETL | Google Cloud | Google Cloud Composer | Google Cloud Platform | Performance Tuning | Python | SQL | SQL Performance | SQL Performance Tuning | SQL Server
Education
Roles
Related jobs
-
A/B | A/B Testing | Apache Spark | B testing | Deep learningCompany laptop | Fully remote work | Home office stipend | Learning and development budget | Paid Maternity LeaveSenior-level Full TimePortugal R1d ago
-
Data Engineering Specialist EUR 28K-49KBI | Classification | Data Bricks | Data Engineering | Data LakesHybrid work | Inclusive work culture | Professional developmentMid-level Full TimeLisbon - Antonio, Portugal R1d ago
-
Data & Automation Engineer EUR 56K-79KAPIs | Azure | Chatbots | Data Pipelines | DatabricksEmployee development opportunities | Flexible work environment | Health and inclusion support | Hybrid work model | Internal mobilitySenior-level Full TimeLisboa, PT R3d ago
-
Data Engineer EUR 38K-65KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SynapseFlex Options | Health insurance | Meal allowance | No-term contract | Paid vacationSenior-level Full TimeLisbon, Portugal R4d ago
-
Mid-level Full TimeAnywhere, Portugal R5d ago
-
API Security | Access Control | Airflow | Amazon Redshift | BigQueryFlexible hours | Remote workSenior-level Full TimePortugal - Remote R7d ago
-
Sr. Applied AI Engineer EUR 58K-81KAgent Orchestration | Agentic loops | Asynchronous services | Benchmarking | CachingEmployee resource groups | Flexible work environment | Hybrid work model | Remote work optionSenior-level Full TimeLisbon, Portugal R9d ago
-
AWS Lambda | AWS S3 | Apache Airflow | Apache Kafka | CI/CDHealth benefits | Mentoring | Professional development | Remote workSenior-level Full TimePorto, Portugal R9d ago
-
Senior Software Engineer (big data) EUR 72K-88KAWS | Algorithms | Apache Iceberg | Apache Spark | CI/CDSenior-level Full TimeRemote Portugal R9d ago
-
Senior Software Engineer (big data) EUR 72K-88KAWS | Apache Iceberg | Apache Spark | CI/CD | Data LakehouseSenior-level Full TimeRemote Portugal R9d ago
-
Senior-level Full TimeRemote, Portugal R11d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkRemote work | Travel up to 15%Senior-level Full TimePorto, Portugal R15d ago
-
Agile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DevOpsFull remote work | Portugal locationSenior-level Full TimeLisbon, Portugal R16d ago
-
Senior ML Engineer @JobCloud EUR 50K-74KAWS | Agent systems | Cloud Computing | Containerization | Data QualityConference budget | Flexible work arrangement | Fully remote or hybrid work | Gym allowance | Meal allowanceSenior-level Full TimeVila Nova de Gaia, Portugal R17d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R17d ago
-
Data Engineer EUR 30K-49KAWS | Alteryx | Apache Spark | Azure Data | Azure Data FactoryHybrid workMid-level Full TimeLisbon - Antonio, Portugal R17d ago
-
Senior Machine Learning Engineer: Ranking (Remote) USD 80K-120KAirflow | Databricks | Feature Store | Luigi | Machine LearningApple laptops provided | Fully remote team | Maternity and paternity leave | Regular team offsites | Training and development budgetSenior-level Full TimePortugal - Remote R17d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | Big Data | Event Driven | Event-driven architecture | Google CloudFlexible working hours | Friday afternoons off | Remote-first environment | Training programs | Transportation supportMid-level Full TimeLisboa, Portugal R18d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | BERT | Big Data | Event Driven | Event-driven architectureFlexible working hours | Friday afternoons off | Quarterly off-sites | Remote-first environment | Training programsMid-level Full TimeLisboa, Portugal R18d ago
-
Amazon Redshift | BigQuery | CI/CD | Cloud Data | Cloud Data WarehouseRemote workSenior-level Full TimePorto, Portugal R22d ago
-
Senior Software Engineer (big data) EUR 100K-129KAWS | Algorithms | Apache Iceberg | Apache Spark | CI/CDSenior-level Full TimeRemote Portugal R22d ago
-
Analytics Application Engineer/Developer EUR 44K-54KAPI Integration | Agile | Angular | Bootstrap | CI/CDHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadershipMid-level Full TimeLisbon - Antonio, Portugal R22d ago
-
Senior-level Full TimePortugal - Remote R23d ago
-
API | AWS | AWS Kinesis | Apache Airflow | Apache KafkaRemote workSenior-level Full TimePorto, Portugal R25d ago
-
Amazon SageMaker | Apache Airflow | CI/CD | Distributed Systems | DockerCross-functional collaboration | Remote workSenior-level Full TimePorto, Portugal R26d ago