Senior GCP Data Engineer/Data Architect Consultant
Tasks
- Assess existing data pipeline
- Build data ingestion pipelines
- Collaborate with client engineering data DevOps and product teams
- Create curated BI ready datasets
- Define BigQuery datasets and tables
- Define cost control strategies
- Define integration patterns for Elasticsearch
- Design Medallion Architecture
- Implement data quality checks and validation
- Implement partitioning and clustering
- Prepare technical documentation and architecture diagrams
- Set up logging monitoring and reprocessing
- Support AI enrichment embeddings semantic search and metadata
- Support batch incremental and on demand processing
Perks/Benefits
Skills/Tech-stack
Apache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud Run | Cloud SQL | Cloud Storage | Column-Level Security | DBT | Data Catalog | Data Lineage | Data Modeling | Data Quality | Data pipeline | Dataflow | Dataform | Dataplex | Elasticsearch | Embeddings | Gemini | Google Cloud | IAM | Lakehouse | Logging | Medallion Architecture | Metadata Management | Monitoring | MySQL | Row Level Security | SQL | Semantic Search | Vector Search | Vertex AI
Education
N/A
Related jobs
-
Principal Research Data Engineer USD 142K-185KAirflow | Analytical processing | ArcGIS | Avro | CI/CDDental | Health care | PTO | Retirement | Sick leaveSenior-level Full TimeSt. Louis, Missouri, US R10h ago
-
Machine Learning Engineer (Active Secret Clearance) USD 160K-190KAgile | Asynchronous programming | CI/CD | Data Engineering | Docker401k plan | FSA | Fully remote work | HSA | Hybrid onsite optionMid-level Full TimeRemote; Tacoma, WA R15h ago
-
Senior Analytics Engineer GBP 70K-74KAWS Glue | AWS Lambda | AWS Step Functions | Automated testing | CI/CD25 days annual leave | Cycle to work scheme | Electric car scheme | Enhanced parental leave | Fertility treatment financial supportSenior-level Full TimeLondon, England, United Kingdom R18h ago
-
Senior Manager, Data Science CAD 120K-150KArtificial Intelligence | Attribution | Calibration | Data Fusion | Data MiningDiscount program | Education reimbursement | Health and dental | Hybrid work | Leadership trainingSenior-level Full TimeToronto, ON - Remote R1d ago
-
A/B | A/B Testing | Agent Frameworks | Agent workflows | B testing100% remote work | Access to learning platforms | English classes | Flexible within LATAM time zones | Referral programSenior-level Full TimeCórdoba, Córdoba Province, Argentina R1d ago
-
API Gateway | AWS | AWS Lambda | Amazon API | Amazon API GatewayAccess to Argentine public holidays | Access to learning platforms | English classes | Professional development | Referral programSenior-level Full TimeCórdoba, Córdoba Province, Argentina R1d ago
-
APOC | AuraDB | Computer Vision | Cypher | Data QualityBirthday gift | Employee benefits card | English classes | Full-time contract | Healthy BreakSenior-level Full TimeBuenos Aires, Argentina R1d ago
-
Langchain | MLOps | Machine Learning | NumPy | PandasFreelance opportunities | Part-time projects | Project based workMid-level FreelanceUnited States - Remote R1d ago
-
Lead AI Engineer EUR 66K-87KAWS | Agentic AI | Azure | Docker | ELTApple MacBook Pro | Certification budget | Coaching | Covered travel | Flexible vacationSenior-level Full TimeUtrecht, Utrecht, Netherlands R1d ago
-
Data Software Engineer USD 90K-170KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | Azure401k plan | Dental insurance | Life insurance | Medical insurance | Remote work hybridSenior-level Full TimeUnited States; United States; United States; … R1d ago
-
AWS | Continuous Deployment | Continuous integration | Couchbase | Distributed SystemsEquipment program | Flexible schedule | Paid time off | Performance bonuses | Remote workMid-level Full TimeRemote job R1d ago
-
Data Engineer GCP (F/H) EUR 50K-55KAPI Development | Agile | BigQuery | Cloud Build | Cloud RunCareer growth | Supportive management | Telework | Training platformMid-level Full TimeParis, Île-de-France, France R1d ago
-
Data Engineer AWS (F/H) EUR 30K-42KAWS Athena | AWS Glue | AWS Lambda | Amazon S3 | Amazon Web ServicesCooptation bonus | Employee benefits | English training | Health insurance | Meal vouchersSenior-level Full TimeLa Garenne-Colombes, Île-de-France, France R1d ago
-
Data Engineer EUR 50K-55KAPI | Agile | Apache Spark | Hadoop | KafkaCo-optation bonus | English language courses | Hybrid work | Meal tickets | Mobility allowanceMid-level Full TimeSophia-Antipolis, Provence-Alpes-Côte d'Azur, France R1d ago
-
Data Engineer AWS Senior (F/H) EUR 30K-42KAPI Gateway | AWS | Amazon API | Amazon API Gateway | CI/CDAfterworks community techlead events | Cooptation bonus | E-learning access | Employee benefits program | English lessonsSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer GCP Senior (F/H) EUR 30K-42KBash | Cloud platform | Docker | GCP architecture | GitEmployee benefits program | English lessons | Health insurance | Mobile allowance | Paid training accessSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer H/F EUR 52K-57KApache Spark | Artifactory | CI/CD | DevOps | ELK StackE-learning access | Employee benefits | English courses | Health insurance | Meal vouchersExecutive-level Full TimeParis, Île-de-France, France R1d ago
-
Senior AI/Machine Learning Engineer USD 140K-170KAWS | Azure | Bias Variance | CI/CD | Cloud platform401k matching | Dental insurance | Flexible spending account | Growth opportunities | Health savings accountSenior-level Full TimeDenver, CO, United States R2d ago
-
Senior Data Engineer EUR 64K-79KAWS | Airflow | DBT | Data Modeling | Data pipelineFlex Friday | Health insurance | Hybrid work up to two days remote per week | Paid Holidays | Paid time offSenior-level Full TimeMadeira, Portugal R2d ago
-
AI Solutions Architect Engineer USD 130K-197K.NET | API | Azure | Backend Development | C#Contract-to-hire | Hybrid work model | Onsite schedule flexibility | Remote work on selected daysSenior-level Full TimeHouston, United States R2d ago
-
Senior Engineer - Ingestion & Streaming Frameworks USD 150K-190KAWS | Airbyte | Airflow | Amazon DMS | CDCSenior-level Full TimeRemote - United States R2d ago
-
Data Science & AI Specialist GBP 28K-28KAWS Bedrock | Apache Pulsar | Apache Spark | Artificial Intelligence | CI/CDCarers leave bonus | Discounted mobile and broadband | Equalized maternity paternity and adoption leave | Holiday purchase scheme | Paid carer’s leaveMid-level Full TimeLondon, GB, E1 8EP R2d ago
-
Databricks Data Engineer MXN 300K-300KCluster optimization | Data Enrichment | Data Ingestion | Data Modeling | Data SecurityConferences workshops and courses | Continuous training | Hybrid work | Indefinite employment contract | Official certificationsMid-level Full TimeMexico City, Mexico R2d ago
-
SAC Sr Data Visualization Engineer Consultant MXN 540K-600KAnalytics | Analytics Cloud | Business Intelligence | Dashboards | Data ModelingAdvanced English support | Hybrid workSenior-level Full TimeMexico R2d ago
-
Senior MLOps Engineer BRL 156K-180KAPIs | AWS | CI/CD | Data Catalog | Data GovernanceCareer growth opportunities | Emotional wellbeing program | Flexible schedule | Healthcare dental and life insurance | Home office reimbursementSenior-level Full TimeBrazil (Remote) R2d ago