Senior GCP Data Engineer/Data Architect Consultant
Tasks
- Assess existing data pipeline
- Build data ingestion pipelines
- Collaborate with client engineering data DevOps and product teams
- Create curated BI ready datasets
- Define BigQuery datasets and tables
- Define cost control strategies
- Define integration patterns for Elasticsearch
- Design Medallion Architecture
- Implement data quality checks and validation
- Implement partitioning and clustering
- Prepare technical documentation and architecture diagrams
- Set up logging monitoring and reprocessing
- Support AI enrichment embeddings semantic search and metadata
- Support batch incremental and on demand processing
Perks/Benefits
Skills/Tech-stack
Apache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud Run | Cloud SQL | Cloud Storage | Column-Level Security | DBT | Data Catalog | Data Lineage | Data Modeling | Data Quality | Data pipeline | Dataflow | Dataform | Dataplex | Elasticsearch | Embeddings | Gemini | Google Cloud | IAM | Lakehouse | Logging | Medallion Architecture | Metadata Management | Monitoring | MySQL | Row Level Security | SQL | Semantic Search | Vector Search | Vertex AI
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
Mid-level Full TimeNoida,Uttar Pradesh,India R5h ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Angular | Azure Databricks | CI/CD | Cloud platformRemote workMid-level Full TimeWork from home, VA, United States R6h ago
-
Senior Data Engineer (Remote) USD 120K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data RefreshEqual opportunity employer | Remote workSenior-level Full TimeUnited States R7h ago
-
Data Engineer INR 2000K-2700KAWS Redshift | Agile | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsHybrid workingMid-level Full TimeIndia R11h ago
-
Software Engineer USD 149K-211KAlgorithms | Code Reviews | Data Structures | Debugging | DeploymentBonus | Equity | Hybrid schedule | Paid benefitsMid-level Full TimeMountain View, CA, USA R13h ago
-
Senior Software Engineer USD 226K-252KAlgorithms | Audio Processing | C++ | Cause analysis | Code reviewHybrid scheduleSenior-level Full TimeMountain View, CA, USA R13h ago
-
(Junior) Data Engineer - Data Platform (m/f/d) EUR 42K-42KApache Beam | Apache Flink | BigQuery | Cloud platform | Data CatalogEGYM Wellpass | Futurebens discounts | Job bike leasing | Remote workEntry-level Full TimeRemote, Hamburg, Berlin, München R16h ago
-
GCP, Digital Analytics, Bigquery/Senior Consultant Specialist INR 2500K-3900KBigQuery | Cloud platform | Data Governance | Data Modeling | Data QualityContinuous professional development | Flexible working | Inclusive and diverse environment | Opportunities for growthSenior-level Full TimeHyderabad, Telangana, India R18h ago
-
Senior AI/ML Engineer INR 2775K-4995KAmazon Web Services | Apache Hadoop | Apache Spark | Azure | Bias MitigationSenior-level Full TimeBengaluru East, Karnataka, India R18h ago
-
Data pipeline | Deep learning | GPU | JAX | Latency optimizationCareer growth | Flexible working hours | Fully remote | High autonomy | Professional developmentSenior-level Full TimeSouth Africa R20h ago
-
Data pipeline | Deep learning | GPU | Inference | JAXCareer growth | Fully remote | Ownership & autonomy | Professional development | Work flexibility EuropeSenior-level Full TimeGermany R20h ago
-
Senior Engineer, Data CAD 123K-187KAmazon Redshift | Apache Airflow | Apache Kafka | Backpressure | Bias VarianceDental coverage | Flexible work hours | Fully remote | Health coverage | Parental leave top-upsSenior-level Full TimeCanada (Remote) R21h ago
-
Principal Data Scientist – Agents Team - BCN/MAD EUR 54K-72KAgent systems | Agentic AI | Data Modeling | Data Processing | ExperimentationHybrid work schedule | Permanent contractSenior-level Full TimeMadrid - Hybrid, Barcelona - Hybrid R23h ago
-
Data Architect AVP INR 3000K-4000KAnalytics | Asset Management | Asset management domain | Asset management domain knowledge | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India R23h ago
-
Access Control | Agile | Data Governance | Data Modeling | Data SecurityFlexible core business hours | Remote workEntry-level Full TimeArlington, VA, Remote, United States R1d ago
-
Agile | Data Architecture | Data Governance | Data Integrity | Data Modeling401k | Employee assistance program | Employee discounts | Health, dental, and vision plans | Life insuranceSenior-level Full TimeArlington, VA, Remote, United States R1d ago
-
Mid-level Full TimeBasel, Basel City, Switzerland - Remote R1d ago
-
Data Engineer INR 3000K-4000KAlteryx | DBT | Data Governance | Data Modeling | Data PipelinesEmployee incentive programs | Flexible work hours | Headspace access | Hybrid work | Mental health daysMid-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
AI Foundry | AKS | ARM Templates | App Services | Application InsightsHybrid work | Remote workSenior-level Full TimeRemote, DL, IN R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
BI Specialist USD 52K-78KAgile | Data Governance | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimePortugal - Remote R1d ago
-
AWS | Anomaly Detection | Azure | Data Pipelines | Databricks30 vacation days | Flexible working hours | Part-time work | Remote workEntry-level Part TimeUlm, Germany R1d ago
-
BigQuery | Cloud Composer | Cloud platform | Data Vault | ELTCareer progression opportunities | Health insurance | Meal card | Welcome kit | Work-life balance supportSenior-level ContractPorto, Lisbon, Porto, Portugal R1d ago