Senior GCP Data Engineer/Data Architect Consultant
Tasks
- Assess existing data pipeline
- Build data ingestion pipelines
- Collaborate with client engineering data DevOps and product teams
- Create curated BI ready datasets
- Define BigQuery datasets and tables
- Define cost control strategies
- Define integration patterns for Elasticsearch
- Design Medallion Architecture
- Implement data quality checks and validation
- Implement partitioning and clustering
- Prepare technical documentation and architecture diagrams
- Set up logging monitoring and reprocessing
- Support AI enrichment embeddings semantic search and metadata
- Support batch incremental and on demand processing
Perks/Benefits
Skills/Tech-stack
Apache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud Run | Cloud SQL | Cloud Storage | Column-Level Security | DBT | Data Catalog | Data Lineage | Data Modeling | Data Quality | Data pipeline | Dataflow | Dataform | Dataplex | Elasticsearch | Embeddings | Gemini | Google Cloud | IAM | Lakehouse | Logging | Medallion Architecture | Metadata Management | Monitoring | MySQL | Row Level Security | SQL | Semantic Search | Vector Search | Vertex AI
Education
N/A
Related jobs
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R18d ago
-
Lead Software Engineer GBP 32K-35KAWS | AWS Lambda | Amazon ECS | Amazon EKS | Auto ScalingHybrid work | Remote work flexibility | Reward and recognition | Volunteering opportunities | Wellness programsEntry-level Full TimeCyberjaya, Selangor, Malaysia R6h ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R6h ago
-
API Integration | Accessibility | Backend Development | Dashboarding | Data ModelingCollaborative international environment | Contract extension opportunity | Fully remote work | Ownership and autonomy | Potential full-time conversionSenior-level Full TimeBrazil R6h ago
-
Senior-level Full TimeRemot, USA, United States R9h ago
-
Senior Data Engineer CAD 150K-175KAWS | Amazon Redshift | Apache Airflow | BigQuery | CDCCellphone stipend | Company-Paid Holidays | Dental insurance | Flexible work hours | Health & wellness stipendSenior-level Full TimeRemote - Canada R12h ago
-
Senior Data Engineer USD 190K-224KAWS | Airflow | CDC Pipelines | Change Data Capture | Cloud Data401k matching | Cellphone stipend | Commuter benefits | Family planning benefits | Flexible PTOSenior-level Full TimeRemote U.S. R12h ago
-
Associate Software Engineer – Java (AI First) USD 140K-200KAPI Design | Async Services | CI/CD | CompletableFuture | Concurrent programmingWork from anywhereMid-level Full TimeUnited States R14h ago
-
AI Transformation Lead USD 130K-188KAI Governance | Agentic Frameworks | Amazon Bedrock | Artificial Intelligence | Data Visualization401k | Flexible PTO | Growth opportunities | Medical/Dental/Vision insurance | Open, inclusive cultureSenior-level Full TimeRemote R14h ago
-
Software Engineer - Foundational Services USD 143K-220KAWS | Angular | Distributed Systems | Go | Google CloudFlexible vacation policy | Flexible working hours | Work from anywhereMid-level Full TimeBelgrade, Serbia R14h ago
-
Lead Software Engineer, Foundational Service Team USD 150K-220KAWS | Angular | Cloud infrastructure | Distributed Systems | GoFlexible vacation policy | Flexible working hours | Work from anywhereSenior-level Full TimeBelgrade, Serbia R14h ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | BigQuery | CI/CD | Cloud IAMFlexible work approach | On-call support rotation | Remote-first work environmentSenior-level Full TimeCanada R14h ago
-
Senior Data Engineer USD 105K-120KAPIs | Automated testing | CI/CD | DBT | Data Quality401k | Insurance & Health | Insurance dental | Insurance vision | Life insuranceSenior-level Full TimeRemot, USA, United States R15h ago
-
Senior Algorithms Engineer USD 144K-200KAWS | Bayesian Inference | CI/CD | Code review | Django3-day weekend | 4-day work week | Fully remote within the United States | Mentoring and training | Travel 1 to 3 times per yearSenior-level Full TimeCary, NC, United States R15h ago
-
Gaming Data Engineer USD 62K-68KAPI Integration | Azure Data | Azure Data Factory | Azure Databricks | Azure FabricMid-level Full TimeRemote R15h ago
-
Gaming Data Engineer USD 62K-68KAPI Integration | Automation | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeRemote R15h ago
-
Staff Machine Learning Engineer, Merchants CAD 213K-314KA/B | A/B Testing | B testing | Data labeling | Deep learningSenior-level Full TimeToronto, ON, CA, Remote, Canada R15h ago
-
Staff AI Engineer USD 250K-265KAI Evaluation | CI/CD | Code review | Deep learning | Docker401k retirement savings plan | Dental coverage | Employer-sponsored healthcare | Flexible spending account | Health savings accountSenior-level Full TimeRemote, USA R16h ago
-
Backend Development | Cause analysis | ClickHouse | Cloud Native | Data IntegrityEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, US R16h ago
-
Sr. Machine Learning Software Engineer USD 153K-206KAWS | Airflow | Amazon EC2 | Amazon S3 | Amazon SageMakerAccess to office locations | Remote work option | Travel for team meetings and cross functional projectsSenior-level Full TimeDenver, Colorado, United States; New York, … R16h ago
-
Sr. Full-Stack Engineer, AI Data Platform USD 180K-260KAWS DynamoDB | Cassandra | Cloud platform | Google Cloud | Google Cloud PlatformHybrid work scheduleSenior-level Full TimeSan Francisco Bay Area R17h ago
-
Data Management Engineer OnPrem ETL Sr MXN 216K-216KAb Initio | Autosys | Batch Processing | Code optimization | Configuration ManagementMid-level Full Timemexico R17h ago
-
Data Management Engineer OnPrem ETL Ex MXN 432K-480KAb Initio | Agile | Data Governance | Data Lake | Data QualityHybrid workMid-level Full Timemexico R17h ago
-
Data Management Engineer OnPrem ETL Pr MXN 336K-336KAb Initio | Autosys | Batch Processing | Code review | Data QualityHybrid work location | Technical support and incident management exposureMid-level Full TimeMexico R17h ago
-
Senior Machine Learning Engineer (Computer Vision) USD 160K-214KAWS | Azure | CI/CD | Computer Vision | Deep learningAnnual company retreat | Company-wide winter break | Education bonus | Equity participation | Optional in person events and meetupsSenior-level Full TimeLatin America R19h ago