Senior Data Engineer (GCP / AI Platform)
Tasks
- Build analytics platform on GCP
- Build embeddings and retrieval substrate
- Create ELT CDC pipelines from Postgres
- Design data warehouse ingestion transformation orchestration
- Ensure data governance validation lineage observability PII controls
- Establish data CI CD and automated testing
- Implement dbt transformations
- Implement vector storage for RAG
- Model dimensional data and semantic metrics layer
- Set up data orchestration workflows
Perks/Benefits
- Additional holidays
- Dental coverage
- Employee referral bonuses
- Free parking
- Hybrid work
- Multisport card
- Private health insurance
- Remote work
- Sponsored certifications
- Sponsored training
Skills/Tech-stack
AI vector search | Apache Airflow | BigQuery | CDC | Cloud Composer | Cloud DataStream | Cloud Dataflow | Cloud Pub/Sub | Cloud Storage | Cloud platform | DBT | Dagster | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Validation | Dimensional Modeling | ELT | ETL | Embeddings | Google Cloud | Google Cloud Platform | PGVector | PII compliance | Pinecone | PostgreSQL | Pub/Sub | Python | RAG | Retrieval-Augmented Generation | SQL | Semantic layer | Vector Databases | Vector Search | Vertex AI | Vertex AI Vector Search
Education
N/A
Roles
Related jobs
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R10d ago
-
AWS | Airflow | DBT | Fine Tuning | Language ModelsBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R7h ago
-
Efs Fcrm 169474 INR 1500K-2400KApache Spark | Azure DevOps | CI/CD | Data Partitioning | Data WarehousingMid-level Full TimeHyderabad, IND-TG, India9h ago
-
Azure AI Developer Consultant NZD 138K-170K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work environment | Opportunity for customer site attendance when required | Split work between home and officeSenior-level Full TimeAuckland, Auckland, NZ10h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States10h ago
-
Data Engineer Sr. BRL 235K-396KAmazon Redshift | Data Modeling | Data Pipelines | Data Storytelling | Data VisualizationRemote work | Work-life balance flexibilitySenior-level Full TimeRemote, Brazil R11h ago
-
AI Agents | Ansible | Azure | Azure DevOps | CI/CDContinuous learning | Knowledge sharing | Professional growth | Technical leadershipSenior-level Full TimeAmsterdam, Netherlands11h ago
-
Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CDMid-level Full TimeAmsterdam, Netherlands11h ago
-
.NET | APIs | Automation | Azure DevOps | C#Senior-level Full TimeAmsterdam, Netherlands11h ago
-
Senior DBA - PostgreSQL, RDS & DevOps Tooling USD 125K-180KAWS Aurora | AWS Aurora PostgreSQL | AWS CloudWatch | AWS CloudWatch Insights | AWS RDSFlexible off hours maintenance availability | Remote workSenior-level Full TimeRemote R11h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD11h ago
-
Senior Database Engineer - #3190 (Remote) INR 1500K-2700KAWS IAM | AWS KMS | AWS RDS | Amazon Aurora | BashOn-call rotation | Remote workSenior-level Full TimeChennai, India R12h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon12h ago
-
AI-assisted software development | AWS | Agentic AI | Azure | Cloud ComputingSenior-level Full TimeUSA-VA-Herndon12h ago
-
A/B | A/B Testing | AI Search | Azure | Azure AIFlexible working hours | Modern office | Multisport card | Private medical care | Unlimited access to Microsoft technologyMid-level ContractRemote R12h ago
-
CRM Integration | Claude API | Docker | Event Driven | Event-driven architectureSenior-level Full TimeCape Town, South Africa12h ago
-
Access Control | Compliance | Data Governance | Data Lineage | Data ModelingAgile team collaborationMid-level Full TimeCape Town, South Africa12h ago
-
Software Engineer SRE (Site Reliability Engineer) INR 1600K-3000KAWS | Ansible | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India Office (BANGALORE) R12h ago
-
API Development | AWS | Amazon SageMaker | CI/CD | Cloud platformAnnual leave | Employee referral program | HMO coverage | Night differential pay | Remote workSenior-level Full TimeRemote R12h ago
-
Mid-level Full TimeZhuhai, Guangdong12h ago
-
Analytics Engineer USD 115K-150KAgile | Azure DevOps | CI/CD | DBT | Data GovernanceAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountMid-level Full TimeHouston, Texas | Tulsa, Oklahoma | …12h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …12h ago
-
Senior Data Engineer (Azure) ZAR 875K-1170KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryIndependent work environment | Remote work | Stakeholder engagementSenior-level ContractJohannesburg, South Africa12h ago
-
Data & Analytics Specialist USD 87K-135KAPI Integration | Alteryx | DAX | JavaScript | Power AppsAdoption Assistance | Educational assistance | Flexible spending account | Health savings account | Life insuranceMid-level Full TimeWichita, Kansas12h ago
-
Anthropic API | AutoGluon | CUDA | CatBoost | Cloud platformRemote workMid-level Full TimeRemote R13h ago