Director, Data Engineering (Google Cloud Platform)
Tasks
- Build real time data streaming ingestion pipelines
- Build vector search infrastructure
- Define GCP data engineering technical vision
- Deploy BigQuery Dataflow Dataproc PubSub Dataplex and Cloud Storage
- Design production data pipelines for machine learning
- Drive talent acquisition and performance management
- Enable BigQuery ML workflows
- Establish data governance, security, and compliance frameworks
- Execute data modeling ingestion and lakehouse standards
- Implement CI CD for data platforms
- Implement continuous data testing and automated monitoring
- Implement retrieval-augmented generation frameworks
- Lead pre sales workshops and solution delivery
- Manage data lineage metadata and access control
- Mentor and scale agile data engineering team
- Oversee enterprise data platform design and deployment
- Provide GCP data subject matter expertise for client engagements
- Set up infrastructure as code with Terraform
Perks/Benefits
- Financial benefits
- Income protection benefits
- Medical/Dental/Vision insurance
- Paid time off
- Tax-advantaged health care accounts
- Wellness time off
Skills/Tech-stack
Agent platform | Apache Beam | BigQuery | BigQuery ML | CI/CD | Cloud Storage | Cloud platform | Column-Level Security | Data Governance | Data Lineage | Data Modeling | Dataflow | Dataplex | Dataproc | ELT | ETL | Gemini Enterprise | Gemini Enterprise Agent Platform | Google Cloud | Google Cloud Platform | IAM | KMS | Knowledge Catalog | LLM | Lakehouse | PubSub | PySpark | Python | Real Time | Real-time Streaming | Retrieval-Augmented Generation | Row Level Security | SQL | Terraform | Vector Search | Vertex AI
Related jobs
-
Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake StorageHands-on project experience | Mentorship from engineers | Onsite work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US11h ago
-
Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsLearning opportunities | Mentorship | On site work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US11h ago
-
Director, Test & Evaluation - Robotics USD 220K-292KAerial systems | C++ | CI/CD | Data Analysis | Data ProcessingHealth and wellness benefits | Travel to test sitesExecutive-level Full TimeCosta Mesa, California, United States17h ago
-
Senior-level Full TimeMiami, United States R1d ago
-
Manager, Data Engineering USD 200K-335KApache Airflow | Apache NiFi | Apache Spark | BigQuery | Cloud platformSenior-level Full TimeUS - San Francisco R1d ago
-
Data Engineering Lead USD 174K-220KAmazon Redshift | BI reporting | DBT | Data Modeling | Data Monitoring401k | Health coverage | Hybrid work environment | Paid parental leave | Paid time offSenior-level Full TimeNew York R1d ago
-
Enterprise Data Architect Internship USD 40K-60KApplication Programming | Application Programming Interfaces | Artificial Intelligence | Cloud Computing | Data CatalogCompany-sponsored events | Hybrid work schedule | Intern socials | Mental health advocate services | MentorshipEntry-level InternshipColumbus, IN, United States1d ago
-
Engineering Manager, Data Transformation USD 214K-321KAirflow | Amazon S3 | Flink SQL | GRPC | HiveMid-level Full TimeUS-SEA, US-SF, US-NYC, US-Remote R1d ago
-
Exec Director -BI, Data Platforms, and Applied AI USD 120K-130KAPI Design | Artificial Intelligence | Automated testing | Business Intelligence | CI/CDExecutive-level Full TimeAlbany, New York, United States1d ago
-
Director of Analytics- Attribution & Performance USD 140K-165KAttribution | Benchmarking | Econometrics | Experimental Design | Geo-testingExecutive-level Full TimeEl Segundo, CA1d ago
-
Director of Analytics- Outcomes & Experimentation USD 140K-200KBigQuery | Cause analysis | Cloud Computing | Data Governance | Data ModelingExecutive-level Full TimeEl Segundo, CA1d ago
-
Engineering Manager, Data Platform USD 290K-330KAWS | Apache Airflow | Apache Spark | DBT | Data Ingestion401k | Commuter benefits | Employee assistance program | Free Lunches | Medical/Dental/Vision insuranceMid-level Full TimeSan Francisco, CA R2d ago
-
Team Lead – Data Warehouse & Decision Support USD 132K-166KApache Spark | Azure Data | Azure Data Governance | Data Governance | Data ModelingCell phone reimbursement | Disability coverage | Employee assistance program | Insurance coverage | Matching charitable gift programSenior-level Full TimeDallas, Texas, United States2d ago
-
Client Stakeholder Management | Competitive Analysis | Content Gap Analysis | Content audit | ECommerce SEOEmployee benefits | Hybrid work modelMid-level Full TimeKansas City, Missouri, United States2d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States2d ago
-
Apache Airflow | Apache Beam | Apache Flink | Apache Iceberg | Apache KafkaHealth and wellness | Meals provided | Paid parental leave | Team offsites | Unlimited paid time offSenior-level Full TimeSan Francisco, CA2d ago
-
Places Data and ML Director USD 262K-342KAlgorithms | Computer Vision | Data Mining | Databases | Deep learningExecutive-level Full TimeCupertino2d ago
-
Data Engineer USD 120K-165KAccess Management | Agile | Bamboo | BigQuery | Cloud StorageBonus opportunitiesSenior-level Full TimeAustin, TX, United States2d ago
-
Data Governance and Analytics Architecture Director USD 150K-200KAI/ML | Architecture standards | BI platforms | Business Intelligence | Cloud analytics401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceExecutive-level Full TimeRemote, United States R2d ago
-
Senior Manager, AI Software Engineering USD 177K-220KAWS | Agile | Automated testing | CI/CD | Claude401k match | Dental insurance | Family benefits | Flexible time off | Hybrid work modelSenior-level Full TimeAtlanta, GA R2d ago
-
Group Director, Analytics-First Party Data & Loyalty USD 100K-230KAdobe Real-Time CDP | Audience Management | Consent Management | Customer Data | Customer Data PlatformExecutive-level Full TimeDetroit, Michigan, United States; New York, …2d ago
-
AWS | Access Control | Application Security | Auditability | Configuration Management401k match | Dental insurance | Life insurance | Long-term disability insurance | Paid leaveSenior-level Full TimeHuntsville, AL2d ago
-
Director, Business Analytics and Planning USD 110K-155KAnalytics frameworks | Business Intelligence | Data Analysis | Data Governance | Digital TransformationExecutive-level Full TimeMain campus - Malaysia2d ago
-
Sr Manager Analytics Engineer USD 157K-235KAirflow | Anomaly Detection | Apache Spark | Data Architecture | Data Compliance401k plan | Bonus eligible | Disability benefits | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeWest Hollywood, CA, US, 900692d ago
-
Director, People Analytics USD 141K-204KAnalytics | Data Integrity | Data Management | Data reporting | Hypothesis Testing401k match | Backup child and elder care | Dental insurance | EAP counseling | Family ResourcesExecutive-level Full Time09510 - Washington Remote, United States R2d ago