Google Cloud Lead Data Engineer (GCP)
Tasks
- Apply cloud security best practices with IAM
- Automate data validation and testing
- Build and maintain data pipelines
- Build data models with dimensional modeling and data vault
- Create documentation and architectural diagrams
- Design ETL/ELT pipelines
- Develop batch and streaming data processing
- Gather requirements and create technical designs
- Implement data quality frameworks
- Implement data solutions with GCP services
- Implement monitoring and cost management
- Manage data versioning governance and lineage
- Optimize pipeline performance cost and scalability
- Provide technical guidance and best practices
- Use Unity Catalog or Data Catalog for governance
Perks/Benefits
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Retirement savings plans
Skills/Tech-stack
Apache Spark | Automated testing | Azure DevOps | BigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | DBT | Data Architecture | Data Catalog | Data Governance | Data Modeling | Data Quality | Data Vault | Data Warehousing | Databricks | Dataflow | Dataproc | Delta Lake | Dimensional Modeling | Distributed Systems | ELT | ETL | GCP Data | GCP Data Catalog | GitHub | GitLab | Google Cloud | Google Cloud Platform | Great Expectations | IAM | Infrastructure as Code | PySpark | Python | SQL | Spark Streaming | Terraform | Unity Catalog | Vertex AI | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AWS | Agentic AI | Angular | CI/CD | DatabricksHybrid work | Technical mentorshipSenior-level Full TimeNormal, United States3h ago
-
Sr. Data Engineer USD 108K-158KAWS | Apache Spark | Automated testing | Azure Event | Azure Event Hubs401k matching | Dental insurance | Disability insurance | Educational growth | Employee discount programSenior-level Full TimeNew York-TONAWANDA4h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 212K-450KCUDA | Deep learning | Distributed Systems | GPU Performance | GPU Performance OptimizationEntry-level Full TimeSan Jose, California, United States4h ago
-
Artificial Intelligence | Data Modeling | Data Pipelines | Data Quality | Data Visualization401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York4h ago
-
Backup and Restore | Blob Storage | Cluster communication | Cluster management | Crash diagnosticsSenior-level Full TimeSan Jose, California, United States4h ago
-
AWS | AWS SDK | Amazon MSK | Apache Kafka | Generative AISenior-level Full TimeNew York, New York, United States5h ago
-
Production Engineer USD 178K-200KApache | Apache Spark | Application Programming | Application Programming Interfaces | C++Entry-level Full TimeMenlo Park, CA5h ago
-
Research Engineer - MSL FAIR Foundations USD 117K-173KBenchmarking | Code review | Data Pipelines | Distributed Systems | Language ModelEntry-level Full TimeMenlo Park, CA5h ago
-
AI Model Serving | AI model | Benchmarking | Cache Management | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
Staff Software Engineer, AI Data Generation Platform USD 207K-300KComputer Vision | Data Engineering | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA5h ago
-
C plus plus | C++ | Cloud Spanner | Cloud Storage | Cloud platformSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Staff Software Engineer, Agentic Data and Evals USD 207K-300KC++ | CSS | Cloud | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA5h ago
-
.NET | App Service | Azure | Azure App | Azure App ServiceDental insurance | Employee assistance plan | Group medical insurance | Gym reimbursement | Health savings accountSenior-level Full TimeBoston, United States6h ago
-
Senior Data Engineer USD 155K-180KAWS | Agile | Alerting | Azure | Bash401k savings plan | Dental insurance | Employee assistance plan | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States7h ago
-
Data Engineer USD 118K-125KAWS | Agile | Apache Spark | Azure | Bash401k savings plan with profit sharing | Commuter parking tax savings | Employee assistance program | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States7h ago
-
Senior GenAI Engineer USD 119K-258KAI Foundry | AI Search | API Management | AWS Bedrock | Active DirectorySenior-level Full TimeMiami, FL, US, 3313110h ago
-
Software Engineer, Applied AI USD 130K-500KData Pipelines | Data Quality | Evaluation Frameworks | Experimental Design | GoDental insurance | Equity grant | Free Equinox Membership | Health insurance | Housing bonusMid-level Full TimeSan Francisco10h ago
-
Staff Machine Learning Engineer USD 188K-221KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R13h ago
-
Staff Software Engineer, Data & AI USD 183K-214KAWS | Airflow | Analytics | Artificial Intelligence | BI AnalyticsSenior-level Full TimeCA - San Francisco; WA - …14h ago
-
ASR | Automatic Speech Recognition | CTC | Data Augmentation | Knowledge Distillation401k matching | Annual offsites | Dental insurance | Free snacks and drinks | Health insuranceSenior-level Full TimeSan Francisco, CA15h ago
-
Application Software Engineer, Data USD 150K-225KAngular | C# | CI/CD | Continuous integration | DeploymentSenior-level Full TimeStarbase, TX16h ago
-
Deployed Engineer (Denver) USD 150K-250KAI Agent | AI agent deployment | AWS | Agent deployment | Agent-based401-k plan | Dental coverage | Flexible vacation | Meals on in office days | Medical coverageSenior-level Full TimeDenver, CO16h ago
-
Deployed Engineer (Las Vegas) USD 150K-250KAWS | Azure | Docker | Failure handling | GCP401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimeLas Vegas, NV16h ago
-
Deployed Engineer (Phoenix) USD 150K-250KAWS | Agent Frameworks | Azure | Cloud Computing | Containers401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimePhoenix, AZ16h ago
-
Full Stack AI Developer USD 146K-222KAgile | Angular | Auto-tagging | CI/CD | Chunking401k | Education reimbursement program | Flexible schedule | Hybrid schedule | MentorshipSenior-level Full TimeLivermore, CA, United States R16h ago