Lead Data Engineer - GCP Data Architect
Tasks
- Contribute to infrastructure automation and DevOps and CI CD best practices
- Design data architectures with BigQuery Dataflow and Pub Sub
- Design scalable secure cost effective data platforms on Google Cloud Platform
- Develop and optimize enterprise ETL ELT pipelines
- Lead development of batch and real time data ingestion and processing
- Participate in architecture reviews and code reviews
- Provide architectural guidance for data modeling storage governance performance scalability
- Support cloud native deployment patterns with Cloud Run and GKE
- Troubleshoot and optimize data processing workloads and platform performance
Perks/Benefits
- Company-Paid Holidays
- Employee assistance programs
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Retirement savings plans
- Sick leave
Skills/Tech-stack
Batch Processing | BigQuery | CI/CD | Cloud Run | Cloud platform | Data Pipeline Architecture | Data pipeline | Dataflow | DevOps | Distributed Systems | ELT | ETL | GKE | Google Cloud | Google Cloud Platform | Kubernetes | Pipeline architecture | Pub/Sub | Python | Streaming processing
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R14d ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R7h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | APIs | Automation | Backend Development | IntegrationDirect impact on company growth | Equity | Hybrid work | Significant ownership | Unlimited PTOMid-level Full TimeKing of Prussia, PA, United States R8h ago
-
Staff Machine Learning Engineer, Foundation - Seattle USD 208K-298KAWS | Accelerate | Azure | C++ | DeepSpeedExperience bonus | Hybrid work model | QGroup communities | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States8h ago
-
Active Learning | DPO | Data Privacy | Deep learning | Few-Shot Learning401k match | Family leave | Flexible time away | Health plansSenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
API Design | Bottleneck analysis | Debugging | Distributed Systems | Generative AI401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Staff Machine Learning Engineer, Agentic App Platform USD 176K-308KAPI Design | Debugging | Distributed Systems | Generative AI | Language Models401k plan with company match | ESPP | Family leave | Flexible time away | Health plansSenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Machine Learning Engineer, Agentic Application USD 139K-216KAPI Design | Distributed Systems | Generative AI | Language Models | Language Processing401k match | ESPP | Family leave | Flexible spending account | Flexible time offEntry-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
C++ | DistributedTraining | ETL | Go | Huggingface401k matching | ESPP | Family leave | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
C++ | Distributed Training | ETL Pipelines | Go | Hugging Face401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Abstractive summarization | Active Learning | DPO | Few-Shot Learning | Few-shotFlexible work persona | Remote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Senior Machine Learning Engineer USD 203K-267KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data PipelinesExperience bonus | Hybrid work model | Mental health benefits | Unlimited sick days | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States9h ago
-
Machine Learning Engineer II USD 167K-220KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data CleansingExperience bonus | Hybrid work model | Mental health benefits | QGroup communities | Unlimited sick daysMid-level Full TimeSeattle, Washington, United States9h ago
-
AI/ML Engineer USD 67K-114KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Cloud platform401k company match | Company paid disability plans | Company paid life insurance | Company-provided tools | Diversity and inclusionEntry-level Full TimeAnniston, Alabama, United States10h ago
-
Machine Learning Engineer USD 155K-228KAWS | Airflow | Argo CD | Azure | CI/CDGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeMid-level Full TimeRemote - US R11h ago
-
Data Visualization Engineer - Advanced Engineering USD 74K-125KAccess Control | Alarm Prioritization | Change Management | Client-Server | CybersecurityMid-level Full TimeHeath, OH, United States13h ago
-
Associate AI Software Engineer USD 65K-100KAgile | Confluence | Data Analysis | Data Modeling | Data Visualization401k company match | Adoption Assistance | DailyPay | Dental insurance | Disability insuranceMid-level Full TimeSt. Louis Park, MN, United States13h ago
-
Intern, AI/ML Engineer (Fall 2026) USD 36K-40KArtificial Intelligence | Automation | CI/CD | Machine Learning | Python401k matching | Educational assistance | Employee stock purchase plan | Housing stipend | Paid HolidaysEntry-level InternshipTampa, Florida, United States13h ago
-
Sr. Databricks Solutions Architect USD 175K-247KAWS | Apache Spark | Azure | Cloud platform | Data ComplianceTravel up to 30 percentSenior-level Full TimeREDSTONE ARSENAL, AL, United States14h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R14h ago
-
Senior-level Full TimeWork from home, VA, United States R14h ago
-
Scientific Computing and Data Management SME USD 150K-185KAgile | Data Lifecycle Management | Data Security | Data lifecycle | DevOpsPublic Trust Clearance | Remote work | Security clearance based access | Travel as neededSenior-level Full TimeWork from home, VA, United States R14h ago
-
Data Engineer USD 145K-160KAWS | AWS Glue | Apache Airflow | Apache Spark | Data QualityContract award contingent | Hybrid work | Public trust clearance support | Technical documentation updates | Travel 15 percent or lessMid-level Full TimeFAIRFAX, VA, United States14h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R14h ago
-
Mid-level Full TimeFAIRFAX, VA, United States14h ago