Data Engineering Team Lead
Tasks
- Aggregate features using Scala
- Build feature store for machine learning
- Build real time bidding data infrastructure
- Conduct code reviews
- Coordinate with infrastructure team on DAG execution
- Create Spark pipelines for ML inference
- Design scalable data pipelines
- Develop data quality observability frameworks
- Enforce data privacy and security policies
- Implement automated data testing and validation
- Lead data engineering teams
- Manage data pipeline lifecycle
- Monitor global production deployments
- Orchestrate workflows with Apache Airflow
- Partner with executives on machine learning roadmaps
- Troubleshoot distributed system incidents
Perks/Benefits
- Dental insurance
- Health insurance
- Learning and training
- Medical benefits
- Travel opportunities
- Vision insurance
Skills/Tech-stack
AWS | Amazon Athena | Amazon EC2 | Amazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Bash | Batch Processing | Cause analysis | Data Governance | Data Observability | Data Privacy | Data Quality | Data Security | Distributed Systems | Docker | Feature Store | Git | Jenkins | Jira | Kubernetes | MySQL | Python | Redis | Root Cause Analysis | Root cause | SQL | Scala | Streaming Data
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Software Engineer, Machine Learning GBP 100K-130KData Structures | Data structures algorithms | Graph theory | Information Retrieval | Language ProcessingSenior-level Full TimeLondon, UK1h ago
-
Software Engineer, Infrastructure GBP 180K-225KAI | Agent Orchestration | Bias Mitigation | C# | C++Senior-level Full TimeZurich, Switzerland | Tel Aviv, Israel …1h ago
-
Senior-level Full TimeLondon, UK1h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …1h ago
-
AI/HPC Network Performance Engineer USD 147K-226KAI Training | Alerting | Auto-remediation | C++ | Configuration ManagementOncall rotationSenior-level Full TimeMenlo Park, CA1h ago
-
Senior-level Full TimeLondon, UK1h ago
-
Forward Deployed Engineering Manager, Gen AI, Manufacturing and Conglomerate, Google Cloud INR 2000K-5000KAgent systems | Artificial Intelligence | Artificial Intelligence Production Systems | Cloud Computing | Google CloudSenior-level Full TimeMumbai, Maharashtra, India1h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …1h ago
-
Mid-level Full TimeBangalore, Karnataka, India; Hyderabad, Telangana, India2h ago
-
Forward Deployed Engineering Manager, GenAI, FSI Google Cloud INR 2000K-5000KAgent systems | Artificial Intelligence | Cloud Computing | Data Sovereignty | Foundation ModelsSenior-level Full TimeMumbai, Maharashtra, India2h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA2h ago
-
AI Customer Engineer, Telecommunications, Google Cloud SGD 160K-220KAI Agent Development Kit | Agent Development Kit | As-a-Service | Audit Logging | Cloud NetworkingConference participation | Travel opportunitiesSenior-level Full TimeSingapore2h ago
-
Product Manager, Responsible AI Infra USD 163K-237KAI Evaluation | Artificial Intelligence | Automated compliance | Compliance | Data GovernanceMid-level Full TimeMountain View, CA, USA2h ago
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-5000KAPIs | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeMumbai, Maharashtra, India2h ago
-
Data Processing | Data orchestration | Data pipeline | Data pipeline management | Dataset ManagementExecutive-level Full TimeSan Jose, CA, USA2h ago
-
Staff Forward Deployed Engineer, GenAI, Google Cloud PLN 480K-492KAPIs | Agent Frameworks | Agent systems | Cloud platform | CrewAISenior-level Full TimeWarsaw, Poland2h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA2h ago
-
Software Engineering Manager II, AI/ML, Google Cloud USD 207K-301KC# | C++ | Cloud platform | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Data Filtering | Data Processing | Data debugging | Deep learning | Distributed ComputingSenior-level Full TimeLondon, UK2h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA2h ago
-
AI Customer Engineer, Manufacturing, Google Cloud USD 207K-301KAI Agent Development Kit | Agent Development Kit | As-a-Service | Audit Logging | Cloud NetworkingConference attendance | Travel opportunitiesSenior-level Full TimeMumbai, Maharashtra, India2h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA2h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA2h ago