Lead Data Engineer, AI
California - San Francisco, United States
USD 172K-285K Senior-level Full Time
Tasks
- Architect agentic retrieval layer
- Automate data delivery pipeline
- Build embedding pipelines
- Build inference infrastructure
- Collaborate with product managers
- Define technical roadmap for agentic retrieval
- Design search and retrieval systems
- Develop attribution modeling
- Develop causal modeling
- Enforce data latency standards
- Enforce data quality standards
- Integrate data delivery with AI orchestration layer
- Integrate internal databases and third party APIs
- Mentor data and AI engineers
- Monitor index freshness
- Translate business requirements into production solutions
Perks/Benefits
- 401k
- Dental insurance
- Employee stock purchase program
- Life and disability insurance
- Medical insurance
- Mental health support
- Paid parental leave
- Time off programs
- Vision insurance
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Spark | DBT | Data Modeling | Data Quality | Data Warehousing | Data cloud | ELT | ETL | Embeddings | Google Cloud | Indexing | Informatica | Latency monitoring | Microsoft Azure | NoSQL | Python | Retrieval-Augmented Generation | SQL | Salesforce Data Cloud | Salesforce data | Semantic Search | Vector Databases | Vector Retrieval | Web Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
AI Software Engineer USD 100K-200KDeep learning | Language Models | Large Language Models | Machine Learning | PyTorchMid-level Full TimeSan Francisco, CA, US / Palo …12h ago
-
Senior Confluent Kafka Lead USD 140K-213KAWS | Access Control | Access Control Lists | Apache Kafka | AvroSenior-level Full TimeColumbus, United States13h ago
-
Software Development Engineer - AI/LLM Network - Global Frontier Tech Research Program - 2027 Start USD 202K-368KC++ | Cause analysis | Fault Localization | High Availability | LinuxEntry-level Full TimeSeattle, Washington, United States13h ago
-
Causal Inference | Cross-modal fusion | Data Modeling | Direct Preference Optimization | Graph Neural NetworksEntry-level Full TimeSeattle, Washington, United States14h ago
-
Machine Learning Engineer Intern (E-commerce Governance Algorithms) - 2026 Summer (BS/MS) USD 122K-246KAlgorithm Design | Fraud Detection | Machine Learning | Python | Risk AssessmentDevelopment workshops | Hands-on experience | Industry exposure | Social eventsEntry-level InternshipSeattle, Washington, United States14h ago
-
Artificial Intelligence | Big Data | Data Processing | Distributed Systems | High PerformanceEntry-level InternshipSan Jose, California, United States14h ago
-
Senior Data Engineer, YouTube Data Science USD 156K-226KApache Flume | Apache Spark | Automation | Business Intelligence | ComplianceSenior-level Full TimeSan Bruno, CA, USA15h ago
-
Staff Software Engineer, YouTube Data Science USD 207K-300KBig Data | Data Structures | Data Structures and Algorithms | Data analytics | Distributed ComputingSenior-level Full TimeSan Bruno, CA, USA15h ago
-
Software Engineer III, BigLake OSS USD 147K-211KApache Arrow | Apache Iceberg | Apache Spark | C++ | Data StorageSenior-level Full TimeSeattle, WA, USA15h ago
-
Senior Machine Learning Engineer USD 160K-250KCaching | Cloud Platforms | GPU Computing | Kubernetes | LLM InferenceSenior-level Full TimeIsrael, center, IL15h ago
-
ADLS Gen2 | API Gateway | AppDynamics | Autoscaling | AzurePaid time offSenior-level Full TimeAddison, United States1d ago
-
Senior Data Engineer USD 113K-188KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage401k retirement plan | Adoption Assistance | Employee referral program | Health savings account | Parental leaveSenior-level Full TimeGH Office: San Antonio, TX (9903 …1d ago
-
Principal Associate, Data Scientist - Innovation Hub USD 147K-184KAWS | Apache Spark | Conda | Generative AI | H2OSenior-level Full TimeMcLean, VA, United States1d ago
-
Commercial Analytics - Senior Associate USD 80K-150KBigQuery | Hadoop | Microsoft Excel | Microsoft PowerPoint | Power BIEmployee benefits | Flexible work environment | Home-based option | Incentive eligibilitySenior-level Full Time127 Public Square, Cleveland, OH, United … R1d ago
-
Sr. Data Engineers USD 158K-173KData Mining | Data Modeling | Feature Selection | Language Processing | Machine Learning401k match | Healthcare benefits | Life insurance | Paid disability | Paid time offSenior-level Full TimeCA - Irvine, HQ, United States1d ago
-
Feature Lead - Technology - GenAI Platform USD 106K-173KArchitecture | Asynchronous programming | Authentication and Authorization | Automation | CI/CDPaid time offSenior-level Full TimeJersey City, United States1d ago
-
Feature Lead - GenAI Team USD 106K-173KAgentic Retrieval Augmented Generation | Agile | Automation | Data Ingestion | Data ProcessingEmployee support resources | Paid time offSenior-level Full TimeNew York, United States1d ago
-
Entry-level Full TimeWellesley-93 Worcester St, United States1d ago
-
Data Scientist USD 75K-90KADaM | Airflow | Dash | Data Analysis | DjangoContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageMid-level Full TimeUS - NY NYC - 55 …1d ago
-
Staff Machine Learning Engineer, Agentic Systems USD 155K-235KAgentic Systems | Benchmarking | C++ | Distributed Systems | Evaluation401k | Annual bonus | Dental insurance | Medical insurance | Paid time offSenior-level Full TimeWaltham Office (POST), United States1d ago
-
Senior Engineer - GenAI Engineering USD 113K-188KGenerative AI | Git | Hugging Face | Language Models | Language ProcessingDisability benefits | Employee assistance program | Health Coach | Life insurance | Paid HolidaysSenior-level Full TimeCambridge, United States1d ago
-
Senior Engineer - GenAI Engineering USD 113K-188KGit | Hugging Face | LLM | Language Processing | Machine LearningDisability benefits | Employee assistance program | Health Coach access | Life insurance | Paid HolidaysSenior-level Full TimeCambridge, United States1d ago
-
Principal AI Engineer - New Glenn Manufacturing USD 164K-230KAWS | Algorithms | Anomaly Detection | C# | C++401k match | Dental insurance | Education Support Program | Life insurance | Long-term disabilitySenior-level Full TimeFL - The Factory at Rocket …1d ago
-
Senior GenAI Engineer USD 90K-189K.NET | AWS | Agno | Amazon Bedrock | Anthropic APIContinuing education | Flexible time off | Healthcare | Learning and development resources | Retirement benefitsSenior-level Full Time999 REMOTE, United States R1d ago
-
Senior-level Full TimeOne Pennsylvania Plaza, 26th Floor, New …1d ago