Lead Data Engineer, AI
California - San Francisco, United States
USD 172K-285K Senior-level Full Time
Tasks
- Architect agentic retrieval layer
- Automate data delivery pipeline
- Build embedding pipelines
- Build inference infrastructure
- Collaborate with product managers
- Define technical roadmap for agentic retrieval
- Design search and retrieval systems
- Develop attribution modeling
- Develop causal modeling
- Enforce data latency standards
- Enforce data quality standards
- Integrate data delivery with AI orchestration layer
- Integrate internal databases and third party APIs
- Mentor data and AI engineers
- Monitor index freshness
- Translate business requirements into production solutions
Perks/Benefits
- 401k
- Dental insurance
- Employee stock purchase program
- Life and disability insurance
- Medical insurance
- Mental health support
- Paid parental leave
- Time off programs
- Vision insurance
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Spark | DBT | Data Modeling | Data Quality | Data Warehousing | Data cloud | ELT | ETL | Embeddings | Google Cloud | Indexing | Informatica | Latency monitoring | Microsoft Azure | NoSQL | Python | Retrieval-Augmented Generation | SQL | Salesforce Data Cloud | Salesforce data | Semantic Search | Vector Databases | Vector Retrieval | Web Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Entry-level Full TimeCary, NC, United States3h ago
-
Apache Spark | Clustering | Data Ingestion | Data Ingestion Pipelines | Data ModelingSenior-level ContractLos Angeles, United States3h ago
-
Cloud Computing | Data Pipelines | Experimental Design | Java | Machine LearningCommunity volunteering | Internal mobility | Learning opportunities | Mentorship programs | Recognition programsMid-level Full TimeAustin, TX, United States3h ago
-
Senior-level Full TimeAustin, TX, United States3h ago
-
Data Analysis | Distributed Systems | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeSan Jose, California, United States5h ago
-
Apache Spark | Computer Vision | Data Curation | Data Pipelines | GroundingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …6h ago
-
AIPS | API Standards | Apigee | Authentication | Best practicesSenior-level Full TimeSeattle, WA, USA; Goleta, CA, USA6h ago
-
Computer Vision | Data Preparation | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA6h ago
-
Senior Software Engineer, AI Powered GRC Automation USD 174K-252KContinuous controls monitoring | Controls monitoring | Data Mining | Data Processing | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA6h ago
-
Staff Software Engineer, NotebookLM, Generative AI, Labs USD 207K-300KAlerting | Computer Vision | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA6h ago
-
Systems Development Engineer, Quantum AI USD 138K-198KAutomation | CI/CD | Cloud APIs | Cloud infrastructure | Configuration ManagementMid-level Full TimeGoleta, CA, USA6h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KAlgorithms | C++ | Data Analysis | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA6h ago
-
Senior-level Full TimeUnited States8h ago
-
AI/ML Engineer USD 117K-171KA/B | A/B Testing | API Development | AWS | B testingDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US9h ago
-
Cloud Data Engineer USD 92K-113KAgile | Apache Airflow | Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 4935510h ago
-
AWS | Azure | Cloud platform | Data Pipelines | Demand forecastingOnsite collaborationSenior-level Full TimeLewisville, TX, US14h ago
-
Forward Deployed Machine Learning Engineer USD 180K-300KAPI Design | Cloud Computing | Deep learning | Diffusion Models | Fine TuningIn-person collaboration days | Remote work flexibility | Travel cost coverageSenior-level Full TimeSan Francisco (USA) R16h ago
-
Senior ML Engineer, Fauna USD 184K-250KComputer Vision | Data Quality | Distributed Training | Edge Deployment | Evaluation PipelinesSenior-level Full TimeNew York, New York, USA17h ago
-
Forward Deployment Engineer - Gen AI USD 162K-224KAWS Bedrock | AWS SageMaker | Autogen | Azure OpenAI | ChromaCareer development opportunities | Individual responsibility | Travel to client sitesMid-level Full TimeNew York, New York, United States17h ago
-
Computer Vision | Experiment design | Experiment tracking | Generative AI | Image ProcessingSenior-level Full TimeAEP Headquarters, United States17h ago
-
Analytics & AI Strategic Reasoning SME USD 141K-160KAgentic AI | Artificial Intelligence | Dashboard Development | Data Synthesis | Data TaxonomyOn-site workSenior-level Full TimeNorfolk, VA17h ago
-
Senior Software Engineer - Platform & MLOps USD 152K-230KAWS | Azure | CI/CD | Datadog | DockerDiscretionary incentive plan | Flexible work policy | Learning and development access | Medical benefitsSenior-level Full TimeSeattle, Washington, United States - Remote R17h ago
-
Data Engineer USD 84K-101KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCharity donation matching | Digital course library | Employee assistance program | Mindfulness program | Volunteer hours matching programMid-level Full TimeIndia Pune (Mississippi Building)17h ago
-
Lead Software Engineer (Python, LLM) - AskGartner USD 116K-170KAWS | AWS EMR | AWS Glue | AWS Kinesis | AWS QuickSight20 plus PTO days | 401k match | Collaborative culture | Employee assistance program | Employee stock purchase planSenior-level Full TimeIrving - 6011 Connection, United States17h ago
-
APIs | Agent architecture | Embeddings | Inference Serving | LLMDirect technical influence | Early stage equity upside | Fast Moving Engineering Culture | High technical autonomy | Remote workMid-level Full TimeSan Francisco, CA; Onsite R17h ago