Lead AI Engineer, Data Solutions
California - San Francisco, United States
USD 172K-285K Senior-level Full Time
Tasks
- Build Python services and APIs for agent workflows
- Build and deploy ML models
- Build offline and online evaluation frameworks
- Build pipelines for agent trace datasets
- Create evaluation datasets golden traces and regression test sets
- Design AI agents with LLM reasoning tool usage and ML decisioning
- Design feedback loops for agent improvement
- Design scalable data pipelines for batch and near real time
- Drive continuous improvement via prompting policies model selection and fine tuning
- Enable continuous retraining and evaluation
- Ensure data quality, consistency, and reliability
- Ensure reliability, observability, and performance
- Integrate models and agents into business workflows
- Orchestrate multi step reasoning and structured outputs
- Run A B experiments and track quality revenue impact and latency
- Track engagement conversion quality metrics
- Transform raw interaction data into features labels and datasets
- Use production signals for continuous optimization
Perks/Benefits
- 401k
- Employee stock purchasing program
- Life and disability insurance
- Medical/Dental/Vision insurance
- Mental health support
- Paid parental leave
- Time off programs
Skills/Tech-stack
A/B | A/B Testing | API Development | Airflow | B testing | Backend systems | Batch Processing | BigQuery | Classification | Dagster | Data Lineage | Data Pipelines | Data Processing | Data Quality | Deep learning | ELT | ETL | Evaluation Frameworks | Experimentation | Feature Engineering | Fine Tuning | Forecasting | LLM orchestration | LLMOps | Language Models | Language Processing | Large Language Models | Machine Learning | Model Fine-tuning | Natural Language | Natural Language Processing | Prompt engineering | Python | Ranking | Recommendation Systems | Regression testing | Snowflake | Spark | Streaming Data | Streaming data processing | Tool orchestration
Education
N/A
Roles
AI | AI Engineer | Engineer | Lead | Lead AI Engineer
Regions
Countries
States
Related jobs
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAgent Orchestration | Apex | Authentication | Authorization | Context ManagementCompetitive compensation | Education budget | Exciting projects | Fitness budget | Flexible scheduleSenior-level Full TimePort Charlotte, United States22h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAgent Orchestration | Apex | Authentication | Context Management | Data GovernanceFlextime | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeAtlanta, United States22h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAgent Orchestration | Apex | Authentication | Context Management | Data GovernanceFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeBaltimore, United States22h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAI workflows | Agent Orchestration | Agent to Agent | Apex | AuthenticationFlextime | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeMiami, United States22h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAPI contracts | Agent Orchestration | Agent to Agent | Apex | AuthenticationFlexible schedule | Mentorship | Office option | Personalized growth roadmap | Remote work optionSenior-level Full TimeBoston, United States22h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAPI Integration | Agent Orchestration | Apex | Authentication | Context ManagementFlexible schedule | Mentorship | Office options | Professional growth | Remote workSenior-level Full TimeTallahassee, United States22h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAPI Integration | Agent Orchestration | Agent integration | Agent to Agent | Agent to Agent IntegrationFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeIrving, United States22h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAgent Orchestration | Apex | Authentication | Context Management | Data GovernanceFlexible schedule | Flextime | Mentorship | Personalized growth roadmaps | Professional growthSenior-level Full TimeBoca Raton, United States23h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAgent Orchestration | Apex | Architecture Decision | Architecture Decision Records | AuthenticationEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeLos Angeles, United States23h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAgent Orchestration | Agent integrations | Agent to Agent | Agent to Agent integrations | ApexEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeRichmond, United States23h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAPI Contract | API contract management | Agent Orchestration | Apex | AuthenticationEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeHouston, United States23h ago
-
Salesforce AI Integration Architect ID68517 USD 172K-285KAPI contracts | Agent Orchestration | Apex | Authentication | Context ManagementFlexible schedule | Mentorship | Office flexibility | Personalized growth roadmaps | Professional growthSenior-level Full TimeSan Francisco, United States23h ago
-
Databricks Forward Deployed Engineer - GPS USD 97K-162KAPIs | AWS | Agent Bricks | Apache Airflow | Apache SparkMentorship | Professional development | Travel 50 PercentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …1d ago
-
OpenAI Forward Deployed Engineer - GPS USD 97K-163KAPI Integration | AWS | Agents SDK | Airflow | Assistants APIProfessional development | Security clearance support | Travel opportunitiesMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …1d ago
-
Lead Snowflake Forward Deployed Engineer - GPS USD 102K-174KAPI Integration | AWS | Arctic Embed | CI/CD | Cortex AILeadership opportunities | Mentorship | Professional development | Travel opportunities | US government security clearance supportSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …1d ago
-
Data Scientist, Innovation Hub USD 108K-108KAPI Integration | Audit Logging | Azure | CI/CD | Code reviewOn-site childcare | Paid parental leave | Paid time off | Public service loan forgiveness | Retirement programsMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd1d ago
-
Lead AI Operations Program Manager USD 163K-220KAI Agents | Artificial Intelligence | Automation | Bias Mitigation | Chain managementTravelSenior-level Full TimeSunnyvale, CA | Redmond, WA1d ago
-
Mid-level Full TimeMenlo Park, CA | New York, …1d ago
-
Robotics Verification & Validation Engineer USD 170K-225KAI Risk | AI Risk Assessment | AI model | AI model validation | AI qualitySenior-level Full TimeBurlingame, CA1d ago
-
Technical Lead, Machine Learning, Google Play USD 207K-300KAlgorithms | C++ | Computer Vision | Data Structures | ExperimentationSenior-level Full TimeMountain View, CA, USA1d ago
-
Asynchronous programming | BigQuery | C++ | Concurrency | Distributed DatabasesSenior-level Full TimeKirkland, WA, USA1d ago
-
Staff Data Engineer, Search, Data Science USD 207K-300KC++ | Data Engineering | Data Pipelines | Data Systems | Data systems architectureSenior-level Full TimeMountain View, CA, USA; New York, …1d ago
-
Data Engineer II USD 106K-151KApache Flume | Data Modeling | Data Pipelines | Data Warehousing | Dimensional ModelingSenior-level Full TimeBoulder, CO, USA; Atlanta, GA, USA1d ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Cloud | Data Privacy | Data Processing | Data StructuresSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA1d ago
-
Applied AI Staff Software Engineer, Looker USD 207K-300KData Processing | Data Visualization | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeKirkland, WA, USA1d ago