Lead AI Engineer, Data Solutions
California - San Francisco, United States
USD 172K-285K Senior-level Full Time
Tasks
- Build Python services and APIs for agent workflows
- Build and deploy ML models
- Build offline and online evaluation frameworks
- Build pipelines for agent trace datasets
- Create evaluation datasets golden traces and regression test sets
- Design AI agents with LLM reasoning tool usage and ML decisioning
- Design feedback loops for agent improvement
- Design scalable data pipelines for batch and near real time
- Drive continuous improvement via prompting policies model selection and fine tuning
- Enable continuous retraining and evaluation
- Ensure data quality, consistency, and reliability
- Ensure reliability, observability, and performance
- Integrate models and agents into business workflows
- Orchestrate multi step reasoning and structured outputs
- Run A B experiments and track quality revenue impact and latency
- Track engagement conversion quality metrics
- Transform raw interaction data into features labels and datasets
- Use production signals for continuous optimization
Perks/Benefits
- 401k
- Employee stock purchasing program
- Life and disability insurance
- Medical/Dental/Vision insurance
- Mental health support
- Paid parental leave
- Time off programs
Skills/Tech-stack
A/B | A/B Testing | API Development | Airflow | B testing | Backend systems | Batch Processing | BigQuery | Classification | Dagster | Data Lineage | Data Pipelines | Data Processing | Data Quality | Deep learning | ELT | ETL | Evaluation Frameworks | Experimentation | Feature Engineering | Fine Tuning | Forecasting | LLM orchestration | LLMOps | Language Models | Language Processing | Large Language Models | Machine Learning | Model Fine-tuning | Natural Language | Natural Language Processing | Prompt engineering | Python | Ranking | Recommendation Systems | Regression testing | Snowflake | Spark | Streaming Data | Streaming data processing | Tool orchestration
Education
N/A
Roles
AI | AI Engineer | Engineer | Lead | Lead AI Engineer
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
AI Intern - Communications USD 50K-68KAnthropic | Artificial Intelligence | Google Cloud | JavaScript | LLM APIsEntry-level Internship Part TimeUnited States, United States2h ago
-
Senior Databricks Platform Engineer USD 140K-165KAWS | Active Directory | Apache Hive | Apache Spark | Audit LoggingSenior-level Full TimeArlington, VA, United States2h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R2h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R2h ago
-
Lead Business Intelligence Engineer USD 100K-150KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeWestchester, IL, United States2h ago
-
Artificial Intelligence | Assessment | Curriculum Development | Live coding | Machine LearningEntry-level Part TimeRemote, United States R3h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL4h ago
-
Senior-level ContractRaleigh, United States4h ago
-
AI Agents | AI Governance | Artificial Intelligence | Cybersecurity compliance | Enterprise SearchHybrid work | Local residency requirementEntry-level ContractAustin, United States5h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES - 032726-2 A USD 136K-140KAI/ML | Agile | Confluence | Jira | LLM401k retirement plan | Dental insurance | Disability insurance | Federal Holidays | Floating holidaysMid-level Full TimeFort George G Meade, United States5h ago
-
AI Platform Engineer USD 108K-215KAutogen | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key VaultMid-level Full TimeBelmont, NC, United States5h ago
-
AI Platform Engineer USD 108K-215KAI Agents | Agent Frameworks | Autogen | Azure Data | Azure Data LakeMid-level Full TimeBelmont, NC, United States5h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York6h ago
-
Project GenAI Engineer III USD 113K-188KAWS | Bedrock | Generative AI | Machine LearningMentorship | Onsite work | Professional development | Travel up to 25%Senior-level Full TimeArlington/Rosslyn, Virginia, United States6h ago
-
Analytics | Artificial Intelligence | Cloud Computing | Data Architecture | Data GovernanceCompetitive benefits package | Mentorship | Professional development | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …6h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R6h ago
-
Software Engineer - TikTok AI Search Infrastructure USD 212K-389KAlgorithm Design | C++ | DAG | Data Architecture | Data ProcessingSenior-level Full TimeSan Jose, California, United States7h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 77K-176KAPI Development | Agile | Backend Development | Cloud Computing | Data Preparation401k | Employee discounts | Employee referral rewards | Flexible work schedule | Health savings accountMid-level Full TimeQuantico, VA, US R8h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R8h ago
-
Computer Vision Engineer USD 170K-251K3D Modeling | AR/VR | Computer Graphics | Computer Vision | Data AnalysisSenior-level Full TimeBurlingame, CA8h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …8h ago
-
AI/HPC Network Performance Engineer USD 147K-226KAI Training | Alerting | Auto-remediation | C++ | Configuration ManagementOncall rotationSenior-level Full TimeMenlo Park, CA8h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …8h ago