Senior Machine Learning Engineer, Applied AI Quality
Bay Area, CA, United States of America
USD 194K-343K Senior-level Full Time
Tasks
- Define evaluation measurement and quality intelligence approaches
- Design scalable systems using LLMs and agents for quality evaluation
- Identify leverage opportunities to improve product behavior understanding and debugging
- Influence engineering standards for reliable measurable trustworthy AI systems
- Lead cross functional initiatives across product infrastructure data and AI teams
- Lead technical strategy for AI driven quality and evaluation systems
- Mentor engineers through technical leadership and design reviews
- Translate organizational needs into technical direction and roadmaps
Perks/Benefits
Skills/Tech-stack
AI infrastructure | Behavioral signals | Data Modeling | Evaluation systems | LLM Agents | Language Models | Large Language Models | Machine Learning | Retrieval-Augmented Generation | Software Architecture
Education
N/A
Related jobs
-
LLM Application Engineer USD 130K-175KAPIs | Agent Frameworks | Databases | Distributed Systems | EvaluationMid-level Full TimeUnited States R4h ago
-
Staff, Advanced Analytics, Incubations USD 180K-221KA/B | A/B Testing | Attribution | Attribution Modeling | B testingSenior-level Full TimeUnited States R9h ago
-
Senior Software Engineer (Data & AI Solutions) USD 125K-156KAWS | Apache Airflow | Apache Spark | BAM | Bioinformatics401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R9h ago
-
A/B | A/B Testing | API Integration | Airflow | Attribution ModelingCross-functional collaboration | Remote workSenior-level Full TimeUnited States R11h ago
-
Data Engineer USD 150K-230KAirflow | Anomaly Detection | Apache Spark | CTE | Cause analysis401k | Dental insurance | Equity | Flexible vacation policy | Health insuranceSenior-level Full TimeLos Angeles, CA11h ago
-
Senior AI Systems Engineer – LLM & Agentic Systems USD 140K-160KAWS | Agentic AI | Alerting | Drift Detection | EmbeddingsDaily group classes | Dry cleaning benefits | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R13h ago
-
Staff Data Scientist (AI/ML) USD 174K-278KAWS | Agile | Azure | BigQuery | Causal InferenceFlexible work optionsSenior-level Full TimeUS - Boston, MA ; US …13h ago
-
Lead ML Engineer USD 170K-210KAWS | Cloud infrastructure | Cloud platform | Computer Vision | Cost OptimizationExecutive-level Full TimeEnglewood Cliffs, NEW JERSEY, United States13h ago
-
Senior IT DataOps Business Intelligence Engineer USD 143K-185KAccess Control | Amazon Web Services | Anthropic | CI/CD | Census401k | Dental insurance | Education and learning stipend | Flexible vacation time | Health insuranceSenior-level Full TimeNew York City R15h ago
-
Artificial Intelligence Machine Learning Engineer 2 USD 130K-270KAI Algorithms | Data Modeling | Data Structures | Machine Learning | Model Evaluation401k contribution | Dental insurance | Disability insurance | Health Savings Account contribution | Life insuranceSenior-level Full TimeAnnapolis Junction, MD15h ago
-
Ai Engineer USD 150K-170KApache Airflow | Artificial Intelligence | Azure Data | Azure Data Factory | Azure DevOps401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractBaltimore, Maryland, USA R16h ago
-
AI Search | Application Insights | Application diagnostics | Azure AI | Azure AI Search401k | Dental insurance | Educational assistance | Health savings account | Life insuranceMid-level Full TimeNew York, United States R16h ago
-
API | Agile | Data Modeling | Data Quality | Data TransformationCI Polygraph sponsorship within first year | Obtain A Plus within 6 months | Obtain Network Plus within 6 months | Obtain Security Plus within 6 months | TS SCI clearance sponsorshipMid-level Full TimeSpringfield, VA; Falls Church, VA; Falls …17h ago
-
Intelligent Systems Engineer II USD 98K-166KAPIs | AWS Lambda | AWS S3 | Amazon Web Services | Artificial Intelligence401k match | Community service day | Dental insurance | Flexible spending accounts | Life insuranceMid-level Full TimeWest Chester, OH, United States17h ago
-
Intelligent Systems Engineer II USD 98K-166KAPI Gateway | APIs | AWS | Artificial Intelligence | Automated testing401k match | Community service day | Flexible spending accounts | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeWest Chester, OH, United States17h ago
-
AWS | Amazon Athena | Amazon EMR | Amazon S3 | Apache AirflowEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNashville, TN17h ago
-
Access Control | Alerting | Amazon Athena | Amazon EMR | Amazon S3Employee discounts | Employee equity | Medical, dental, and vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R17h ago
-
Deployment Engineer (Data Analytics) USD 46K-76KData Modeling | Data Quality | Data Visualization | JavaScript | LookerCross-functional collaboration | Growth minded culture | In-person workMid-level Full TimeAustin, TX17h ago
-
Microsoft AI Engineer USD 20K-30K.NET | AI Search | AI Studio | AI workflows | Agentic AI401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilityEntry-level ContractOmaha, Nebraska, USA R18h ago
-
Entry-level Full TimeUnited States18h ago
-
Prompt Engineer USD 100K-150KA/B | A/B Testing | AI Agents | API Development | Agent systemsCareer advancement path | Coffee | Continuous feedback | Cross-functional collaboration | Growth opportunitiesEntry-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R18h ago
-
ML Engineer, Foundation Model Recipes USD 175K-215KBayesian Inference | Data Curation | Data Pipelines | Data labeling | Deep learningSenior-level Full TimeMountain View, CA, USA; San Francisco, … R19h ago
-
Lead Azure Fabric Data Engineer - Remote Position USD 127K-190KAzure | Azure AI | Azure Data | Azure Data Lake | Azure Data Lake Storage401k matching | Dental insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimePhoenix, Arizona, USA R19h ago
-
Data Engineer USD 130K-130KAzure | Azure Data | Azure Data Factory | Azure DevOps | Azure Functions401k | Critical illness accident and hospital | Employee assistance program | Health spending account | Life insuranceSenior-level ContractBaltimore, Maryland, USA R19h ago
-
Backend Engineer, AI Internal Systems USD 90K-120KAPI Development | AWS | Azure | Cloud infrastructure | Cloud platformEntry-level Full TimeUnited States R19h ago