AI Engineer, Quality

San Francisco, CA or Remote (USA) / Remote (US) R

USD 170K-220K Entry-level Full Time

@ F...

Apply Save

Found 1mo ago

Tasks

Build unified evaluation platform for AI agents
Create automated model evaluation pipelines
Create evaluation datasets from production traces
Define evaluation standards and best practices
Design guardrails and monitoring for quality regressions
Develop evaluation harnesses and comparison frameworks
Implement observability and tracing for agent execution
Integrate and orchestrate LLMs tools and retrieval systems

Perks/Benefits

Skills/Tech-stack

Education

N/A

Apply Save

Language: en Views:

12 Clicks:

1 Saves: 0

Related jobs

Instructor - Masterclass, GenAI/Agentic AI Workshops USD 110K-120K

AI Assistants | AI coding | AI coding tools | API Integration | API Keys

24x7 support | Collaborative learning environment | Live virtual classes

Senior-level Full Time

United States - Remote R

14h ago
Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms) USD 120K

Analytical writing | Business Analysis | Data Synthesis | Evaluation Frameworks | Financial Modeling

Individual contributor | Project based work | Remote work

Senior-level Full Time

United States - Remote R

14h ago
Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms) USD 120K

Benchmarking | Commercial due diligence | Cost Optimization | Data Interpretation | Due Diligence

Project-based role | Remote work

Senior-level Full Time

Florida, United States - Remote R

14h ago
Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms) USD 120K

Data Analysis | Evaluation Design | Evaluation rubrics | Financial Modeling | Hypothesis-driven

Individual Contributor Role | Project based work | Remote work

Senior-level Full Time

Texas, United States - Remote R

14h ago
Senior/Staff/Principal Hardware Engineer - Robotic Hardware USD 110K-185K

C plus plus | C# | CAD | Dynamics | FDA Compliance

401k | Company holidays | Dental insurance | Health insurance | Paid maternity/paternity leave

Senior-level Full Time

Los Angeles, California R

14h ago
Principal Agentic AI Engineer USD 274K-338K

Agent Orchestration | Auditability | Benchmarking | Confidence scoring | Distributed Systems

Continuing education support | Dental insurance | Flexible vacation policy | Health insurance | Paid parental leave

Senior-level Full Time

san francisconew york R

16h ago
Senior Data Engineer USD 117K-162K

AWS | Azure | BigQuery | DBT | Data Architecture

401k | Annual wellness stipend | Cell phone reimbursement | Coaches and therapists access | Collective Pause Days

Senior-level Full Time

Remote - US R

16h ago
Embedded Software Engineer II USD 115K-140K

Bash | C plus plus | C# | CI/CD | D-bus

ERGs | Family Caregiver Support | Flexible PTO | HSA match | Health benefits

Mid-level Full Time

Remote - USA R

17h ago
AI Engineer USD 131K-185K

Anthropic API | Apps Script | Autogen | Cloud deployment | CrewAI

Async first collaboration | Conversion to employment based on performance | Direct access to leadership | Fast feedback loops | Fully remote

Mid-level Full Time

United R

17h ago
Senior Solution Engineer USD 165K-216K

Analytics | Cloud Computing | Data Architecture | Data Lake | Data Warehouse

Senior-level Full Time

US-CA-Bay Area-Remote R

18h ago
Senior Software Engineer USD 140K-185K

AWS | Automated testing | Azure | C++ | Git

401K company matching | Dental insurance | Dependent care benefits | Flexible spending account | Health insurance

Senior-level Full Time

Boulder, CO R

19h ago
Senior Software Engineer for AI USD 149K-208K

AWS | Anthropic Claude | Cloud infrastructure | Code Reviews | Data Privacy

Senior-level Full Time

Remote- United States R

20h ago
Software / Computer Science Intern USD 42K-50K

Data Parsing | Data Querying | Data Storage | Data pipeline | Debugging

Collaborative team activities | Hybrid work arrangement | Mentorship | Occasional local travel | Professional development

Entry-level Internship

Monroeville, PA R

22h ago
Machine Learning Engineer USD 150K-215K

Data Augmentation | Deep learning | Isaac | Loss Functions | Medical Imaging

Mid-level Full Time

San Francisco (hybrid) R

23h ago
AI Engineer (Latam, Remote) USD 70K-110K

API Integration | Authentication | Claude | Database Management | LLM integration

Collaboration with U S based teams | Fully remote | High ownership and autonomy | Part-time flexibility

Senior-level Part Time

Florida, Aventura, United States of America R

1d ago
Software Engineer II - Model Platform USD 149K-214K

AWS | Azure | Cloud Computing | Data Pipelines | Distributed Systems

Mid-level Full Time

Remote - USA R

1d ago
Data Platform Engineer III USD 135K-160K

APIs | AWS Lambda | Agile | Amazon RDS | Amazon S3

401k employer match | Dental insurance | ESPP | Flexible spending account | Health insurance

Senior-level Full Time

Remote, United States R

1d ago
Senior Software Engineer (Typescript / FrontEnd) - AI/ML USD 141K-232K

API Design | AWS | Azure | Cloud platform | Google Cloud

Flexible time off | Flexible work environment | Global gatherings | Healthcare | Home office setup

Senior-level Full Time

United States (remote) R

1d ago
Data Scientist / AI/ML Engineer (Imagery) VAWFH 1652 USD 153K-207K

Accuracy | Computer Vision | Containerization | Data Cleansing | Data Preprocessing

Senior-level Full Time

Reston, VA R

1d ago
Senior Machine Learning Ops Engineer USD 150K-173K

AWS | Airflow | Bash | Batch inference | CI/CD

Employee mentorship program | Leadership programs

Senior-level Full Time

United States R

1d ago
Forward Deployed Machine Learning Engineer USD 180K-300K

API Design | Cloud Computing | Deep learning | Diffusion Models | Fine Tuning

In-person collaboration days | Remote work flexibility | Travel cost coverage

Senior-level Full Time

San Francisco (USA) R

1d ago
Senior Software Engineer - Platform & MLOps USD 152K-230K

AWS | Azure | CI/CD | Datadog | Docker

Discretionary incentive plan | Flexible work policy | Learning and development access | Medical benefits

Senior-level Full Time

Seattle, Washington, United States - Remote R

1d ago
Physics Expert with Python - Freelance AI Trainer USD 152K

C# | MATLAB | NumPy | Pandas | Python

English language support | Flexible schedule | Part-time project-based work

Senior-level Freelance

United States - Remote R

1d ago
Physics Expert with Python - Freelance AI Trainer USD 152K

Electromagnetism | Mechanics | NumPy | Numerical Simulation | Pandas

Flexible part-time schedule | Freelance project-based work

Senior-level Freelance

Florida, United States - Remote R

1d ago
Physics Expert with Python - Freelance AI Trainer USD 152K

Computational physics | NumPy | Numerical Simulation | Pandas | Python

Part-time freelancing

Senior-level Freelance

Michigan, United States - Remote R

1d ago

AI Engineer, Quality

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs