AI Engineer, Model Quality and Performance
Tasks
- Automate eval execution pipelines
- Benchmark model performance for customers
- Build AI agent driven eval suites
- Build quality and performance tooling
- Define model quality metrics
- Forecast model performance
- Generate and validate test cases
- Mine trajectories from workloads
- Synthesize representative eval sets
Perks/Benefits
- N/A
Skills/Tech-stack
AI Agents | Artificial Intelligence | Benchmarking | CI/CD | Docker | FPGA | GPU | Git | Long Context | Machine Learning | Model Evaluation | Performance Tuning | Statistics | Time Series
Education
N/A
Roles
AI | AI Engineer | Engineer | Learning Engineer | Machine Learning Engineer
Regions
Countries
States
Cities
Related jobs
-
Senior Machine Learning Engineer USD 195K-303KA/B | A/B Testing | AI | B testing | Deep learningFinancial wellness support | Flexible remote work | Health and wellness support | Time offSenior-level Full TimeAustin, Texas6h ago
-
Senior Machine Learning Engineer USD 148K-361KA/B | A/B Testing | B testing | Deep learning | Discriminative modelsCommuter benefits | Disability benefits | Financial wellness support | Global mental health support | Health insuranceSenior-level Full TimeSan Jose, California6h ago
-
Senior Machine Learning Engineer, Search Assistant USD 361K-510KA/B | A/B Testing | Airflow | B testing | Bandit AlgorithmsDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California7h ago
-
Lead Data Engineer (Sr. Palantir Engineer) USD 110K-160KAccess Control | Data Cleansing | Data Governance | Data Modeling | Data TransformationCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical/Dental/Vision insurance | Paid time offSenior-level Full TimeChicago, IL, US9h ago
-
Senior Forward Deployed AI Engineer, Enterprise USD 216K-270KA/B | A/B Testing | AWS | Agent systems | Artificial IntelligenceCommuter stipend | Health, dental, vision insurance | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY9h ago
-
Forward Deployed AI Engineer, Enterprise USD 180K-225KA/B | A/B Testing | AWS | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY9h ago
-
Forward Deployed AI Engineer USD 110K-160KAI Agents | APIs | Artificial Intelligence | Cloud infrastructure | LLM401k employer match | Family building benefits | Flexible time off | Free OneMedical memberships | Healthcare plansEntry-level Full TimeNew York, NY, United States10h ago
-
Forward Deployed AI Engineer II USD 180K-230KAI Agents | APIs | Cloud infrastructure | Data Privacy | Evaluation401k match | Family building benefits fertility adoption surrogacy support | Flexible time off | Free OneMedical memberships | Healthcare plansMid-level Full TimeNew York, NY, United States10h ago
-
Sr. Delivery Acceleration AI Architect USD 168K-295KA/B | A/B Testing | AI Agent | AI Agent Development | AI agent orchestrationSenior-level Full TimeDallas, Texas, United States10h ago
-
Agent systems | Artificial Intelligence | C++ | Imitation Learning | LLM401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA; Mercer Island, USA11h ago
-
Sr. Embedded Software Engineer (Platforms) USD 90K-135KArtifactory | Atlassian Bamboo | BSP | Bash | BitbucketSenior-level Full TimeLafayette, CO11h ago
-
Full Stack Software Engineer, Data USD 160K-225KAngular | Build Automation | C# | CI/CD | Continuous integrationExtended hours | Travel | Weekend availabilitySenior-level Full TimeStarbase, TX11h ago
-
Embedded Software Engineer USD 150K-186K*nix | Authentication | Bash | Bazel | Build AutomationOn site work 4 day schedule | Proof of vaccination requiredSenior-level Full TimeSunnyvale, CA, United States11h ago
-
Senior Staff Forward Deployed AI Engineer, Enterprise USD 288K-360KA/B | A/B Testing | AWS | Agent systems | AlgorithmsCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY11h ago
-
Staff Forward Deployed AI Engineer, Enterprise USD 252K-315KA/B | A/B Testing | AWS | Agent systems | AzureCommuter stipend | Comprehensive health coverage | Dental and vision coverage | Generous PTO | Learning and development stipendSenior-level Full TimeSan Francisco, CA; New York, NY11h ago
-
API Design | AWS | AWS Lambda | Agentic AI | Amazon EC2Senior-level Full TimeOffice Location or Remote - USA R11h ago
-
API Design | AWS | Agentic AI | Cypher | Data ArchitectureSenior-level Full TimeOffice Location or Remote - USA R11h ago
-
Software Engineer, Infrastructure - Autonomy & Robotics USD 159K-235KApache Flink | Apache Spark | C++ | Continuous integration | Data ProcessingMid-level Full TimeSan Francisco, CA12h ago
-
Senior AI Engineer USD 139K-229KAnt | Apache Maven | Configuration Management | Data Engineering | Data MiningEmployee growth opportunities | Flexible work hybrid work model | Health and wellness programs | Paid time offSenior-level Full TimeSunnyvale, CA, United States12h ago
-
Full Stack Software Engineer, Data USD 125K-175KAngular | Build systems | C# | CI/CD | Computer Vision401k retirement plan | Employee stock purchase plan | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leaveEntry-level Full TimeHawthorne, CA12h ago
-
Principal Engineer - GenAI Applications & MLOps USD 175K-242KAWS | Bigtable | Data integration | Distributed Systems | Event ProcessingRemote US basedSenior-level Full TimeUS Remote R13h ago
-
Staff Machine Learning Engineer USD 152K-277KAWS | Airflow | Apache Spark | BigQuery | Cloud Computing401k plan | Commuter benefits | Dental insurance | Electric vehicle charging station | Employee assistance programSenior-level Full TimeMountain View, USA13h ago
-
Machine Learning Engineer USD 153K-222KAWS | CI/CD | Cloud platform | Deep learning | Federated LearningMid-level Full TimePeachtree Corners, GA, United States14h ago
-
Embedded Engineer USD 125K-145KC plus plus | C# | Code review | Debugging | Electronic testRelocation assistanceMid-level Full TimeBoston, MA14h ago
-
Senior Software Engineer, Data USD 225K-300KAPIs | AWS | Airflow | Argo | Batch Processing401k match | Family building benefits | Flexible time off | Free OneMedical memberships | Healthcare plansSenior-level Full TimeNew York, NY, United States14h ago