Staff Machine Learning Engineer, Agentic
Tasks
- Analyze production issues
- Build metrics and monitoring
- Define evaluation frameworks
- Evaluate large language models
- Evaluate model quality latency and cost
- Identify root causes
- Lead improvements for reliability
- Measure agent performance
- Report agent performance for roadmap decisions
- Translate evaluation results into launch criteria
Perks/Benefits
- 401k matching
- Employer-paid disability insurance
- Employer-paid life insurance
- Lifestyle spending account
- Mental health benefits
- Paid health insurance
- Paid time off
- Parental leave
- Sick time
Skills/Tech-stack
Cause analysis | Cost Optimization | DataSet | Evaluation Frameworks | Language Models | Large Language Models | Latency optimization | Machine Learning | Metrics | Model Evaluation | Model selection | Monitoring | Observability | Production Support | Root Cause Analysis | Root cause | Safety engineering | Scorecard
Education
N/A
Regions
Countries
States
Related jobs
-
Artificial Intelligence | Machine Learning | Marketing | Product Development | Product ManagementCoaching | Community access | Relocation support | Startup hiring support | Weekly founder sparringMid-level ContractAustin, United States R4h ago
-
Principal AI Engineer - Core Platform USD 250K-290KAWS | Agents SDK | Anomaly Detection | Automated testing | Classification401k match | Company-provided phone | Health insurance | Hybrid work | PTOSenior-level Full TimeNew York, New York, United States8h ago
-
Engineer, AI Dev Tools USD 90K-120KAPI Integration | Agent architecture | Artificial Intelligence | Containerization | Data Modeling401k | Dental insurance | Health insurance | Hybrid work | Paid HolidaysMid-level Full TimeMinnetonka, MN, US11h ago
-
Engineer, AI Dev Tools USD 90K-120KAPI Integration | Agent architecture | Containerization | Data pipeline | Docker401k | Dental insurance | Health insurance | Paid Holidays | Paid time offMid-level Full TimeFoxboro, MA, US11h ago
-
Staff AI Engineer USD 210K-235KAgent systems | Agentic AI | Anthropic API | Anthropic Claude | Automated Evaluation401k | Career growth | Disability and life insurance | Equipment provided | Flexible vacation policySenior-level Full TimeRemote (United States) R11h ago
-
Senior AI Engineer USD 170K-200KAgent systems | Agentic AI | Anthropic API | Automated evals | Backend architecture401k | Company-provided equipment | Comprehensive medical, dental and vision coverage | Disability insurance | Flexible vacation policySenior-level Full TimeRemote (United States) R11h ago
-
Checkpointing | Cloud Networking | Failure recovery | Golang | Human Feedback401k match | Cell phone stipend | Commuter benefits | Dental insurance | HSA employer contributionsSenior-level Full TimeSan Francisco, CA - US12h ago
-
Principal Engineer, AI Model LifeCycle USD 260K-326KAdapters | Checkpointing | DPO | DeepSpeed | Distributed TrainingCell phone stipend | Commuter benefits | Dental insurance | Health insurance | Mental health wellness supportSenior-level Full TimeSan Francisco, CA - US12h ago
-
Senior AI Solutions Builder, People USD 134K-192KAgent Development | Artificial Intelligence | Automation | Coding | Data GovernanceSenior-level Full TimeRemote, United States R13h ago
-
AI Analytics Engineer (AI & Analytics Platform) USD 141K-193KAgent architecture | Anomaly Detection | BI Semantic Modeling | Clustering | DBTEntry-level Full TimeSan Francisco, CA; Austin, TX; New …13h ago
-
Bulk Inference | C++ | Data Mining | Data Pipelines | Data QualitySenior-level Full TimeMountain View, CA, USA13h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R14h ago
-
Senior Agentic AI Engineer USD 150K-180KA/B | A/B Testing | APIs | AWS | Agent workflowsDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeNew York, New York, United States14h ago
-
Principal Agentic AI Engineer USD 220K-250KA/B | A/B Testing | APIs | AWS | Agentic WorkflowsEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeSan Francisco, California, United States14h ago
-
Principal Agentic AI Engineer USD 220K-250KA/B | A/B Testing | API Design | AWS | Agentic AIDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeNew York, New York, United States14h ago
-
Lead AI Engineer USD 200K-215KA/B | A/B Testing | AWS Bedrock | Agentic LLM | Agentic LLM systemsDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R14h ago
-
Senior Agentic AI Engineer USD 150K-180KA/B | A/B Testing | APIs | AWS | Agentic AIDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeSan Francisco, California, United States14h ago
-
Senior Machine Learning Engineer USD 198K-287KArtificial Intelligence | Data Engineering | Fine Tuning | Foundation Models | GenAISenior-level Full TimeRemote - US R14h ago
-
GenAI Principal Engineer - Remote USD 145K-215KAI orchestration | API first | API-first design | AWS | Android401k matching | DEI focus | Development opportunities | Flexible schedule | Flexible time offSenior-level Full TimeUnited States, UNITED STATES, United States R15h ago
-
Senior Data Engineer USD 140K-188KAWS | Alerting | Containerization | DBT | Data Ingestion401k matching | Employee Referral | Employee assistance program | Employee resource groups | Employee stock purchase planSenior-level Full TimeSeattle, Washington, United States15h ago
-
Data Engineer USD 118K-148KApache Airflow | Apache Beam | ArgoCD | BigQuery | CI/CD401k retirement savings plan | EAP | Employee discount | FAM membership | Fitness Reimbursement ProgramMid-level Full TimeUnited States16h ago
-
Machine Learning Engineer - Senior Consultant USD 161K-230KAWS Lambda | AWS SageMaker | Agentic Systems | Amazon ECR | Amazon EMR401k company match | Certification support | Dental insurance | Health insurance | Professional developmentSenior-level Full TimeUSA17h ago
-
Senior Data Engineer - Clinical Trial Data USD 121K-202KADaM | AWS SageMaker | Amazon Web Services | C# | C++401k | Dental insurance | Medical insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeNorth Chicago, IL, United States17h ago
-
Data Scientist USD 184K-199KBiomedical Signal Processing | Classification | Convolutional Neural Networks | Data Preprocessing | Data cleaning401k match | Cell phone stipend | Dental benefits | Employee stock purchase plan | Flexible paid time offSenior-level Full TimeSunnyvale, CA17h ago
-
Data Engineer - Governance and QA USD 120K-150KCI/CD | DBT | Data Architecture | Data Contracts | Data Modeling401k with company match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeDallas, TX - Hybrid (3x in … R19h ago