Senior Machine Learning Engineer, Agent Oversight
San Francisco, CA; New York, NY
USD 216K-270K Senior-level Full Time
Tasks
- Build observability for agent behavior in production
- Collaborate with engineers to productionize ML systems
- Design evaluation methodologies and metrics
- Develop drift anomaly and misalignment detection systems
- Run experiments to validate model and agent improvements
- Translate enterprise and government requirements into platform capabilities
Perks/Benefits
- Dental insurance
- Health insurance
- Learning and development stipend
- Paid time off
- Retirement benefits
- Vision insurance
Skills/Tech-stack
Agent Orchestration | Anomaly Detection | Drift Detection | Evaluation Methodologies | Experimentation | Fine Tuning | Human Feedback | Language Models | Large Language Models | Learning from Human Feedback | Machine Learning | Model Monitoring | Model Training | Multi-Agent | Multi-agent orchestration | Reinforcement Learning | Reinforcement Learning from Human Feedback | Reward Modeling | Statistical Analysis | Supervised Fine Tuning
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Software Engineer, Machine Learning, Travel Ads USD 147K-211KA/B | A/B Testing | Adbrain | B testing | C++Mid-level Full TimeMountain View, CA, USA6h ago
-
Senior Staff Engineer, GDC AI Inference Platform USD 262K-365KAgent coordination | C++ | Cloud infrastructure | Containerization | Data StructuresBonus | Equity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA6h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935510h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US12h ago
-
Senior-level Full TimeSeattle, Washington, United States; USA - …13h ago
-
Principal AI Engineering Architect USD 224K-308KAWS | Data Processing | Docker | Google Cloud | High AvailabilityAdoption and surrogacy reimbursement | Cancer Care Program | Employee Assistance Program (EAP) | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R13h ago
-
Staff Robotics Engineer, Maritime USD 254K-336KC++ | Collision Avoidance | Computer Vision | Computer Vision Algorithms | Machine LearningHealth benefits | Mentorship | Recovery BenefitsSenior-level Full TimeQuincy, Massachusetts, United States14h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KC++ | Cameras | Computer Vision | Gazebo | LidarHealth insurance | Mentorship | Travel opportunitiesSenior-level Full TimeQuincy, Massachusetts, United States14h ago
-
Machine Learning Engineer, GPU Kernel and Runtime USD 213K-263KCUDA | Deep learning | GPU Computing | Kernel optimization | Machine LearningSenior-level Full TimeMountain View, California16h ago
-
Distributed Systems | Fault Tolerance | GPU Computing | JAX | Low LatencyBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, California16h ago
-
RFML Engineer, EW USD 166K-220K5G | C++ | Channel equalization | Channel estimation | Deep learningEmployee benefits package | Travel | U.S. Secret security clearance supportMid-level Full TimeCosta Mesa, California, United States17h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeUnited States17h ago
-
Mid-level Full TimeSan Francisco Bay Area; Seattle Metro …18h ago
-
ML Agent Engineer USD 155K-300KCI/CD | Distributed machine learning | Distributed testing | Evaluation Frameworks | ML monitoringMid-level Full TimeSan Francisco Bay Area; Seattle Metro …18h ago
-
Staff ML Engineer, StockStory USD 140K-160KCNN | Deep learning | Embeddings | Human-in-the-loop | Information ExtractionDaily group classes | Daily specials | Dry cleaning | Free onsite fitness center | Free shuttle transportationSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States18h ago
-
Staff Engineer, Data Analysis (R5290) USD 121K-197KAnomaly Detection | Automated Validation | Cloud Storage | Communications | DashboardsSenior-level Full TimeUnited States18h ago
-
Staff Research Engineer, Discovery Team USD 350K-850KArtificial Intelligence | Cloud deployment | Containerization | Data Pipelines | Distributed SystemsFlexible remote work policy | Flexible working hours | Generous vacation | Parental leave | Visa sponsorship assistanceSenior-level Full TimeSan Francisco, CA19h ago
-
Senior AI Solutions Engineer USD 164K-215KAI Observability | Agentic Systems | Airflow | Amazon S3 | Amazon Web Services401k plan | Annual Caltrain Pass | Fastrak reimbursement | Fitness reimbursement | Health, dental, vision insuranceSenior-level Full TimeUS - Remote R19h ago
-
C++ | Deep learning | Distributed Training | ETL Pipelines | GoSenior-level Full TimeMountain View, CALIFORNIA, United States19h ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States19h ago
-
Camera Software - Sr. Machine Learning Engineer USD 161K-264KC++ | Computer Vision | Data pipeline | Deep learning | Edge inferenceSenior-level Full TimeCupertino19h ago
-
Senior-level Full TimeOakland, CA, United States19h ago
-
Test Data Engineer USD 68K-131KArtificial Intelligence | Automation | Cloud | Configuration Management | Data Governance401k match | Catered lunches | Coffee tea beverages | Dental insurance | Health insuranceMid-level Full TimeBoston20h ago
-
Active Learning | Agentic Workflows | Bayesian optimization | Computational Biology | Experimental DesignSenior-level Full TimeSomerville, MA20h ago