Senior Machine Learning Engineer, Model Risk Management
Bay Area, CA, United States of America
USD 160K-283K Senior-level Full Time
Tasks
- Build LLM agent validation tooling
- Challenge model owners
- Connect explainability to model and product decisions
- Define acceptance thresholds
- Define validation standards for production AI
- Evaluate ML systems end to end
- Hunt silent model errors
- Orchestrate parallel agents
- Prove issues before production
- Reproduce model results
- Select robust evaluation methods
Perks/Benefits
Skills/Tech-stack
Agentic Systems | Amazon Web Services | Benchmarking | CI/CD | Cloud platform | Databricks | Decision Trees | Deep learning | Experiment design | Generative AI | GitHub | Google Cloud | Google Cloud Platform | Holdout Validation | Jira | LLM | LightGBM | MLflow | Machine Learning | Model Evaluation | Model calibration | NumPy | Pandas | Prefect | PyTorch | Pytest | Python | Regression | Reproducible Code | Ruff | SQL | Scikit-learn | Snowflake | Statistical modeling | Stress Testing | Uncertainty Quantification | Vertex AI | Web Services | XGBoost
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R3h ago
-
AWS | Data Auditing | Data Engineering | Data Infrastructure | Data ModelingSenior-level Full TimeSeattle, Washington, USA8h ago
-
Sr. Firmware Engineer, Annapurna Labs, Machine Learning Acceleration - Power and Performance USD 193K-261KData Pipelines | Embedded C | Firmware | Frequency Voltage | Frequency Voltage ScalingCode reviews | Knowledge sharing | MentorshipSenior-level Full TimeCupertino, California, USA8h ago
-
Senior Staff Machine Learning Engineer USD 242K-357KA/B | A/B Testing | B testing | C++ | Deep learning11 paid holidays | 401k employer matching | Basic life insurance | Commuter benefits | Dental insuranceSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA9h ago
-
Staff Data Engineer, Ads USD 248K-279KAPI Integration | Airflow | Alerting | Anomaly Detection | BigQuerySenior-level Full TimeRemote (U.S.) R10h ago
-
ML Engineer USD 160K-235K3D Detection | 3D segmentation | 3D transforms | 3D understanding | Computer VisionSenior-level Full TimeSan Francisco10h ago
-
Staff Data Platform Engineer USD 190K-240KAirflow | Amazon Redshift | Amazon Web Services | Apache Kafka | Apache Spark401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeLos Angeles, California, United States10h ago
-
Staff Data Platform Engineer USD 190K-240KAWS | Airflow | Amazon Redshift | Apache Spark | Autoscaling401k | Commuter benefits | Continued education benefit | FSA | Health insuranceSenior-level Full TimeNew York, New York, United States10h ago
-
Staff Data Platform Engineer USD 190K-240KAmazon Web Services | Apache Airflow | Apache DataDog | Apache Flink | Apache Kafka401k | Commuter benefits | Continued education benefit | FSA | Health insuranceSenior-level Full TimeSan Francisco, California, United States10h ago
-
Apache Airflow | Data Lakes | Data Pipelines | Data Validation | Data WarehousingCommute subsidy | Employee assistance program | Employee resource groups | Employee stock ownership | Generous vacation and personal daysEntry-level Full TimeMountain View, CA, USA11h ago
-
Apache Airflow | Data Pipelines | Data Processing | Data Validation | Distributed SystemsCommute subsidy | Comprehensive health insurance | Employee assistance program | Employee resource groups | Employee stock ownershipEntry-level Full TimeSan Francisco, CA, USA11h ago
-
Airflow | Data Pipelines | Data Processing | Data Validation | Distributed SystemsCommute subsidy | Comprehensive health insurance | Disability insurance | Employee assistance program | Employee resource groupsEntry-level Full TimeBellevue, WA, USA11h ago
-
Staff Machine Learning Engineer (Modeling), Support USD 160K-283KDeep learning | Dialog Systems | Fine Tuning | Generative AI | JAXFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings planSenior-level Full TimeSeattle, WA, United States of America11h ago
-
AI Engineer - Nexus Black USD 90K-100KAPIs | CI/CD | Cloud Computing | Embeddings | Evaluation401k company contribution | Disability benefits | Flexible paid time off | Flexible spending accounts | Hybrid work optionsSenior-level Full TimeItasca, Illinois, United States11h ago
-
AI Engineer - Nexus Black USD 90K-100KAgent systems | CI/CD | Cloud services | Embeddings | Evaluation401k contribution | Dental insurance | Disability benefits | Flexible spending accounts | Flexible time offSenior-level Full TimeSan Diego, California, United States11h ago
-
Senior-level Contract Full TimeChicago, Illinois, United States11h ago
-
Senior Embedded Software Engineer USD 160K-200KBare Metal | C Language | C# | C++ | Computer Architecture401k matching | Dental insurance | Health insurance | Onsite meals | Paid Maternity LeaveSenior-level Full TimeEl Segundo, California, United States12h ago
-
Senior Machine Learning Engineer USD 170K-220KCausal Inference | Data Processing | FastAPI | Machine Learning | PandasSenior-level Full TimeNew York, NY12h ago
-
Lead Data Engineer, Revenue Engine USD 175K-255KDBT | Dagster | Data Exploration | Data Governance | Data ModelingSenior-level Full TimeNew York, NY12h ago
-
Senior Data Engineer USD 150K-220KClustering | DBT | Dagster | Data Lineage | Data ModelingIn office 4 days per week | On-call rotationSenior-level Full TimeNew York, NY12h ago
-
Data Engineer - Java - Loops USD 115K-125KAPI Key | API Security | AWS | Authentication | Azure401k match | Community volunteering events | Dental insurance | Disability benefits | Flexible paid time offMid-level Full TimePalo Alto, California, United States13h ago
-
A/B | A/B Testing | AWS | Alerting | B testingAnnual refresh grants | Equity grant | Flex First Work Options | On-call rotation | Remote workSenior-level Full TimeUnited States - Remote R13h ago
-
Senior Data Engineer USD 170K-204KAlerting | Apache Airflow | DBT | Data Modeling | Data Quality401k match | Dental insurance | Flexible PTO | Health insurance | Retirement benefitsSenior-level Full TimeAmerican Fork, Utah, United States13h ago
-
Senior Analytics Engineer USD 105K-135KAPIs | Adobe Analytics | Anomaly Detection | Attribution | BigQuery401k | Dental | Family building benefit | Maternity leave | MedicalSenior-level Full TimeMinneapolis; Philadelphia14h ago
-
Senior Learning Perception Engineer - SLAM USD 190K-235K3D Geometry | C++ | CI/CD | CLIP | Camera ModelsSenior-level Full TimeSunnyvale, C A14h ago