Senior Machine Learning Engineer, Model Risk Management
Bay Area, CA, United States of America
USD 160K-283K Senior-level Full Time
Tasks
- Build LLM agent validation tooling
- Challenge model owners
- Connect explainability to model and product decisions
- Define acceptance thresholds
- Define validation standards for production AI
- Evaluate ML systems end to end
- Hunt silent model errors
- Orchestrate parallel agents
- Prove issues before production
- Reproduce model results
- Select robust evaluation methods
Perks/Benefits
Skills/Tech-stack
Agentic Systems | Amazon Web Services | Benchmarking | CI/CD | Cloud platform | Databricks | Decision Trees | Deep learning | Experiment design | Generative AI | GitHub | Google Cloud | Google Cloud Platform | Holdout Validation | Jira | LLM | LightGBM | MLflow | Machine Learning | Model Evaluation | Model calibration | NumPy | Pandas | Prefect | PyTorch | Pytest | Python | Regression | Reproducible Code | Ruff | SQL | Scikit-learn | Snowflake | Statistical modeling | Stress Testing | Uncertainty Quantification | Vertex AI | Web Services | XGBoost
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R4h ago
-
Staff Analytics Engineer USD 240K-250KBigQuery | BigQuery ML | Cloud platform | Customer Relationship Management | Customer relationshipEquity | Health insurance | Paid time offSenior-level Full TimeSF | Boston9h ago
-
AWS | Data Auditing | Data Engineering | Data Infrastructure | Data ModelingSenior-level Full TimeSeattle, Washington, USA10h ago
-
Sr. Firmware Engineer, Annapurna Labs, Machine Learning Acceleration - Power and Performance USD 193K-261KData Pipelines | Embedded C | Firmware | Frequency Voltage | Frequency Voltage ScalingCode reviews | Knowledge sharing | MentorshipSenior-level Full TimeCupertino, California, USA10h ago
-
Senior Staff Machine Learning Engineer USD 242K-357KA/B | A/B Testing | B testing | C++ | Deep learning11 paid holidays | 401k employer matching | Basic life insurance | Commuter benefits | Dental insuranceSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA11h ago
-
Staff Data Engineer, Ads USD 248K-279KAPI Integration | Airflow | Alerting | Anomaly Detection | BigQuerySenior-level Full TimeRemote (U.S.) R11h ago
-
AI Engineer USD 150K-225KAI Search | API Development | AWS | Agents SDK | Arize PhoenixEmployee discounts | Matching 401-K | Medical/Dental/Vision | Paid time off | Wellness programSenior-level Full TimeUnited States, San Diego, CA11h ago
-
ML Engineer USD 160K-235K3D Detection | 3D segmentation | 3D transforms | 3D understanding | Computer VisionSenior-level Full TimeSan Francisco12h ago
-
Staff Data Platform Engineer USD 190K-240KAirflow | Amazon Redshift | Amazon Web Services | Apache Kafka | Apache Spark401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeLos Angeles, California, United States12h ago
-
Staff Data Platform Engineer USD 190K-240KAWS | Airflow | Amazon Redshift | Apache Spark | Autoscaling401k | Commuter benefits | Continued education benefit | FSA | Health insuranceSenior-level Full TimeNew York, New York, United States12h ago
-
Staff Data Platform Engineer USD 190K-240KAmazon Web Services | Apache Airflow | Apache DataDog | Apache Flink | Apache Kafka401k | Commuter benefits | Continued education benefit | FSA | Health insuranceSenior-level Full TimeSan Francisco, California, United States12h ago
-
Apache Airflow | Data Lakes | Data Pipelines | Data Validation | Data WarehousingCommute subsidy | Employee assistance program | Employee resource groups | Employee stock ownership | Generous vacation and personal daysEntry-level Full TimeMountain View, CA, USA12h ago
-
Apache Airflow | Data Pipelines | Data Processing | Data Validation | Distributed SystemsCommute subsidy | Comprehensive health insurance | Employee assistance program | Employee resource groups | Employee stock ownershipEntry-level Full TimeSan Francisco, CA, USA12h ago
-
Airflow | Data Pipelines | Data Processing | Data Validation | Distributed SystemsCommute subsidy | Comprehensive health insurance | Disability insurance | Employee assistance program | Employee resource groupsEntry-level Full TimeBellevue, WA, USA12h ago
-
Machine Learning Engineer, Conversion ML USD 207K-275KBatch Processing | Deep learning | Machine Learning | Machine Learning Pipelines | Model DriftDental insurance | Equity | Health insurance | Remote work | Vision insuranceSenior-level Full TimeUnited States (Remote) R12h ago
-
Staff Machine Learning Engineer (Modeling), Support USD 160K-283KDeep learning | Dialog Systems | Fine Tuning | Generative AI | JAXFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings planSenior-level Full TimeSeattle, WA, United States of America12h ago
-
AI Engineer - Nexus Black USD 90K-100KAPIs | CI/CD | Cloud Computing | Embeddings | Evaluation401k company contribution | Disability benefits | Flexible paid time off | Flexible spending accounts | Hybrid work optionsSenior-level Full TimeItasca, Illinois, United States12h ago
-
AI Engineer - Nexus Black USD 90K-100KAgent systems | CI/CD | Cloud services | Embeddings | Evaluation401k contribution | Dental insurance | Disability benefits | Flexible spending accounts | Flexible time offSenior-level Full TimeSan Diego, California, United States12h ago
-
Senior-level Contract Full TimeChicago, Illinois, United States13h ago
-
Senior Embedded Software Engineer USD 160K-200KBare Metal | C Language | C# | C++ | Computer Architecture401k matching | Dental insurance | Health insurance | Onsite meals | Paid Maternity LeaveSenior-level Full TimeEl Segundo, California, United States13h ago
-
Applied AI Engineer USD 205K-282KAMS Integration | API Integration | Carrier Portal | Carrier Portal Integration | Data integration401k plan | FSA | Flexible vacation | HSA | Health insuranceExecutive-level Full TimeAustin - HQ R13h ago
-
Distinguished AI Engineer USD 350K-600KAgent systems | DBT | EHR Integration | Fine Tuning | GuardrailsSenior-level Full TimeNew York, NY R13h ago
-
Senior Machine Learning Engineer USD 170K-220KCausal Inference | Data Processing | FastAPI | Machine Learning | PandasSenior-level Full TimeNew York, NY13h ago
-
Lead Data Engineer, Revenue Engine USD 175K-255KDBT | Dagster | Data Exploration | Data Governance | Data ModelingSenior-level Full TimeNew York, NY13h ago
-
Senior Data Engineer USD 150K-220KClustering | DBT | Dagster | Data Lineage | Data ModelingIn office 4 days per week | On-call rotationSenior-level Full TimeNew York, NY13h ago