Senior AI/ML Model Validation & Governance Specialist
Tasks
- Assess data quality and implementation
- Assess model monitoring frameworks
- Benchmark model performance
- Communicate with stakeholders and risk teams
- Conduct sensitivity analysis
- Document validation findings and recommendations
- Evaluate NLP LLM and RAG solutions
- Evaluate explainability and robustness
- Evaluate model methodology and assumptions
- Perform independent model validation
- Review regulatory compliance
- Run stress testing
- Support AI governance and model risk standards development
- Test bias and fairness
Perks/Benefits
Skills/Tech-stack
Benchmarking | Bias detection | Explainable AI | Fairness testing | Generative AI | LLM | Machine Learning | Model Monitoring | NLP | Python | RAG | Robustness Testing | SQL | Sensitivity Analysis | Stress Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Regions
Countries
States
Cities
Related jobs
-
Artificial Intelligence | Automation | LLM integrations | Langchain | Language ModelsContractor | Fully remoteSenior-level ContractLos Angeles R9h ago
-
Forward Deployed AI Engineer (GenAI, AWS) USD 175K-200KAWS | AWS CDK | AWS Neptune | Amazon ECS | Amazon SageMakerRemote-friendly cultureSenior-level Full TimeNew Jersey9h ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | DockerCareer coaching | Employee assistance programme | Flexible working hours | Global career opportunities | Hybrid workEntry-level Full TimeColorado, United States14h ago
-
Senior Digital Analytics Specialist USD 90K-120KA/B | A/B Testing | B testing | Chrome DevTools | Conversion RateDental insurance | Health insurance | Paid parental leave | Paid vacation | Remote workSenior-level Full TimeUnited States, USA, United States R15h ago
-
Applied AI Lead USD 120K-150KAgent workflows | Automated evals | Benchmarking | Continuous Monitoring | Evaluation Frameworks401k plan | Health insurance | Paid time off | Parental leave | Visa sponsorship not availableSenior-level Full TimeRemote/Hybrid R15h ago
-
AI Intern - Communications USD 50K-68KAnthropic | Artificial Intelligence | Google Cloud | JavaScript | LLM APIsEntry-level Internship Part TimeUnited States, United States16h ago
-
A/B | A/B Testing | Access Control | B testing | ExperimentationSenior-level Full TimeChicago, IL, United States16h ago
-
WEM AQM Prompt Engineer USD 70K-195KAPI | Contact center | F1-score | Genesys | JSON401k employer matching | Basic life insurance | Company-Paid Holidays | Employee stock purchase plan | Health, dental, vision coverageMid-level Full TimeUnited States (Remote) R16h ago
-
Checkpointing | DeepSpeed | Distributed Computing | Fault Tolerance | Fine Tuning401k | Dental insurance | Health insurance | Hybrid work | Paid HolidaysSenior-level Full TimeBellevue18h ago
-
AI Agents | AI Governance | Artificial Intelligence | Cybersecurity compliance | Enterprise SearchHybrid work | Local residency requirementEntry-level ContractAustin, United States19h ago
-
Benchmarking | Bias Fairness Testing | Bias/fairness | Data Quality | Explainable AIBonus | Hybrid work | Onsite work in New York City | Sign-on bonusSenior-level Full TimeNew York, New York, United States19h ago
-
AI Platform Engineer USD 108K-215KAutogen | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key VaultMid-level Full TimeBelmont, NC, United States19h ago
-
AI Platform Engineer USD 108K-215KAI Agents | Agent Frameworks | Autogen | Azure Data | Azure Data LakeMid-level Full TimeBelmont, NC, United States19h ago
-
Analytics | Artificial Intelligence | Cloud Computing | Data Architecture | Data GovernanceCompetitive benefits package | Mentorship | Professional development | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …20h ago
-
Lead, AI Engineering USD 180K-220KAWS Firehose | AWS Glue | AWS SageMaker | Amazon Kinesis | Automated retraining401k match | Employer Income Protection | Medical/Dental/Vision | Paid parental leave | Paid time offSenior-level Full TimeCharlotte, North Carolina, United States21h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 77K-176KAPI Development | Agile | Backend Development | Cloud Computing | Data Preparation401k | Employee discounts | Employee referral rewards | Flexible work schedule | Health savings accountMid-level Full TimeQuantico, VA, US R22h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R22h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …22h ago
-
AI Embedded Business Automation Engineer USD 130K-175KAPI Integration | Agent Frameworks | Auditability | Authentication | AuthorizationSenior-level Full TimeNew York City, NY, United States1d ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States1d ago
-
AI Engineer (Temporary) USD 85K-95KAWS | Agents SDK | Anthropic API | Azure | Data RiskAccess to training and enablement resources | Hybrid work environment | Temporary contract with benefitsEntry-level Full Time TemporaryIthaca (Main Campus), United States1d ago
-
AI/LLM Engineer USD 101K-203KAPI Design | AWS | Anthropic | Atlas Vector Search | AzureMedical/Dental/Vision | Paid time off | Retirement savings | Wellness programsMid-level Full TimeHartford-Farmington Ave Rogers, United States1d ago
-
Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud ML | Cloud ML platformsOn-site work | TS SCI CI polygraph clearanceSenior-level Full TimeWashington, DC1d ago
-
AI/ML Engineer - TS/SCI + CI Polygraph Required USD 141K-225KAWS SageMaker | Azure Machine Learning | Bias Testing | CI/CD | Data PreprocessingOn site work opportunitySenior-level Full TimeWashington, DC1d ago
-
AI Engineer USD 100K-120KAgile | CI/CD | Data Analysis | Data cleaning | DockerRelocation assistanceEntry-level Full TimePittsburgh, PA1d ago