Director Model Risk Management - AI/Gen AI
USD 136K-204K Executive-level Full Time
Tasks
- Assess data quality and lineage
- Assess guardrails and HITL HOTL controls
- Assess quantitative and qualitative testing
- Define performance metrics for AI and GenAI
- Deliver model validation findings and recommendations
- Develop model validation tools
- Enhance GenAI model validation framework
- Evaluate prompt engineering and context engineering
- Lead model validation
- Monitor external AI ML advancements
- Partner with data science and actuarial teams
- Perform model drift detection
- Report validation results to stakeholders
- Review and challenge AI and GenAI models
- Review model outputs for downstream use
- Upskill teams on GenAI tools
- Validate model accuracy and integrity
Perks/Benefits
- N/A
Skills/Tech-stack
Agent Development Kit | Artificial Intelligence | Context engineering | Data Lineage | Data Quality | Drift Detection | Generative AI | Google Agent Development Kit | Guardrails | Huggingface | Human On The Loop | Human-in-the-loop | LLM Evaluation | Langchain | Langgraph | Language Models | Large Language Models | Machine Learning | Model Drift | Model Drift Detection | Model Risk Management | Model Validation | Model risk | Neural Networks | OpenAI API | Prompt engineering | Python | Qualitative assessment | Quantitative metrics | R | RAG | Retrieval-Augmented Generation | Risk Management | SAS | SQL | The Loop | Vertex AI
Education
Regions
Countries
States
Cities
Related jobs
-
Director, Analytics & Compliance USD 150K-300KAnalytics | Analytics Strategy | Analytics frameworks | Compliance Monitoring | Data Governance401k | Holiday pay | Parental leave | Sick time | VacationExecutive-level Full TimeUS014 MA Raynham - 325 Paramount …17h ago
-
Executive-level Full TimeNew York, New York, United States1d ago
-
Director, Health Plan Enrollment & Eligibility USD 130K-165KAudit Readiness | Capitated Healthcare | Census Management | Eligibility | EnrollmentEquity program | Health insurance | Life insurance | Paid time off | Sick leaveExecutive-level Full TimeUnited States R2d ago
-
Senior Director, Growth & Commerce Product Analytics USD 230K-280KA/B | A/B Testing | B testing | CUPED | Causal Inference401k | Dental insurance | Discounts | Medical insurance | Paid leaveExecutive-level Full TimeNew York, NEW YORK, United States R2d ago
-
Director, Data Engineering & Architecture (Remote) USD 210K-272KAI | Analytics reporting | Cloud Native | Data Architecture | Data Governance401k matching | Cell phone stipend | Employee stock purchase plan | Flexible paid time off | Health benefitsSenior-level Full TimeSunnyvale, CA R2d ago
-
Access Controls | Airbyte | Airbyte Ingestion | Alteryx | Analytics engineeringComprehensive well being package | Remote-first work cultureExecutive-level Full TimeChicago, IL, United States R2d ago
-
Alteryx | Analytics | Business Intelligence | Customer Relationship Management | Customer relationshipComprehensive well-being benefits | Remote-first cultureExecutive-level Full TimeAtlanta, GA, United States R2d ago
-
Airbyte | Alteryx | Amazon Redshift | Analytics engineering | Business IntelligenceCareer growth | Comprehensive well being package | Purpose-driven mission | Remote-first cultureExecutive-level Full TimeDallas, TX, United States R2d ago
-
Senior Director, Content Analytics and Special Projects USD 160K-180KAI | APIs | BigQuery | CSV | Dashboards401k match | Commuter benefits | Dental insurance | Employee assistance program | Gym membership discountsSenior-level Full TimeNew York, New York, United States2d ago
-
AI | Agentic Workflows | Analytics Platforms | Automation | Behavioral analyticsExecutive-level Full TimeBrooklyn, NY; San Francisco, CA; Washington, …2d ago
-
Director Product Management - Analytics, Oracle Health USD 139K-306KAPIs | Agile Product | Agile Product Development | Business case | CDA401k company match | Adoption Assistance | Commuter and parking benefits | Dental insurance | Disability insuranceExecutive-level Full TimeUnited States2d ago
-
Associate Director, Market Access Analytics USD 150K-190KBusiness Intelligence | Dashboard Development | Data Visualization | Data analytics | ExcelCollaborative team environment | Conference attendance opportunity | Generous time-off policy | Work-life balance emphasisMid-level Full TimeWaltham, MA, United States3d ago
-
Business Intelligence | Dashboard Development | Data Architecture | Data Governance | Data LiteracyExecutive-level Full TimeCleveland, OH, 44103, US3d ago
-
Director, Solution Architecture - (Data Science & AI) USD 200K-300KAWS | Agent workflows | Agentic Systems | Artificial Intelligence | AzureExecutive-level Full TimeChicago, IL, United States3d ago
-
Assistant Director, Enrollment Content USD 50K-65KA/B | A/B Testing | Analytics | Audience research | B testingHybrid work schedule | Medical, dental & vision coverage | Paid Holidays | Paid time off | Retirement planExecutive-level Full TimePennsylvania-Philadelphia-Main Campus3d ago
-
Business Intelligence | CI/CD | Cloud Computing | Data Lake | PythonHealth insurance | Job security | Pension plan | Tax-deferred savings | Work from homeExecutive-level Full TimeLong Island City, NY, United States3d ago
-
APIs | Access Control | CI/CD | Cloud Data | Cloud Data PlatformsHealth insurance | Pension plan | Tax-deferred savings | Work From Home Up To Two Days | Worksite wellness programExecutive-level Full TimeLong Island City, NY, United States3d ago
-
A/B | A/B Testing | Azure | B testing | DAXHybrid work | Onsite workExecutive-level Full TimeNewark, New Jersey, United States3d ago
-
Director, Enterprise Applications and Data Analytics USD 145K-175KAPIs | Asana | Customer Relationship Management | Customer relationship | DBTExecutive-level Full TimeUnited States3d ago
-
Director of AI & Machine Learning USD 200K-272KAI Governance | API Integration | Access Control | Audit Logging | Cloud Security401k matching | Company-Paid Holidays | Corporate discounts | Insurance (medical, dental, vision) | Paid time offExecutive-level Full TimeRemote (All), United States R3d ago
-
Director, Data Engineering (AI Native) USD 216K-318KAmplitude | Anomaly Detection | Artificial Intelligence | Cloud Cost Management | Cost ManagementRemote work environmentExecutive-level Full TimeRemote, USA; Remote, Canada R3d ago
-
Director, Applied AI Product Manager USD 127K-250KAI Governance | APIs | Access Control | Agentic architecture | Artificial IntelligenceFlexible resources tools wellbeing programs | Paid leave | Paid volunteer timeExecutive-level Full TimeNew York, NY, United States3d ago
-
Director, Yield Strategy & Analytics USD 128K-150KAWS | Ad Manager | Anomaly Detection | Azure | Data ModelingOnsite work in NYCExecutive-level Full TimeUSA - NY - New York …3d ago
-
Associate Director, Business Insights and Analytics USD 156K-247KAgile | Business acumen | Claims data | Customer Segmentation | Data ScienceMid-level Full TimeUSA - Pennsylvania - North Wales …3d ago
-
Director of Machine Learning Engineering - Agent Factory USD 225K-414KAI Agent | AI agent engineering | API Integration | Agent Engineering | Artificial IntelligenceCompany benefits | Flexible work schedule | In-office collaboration opportunities | Professional development opportunitiesExecutive-level Full TimeUSA, WA, Seattle, United States3d ago