Senior AI Scientist
Durham, North Carolina, United States of America
USD 108K-270K Senior-level Full Time
Tasks
- Assess model bias fairness safety explainability
- Build automated evaluation pipelines
- Build human in the loop evaluation
- Build simulation based evaluation environments
- Collaborate with cross-functional teams
- Conduct end to end pipeline evaluation
- Create audit ready evaluation frameworks
- Define evaluation metrics
- Design LLM evaluation frameworks
- Develop agent evaluation strategies
- Develop prompt and version tracking systems
- Enable observability and traceability
- Ensure responsible AI compliance
- Establish evaluation standards
- Evaluate RAG systems
- Evaluate multi agent task success
- Implement LLM benchmarking
- Implement offline online evaluation
- Implement production monitoring
- Integrate evaluation with enterprise AI platforms
- Measure tool usage accuracy
- Mentor junior team members
- Mitigate privacy and data leakage risks
- Monitor model performance and drift
- Run A/B testing
- Set up canary releases
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Agent systems | Agentic AI | Artificial Intelligence | B testing | Bias Mitigation | Canary Releases | Data Privacy | Drift Detection | Embeddings | Evaluation metrics | Experiment Management | Experimental Design | Fairness | Knowledge graphs | LLM Evaluation | Langchain | Langgraph | Langsmith | Language Models | Language Processing | Large Language Models | Machine Learning | Model Drift | Model Drift Detection | Model Monitoring | Multi-Agent | Multi-Agent Systems | Natural Language | Natural Language Processing | OpenTelemetry | Privacy Protection | Prompt engineering | PyTorch | Python | RAG | Responsible AI | Retrieval-Augmented Generation | Semantic Kernel | TensorFlow | Tool use | Vector Databases
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Data Scientist USD 80K-157KAWS | Airflow | Annotation | Azure | ClassificationHybrid work mode | Professional development opportunitiesMid-levelGeorgetown University: Main Campus: Walsh School …20d ago
-
ATAC-seq | Chemo-genomics | Chemo-informatics | Chemo-proteomics | Molecular BiologyDental | Health care | PTO | Retirement | Sick leaveMid-level Full TimeCambridge, Massachusetts, US1h ago
-
Data Scientist USD 135K-180KData Analysis | Data Pipelines | Data Science | Data Validation | ETLDental insurance | Disability insurance | Flexible spending account | Flexible work-life balance | Health savings accountSenior-level Full TimeYorktown, VA5h ago
-
Clinical Product Specialist, AI Development USD 23K-84KACT | Artificial Intelligence | CBT | Clinical Research | Clinical Trial DesignMid-level Full TimeUnited States7h ago
-
Senior Product Data Scientist, Pickups & Dropoffs USD 196K-242KA/B | A/B Testing | B testing | Data Pipelines | Experiment designCompany benefits program | Discretionary annual bonus | Equity incentive plan | Hybrid work schedule | Potential travel to pre launch territoriesSenior-level Full TimeMountain View, CA, US; San Francisco, …9h ago
-
Manager of Applied AI Architecture, Startups USD 315K-380KAI architecture | API Integration | Agentic Architectures | Context engineering | Developer ToolingSenior-level Full TimeSan Francisco, CA10h ago
-
AI Governance Leader USD 165K-216KAI Act | AI Governance | AI RMF | Artificial Intelligence | Data GovernanceRemote-first work environment | Travel as requiredSenior-level Full TimeUS-Remote R10h ago
-
Data & AI Strategy Leader USD 165K-216KAI Governance | AWS | Artificial Intelligence | Azure | Business caseAutonomy | Casual work environment | Inclusive culture | Remote-first environmentSenior-level Full TimeUS-Remote R10h ago
-
AWS Amazon Connect Agentic AI Engineer USD 153K-227KAWS CDK | AWS Lambda | Amazon Bedrock | Amazon CloudWatch | Amazon ConnectMid-level Full TimeUnited States - Remote R10h ago
-
Sr. Data Scientist, Product USD 145K-203KAmplitude | Apache Airflow | DBT | Data Integrity | Data Quality401k match | Family-forming benefits | Financial Planning Sessions | Flexible time off | Free snacks and refreshmentsSenior-level Full TimeAustin, Texas, United States11h ago
-
Senior AI Research Scientist- World Model USD 165K-185K3D Reconstruction | Auto-labeling | C++ | Computer Vision | Data Curation401k matching | Health insurance | Paid time off | Parental leaveSenior-level Full TimeSunnyvale, CA, United States12h ago
-
System & Data Scientist USD 140K-190KAgile | Data Analysis | Data Management | Data Visualization | GISCore working hours | Hybrid work environment | Office-based roleMid-level Full TimeSunnyvale12h ago
-
AI Research Scientist- World Model USD 165K-185K3D Reconstruction | Auto-labeling | C plus plus | Computer Vision | Data Curation401k matching | Health insurance | Life and disability protection | Paid time off | Parental leaveMid-level Full TimeSunnyvale, CA, United States12h ago
-
Senior Data Scientist USD 137K-237KAnomaly Detection | AutoEncoder | Betweenness centrality | Boosted Trees | Cluster detection401k employer contribution | Bereavement leave | Company laptop | Flexible work hours | HSA and FSASenior-level Full TimeMaryland12h ago
-
Senior-level Full TimeLATAM (Remote), US (Remote) R12h ago
-
ADME-Tox | Cheminformatics | Data Analysis | Data Visualization | Deep learningSenior-level Full TimeRedwood City, California, United States12h ago
-
Data Scientist USD 200K-330KAPI Integration | Causal Inference | Data Modeling | Data Pipelines | Data Visualization401k | Commuter benefits | Employee assistance program | Free Lunches | Medical, dental, and vision insuranceMid-level Full TimeSan Francisco, CA13h ago
-
Data Scientist, Marketing USD 141K-202KAirflow | Attribution Modeling | BI Dashboards | BigQuery | Cloud DataFree days | Healthcare benefits | Paid Holidays | Paid time off | Pet insuranceMid-level Full TimeUS - San Francisco, United States; …13h ago
-
AI Solutions Specialist USD 83K-115KAutomation | Data Modeling | LLM evaluations | Language Models | Large Language Models401k match | Community involvement time | Commuter benefit | Health, dental, and vision benefits | In-office and remote flexibilitySenior-level Full TimeRemote, USA R13h ago
-
Data Insights – Tech Manager – IC4 USD 138K-225KAirflow | Amazon SageMaker | Business Intelligence | Customer Health | DBTHybrid work option | Inclusion and fun culture | Mentoring and growth opportunitiesMid-level Full TimeSan Francisco, CA, United States13h ago
-
Mid-level Full TimeDallas, TX, United States14h ago
-
Senior-level Full TimeMountain View, California, USA; San Francisco, …14h ago
-
Data Scientist USD 170K-216KExperimental Design | Machine Learning | Python | R | SQLCompany benefits program | Discretionary annual bonus | Equity incentive plan | Remote work eligibilityMid-level Full TimeMountain View, California, USA; San Francisco, …14h ago
-
Senior-level Full TimeWashington, D.C.14h ago
-
AI Lead, Strategy, and Operations USD 220K-280KAI strategy | Artificial Intelligence | Data Pipelines | Executive Communication | Machine Learning401k | Equity | FSA | Flexible time off | Flexible work hoursSenior-level Full TimeSanta Clara, CA or Remote R15h ago