Senior AI Scientist
Durham, North Carolina, United States of America
USD 108K-270K Senior-level Full Time
Tasks
- Apply responsible AI principles for safety fairness and explainability
- Assess tool usage accuracy and inter agent coordination
- Build audit ready evaluation frameworks for regulated environments
- Build scenario based and simulation driven evaluation environments
- Design evaluation frameworks for large language models
- Develop domain specific LLM benchmarks using clinical and regulatory data
- Develop evaluation tooling and experiment management platforms
- Enable observability and traceability with OpenTelemetry
- Evaluate end to end AI pipelines including RAG
- Evaluate multi agent and agentic AI systems
- Implement automated and human in the loop evaluation pipelines
- Implement offline and online evaluation with A B testing and canary releases
- Integrate evaluation frameworks with enterprise AI platforms
- Measure task success rates planning and reasoning quality
- Mitigate data leakage and privacy risks
- Monitor production performance and model drift detection
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Artificial Intelligence | B testing | Canary Releases | Embeddings | Evaluation metrics | Experiment Management | Human-in-the-loop | Knowledge graphs | LLM Evaluation | Langchain | Langgraph | Langsmith | Language Models | Large Language Models | Machine Learning | OpenTelemetry | Prompt engineering | PyTorch | Python | RAG | Responsible AI | Retrieval-Augmented Generation | Semantic Kernel | TensorFlow | The Loop | Vector Databases | Vector Search
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Data Scientist USD 80K-157KAWS | Airflow | Annotation | Azure | ClassificationHybrid work mode | Professional development opportunitiesMid-levelGeorgetown University: Main Campus: Walsh School …27d ago
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States5h ago
-
Data and Transformation Associate USD 76K-112KAgile | C# | Cloud Computing | Data Analysis | Data VisualizationMid-level Full TimeMorristown, NJ, United States5h ago
-
Principal Applied AI Scientist - Agentic AI USD 190K-210KAgentic Systems | Autogen | Cloud Computing | Data Quality | Data Systems401k match | Flexible schedule | Health insurance | Paid parental leave | Paid time offSenior-level Full TimeWork From Home, United States R6h ago
-
Principal Applied AI Scientist - Predictive AI USD 190K-210KAnomaly Detection | Big Data | Cloud Computing | Data Quality | Data quality assurance401k match | Disability insurance | Employee assistance program | Flexible schedules | Health insuranceSenior-level Full TimeWork From Home, United States R6h ago
-
Principal Applied AI Scientist - Agentic AI USD 190K-210KAccuracy testing | Agentic Systems | Autogen | Cloud Computing | CrewAI401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible schedulingSenior-level Full TimeWork From Home, United States R6h ago
-
AI Intern USD 50K-58KAccess Control | Artificial Intelligence | Cybersecurity | Data Privacy | Help deskEntry-level InternshipYork, United States9h ago
-
APIs | Android Development | Artificial Intelligence | IOS Development | JavaMid-level ContractChicago, United States9h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …10h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …10h ago
-
Deep learning | Fine Tuning | GPU resource management | Language Models | Large Language ModelsEntry-level Full TimeSeattle, Washington, United States11h ago
-
TikTok Shop - E-commerce Anti-Fraud Data Scientist USD 156K-296KA/B | A/B Testing | Analytics | B testing | Big DataMid-level Full TimeSeattle, Washington, United States11h ago
-
Senior Data Scientist, Long Island City, New York USD 160K-200KBig Data | Cloud platform | Clustering | Data Modeling | Data PipelinesTelecommuteSenior-level Full TimeLong Island City, NY, United States11h ago
-
Software Engineer, Systems ML - SW/HW Co-design USD 117K-173KAI infrastructure | Bias Mitigation | C# | C++ | Co-designSenior-level Full TimeSunnyvale, CA | Redmond, WA11h ago
-
Product Data Scientist, Discover Experience USD 138K-198KA/B | A/B Testing | B testing | Data Visualization | Experimentation analysisMid-level Full TimeMountain View, CA, USA12h ago
-
GTM Applied AI Architect, Google Cloud USD 153K-222KAgent Development | Agent Development Kit | Cloud platform | Function Calling | GeminiSenior-level Full TimeAustin, TX, USA; Boulder, CO, USA12h ago
-
Agentic AI Engineer USD 103K-158KAI Search | Agent Orchestration | Anthropic Claude | App Service | Autogen401k match | Flexible paid time off | Hybrid work flexibility | Medical/Dental/Vision | Paid parental leaveMid-level Full TimeGolden, CO, US13h ago
-
Senior Staff Data Scientist - Consumer Relevance USD 232K-325KCausal Inference | Counterfactual evaluation | Experimental Design | Offline evaluation | Power analysis401k employer match | Caregiving support | Comprehensive healthcare | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R22h ago
-
Senior-level Full TimeUS - Remote R23h ago
-
Senior Director, Head of AI Governance & Enablement USD 176K-265KAI Governance | AI Governance Measurement | AI Lifecycle | AI Lifecycle Management | AI Model Monitoring401k retirement plan | Medical, dental, and vision coverage | Paid leaves | Paid vacation and holidaysSenior-level Full TimeUS - Gaithersburg - MD, United …23h ago
-
Senior Data Scientist — Applied Analytics (Data & AI) USD 118K-195KClustering | DBT | Data Modeling | Data Quality | Data pipeline401k employer match | Paid parental leave | Paid time off and holidays | Tuition reimbursementSenior-level Full TimeRaleigh, United States R23h ago
-
Amber | Biophysics | CHARMM | Deep learning | Diffusion ModelsSenior-level Full TimeNew York, United States23h ago
-
Principal AI/ML Engineer USD 165K-226KC# | C++ | CI/CD | CUDA | Computer Vision401k match | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeRemote PA - PA PAR, United … R23h ago
-
AI Architect USD 130K-155KAI Governance | AI Search | AI architecture | API Integration | AWS AgentCoreHybrid work | Medical insurance | Paid time off | Professional development opportunities | Retirement planningSenior-level Full TimeUSA - Woburn (MA), United States23h ago
-
AV Safety Engineering Analytics Engineer (GPSSC) USD 160K-246KCI/CD | Dash | Docker | GitHub | JenkinsRemote workMid-level Full TimeWork From Home - United States, … R23h ago