Senior and Principal Applied Scientists - CoreAI
Redmond, WA, US; Mountain View, CA, US
USD 119K-304K Senior-level Full Time
Tasks
- Advance observability for AI systems using traces logs metrics evaluations and cost signals
- Build models to detect regressions identify root causes and characterize agent behavior
- Contribute to instrumentation and semantic standards for agent observability
- Define quality signals and benchmarks for agent performance
- Design methodologies connecting offline evals online signals and production telemetry
- Develop evaluation and measurement frameworks for agents and multi agent systems
- Lead scientific direction and mentor teams
- Partner with engineering teams to operationalize evaluation and observability in production
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Anomaly Detection | Application Insights | Azure Monitor | B testing | Canary deployments | Causal Inference | Data Analysis | Distributed tracing | Evaluation Frameworks | Experiment design | Langchain | Langgraph | Language Models | Language Processing | Large Language Models | Machine Learning | Natural Language | Natural Language Processing | OpenAI SDK | Python | Regression Analysis | Staged rollouts | Statistics | Telemetry Analysis
Education
Regions
Countries
States
Related jobs
-
Senior-level Full TimeSunnyvale, CA3h ago
-
Technical Principal USD 216K-235KData Mining | Data Visualization | Data pipeline | Excel | PHPTelecommute allowed from anywhere in the U.S.Senior-level Full TimeMenlo Park, CA | Remote, US R3h ago
-
Senior Data Scientist, GeminiApp, DeepMind USD 232K-252KData Analysis | Data Visualization | Experiment design | Language Processing | Machine LearningSenior-level Full TimeMountain View, CA, USA; New York, …4h ago
-
Genome Editing Scientist--Bioinformatics USD 94K-141KATAC-seq | Amplicon sequencing | CRISPR-Cas | Chromatin Accessibility | Data VisualizationDental | Health care | Paid time off | Retirement | Sick leaveMid-level Full TimeChesterfield, Missouri, US7h ago
-
Data Scientist - PhD required - onsite Dallas, TX USD 85K-110KAlteryx | Correlation Analysis | Data Cleansing | Data Mining | Data VisualizationEmployer 401k match | Medical/Dental/Vision | Paid time off | Professional growth | Profit sharingMid-level Full TimeDallas, Texas, United States9h ago
-
Data Scientist - PhD required - onsite NYC USD 130K-160KAlteryx | Correlation | Data Cleansing | Data Mining | Data Visualization401k matching | Background check screening | Employee stock purchase program | Holidays | Medical/Dental/Vision insuranceMid-level Full TimeNew York, New York, United States9h ago
-
Principal Applied Scientist - Copilot USD 139K-304KA I | A I Product Development | A/B | A/B Testing | B testingSenior-level Full TimeRedmond, WA, US14h ago
-
Quantum Applied Scientist, Processor Test & Measurement, Amazon Center for Quantum Computing USD 136K-184KC++ | Error correction | Experimental Measurement Techniques | Experimental measurement | JavaCareer growth | Mentorship | Work-life balanceMid-level Full TimePasadena, California, USA15h ago
-
Sr Data Scientist USD 113K-147KData Analysis | Data Visualization | Machine Learning | Python | SQL401k match | Paid time off | Stock purchase planSenior-level Full TimeStamford - 56 Top Gallant, United …15h ago
-
Principal Applied Scientist USD 139K-304KApache Spark | Big Data | Cosmos | Data Processing | Data ScienceSenior-level Full TimeRedmond, WA, US16h ago
-
Senior Data Scientist USD 99K-135KAgile | Artificial Intelligence | Data Analysis | Data Visualization | Exploratory Data Analysis401k | Certification reimbursement | Cruise and Travel Privileges for Family | Employee stock purchase plan | Health benefitsSenior-level Full TimeMiami, FL, United States16h ago
-
Senior Data Scientist USD 36K-42KAWS | Chronos | DBT | Deep learning | Experimentation401k match | Career growth | Dental insurance | Gym reimbursement | Health insuranceSenior-level Full TimeProvo, UT17h ago
-
Bioinformatics Staff Data Scientist # 4768 USD 169K-224KDNA Methylation | Data Processing | Epidemiology | Genomics | Git401k employer match | Flexible time off | Medical, dental & vision coverage | Mindfulness programsSenior-level Full TimeMenlo Park, CA18h ago
-
Data Science Principal USD 176K-282KAI Assisted Development | Anomaly Detection | Audit Trail | Business Intelligence | Code generationEmployee resource groups | Employee wellbeing support | Fitness programs | Learning and development programs | Medical, dental, vision plansSenior-level Full TimeBoston, Massachusetts, United States18h ago
-
Data Science Principal USD 176K-282KAnomaly Detection | Audit Trail | Automation | Data Cleansing | Data Governance401k employer match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeNew York, New York, United States18h ago
-
Data Science Principal USD 176K-282KAnomaly Detection | Audit trails | Data Governance | Data Lineage | Data Management401k employer match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSterling18h ago
-
Data Science Principal USD 176K-282KAI | Audit trails | Business Intelligence | Data Governance | Data Lineage401k employer match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeAtlanta, Georgia, United States18h ago
-
Data Science Principal USD 176K-282KAnomaly Detection | Audit trails | Business Intelligence | Data Cleansing | Data Governance401k match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimePhoenix, Arizona, United States18h ago
-
Data Science Principal USD 176K-282KAI code generation | Anomaly Detection | Audit trails | Business Intelligence | Code generation401k match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSan Francisco, California, United States18h ago
-
Data Science Principal USD 176K-282KAnomaly Detection | Audit trails | Data Cleansing | Data Governance | Data Lineage401k employer match | Discretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSeattle, Washington, United States18h ago
-
Senior-level Full TimeManhattan, NY; Toronto, Canada18h ago
-
Staff Data Scientist USD 200K-325KClinical Research | Data Science | Data pipeline | Experiment design | Healthcare DataSenior-level Full TimeCambridge, Massachusetts, United States, New York, …19h ago
-
Data Scientist USD 93K-116KDeep learning | Dense retrieval | Embeddings | Langchain | Language Models401k match | Commuter benefits | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeRemote- US R19h ago
-
Project Data Scientist USD 66K-72KDashboard Development | Data Analysis | Data Governance | Data Management | Data SovereigntyMid-level Full TimeLos Angeles, CA, US19h ago
-
Data Scientist USD 98K-184KArtificial Intelligence | Data Visualization | Databricks | ETL | GenAICertifications | Hands-on experience | Industry training | Ongoing learningSenior-level Full TimeWashington, DC19h ago