Data Scientist
Enterprise - US, Texas, Frisco, United States
USD 130K-175K (estimate) Mid-level Full Time
Tasks
- Benchmark LLMs and agentic systems
- Build synthetic and real world datasets
- Collaborate with engineers and product teams on evaluation standards
- Create agent test harnesses and pass fail criteria
- Define evaluation metrics and instrument dashboards
- Design evaluation pipelines for agentic AI systems
- Develop knowledge graph evaluation methods
- Implement LLM as judge and preference evaluation workflows
Perks/Benefits
- Community involvement support
- Family-friendly benefits
- Flexible work hours
- Medical, dental & vision coverage
- Paid parental leave
- Paid time off
- Retirement plans
Skills/Tech-stack
AWS | Agent coordination | Agentic AI | Data Generation | EleutherAI LM Eval | Embedding-based retrieval | Entity Resolution | Experimental Design | Faithfulness | Groundedness | Hallucination detection | Helm | Knowledge graphs | LLM-as-judge | Langfuse | Language Models | Large Language Models | Lm-eval | MLflow | Machine Learning | Multi-Agent | Multi-Agent Coordination | NebulaGraph | Neo4j | NumPy | Pandas | Preference Evaluation | Python | Qdrant | Ragas | React | Scikit-learn | Statistical Analysis | Synthetic Data Generation | Synthetic data | Vector Databases | Weights and Biases
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Data Scientist USD 114K-190KAnomaly Detection | Classification | Clustering | Data Visualization | HadoopHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Chantilly2h ago
-
Research Scientist Graduate - (Trust and Safety - CV/NLP/Multimodal LLM, San Jose) - 2026 Start (BS/MS) USD 137K-237KComputer Vision | Deep learning | Distributed Training | Language Models | Language ProcessingEntry-level Full TimeSan Jose, California, United States4h ago
-
Research Scientist Graduate - (Trust and Safety - CV/NLP/Multimodal LLM) - 2026 Start (BS/MS) USD 137K-237KComputer Vision | Deep learning | Language Models | Large Language Models | Multimodal LearningEntry-level Full TimeSeattle, Washington, United States4h ago
-
Research Scientist in Large Language Model (LLM) - Seed - Graduates - 2027 Start (PhD) USD 244K-450KData Engineering | Deep learning | Instruction Tuning | Language Processing | Machine LearningEntry-level Full TimeSan Jose, California, United States4h ago
-
Senior Data Scientist USD 112K-183KAWS Glue | AWS Lambda | Amazon Bedrock | Amazon EMR | Amazon S3401k savings plan | Career development | Employee assistance program | Flexible spending accounts | Health savings accountSenior-level Full TimePeoria, Illinois, United States16h ago
-
Staff Applied Scientist USD 193K-242KAlgorithms | Data Analysis | Machine Learning | Machine Learning Inference | Metrics401k match | Child care benefits | Family building benefits | Lyft Pink membership | Lyft creditsSenior-level Full TimeSan Francisco, CA R18h ago
-
Cassandra | Data Cleansing | Data Imputation | Data Preprocessing | DockerMid-level Full TimeSunnyvale, California1d ago
-
AI Research Scientist III USD 150K-275KAzure | Bioinformatics | Cheminformatics | Deep learning | DevOpsAbove market benefits | Generous vacation | Parental leave | Team-building activitiesSenior-level Full TimeBoston, MA1d ago
-
AI Research Scientist I USD 131K-208KArtificial Intelligence | Deep learning | DevOps | Distributed Computing | Graph Neural NetworksGenerous vacation | Great colleagues | Parental leave | Team-building activitiesMid-level Full TimeBoston, MA1d ago
-
AI Research Scientist II USD 144K-216KAzure | Bioinformatics | Cheminformatics | Deep learning | DevOpsGenerous vacation | Parental leave | Team-building activitiesMid-level Full TimeBoston, MA1d ago
-
Applied & Computational Research Scientists USD 112K-149KAlgorithm Design | Artificial Intelligence | Benchmarking | C# | C++Hybrid work schedule | Travel for conferencesMid-level Full TimeMenlo Park, CA, United States1d ago
-
Data Scientist (Machine Learning) USD 180K-230KCausal Inference | Classification | Credit Scoring | Forecasting | Machine Learning401k | Dental insurance | Equity | Extended maternity leave | Extended paternity leaveMid-level Full TimeNYC1d ago
-
Senior-level Full TimeMountain View, CA1d ago
-
Supply Chain Strategy and Transformation Data Scientist USD 130K-229KBig Data | Cloud Computing | Dashboards | Data Modeling | Data PipelinesMid-level Full TimeTempe, Arizona, United States2d ago
-
DPO | Data Curation | Data Generation | Data Quality | Data Quality ManagementSenior-level Full TimeMenlo Park, CA2d ago
-
Researcher, Frontier Strategy and Governance, DeepMind USD 156K-228KArtificial Intelligence | Data Structures | Evaluation metrics | Machine Learning | ResearchMid-level Full TimeMountain View, CA, USA; New York, …2d ago
-
Data Modeling | Database querying | Deep learning | Incrementality testing | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …2d ago
-
Staff Applied Data Scientist, Pricing USD 207K-244KA/B | A/B Testing | B testing | Causal Inference | Data ModelingQuarterly in person surges | Remote-first workSenior-level Full TimeRemote - USA R2d ago
-
Data Scientist USD 102K-202KArtificial Intelligence | Data Preparation | Data cleaning | Explainable AI | Generative AIEntry-level Full TimeUnited States2d ago
-
Applied Scientist, AWS Automated Reasoning USD 142K-223KAutomated Reasoning | Cloud | Dafny | Haskell | KotlinFlexible work hours | Mentoring community | Training and career growth resources | Work-life harmonyMid-level Full TimeArlington, Virginia, USA2d ago
-
AI Scientist USD 100K-150KAccelerator hardware | Deep learning | Distributed Training | JAX | Language ModelsRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Staff Product Data Scientist, Experimentation USD 230K-284KApplied statistics | Causal Inference | Data Pipelines | Experimental Design | ExperimentationAnnual bonus program | Company benefits program | Equity incentive planSenior-level Full TimeSan Francisco, CA; Mountain View, CA2d ago
-
Applied AI Data Scientist USD 180K-240KAgile | Causal Inference | Chain-of-Thought | Computer Vision | Deep learningAnnual team retreat | Flexible schedule | Free Lunches | Health insurance | Remote workMid-level Full TimeLA office / US remote R2d ago
-
Researcher, Robot Intelligence USD 163K-324K3D Mapping | 3D Perception | Agentic Architectures | C# | C++Senior-level Full Time665 Clyde Avenue, Mountain View, CA, …2d ago
-
Sr. Product Data Scientist, Planning USD 196K-242KCausal Inference | Data Pipeline Development | Data pipeline | Forecasting | Machine LearningCompany benefits program | Discretionary annual bonus | Equity incentive planSenior-level Full TimeSan Francisco, CA; Mountain View, CA2d ago