Data Scientist - AI evaluation
Heredia, Flores, Costa Rica
USD 116K-123K (estimate) Mid-level Contract
Tasks
- Analyze evaluation data and performance trends
- Apply statistical analysis to assess AI effectiveness
- Collaborate with AI research engineering and product teams
- Develop evaluation metrics for AI systems
- Document evaluation findings and recommendations
- Identify trends patterns and improvement opportunities
- Maintain data integrity and align with quality standards
- Use experimentation techniques to evaluate AI systems
- Validate data quality for evaluation
Perks/Benefits
Skills/Tech-stack
Benchmarking | Data Analysis | Data Quality | Experimentation | Machine Learning | Python | SQL | Statistics
Education
Roles
Regions
Countries
States
Related jobs
-
Senior Research Scientist/Software Engineer, LLM/Agent Platform (TikTok-Content Ecology AI Innovation & Platform) USD 160K-230KCUDA | Deep learning | DeepSpeed ZeRO | Distributed Systems | Evaluation FrameworksSenior-level Full TimeSan Jose, California, United States3d ago
-
A/B | A/B Testing | Anomaly Detection | B testing | Classification AlgorithmsSenior-level Full TimeSan José, CA, USA; Mountain View, …3d ago
-
5017 Data Scientist/Analyst USD 99K-140KAWS | Azure | Cloud services | Dashboard Development | Data IngestionMid-level Full TimeSan Jose, CA5d ago
-
Algorithms | C++ | Cause analysis | Data Structures | Distributed Systems401k savings plan | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeSan Jose, California, United States5d ago
-
Research Scientist Graduate (Data-Intelligent Creation-Vision and Graphics-Global GenAI) - 2027 Start (PhD) USD 162K-316K3D Generation | Adversarial Networks | C plus plus | Computer Vision | Diffusion Models401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States5d ago
-
Computer Vision | Deep learning | Foundation Models | Generative AI | Large Scale TrainingEntry-level Full TimeSan Jose, California, United States5d ago
-
Research Scientist Graduate (Foundation Model-Speech-Interaction & Learning) - 2026 Start (PhD） USD 254K-480KAlgorithms | Audio CODEC | Audio Codec Learning | C# | C++401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityEntry-level Full TimeSan Jose, California, United States5d ago
-
Research Scientist Graduate (Seed AI Foundation Model Infrastructure) - 2027 Start (PhD) USD 254K-480KAlgorithms | C plus plus | C# | Data Structures | Deep learning401k matching | Dental insurance | Health insurance | Life insurance | Long-term disabilityEntry-level Full TimeSan Jose, California, United States5d ago
-
Algorithms | CUDA | Computer Architecture | Data Structures | Deep Learning Training401k match | Life insurance | Long-term disability | Medical/Dental/Vision insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States5d ago
-
Research Scientist Graduate (Seed Quantum Chemistry and Machine Learning) - 2027 Start (PhD) USD 162K-316KDeep learning | Machine Learning | Mathematics | Programming | Quantum Chemistry401k matching | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States5d ago
-
Adaptive Procedures | C++ | Computational modeling | Data Analysis | Experiment design401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSan Jose, California, United States5d ago
-
Research Scientist - Driven Agent Self-Evolution - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 202K-368KDeep learning | JAX | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSan Jose, California, United States5d ago
-
Audio Modeling | C plus plus | C# | Deep learning | Instruction Tuning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States5d ago
-
C++ | Computer Vision | Deep learning | End to End | End to End Machine Learning Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSan Jose, California, United States5d ago
-
Co-design | Computer Vision | Data Compression | Deep learning | Efficient Neural NetworksEntry-level InternshipSan Jose, California, United States5d ago
-
Research Scientist, Generative AI Graduate (Intelligent Creation) -Global Frontier Tech Recruitment Program -2027 Start (PhD) USD 254K-588K3D Generation | Adversarial Networks | C++ | Computer Vision | Diffusion Models401k savings plan | Health insurance | Paid Holidays | Paid parental leave | Paid personal timeEntry-level Full TimeSan Jose, California, United States5d ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 218K-480KAccess Optimization | Algorithms | CUDA | Computer Architecture | Data Structures401k match | Life insurance | Long-term disability | Medical/Dental/Vision insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States5d ago
-
Architecture Optimization | C plus plus | Computer Vision | Data Pipelines | Machine Learning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States5d ago
-
Bandwidth Optimization | Co-design | Computer Vision | Data Compression | Deep learningHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level InternshipSan Jose, California, United States5d ago
-
C# | C++ | Computer Vision | Data Pipelines | Deep learning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States5d ago
-
Automatic Speech Recognition | Automatic Speech Translation | C plus plus | Deep learning | Distributed Computing401k savings plan | Dental insurance | Life insurance | Long-Term Disability coverage | Medical insuranceMid-level Full TimeSan Jose, California, United States5d ago
-
3DGS | C# | C++ | Computer Graphics | Computer Vision401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSan Jose, California, United States5d ago
-
Research Scientist, Vision Foundation Model USD 254K-480KComputer Vision | Deep learning | Foundation Models | Large Scale Training | Large-scale401k match | Dental insurance | Life insurance | Long-Term Disability coverage | Medical insuranceEntry-level Full TimeSan Jose, California, United States5d ago
-
Senior Research Scientist - Machine Learning System USD 218K-387KAccess Optimization | C# | C++ | CUDA | Computer ArchitectureSenior-level Full TimeSan Jose, California, United States5d ago
-
C plus plus | C# | Data pipeline | Deep learning | Language Processing401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States5d ago