Data Scientist - AI evaluation
Heredia, Flores, Costa Rica
USD 116K-123K (estimate) Mid-level Contract
Tasks
- Analyze evaluation data and performance trends
- Apply statistical analysis to assess AI effectiveness
- Collaborate with AI research engineering and product teams
- Develop evaluation metrics for AI systems
- Document evaluation findings and recommendations
- Identify trends patterns and improvement opportunities
- Maintain data integrity and align with quality standards
- Use experimentation techniques to evaluate AI systems
- Validate data quality for evaluation
Perks/Benefits
Skills/Tech-stack
Benchmarking | Data Analysis | Data Quality | Experimentation | Machine Learning | Python | SQL | Statistics
Education
Roles
Regions
Countries
States
Related jobs
-
(General Hire) Machine Learning Scientist Graduate (TikTok Recommendation) - 2027 Start (PhD) USD 119K-177KAlgorithms | C plus plus | C# | Data Structures | Deep learningEntry-level Full TimeSan Jose, California, United States4h ago
-
Computer Vision | Distributed Training | Language Models | Language Processing | Large Language ModelsCareer growthEntry-level Full TimeSan Jose, California, United States4h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Visual Search) - 2027 Start (PhD) USD 136K-205KComputer Vision | Data Mining | Distributed Systems | Evaluation | Information RetrievalEntry-level Full TimeSan Jose, California, United States4h ago
-
3D Modeling | 3D representations | Autoregressive models | Data strategy | Deep learningSenior-level Full TimeSan Jose, California, United States4h ago
-
Research scientist - AI Infra - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 212K-387KAI Memory Systems | AI memory | Artificial Intelligence | Benchmarking | CPU SchedulingNone Full TimeSan Jose, California, United States4h ago
-
3D Gaussian Splatting | 3D Scene | 3D Scene Reconstruction | Architecture Optimization | Context MemorySenior-level Full TimeSan Jose, California, United States4h ago
-
Staff Data Scientist, Marketing USD 175K-200KAWS | Ad Ranking | Embeddings | Funnel Optimization | LTV modelingSenior-level Full TimeAlajuela, Costa Rica (remote); Cartago, Costa … R4d ago
-
Staff Applied Scientist, AdTech USD 175K-200KAWS Cloud | Collaborative Filtering | Content-Based Recommendation | Content-based | Funnel OptimizationDiversity and inclusion | Equal employment opportunity | Remote-first cultureSenior-level Full TimeAlajuela, Costa Rica (remote); Cartago, Costa … R4d ago
-
Lead Data Scientist, AdTech USD 175K-200KAWS | Ad Tech Algorithms | Ad-Tech | Collaborative Filtering | Content-Based FilteringDiversity and inclusion | Remote-first teamSenior-level Full TimeAlajuela, Costa Rica (remote); Cartago, Costa … R4d ago
-
Lead Applied Scientist, Marketing USD 175K-200KAWS | Ad Ranking | Amazon SageMaker | Collaborative Filtering | Content-Based RecommendationSenior-level Full TimeAlajuela, Costa Rica (remote); Cartago, Costa … R4d ago
-
AI Agents | Cause analysis | Co Optimization | Distributed Systems | Elastic scalabilityPublishing supportSenior-level Full TimeSan Jose, California, United States6d ago
-
Agent systems | Data analytics | Deep learning | Fine Tuning | GPU resource managementEntry-level Full TimeSan Jose, California, United States6d ago
-
Algorithm Development | Language Models | Large Language Models | Machine Learning | Multimodal Machine LearningIndustry expert collaboration | Publishing opportunities | Research community eventsEntry-level Full TimeSan Jose, California, United States6d ago
-
CUDA | Distributed Systems | GPU | Language Models | Large Language ModelsCareer growth | Global team collaborationEntry-level Full TimeSan Jose, California, United States6d ago
-
Student Researcher (LLM Post Training – Agent & Reinforcement Learning) - 2026 Start (PhD) USD 202K-368KData Engineering | Deep learning | Human Feedback | Instruction Tuning | Language ModelsCommunity building | Development events | Internship | Research mentorshipEntry-level Full TimeSan Jose, California, United States6d ago
-
3D Generation | Foundation Models | Generative AI | Image Generation | Machine LearningEntry-level Full TimeSan Jose, California, United States6d ago
-
Research Scientist in Large Language Model (LLM) - Seed - Graduates - 2027 Start (PhD) USD 244K-450KData Engineering | Deep learning | Instruction Tuning | Language Processing | Machine LearningEntry-level Full TimeSan Jose, California, United States7d ago
-
Data Scientist / Machine Learning Engineer USD 110K-133KAWS SageMaker | Agile | Apache Airflow | Azure Machine Learning | DBTEnglish communication | Remote workMid-level Full TimeBrazil / Colombia / Costa Rica … R8d ago
-
Senior Data Scientist USD 169K-190KA/B | A/B Testing | B testing | Dashboards | Data AnalysisDental insurance | Disability benefits | Equity awards | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California10d ago
-
Senior Data Scientist USD 169K-195KA/B | A/B Testing | B testing | Data Pipelines | Data VisualizationDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California10d ago
-
Mid-level Full TimeSan Jose, United States R10d ago
-
A/B | A/B Testing | B testing | Causal Inference | Data MiningEntry-level InternshipSan Jose, California, United States12d ago
-
Senior Data Scientist USD 112K-221KApache Spark | Bot Detection | DNS | Fraud Prevention | HTTPCareer development | Learning programs | MentoringSenior-level Full TimeCosta Rica19d ago
-
Senior Consultant, Data Science and Analytics USD 90K-150KApache Arrow | C++ | Dash | ETL | H2OConference and seminar support | Flexible time off | Remote work | Tuition reimbursement | Workplace flexibilitySenior-level Full TimeLagunilla de Heredia, Costa Rica R21d ago