Research Scientist

Description

Company Intro

Toloka AI is a global tech company that offers end-to-end data labeling solutions based on the effective combination of public crowd, domain experts and ML. Toloka has one of the most advanced annotation platforms in the market together with huge experience gathered by the whole team. Our solutions are powered by the most diverse global crowd from 100+ countries speaking 40+ languages and extensive experience in the practical application of SOTA models.

Responsibilities

• Establish partnerships with other research labs (universities and AI companies);
• Develop research ideas, design data collection pipelines, and conduct experiments;
• Publish scientific papers and present at top-tier conferences.

Project examples

• Evaluate the impact of data on model performance through internal fine-tuning experiments;
• Develop high-quality evaluation metrics to measure performance in coding, math, reasoning, multimodality, and other complex tasks;
• Experiment with red-teaming approaches to identify model vulnerabilities and improve safety alignment.

Requirements

• Comprehensive knowledge of deep learning fundamentals and a strong scientific understanding of the field of generative AI;
• PhD or industry research experience in computer science, machine learning, data science, or a related field;
• Proven track record and experience conducting deep learning research, from idea to publication;
• Strong engineering skills with proficiency in Python and commonly used ML frameworks/libraries;
• Proficiency in English (C1+).

Preferred but not required

• Published papers at top-tier venues (such as NeurIPS, ICML, ICLR, ACL, EMNLP, etc.);
• Experience with large language models or other generative AI technologies;
• Industry experience in machine learning, data science, or a related field.

Benefits

• Personal and career development: we support employee’s ambition for professional development and encourage them to implement their ideas in their projects;
• Flexibility: we offer remote or hybrid employment. You will also design with your manager a workday that works best for you;
• Paid parental leave + Annual vacation policy;
• Transportation expenses reimbursement;
• Meal allowance for every working day in the office;
• Contributions to personal pension plan.

Country of Origin