Research Scientist Intern, Llama Applied LLM (Post-Training)

Bellevue, WA | Menlo Park, CA | Seattle, WA

Meta

Giving people the power to build community and bring the world closer together

View all jobs at Meta

Apply now Apply later

Llama large language models have been widely adopted in open source and are used to power many generative AI applications at Meta and beyond.

Meta is seeking Research Interns to join our Llama post-training language team. We are committed to advancing the field of artificial intelligence by making fundamental advances in technologies to help interact with and understand our world. We are seeking individuals passionate in areas such as generative modeling, deep learning, natural language processing, machine learning, and reinforcement learning. Our interns have an opportunity to make core algorithmic advances and apply their ideas at an unprecedented scale.

Our internships are twelve (12) to sixteen (16), or twenty-four (24) weeks long and we have various start dates throughout the year.Research Scientist Intern, Llama Applied LLM (Post-Training) Responsibilities
  • Develop state-of-the-art generative AI algorithms and data, to help more effectively align our LLMs during post-training stages.
  • Improve the performance of our foundational Llama models, which have wide open source adoption.
  • Based on the project, help analyze and improve efficiency, scalability, and stability of corresponding deployed algorithms.
  • Collaborate with researchers and cross-functional partners including communicating research plans, progress, and results.
  • Disseminate research results.
  • When applicable, contribute to research that can be applied to Meta product development.
Minimum Qualifications
  • Currently has or is in the process of obtaining a Ph.D. degree in Computer Science, Artificial Intelligence, Generative AI, or relevant technical field.
  • Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.
  • Experience with Python, C++, C, Java or other related languages.
  • Experience building systems based on machine learning and/or deep learning methods.
Preferred Qualifications
  • Intent to return to the degree program after the completion of the internship/co-op.
  • Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, ICCV, ECCV, or similar.
  • Experience working and communicating cross functionally in a team environment.
  • Experience in advancing AI techniques, including core contributions to open source libraries and frameworks in computer vision.
  • Experience solving analytical problems using quantitative approaches.
  • Experience setting up ML experiments and analyzing their results.
  • Experience manipulating and analyzing complex, large scale, high-dimensionality data from varying sources.
  • Experience in utilizing theoretical and empirical research to solve problems.
  • Experience training and aligning LLMs.
For those who live in or expect to work from California if hired for this position, please click here for additional information. LocationsAbout Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
US$7,800/month to US$11,293/month + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity and Affirmative Action Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.
Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@fb.com.
Apply now Apply later
Job stats:  12  3  0

Tags: Computer Science Computer Vision Deep Learning EMNLP Generative AI Generative modeling ICLR ICML Java LLaMA LLMs Machine Learning NeurIPS NLP Open Source Physics Python Reinforcement Learning Research VR

Perks/benefits: Career development Conferences Equity / stock options Health care Salary bonus Startup environment

Region: North America
Country: United States

More jobs like this