Junior LLM Research Engineer

You will be part of a large team of research engineers and work on developing large language models specialized to meet the customers' specific needs and culture. You are expected to train models (pretraining, SFT, DPO, etc..), modify existing code, and implement cutting-edge techniques. You will be collaborating with the data engineering team in their data collection, cleaning and preprocessing tasks, and the annotation team with their evaluation tasks. In addition to product based efforts you are expected to keep up with the scientific literature and contribute to it as well by publishing papers.

Requirements

1.      Basic Computer Science and Programming

·        Data Structures and Algorithms (practice with LeetCode type problems)

·        Object Oriented Programming

·        (optional) Functional Programming

·        Writing robust and reusable code according to design patterns

·        Ability and willingness to write readable and well documented Python code

·        Version Control (git)

2.      Machine Learning and Deep Learning

·        Classical Machine Learning and Deep Learning especially as applied to NLP

·        Scikit-Learn, Jupyter Notebook/Lab, Pandas, Numpy

·        At least one of Pytorch, Tensorflow (not Keras) or JAX

·        Ability to design and implement neural networks from scratch in one of the above frameworks

·        (optional) Model Compression (Quantization, Distillation, Pruning)

·        (optional) Reinforcement Learning

3.      Natural Language Processing

·        Data Collection and Preprocessing

·        Text Representation (e.g. BoW, word embeddings, contextual embeddings)

·        Neural Network Architectures used in NLP

·        Language Models (n-gram, masked and causal)

·        (optional) Information Retrieval

4.      Large Language Models

·        Huggingface transformers

·        In-context Learning (prompt engineering)

·        Instruction Tuning (SFT)

·        Alignment (e.g. RLHF-PPO, DPO)

·        (optional) 3D Parallelism (data, tensor, pipeline)

·        (optional) Model Deployment (inference optimizations)

·        Evaluation of LLMs

5.      Academic Credentials

·        Degree in Computer Engineering or related fields

·        Willingness to follow NLP and LLM literature to stay informed of latest developments

·        (optional) Publications in reputable conferences and journals

6.      Non-technical Requirements

·        Fluency in written and spoken English

·        (optional) Proficiency in Arabic, Portuguese, Spanish or Russian

·        Strong communication skills

Benefits

• A real job from day one: We offer you a professional career in one of the leading multinational technology company.
• Local & international: Reaching more than 190 countries, Huawei is a successful and respected business. We focus on the needs of local costumers by harnessing global expertise and team work. For you, that means exceptional exposure and experience.
• Great Development Opportunities: We'll support you every step of the way, with hands on experience which includes functional, cross functional and international rotations.
• Fast growth and ambitious vision.
• Learning and Development opportunities.