Senior Software Engineer, Systems ML - Collective Compute Enablement
Oslo, Norway
Meta is seeking an AI Research Scientist/Software Engineer to join our team. The ideal candidate will have industry experience working on AI infrastructure related topics. The position will involve taking these skills and applying them to solve some of the most crucial and exciting problems that exist on the web.
The Collective Compute Enablement team is dedicated to maximizing training performance of Generative AI and Recommendation models on Meta's Training and Inference Accelerator (MTIA). We model and project the performance of current and future training workloads on MTIA while it is being designed to provide early, crucial feedback to the architecture, compiler, and kernels teams. We employ cutting-edge optimization and data parallelization strategies to maximize training throughput for the next generations of LLMs and deep recommendation models, and we work cross-functionally with many partner teams to assure the end-to-end performance of large-scale training in order to more quickly deliver the next generation of AI experiences to our users.Senior Software Engineer, Systems ML - Collective Compute Enablement Responsibilities
The Collective Compute Enablement team is dedicated to maximizing training performance of Generative AI and Recommendation models on Meta's Training and Inference Accelerator (MTIA). We model and project the performance of current and future training workloads on MTIA while it is being designed to provide early, crucial feedback to the architecture, compiler, and kernels teams. We employ cutting-edge optimization and data parallelization strategies to maximize training throughput for the next generations of LLMs and deep recommendation models, and we work cross-functionally with many partner teams to assure the end-to-end performance of large-scale training in order to more quickly deliver the next generation of AI experiences to our users.Senior Software Engineer, Systems ML - Collective Compute Enablement Responsibilities
- Apply state-of-the-art AI infrastructure and software/hardware acceleration techniques to build and optimize our large-scale AI workloads
- Analyze, benchmark, and optimize large-scale workloads on next-generation training superclusters
- Define use cases and develop methodology and benchmarks to evaluate different approaches
- Set direction and goals for the team related to project impact, AI system design, infrastructure, and developer efficiency
- Lead large and complex technical efforts across many engineers and teams
- Influence and impact next-generation of model and hardware architecture choices through deep and thorough data-driven analyses
- Helps onboard new team members, provides mentorship, and enables successful ramp up on the team's code base
- Mentor other engineers, research scientists and improve the quality of engineering work in the broader team
- Bachelor’s degree in computer science or a related STEM field
- Specialized experience in one or more of the following machine learning/deep learning domains: hardware accelerator architectures, machine learning compilers or ML systems, AI infrastructure, high-performance computing, performance optimizations or ML frameworks such as PyTorch
- Proven C/C++ and Python programming skills in developing AI Systems infrastructure or AI algorithms
- Experience with debugging in C++, Python and/or PyTorch
- Track record of defining and leading long-term plans for the team
- Track record of mentoring and growing other engineers
- Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
- Master's degree/PhD in computer science or related STEM field and strong experience in AI framework development or accelerating deep learning models on hardware architectures
- Experience with training of large-scale AI models
- Experience with distributed AI systems and communication protocols such as MPI or collective libraries such as NCCL
- Experience or knowledge in one or more of LLM/LDM, ranking and recommender models or collective communication libraries
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
12
0
0
Categories:
Engineering Jobs
Machine Learning Jobs
Tags: Architecture Computer Science Deep Learning Engineering Generative AI LLMs Machine Learning ML infrastructure PhD Physics Python PyTorch Research STEM VR
Perks/benefits: Career development
Region:
Europe
Country:
Norway
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsPrincipal Data Engineer jobsPrincipal Data Scientist jobsWriter - Freelance AI Tutor jobsContent writer - Freelance AI Tutor jobsData Manager jobsData Science Manager jobsData Scientist II jobsJunior Data Analyst jobsResearch Scientist jobsBusiness Data Analyst jobsSenior Machine Learning Researcher jobsBI Analyst jobsSr Data Engineer jobsSr. Data Scientist jobsSoftware Engineer, Machine Learning jobsData Science Intern jobsBusiness Intelligence Engineer jobsLead Data Analyst jobsJunior Data Engineer jobsJunior Data Scientist jobsData Analyst II jobsSenior AI Engineer jobsAzure Data Engineer jobsCopywriter - Freelance AI Tutor jobs
Data governance jobsSnowflake jobsLinux jobsHadoop jobsOpen Source jobsRDBMS jobsBanking jobsJavaScript jobsPhysics jobsMLOps jobsKafka jobsScala jobsData Warehousing jobsComputer Vision jobsGoogle Cloud jobsNoSQL jobsAirflow jobsSAS jobsOracle jobsData warehouse jobsLooker jobsKPIs jobsPostgreSQL jobsData Mining jobsStreaming jobs
R&D jobsCX jobsClassification jobsScikit-learn jobsGitHub jobsTerraform jobsScrum jobsDistributed Systems jobsPandas jobsPySpark jobsJira jobsIndustrial jobsBigQuery jobsRedshift jobsReact jobsRobotics jobsUnstructured data jobsJenkins jobsMySQL jobsMicroservices jobsdbt jobsMatlab jobsE-commerce jobsData strategy jobsPrototyping jobs