Machine Learning Engineer (Music & Audio)

Background

At Udio, our mission is to enable the next generation of music creators with state-of-the-art AI tools. Our founding team is composed of world-leading AI researchers, formerly of Google DeepMind. Between the founders, they have 4 PhDs,

About the role 

As a Machine Learning Engineer focusing on Music & Audio, you will build and deploy state-of-the-art generative music models at scale. You will join a creative and ambitious team building the future of the creative economy through AI, working directly with world-class machine learning experts who have an exceptional track record in generative AI.

What we're looking for

• 2+ years of experience in developing music/audio ML models in JAX, PyTorch, or TensorFlow
• Experience implementing foundational ML architectures from scratch (e.g. autoregressive models, diffusion models, neural audio codecs) for music generation and audio processing
• Experience building robust data pipelines (using GCP/AWS/Azure/on-prem infrastructure) and optimizing data loading systems for training (e.g. parallel audio loading, efficient memory management, caching) with focus on large-scale music datasets
• Track record in music/audio ML innovation and expertise in advanced deep learning techniques
• End-to-end understanding of music generation systems and excitement for advancing the state-of-the-art
• Strong debugging skills to iteratively improve model quality and audio fidelity
• Nice to have:
• Familiarity with kubernetes and docker
• Experience in low-level ML optimization e.g. profiling, latency, and kernel implementation 

Our Culture

We love doing things exceptionally well, and we have fun doing so! Some cultural traits we value are:

• Passion for creating products people love
• Commitment to do what is right, no matter how hard the task
• Willingness to work hard with others who work similarly hard, to achieve revolutionary technology.
• Deep interest in generative AI and pioneering technology

Benefits

• Highly competitive salary and equity
• Flexible time off (~25 days PTO/year)
• Fantastic office location in Manhattan
• Productivity package, including ChatGPT Plus and Copilot
• Top notch private health, dental, and vision insurance for you and your dependents
• 401(k) plan options with 5% employer matching
• Concierge medical/primary care through One Medical and Rightway
• Mental health support from Spring Health
• Personalized life insurance, travel assistance, and many other perks

Udio's success hinges on hiring great people and creating an environment where we can be happy, feel challenged, and do our best work.