Senior Engineer, ML Infrastructure

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies of 2024.

As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you’re someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, CoreWeave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry.  

CoreWeave powers the creation and delivery of the intelligence that drives innovation. 

About the role:

The ML Infrastructure Team plays a key role in CoreWeave’s customer journey as the team responsible for supporting and innovating the interfaces our customers use to schedule and drive their machine learning workloads. Initially supporting our Slurm and Inference interfaces, this team has a mandate to keep their fingers on the pulse of the Machine Learning community and provide commoditized solutions targeted to their needs that reduce friction and increase the efficiency and reliability of consuming CoreWeave’s world-class GPU cloud.

We are seeking a Senior Engineer to join the ML Infrastructure Team and help us build the interfaces of consumption that CoreWeave’s customers need in order to be successful. This individual will join a team of mixed-skill engineers and have the opportunity to work on the full gamut of rewarding challenges that come with the business of building a cloud in a communicative, supportive, and high-performing environment. As a member of the ML Infrastructure Team, you would have the opportunity to:

• Identify and implement scalable and fault-tolerant interfaces for consuming GPU resources that are responsive to the needs and practices of the ML community.
• Create test plans, deployment automation, dashboards, alerts, and insights into our product’s operations as well as participate in the ML Infrastructure on-call rotation.
• Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself.

Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk. 

• You have six or more years of experience in a software engineering industry with a specialization in developing and troubleshooting distributed systems in production and at scale.
• You have a drive to learn and grow in a rapidly evolving technology space and have interest or experience in some of the current core technologies supported by the team such as Slurm, KNative, and/or Istio.
• You are comfortable with the idea of using Go as your primary programming language and are capable of navigating a Linux operating environment.
• You have experience using Kubernetes with an applicable understanding of its major components and ingress/service meshes.
• You have thorough knowledge of cloud-native development including experience with container technologies, microservice design and architectural patterns.
• You have familiarity with complex event processing and event-driven architecture.
• You can transform problems in elastic architectures, decompose them into achievable tasks, and socialize both to your teammates.
• You’re interested in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design.
• You’re excited about being part of a team of diverse perspectives and backgrounds that believe in tackling challenges, growing hand in hand, and winning together.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $175,000-$210,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

What We Offer

The range we’ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs, including:

• Medical, dental, and vision insurance - 100% paid for by CoreWeave
• Company-paid Life Insurance 
• Voluntary supplemental life insurance 
• Short and long-term disability insurance 
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement 
• Mental Wellness Benefits through Spring Health 
• Family-Forming support provided by Carrot
• Paid Parental Leave 
• Flexible, full-service childcare support with Kinside
• 401(k) with a generous employer match
• Flexible PTO
• Catered lunch each day in our office and data center locations
• A casual work environment
• A work culture focused on innovative disruption

Our Workplace

At CoreWeave, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences.

For those who do not live within 30 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets. Onboarding is essential to your success. New employees not based out of an office will be invited to attend onboarding training at one of our hubs within their first month of employment. We continue to foster a collaborative environment by bringing teams together quarterly.

California Consumer Privacy Act - California applicants only

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: careers@coreweave.com.