Supercomputing Engineer
San Francisco, CA
â ď¸ We'll shut down after Aug 1st - try foođŚ for all jobs in tech â ď¸
Full Time Senior-level / Expert USD 170K - 300K
San Francisco Compute
The San Francisco Compute Company: Large, low-cost GPU clusters you can rent by the hour, for pre-training, inference, and more. Get H100s with 3.2Tb/s InfiniBand, parallel storage, fast networking, and priority support.Compute is a commodity. We think people should buy it like one.
Startups shouldnât be forced to buy a yearâs worth of compute time in order to get market rate and compute providers shouldnât go bankrupt because they canât fully book their clusters.
At SF Compute, our goal is to solve this issue the same way this was solved for every other commodity â by building a venue where compute contracts are traded in real-time and by bringing a new kind of participant into the supply chain, traders.
If we succeed, buyers will be able to get a good price for any order, whether itâs 32 H100s for a month or 8,000 H100s for an hour, and sellers will instantly book out their clusters because traders will speculatively buy them, for a spread. Every FLOP will flow through us somewhere in the supply chain. What Brent is for oil, we will be for compute.
About the Role
ML training clusters are some of the most high performance computers on the planet. Even relatively small clusters would have been in the TOP500 5 years ago. Our supercomputing team is responsible for keeping our compute clusters running smoothly, monitoring hardware health, participating in on-call rotation, and fixing things when they go wrong. We believe strongly in automation â code is the only reliable way to manage hardware at scale. As we scale, this will become a more data-driven role, predicting failures before they happen. Weâre a small team, so youâll be spending time talking to customers as well.
About You
Youâve managed at least one GPU training cluster in the past (ideally a cluster with >1k GPUâs but not required)
You deeply understand Linux, networking fundamentals, CUDA, NCCL, and Infiniband
You enjoy automating hardware deployments, leveraging IaC wherever possible
You appreciate and value good documentation
Some Nice to Haves
Experience with Rust (our bare metal tooling is written in Rust)
Experience with Linux virtualization (KVM, QEMU, libvirt, etc.)
Experience with Kubernetes implementation including CRDâs and CNIâs
Experience with HPC network architectures (eBGP, fat-tree, VXLAN, MCLAG, etc.)
Compensation
US: $170k - $300k + equity
BenefitsGenerous equity grant
Team members are offered a competitive salary along with equity in the company
Visa Sponsorships
Yes, we sponsor visas and work permits
Retirement matching
We match 401(k) plans up to 4%
Medical, dental & vision
We offer competitive medical, dental, vision insurance for employees and dependents and cover 100% of premiums
Time off
We offer unlimited paid time off as well as 10+ observed holidays
Parental leave
We offer biological, adoptive, and foster parents paid time off to spend quality time with family
Daily lunch
We cover lunch daily for employees
Unlimited office book budget
You can buy as many books for the office as you want
The San Francisco Compute Company is committed to maintaining a workplace free from discrimination and harassment.
We make employment decisions based on business needs, job requirements, and individual qualifications, without regard to race, color, religion, belief, national origin, social or ethical origin, age, physical, mental, or sensory disability, sexual orientation, gender identity or expression, marital status, civil union or domestic partnership status, past or present military service, HIV status, family medical history or genetic information, family or parental status including pregnancy, or any other status protected by law.
We welcome the opportunity to consider qualified applicants with prior arrest or conviction records. Our commitment to diversity includes hiring talented individuals regardless of their criminal history, in accordance with local, state, and federal laws, including San Franciscoâs Fair Chance Ordinance and Californiaâs ban-the-box laws.
If you require reasonable accommodation for any reason, please reach out to us at team@sfcompute.com.
Tags: Architecture CUDA GPU HPC InfiniBand Kubernetes Linux Machine Learning Rust
Perks/benefits: 401(k) matching Career development Competitive pay Equity / stock options Flex vacation Health care Insurance Medical leave Parental leave Unlimited paid time off
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.