ML Integration & Operations Software Engineer
Sunnyvale CA or Toronto Canada
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Cerebras Systems
Cerebras is the go-to platform for fast and effortless AI training. Learn more at cerebras.ai.Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.
Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.
About The Role
As a Software Engineer on the ML Integration and Ops team, you will be a critical force in improving software quality through advanced debugging and automation. You’ll work across the full Cerebras AI platform—spanning hardware, software, and ML workloads—to identify, isolate, and resolve complex issues. This role emphasizes deep systems understanding, creative problem-solving, and building AI-powered tools to automate diagnostics, validation, and workflows. Your ability to break down ambiguous problems and automate solutions at scale will directly impact the reliability and performance of our training and inference products.
Responsibilities
- Debug and resolve complex integration issues across the Cerebras AI platform, spanning ML, compiler, runtime, and hardware layers.
- Develop and deploy AI-enhanced debugging and validation tools to accelerate issue identification and resolution.
- Automate test generation, data capture, and diagnostics using scripting and intelligent systems.
- Create and execute robust validation plans for LLM and multimodal workloads in production-scale environments.
- Identify edge cases, stress failure modes, and proactively improve system resilience.
- Design and maintain CI/CD pipelines to ensure continuous integration, fast feedback, and early detection of regressions.
- Collaborate with product, software, and hardware teams to establish clear quality criteria and efficient handoffs.
- Drive adoption of debugging best practices and tools across teams.
- Contribute to continuous improvement by implementing quality metrics, automation pipelines, and actionable insights.
Skills And Qualifications
- 2+ years of experience in software integration, debugging, or quality engineering.
- Strong programming and automation skills in Python, C++, Go, or similar languages.
- Experience testing compute, machine learning, networking, or storage systems in large-scale environments.
- Solid understanding of system architecture (compute, networking, storage) and ML workloads.
- Proven ability to break down complex issues into root causes and scalable solutions across distributed or complex systems.
- Ability to understand complex systems and design comprehensive, effective test plans.
- Strong collaboration and communication skills across cross-functional teams.
- Experience collaborating with globally distributed teams across time zones.
Preferred Skills and Qualifications
- Experience with ML workloads such as LLM or multimodal model training and inference.
- Familiarity with AI-driven tools, prompt engineering, or synthetic data generation for validation.
- Background in hardware architecture, performance optimization, compilers, or ML frameworks (e.g., PyTorch, TensorFlow).
- Experience with distributed systems, cloud environments, and microservices deployment and debugging.
- Knowledge of CI/CD pipelines, automated test infrastructure, and system-level benchmarking.
- Exposure to software/hardware co-design and scalable ML system integration.
Location
- This role follows a hybrid schedule, requiring in-office presence 3 days per week. Please note, fully remote is not an option.
- Office locations: Sunnyvale, Toronto.
Why Join Cerebras
People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
- Build a breakthrough AI platform beyond the constraints of the GPU.
- Publish and open source their cutting-edge AI research.
- Work on one of the fastest AI supercomputers in the world.
- Enjoy job stability with startup vitality.
- Our simple, non-corporate work culture that respects individual beliefs.
Read our blog: Five Reasons to Join Cerebras in 2025.
Apply today and become part of the forefront of groundbreaking advancements in AI!
Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.
This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture CI/CD Distributed Systems Engineering Generative AI GPU LLMs Machine Learning Microservices Model training Open Source Pipelines Prompt engineering Python PyTorch Research TensorFlow Testing
Perks/benefits: Career development Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.