Senior ML Software Engineer - AI Platform

About Anaconda

Be at the center of AI

With more than 45 million users, Anaconda is the most popular operating system for AI providing access to the foundational open-source Python packages used in modern AI, data science, and machine learning through a seamless platform. We pioneered the use of Python for data science, championed its vibrant community, and continue to steward open-source projects that make tomorrow’s innovations possible. Our enterprise-grade solutions enable corporate, research, and academic institutions around the world to harness the power of open source for competitive advantage, groundbreaking research, and a better world. To learn more visit https://www.anaconda.com.

Here is why people love most about working here: We’re not just a company, we’re part of a movement. Our dedicated employees and user community are democratizing data science and creating and promoting open-source technologies for a better world, and our commercial offerings make it possible for enterprise users to leverage the most innovative output from open source in a secure, governed way.

Summary

As a Senior Software Engineer in our AI Platform team, you'll be at the forefront of creating the AI Core services that form the backbone of our AI ecosystem. Your work will directly enable developers to build and deploy sophisticated AI applications. You'll collaborate with cross-functional teams to design and implement scalable, robust solutions that expand the capabilities of our AI platform.

What You’ll Do:

• Design and implement microservices and APIs for ML model deployment, inference, and management
• Develop and maintain scalable Kubernetes-based platform solutions to support growing ML infrastructure needs
• Partner with product teams to understand developer needs and translate them into technical solutions
• Mentor junior engineers and promote best practices in software development for AI
• Research emerging ML trends and incorporate new technologies into our ecosystem

What You’ll Need:

• Bachelor's degree in Computer Science, Engineering, or a related field
• 7+ years of professional software development experience
• Extensive Kubernetes expertise including:

Custom operator development

Cluster management and autoscaling

Service mesh usage

Infrastructure as Code (Terraform, Helm)

• Strong understanding of CI/CD practices and tools (ArgoCD)
• Expertise in container orchestration and microservices architecture
• Expert-level Python development with production experience in FastAPI, async services, and package development
• Strong background in system design including API development, authentication, and high-availability patterns
• Proven experience building and maintaining ML deployment pipelines
• Understanding of LLM systems and RAG architecture
• Hands-on experience with monitoring and telemetry systems
• Hands-on experience with ML model serving
• Experience implementing and managing message queue systems (Kafka, AWS SQS)
• Experience with cloud and industry services (Hugging Face, Anthropic, AWS)
• Strong problem-solving skills and ability to work effectively in a collaborative team environment
• Experience mentoring junior engineers and implementing best practices
• Positive work attitude and enthusiasm for tackling complex challenges

What Will Make You Stand Out:

• Master's or Ph.D. in Computer Science, Data Science, or a related field
• Open-source contributions to infrastructure or MLOps tools
• Proven experience with the design and development of custom Kubernetes operators
• Familiarity with Anaconda's product ecosystem

Why You’ll Like Working Here

• Unique opportunity to translate strong open-source adoption and user enthusiasm into commercial product growth
• Dynamic company that rewards high-performers
• On the cutting edge of enterprise application of data science, machine learning, and AI
• Collaborative team environment that values multiple perspectives and clear thinking
• Employees-first culture
• Flexible working hours
• Medical*, Dental*, Vision*, HSA*, Life* and 401K*
• Paid parental leave - both parents
• Monthly productivity stipend 
• Open vacation policy* 
• Quarterly Snake days (company-wide bonus day off)
• 100% remote 

*FTE employees based on your region

An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.

Anaconda, Inc. (“We”, “Us”) are committed to protecting and respecting your privacy. This Privacy Notice sets out the basis on which the personal data collected from you, or that you provide to Us, will be processed by Us in connection with Our recruitment processes. By clicking “Submit Application”, you acknowledge you have read our Privacy Policy and that Anaconda can retain your application data for up to 1-year, unless otherwise stated.  For the purpose of the General Data Protection Regulation (“GDPR”) ”) and the version of the GDPR retained in UK law (the “UK GDPR”) the Data Controller.

This job post expires 30 days from its original post date

Anaconda is an EEO/AA employer M/F/V/D.