Software Engineer, LLM Platform

Lamini enables every enterprise to safely, quickly, and cost-effectively build their own Expert AI. Our customers own their own models, trained on their data. Lamini optimizes for Expert AI workloads with minimal hallucination, enterprise-grade security, and enterprise flexibility, running on any infrastructure. Our team is made up of highly committed engineers, researchers, and tech industry veterans excited by mission and technology. We’re backed by leading VCs as well as computing and technology companies.

This would be your dream job if you enjoy doing following:

• Design, build, and maintain an LLM platform on Kubernetes to support large language models and other emerging AI technologies.
• Manage Kubernetes-based cluster, with hands-on experience building a system to manage bare-metal GPU server clusters using Kubernetes.
• Work on complex problems by learning and modifying an entire system.
• Write clear and readable code in Python or similar programming languages, with a focus on thorough testing, concise documentation, and a holistic approach to the long-term impact of the system.
• Collaborate with machine learning engineers, application engineers, and product managers to understand requirements and implement solutions.
• Learning: Keep updated with the rapidly advancing LLM technology landscape.

We are looking for someone with the following qualifications

• Experience: 6+ years in building applications end-to-end. Demonstrated experience in building complex systems using open-source tools on the Kubernetes platform and evolving these systems to accommodate changes in requirements.
• Languages: Proficient in Python or other comparable languages.
• Education: Bachelor’s degree in Computer Science or related field.
• Good understanding of how LLM training and inference work and how LLMs are used; passionate about making LLMs available to enterprise customers.
• Team Spirit: Embrace a collaborative mindset and a drive to achieve top-tier results within an inclusive team environment. Maintain a sharp focus, demonstrate commitment, and be a dependable team player.

Bonus points if you have experiences in

• Building an LLM platform
• Training LLMs (pre-training, post-training, fine-tuning)
• Working with AMD GPUs
• Talking with customers directly

At Lamini AI, we are committed to providing an environment of mutual respect where equal employment opportunities are available to all applicants without regard to race, color, religion, sex, pregnancy (including childbirth, lactation and related medical conditions), national origin, age, physical and mental disability, marital status, sexual orientation, gender identity, gender expression, genetic information (including characteristics and testing), military and veteran status, and any other characteristic protected by applicable law. Lamini AI believes that diversity and inclusion among our employees is critical to our success as a company, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. Selection for employment is decided on the basis of qualifications, merit, and business need.