Software Engineer II - LLMOps

Who Are We?

Taking care of our customers, our communities and each other. That’s the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 160 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what you do and where you do it.

Job Category

Technology

Compensation Overview

The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. As part of our comprehensive compensation and benefits program, employees are also eligible for performance-based cash incentive awards.

Salary Range

$117,200.00 - $193,400.00

Target Openings

1

What Is the Opportunity?

Travelers is seeking a Software Engineer II, Enterprise Artificial Intelligence (AI) to join and support our LLMOps team in Atlanta as we advance our Technology landscape. As a member of Enterprise Data & Analytics (ED&A), you’ll be joining a strategic and collaborative team that is passionate about transforming our business and technology capabilities and paving the way for best-in-class technology, data and analytics.

Our LLMOps team is dedicated to building and optimizing the infrastructure that powers our advanced AI solutions. We are looking for an individual who will complete advanced end-to-end engineering tasks by designing, developing, analyzing, configuring, testing, debugging, troubleshooting, documenting, health monitoring and alerting of the systems. You will deliver solutions based on user or system specifications, consulting with users to determine hardware, software or system functional specifications, manage interactions between the systems and other technical support areas, and define technical requirements and coordinate team resources to solve problems.

What Will You Do?

• Design, develop, and maintain scalable and efficient systems for deploying and managing large language models. 
• Collaborate with data scientists, software engineers, and other stakeholders to optimize model performance and deployment processes. 
• Implement monitoring and logging solutions to ensure the reliability and performance of AI systems. 
• Troubleshoot and resolve issues related to model deployment and operations. 
• Contribute to the continuous improvement of our LLMOps practices and infrastructure. 
• Stay up-to-date with the latest advancements in AI and machine learning technologies.  
• Contribute towards our AI agentic strategy performing analysis, design, development, and configuration functions (includes defining technical requirements) with a high degree of accuracy and speed, operating as an individual contributor to team goals. 
• Perform technical evaluations of AI/ML vendors and platforms. 
• Establish best practices for AI development and deployment, including LLMOps, CI/CD pipelines, and real-time monitoring. 
• Perform analysis, assessment and resolution for defects and incidents of advanced complexity and escalate appropriately. 
• Work independently to tackle well-scoped and loosely scoped problems. 
• Seek opportunities to expand technical knowledge and capabilities. 
• Provide technical guidance and mentorship to junior employees. 
• Perform other duties as assigned. 

What Will Our Ideal Candidate Have?

• Four or more years of programming/development experience (Python, AWS, JavaScript, Node.js etc.). 
• Hands-on experience with AI infrastructure, including deploying LLM inference servers using Kubernetes. 
• Delivery – Intermediate delivery skills including the ability to estimate accurate timelines for tasks and deliver work at a steady, predictable pace to achieve commitments, contribute to the software design strategy and methodologies used to best meet the system requirements, consider and build for many different use cases, avoid over engineering, and ensure automation, deliver complete solutions but release them in small batches, and identify important tradeoffs and negotiate them. 
• Domain Expertise – Demonstrated track record of domain expertise including understanding technical concepts necessary to do the job effectively and aware of industry trends, demonstrate willingness, cooperation, and concern for business issues and priorities, and possess in depth knowledge of immediate systems worked on and some knowledge of adjacent systems. 
• Problem Solving – Strong problem solver who ensures solutions are built for the long term, is able to resolve new issues, recognizes mistakes using them as learning and teaching opportunities and consistently breaks down large problems into smaller, more manageable ones. 
• Communication – Strong communicator who possesses the ability to articulate information clearly and concisely with the business, document work in a clear, easy to follow manner, collaborate well with team members as both a mentor and mentee, take in vague requirements and ask the right questions to ensure clarification, offer feedback appropriately and effectively, seek out and receives constructive criticism well, listen when others are speaking and make space for colleagues to share their thoughts. 
• Leadership – Intermediate leadership skills with the ability to help create a safe environment for others to learn and grow as engineers and a proven track record of self-motivation in identifying opportunities and tracking team efforts. 

What is a Must Have?

• Bachelor’s degree or its equivalent in work experience.
• Two years of programming/development experience.

What Is in It for You?

• Health Insurance: Employees and their eligible family members – including spouses, domestic partners, and children – are eligible for coverage from the first day of employment.
• Retirement: Travelers matches your 401(k) contributions dollar-for-dollar up to your first 5% of eligible pay, subject to an annual maximum. If you have student loan debt, you can enroll in the Paying it Forward Savings Program. When you make a payment toward your student loan, Travelers will make an annual contribution into your 401(k) account. You are also eligible for a Pension Plan that is 100% funded by Travelers.
• Paid Time Off: Start your career at Travelers with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
• Wellness Program: The Travelers wellness program is comprised of tools, discounts and resources that empower you to achieve your wellness goals and caregiving needs. In addition, our mental health program provides access to free professional counseling services, health coaching and other resources to support your daily life needs.
• Volunteer Encouragement: We have a deep commitment to the communities we serve and encourage our employees to get involved. Travelers has a Matching Gift and Volunteer Rewards program that enables you to give back to the charity of your choice.

Employment Practices

Travelers is an equal opportunity employer. We value the unique abilities and talents each individual brings to our organization and recognize that we benefit in numerous ways from our differences. 

In accordance with local law, candidates seeking employment in Colorado are not required to disclose dates of attendance at or graduation from educational institutions.

If you are a candidate and have specific questions regarding the physical requirements of this role, please send us an email so we may assist you.

Travelers reserves the right to fill this position at a level above or below the level included in this posting.

To learn more about our comprehensive benefit programs please visit http://careers.travelers.com/life-at-travelers/benefits/.