Prompt Engineer and Conversation Designer (Backend)

It's fun to work in a company where people truly BELIEVE in what they're doing!

We're committed to bringing passion and customer focus to the business.

Job Description

Prompt Engineer & Conversation Designer (Backend)

This role requires working from our local Hyderabad office 2-3x a week.

Location: Hyderabad, Telangana, India

ABOUT THE TEAM

• The Generative AI Quality & Experience team owns ABC’s end-to-end conversational stack: the prompt library, multi-turn orchestration layer, and the evaluation platform that guards against hallucinations, logic regressions, and prompt drift. We build and run the automated pipelines that score accuracy, safety, latency, and cost for every agent interaction across Evo, Glofox, Ignite, and Trainerize. Working hand-in-hand with product managers, UX writers, backend engineers, and LLM researchers, we turn breakthrough language-model capabilities into reliable, brand-aligned user experiences—at scale and under tight latency budgets. As our Prompt Engineer / Conversation Designer (Backend) you’ll be the technical linchpin: designing conversation flows, hardening prompts, and proving quality through rigorous, metrics-driven testing.

• At ABC, we love entrepreneurs because we are entrepreneurs. We know how much grit it takes to start your own business and grow it into something that lasts. We roll our sleeves up, we act fast, and we learn together. You will be working closely with talented software engineers and senior engineering leaders to optimize and build upon our single integration platform strategy.
   

WHAT YOU WILL DO

• Build automated evaluation pipelines (Promptfoo, OpenAI Evals, custom test harnesses) that score prompts and agent flows for correctness, relevance, safety and cost.

• Act as the bridge between backend engineering and product interaction teams, making sure every proof-of-concept behaves exactly as designed and agent logic remains consistent from prototype to production.

• Define Gen-AI quality metrics—answer accuracy, reasoning-step coverage, hallucination rate, latency and user-satisfaction scores—and surface them in live dashboards.

• Own regression-test coverage: schedule nightly eval runs, track logic regressions / prompt-stability issues and coordinate “human-in-the-loop” reviews for gray-area failures.

• Rapidly iterate and fine-tune prompts for GPT-4, Claude and open-weights models, using the evaluation pipeline to lift accuracy and suppress hallucinations.

• Architect multi-turn conversation flows and function-call chains that invoke micro-services or tool APIs to fulfil user intents.

• Design agent personas, guardrails and JSON-schema response formats that downstream services can reliably parse.

• Document prompt patterns, failure modes and best practices in an internal library adopted by all product squads.

• Collaborate with UX conversation designers to match tone, brand voice and accessibility guidelines.

• Mentor engineers on prompt safety, system-prompt layering and structured output design; champion an experimentation culture across teams.
  
  WHAT YOU WILL NEED

·5–8 years total software-/ML-engineering experience including 2–3 years focused on QA or evaluation of ML/LLM systems.

·Hands-on experience building test harnesses for LLM behaviour using OpenAI Evals, Promptfoo or similar frameworks; comfortable designing A/B and regression suites.

·Proven success shipping features on GPT-4, Claude or similar models in production.

·Deep skills with LangChain/LlamaIndex, OpenAI function-calling and JSON-schema prompts, plus retrieval-augmented-generation (RAG) pipelines.

·Strong coding in Python (preferred) or Node.js; familiarity with CI/CD and serverless runtimes on AWS or Azure.

·Meticulous attention to detail and documentation; able to codify evaluation protocols so results are reproducible and debuggable.

·Solid grasp of conversation-design heuristics (intent recognition, turn-taking, error recovery) and evaluation metrics (BLEU/F1, toxicity scores).

·Exceptional written & verbal communication—able to translate model behaviours and trade-offs for both technical and non-technical audiences.

·Demonstrated mentoring skills—cultivating curiosity, psychological safety and innovation within diverse teams.

WHAT’S IN IT FOR YOU:  

• Purpose led company with a Values focused culture – Best Life, One Team, Growth Mindset 

• Time Off – competitive PTO plans with 15 Earned accrued leave, 12 days Sick leave, and 12 days Casual leave per year 

• 11 Holidays plus 4 Days of Disconnect – once a quarter, we take a collective breather and enjoy a day off together around the globe. #oneteam 

• Group Mediclaim insurance coverage of INR 500,000 for employee + spouse, 2 kids, and parents or parent-in-laws, and including EAP counseling 

• Life Insurance and Personal Accident Insurance 

• Best Life Perk – we are committed to meeting you wherever you are in your fitness journey with a quarterly reimbursement 

• Premium Calm App – enjoy tranquility with a Calm App subscription for you and up to 4 dependents over the age of 16 

• Support for working women with financial aid towards crèche facility, ensuring a safe and nurturing environment for their little ones while they focus on their careers. 

We’re committed to diversity and passion, and encourage you to apply, even if you don’t demonstrate all the listed skillsets! 

ABC’S COMMITMENT TO DIVERSITY, EQUALITY, BELONGING AND INCLUSION: 
ABC is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.  We are intentional about creating an environment where employees, our clients and other stakeholders feel valued and inspired to reach their full potential and make authentic connections. We foster a workplace culture that embraces each person’s diversity, including the extent to which they are similar or different. ABC leaders believe that an equitable and inclusive culture is not only the right thing to do, it is a business imperative. Read more about our commitment to diversity, equality, belonging and inclusion at abcfitness.com  

ABOUT ABC: 

ABC Fitness (abcfitness.com) is the premier provider of software and related services for the fitness industry and has built a reputation for excellence in support for clubs and their members. ABC is the trusted provider to boost performance and create a total fitness experience for over 41 million members of clubs of all sizes whether a multi-location chain, franchise or an independent gym. 

 
Founded in 1981, ABC helps over 31,000 gyms and health clubs globally perform better and more profitably offering a comprehensive SaaS club management solution that enables club operators to achieve optimal performance. ABC Fitness is a Thoma Bravo portfolio company, a private equity firm focused on investing in software and technology companies (thomabravo.com). 

#LI-HYBRID 

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!