Senior Member of Technical Staff – LLM/AI

Join us as we work to create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all.

Responsibilities may include, but are not limited to:  

50% [Primary Function] Technical Execution 

• Contribute to accurate, unambiguous technical design specifications, including GenAI system integration and AI-enhanced workflows.
• Deliver customer value in the form of high-quality AI-powered software components and services, ensuring adherence to security, performance, longevity, and AI-driven automation best practices.
• Estimate the size of development tasks in story points, considering LLM inference latency and AI API rate limits.
• Understand and follow coding conventions, architectures, and best practices for GenAI-powered applications, LLM prompt engineering, and RAG (Retrieval-Augmented Generation) models.
• Write, debug, and deploy code to production, ensuring timely fixes for GenAI-based APIs, embeddings, and AI-driven microservices.
• Integrate and optimize OpenAI, Azure OpenAI, Hugging Face, LangChain, and LlamaIndex into enterprise applications.
• Leverage vector databases (Pinecone, FAISS, ChromaDB) for similarity search and AI retrieval pipelines.
• Adhere to Definition of Done (DOD) as part of the sprint, including:
  • Unit tests, functional testing
  • LLM performance benchmarking (BLEU, ROUGE, cosine similarity)
  • AI model validation & API response optimization (temperature, top-k, max tokens)
  • Code reviews, bug fixes, documentation
  • Adherence to AI governance & responsible AI practices

30% Contributions to the Team 

• Learn domain-specific AI applications, including GenAI capabilities in automation, search, and AI-assisted decision-making.
• Take ownership of AI-enhanced product features, ensuring continuous model improvement and fine-tuning strategies.
• Contribute to agile ceremonies with a focus on AI-driven solutions and optimizations.
• Volunteer for GenAI-focused backlog items, such as:
  • RAG model refinement
  • Prompt engineering for better accuracy
  • LLM evaluation and response optimization
• Participate in scrum meetings (daily stand-ups, sprint planning, readouts, retrospectives) with a focus on AI model iteration and feature scaling.
• Drive self-organization in AI workflows, ensuring GenAI is used effectively across teams.

10% Cross functional Coordination and Communication  

• Work collaboratively across Technology, Product, AI/ML, and DevOps teams to align AI-driven enhancements with business goals.
• Build strong relationships with AI engineers, data scientists, and cloud architects to optimize LLM-based applications.
• Ensure AI compliance with security, ethical AI policies, and privacy standards (HIPAA, GDPR, SOC2, AI governance best practices).

10% Mentorship of Others 

• Train and mentor developers on GenAI integration, AI API usage, embeddings, and vector search optimizations.
• Guide the team on LLM prompt engineering, RAG model improvements, and API latency optimization.
• Encourage adoption of AI-enhanced developer workflows (e.g., Copilot, AI-assisted code generation, AI-powered testing).

Education, Experience, & Skills Required: 

• 5-10 years of experience in an engineering role, with exposure to AI/ML concepts.
• Experience in an Agile environment preferred.
• Bachelor’s Degree or equivalent in Computer Science, Engineering, or related field.
• Strong software engineering experience, including AI model integration and GenAI API workflows.
• Knowledge of modern programming language: Python (preferred for AI applications)
• Familiarity with Unix/Linux, Big Data, SQL, NoSQL, and AI data pipelines.
• Experience with AI frameworks and APIs such as OpenAI GPT, Hugging Face Transformers, LangChain, LlamaIndex.
• Exposure to retrieval-augmented generation (RAG), embeddings, and AI search optimization techniques.
• Understanding of vector databases (FAISS, Pinecone, ChromaDB) and similarity search models.
• Proficiency in cloud-based AI deployments (AWS or Azure OpenAI).
• Strong grasp of GenAI model evaluation techniques (BLEU, ROUGE, BERT Score, cosine similarity metrics).

Behaviors & Abilities Required:   

• Ability to design and implement AI-powered solutions that improve software functionality.
• Problem-solving mindset to debug and optimize AI-generated responses.
• Ability to collaborate across AI, DevOps, and software engineering teams for seamless AI model integration.
• Experience in AI-driven feature development, from prompt engineering to embedding optimization.
• Ability to assess AI-generated content for bias, accuracy, and compliance.
• Strong analytical skills to measure AI model performance and recommend improvements.
• Curiosity and eagerness to explore new AI models, tools, and best practices for scalable GenAI deployment.

About athenahealth

Here’s our vision: To create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all.  

What’s unique about our locations? 
From an historic, 19th century arsenal to a converted, landmark power plant, all of athenahealth’s offices were carefully chosen to represent our innovative spirit and promote the most positive and productive work environment for our teams. Our 10 offices across the United States and India — plus numerous remote employees — all work to modernize the healthcare experience, together. 
 
Our company culture might be our best feature. 
We don't take ourselves too seriously. But our work? That’s another story. athenahealth develops and implements products and services that support US healthcare: It’s our chance to create healthier futures for ourselves, for our family and friends, for everyone.  

Our vibrant and talented employees — or athenistas, as we call ourselves — spark the innovation and passion needed to accomplish our goal. We continue to expand our workforce with amazing people who bring diverse backgrounds, experiences, and perspectives at every level, and foster an environment where every athenista feels comfortable bringing their best selves to work. 

Our size makes a difference, too: We are small enough that your individual contributions will stand out — but large enough to grow your career with our resources and established business stability. 
 
Giving back is integral to our culture. Our athenaGives platform strives to support food security, expand access to high-quality healthcare for all, and support STEM education to develop providers and technologists who will provide access to high-quality healthcare for all in the future. As part of the evolution of athenahealth’s Corporate Social Responsibility (CSR) program, we’ve selected nonprofit partners that align with our purpose and let us foster long-term partnerships for charitable giving, employee volunteerism, insight sharing, collaboration, and cross-team engagement.   

What can we do for you? 
Along with health and financial benefits, athenistas enjoy perks specific to each location, including commuter support, employee assistance programs, tuition assistance, employee resource groups, and collaborative workspaces — some offices even welcome dogs.  

In addition to our traditional benefits and perks, we sponsor events throughout the year, including book clubs, external speakers, and hackathons. And we provide athenistas with a company culture based on learning, the support of an engaged team, and an inclusive environment where all employees are valued.  

We also encourage a better work-life balance for athenistas with our flexibility. While we know in-office collaboration is critical to our vision, we recognize that not all work needs to be done within an office environment, full-time. With consistent communication and digital collaboration tools, athenahealth enables employees to find a balance that feels fulfilling and productive for each individual situation.