Staff Machine Learning Engineer

What We’re BuildingHoneycomb is the observability platform for teams who manage software that matters. Send any data to our one-of-a-kind data store, solve problems with all the relevant context, and fix issues before your customers find them. Honeycomb is the unified, fast, and collaborative choice for engineering teams who care about customer experience to get the answers they need, quickly. We are passionate about consumer-quality developer tools and excited to build technology that raises our industry’s expectations of what our tools can do for us. We’re working with well known companies like HelloFresh, Slack, LaunchDarkly, and Vanguard and more across a range of industries. This is an exciting time in our trajectory, as we’ve closed Series D funding, scaled past the 200-person mark, and were named to Forbes’ America’s Best Startups of 2022 and 2023!  If you want to see what we’ve been up to, please check out these blog posts and Honeycomb.iopress releases.  Who We AreWe come for the impact, and stay for the culture! We’re a talented, opinionated, passionate, fiercely inclusive, and responsible group of bees. We have conviction and we strive to live our values every day. We want our people to do what they truly love amongst a team of highly talented (but humble) peers. How We WorkWe are a remote-first company, which means we believe it is not where you sit, but how you deliver that matters most. We invest in our people and care about how you orient to our culture and processes. At the same time we imbue a lot of trust, autonomy, and accountability from Day 1. #LI-Remote
2025: The Year of AI at Honeycomb!We’re thrilled to announce the formation of our dedicated AI Team, a powerhouse of innovation and vision. This team will drive our AI strategy, crafting game-changing product features that span the spectrum of machine learning (ML) to generative AI (GenAI). They’ll also elevate the engineering domain by building the frameworks that enable teams across Honeycomb to harness the power of AI effectively.
While AI isn’t new territory for Honeycomb, this initiative marks an exciting leap forward as we scale our capabilities and impact. Want a peek at what we’ve been up to? Dive into our blog posts to see the journey so far:
Observability in the Age of AIObservability, Meet Natural Language Querying with Query Assistant So we shipped an AI Product, did it work?

What you’ll do in the role:

• Lead the Charge in AI Experimentation: Drive our experimentation and evaluation efforts—both online and offline—pioneering new AI innovations.
• Set the Standard for AI Excellence: Shape and refine our AI best practices by staying ahead of the curve with the latest industry advancements.
• Own Production-Ready Systems: Deploy and monitor application and infrastructure code, ensuring robust performance in production environments.
• Collaborate with Product and Design: Partner closely with product managers and designers in our triad model to bring AI-driven ideas to life and deliver delightful user experiences.
• Empower R&D Teams: Support cross-functional teams across Honeycomb in developing and delivering cutting-edge, AI-powered product features that amaze our users.

What you’ll bring to the role:

• GenAI Expertise: At least 1+ year of experience building and deploying production-ready features with generative AI.
• ML Mastery: 5+ years of hands-on experience in machine learning, with a strong foundation in building and refining models.
• Deep Knowledge of Retrieval & Recommendation Systems: Proven experience designing systems that deliver personalized, relevant results.
• Collaborative Spirit: A track record of working effectively with engineers, product managers, and cross-functional teams to bring AI-driven visions to life.
• Production Ownership: Experience owning your model’s performance and behavior in live production environments.
• Bonus Points:
• Experience in the developer tools space.
• Familiarity with adjacent areas like UI integration or production infrastructure development.

What you’ll get when you join the hive:

• Base pay (range) of $208,500 - $245,000 USD
• A stake in our success - generous equity with employee-friendly stock program
• It’s not about how strong of a negotiator you are - our pay is based on transparent levels relative to experience
• Time to recharge - Unlimited PTO and paid sabbatical
• A remote-first mindset and culture (really!)
• Home office, co-working, and internet stipend
• 100% employee/75% for dependents coverage for all benefits 
• Up to 16 weeks of paid parental leave, regardless of path to parenthood
• Annual development allowance 
• And much more...

Please note we cannot currently sponsor or do visa transfers at this time.
Diversity & Accommodations:We're building a diverse and inclusive workplace where we learn from each other, and welcome nontraditional candidates, and people of all backgrounds, experiences, abilities and perspectives. You don't need to be a millennial to join us, all gens are welcome! Further, we (of course) follow federal and state disability laws and are happy to provide reasonable accommodations during the application phase, interview process, and employment. Please email Talent@honeycomb.io to discuss accessible formats or accommodations. As an equal opportunity employer our hiring process is designed to put you at ease and help you show your best work; if we can do better - we want to know!