Backend Engineer, Agent Collaboration Platform
New York City
Full Time Senior-level / Expert USD 160K - 300K
About Hebbia
The user interface for universal knowledge capture. We want every atom of information that our users need to be at their fingertips.
Designed to be generally capable– it can tackle even the most complex tasks, citing answers over any amount of sources. By showing its work, Hebbia empowers users to collaborate with AI on each step and validate responses instead of blindly trusting them. Our mission is to put capable AI in the hands of 1 billion people by 2030.
The Team
The Agent Collaboration platform team at Hebbia builds the interactive scratch-pad, analysis, and content creation tools for Agents. Our flagship product, Matrix, is a generative spreadsheet that leverages our ISD process to coordinate complex agentic workflows across thousands of documents. We pair a simple, elegant interface—where users can kick off complex multistep document workflows—with a real-time, high-throughput LLM execution engine capable of processing the equivalent of 100 Harry Potter novels per second. Together, we turn massive, unstructured document repositories into seamless, actionable intelligence.
Our team works in person 5 days a week at our SoHo office in NYC.
The Role
A backend engineer at Hebbia blends expertise in systems, application layer software, and data modeling to build highly efficient software solutions. You will be responsible for leveraging the latest software and agentic solutions and integrating product experience with powerful distributed systems. You’ll help protect Hebbia’s technical edge via elegant software design, efficient data communication, and sophisticated integrations. We value engineers who move fast, hold themselves accountable to quality, and are detail-oriented.
Responsibilities
- Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs.
- Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume.
- Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents.
- Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth.
Who You Are
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field. A strong academic background with coursework in data structures, algorithms, and software development is preferred.
- 5+ years software development experience at a venture-backed startup or top technology firm, with a focus on backend software engineering.
- Proficiency in building backend and API systems using technologies such as Python, Java, or Go.
- Extensive experience with cloud platforms (e.g., AWS)
- Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
- Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders.
- Proven experience in leading software development projects and collaborating with cross-functional teams. Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.
- Enthusiasm for continuous learning and professional growth. A passion for exploring new technologies, frameworks, and software development methodologies.
- Embraces rapid prototyping with an emphasis on user feedback
- Autonomous and excited about taking ownership over major initiatives
- Bonuses:
- Experience building agentic systems or LLM enabled products.
- Frequent user of AI products, especially during the development lifecycle (i.e. Cursor, Claude Code, etc).
Compensation
The salary range for this role is $160,000 to $300,000, covering levels from junior to principal. Final leveling is determined through our assessment process, and exceptions to this range may be made for candidates with qualifications that fall outside our standard framework.
Life @ Hebbia
PTO: Unlimited
Insurance: Medical + Dental + Vision + 401K
Eats: Catered lunch daily + doordash dinner credit
Parental leave policy: 3 months non-birthing parent, 4 months for birthing parent
Fertility benefits: $15k lifetime benefit
New hire equity grant: competitive equity package with unmatched upside potential
#LI-Onsite
Tags: APIs AWS Claude Computer Science Content creation Distributed Systems Elasticsearch Engineering Java Kafka LLMs PostgreSQL Prototyping Python Statistics
Perks/benefits: Career development Competitive pay Equity / stock options Fertility benefits Health care Medical leave Parental leave Startup environment Unlimited paid time off
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.