Staff AI Product Engineer
Melbourne HQ or Sydney
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Heidi Health
Heidi Health’s AI medical scribe transcribes visits and generates notes to save time & focus on care. Trusted in Europe & beyond – try for free today!Who are Heidi?
Heidi is on a mission to halve the time it takes to deliver world-class care.
We believe that by 2050, every clinician will practice with AI systems that free them from administrative burdens and increase the quality and accessibility of care to patients across the world.
Built for clinicians, by clinicians, at the core of Heidi is its people. We are an eclectic bunch of inventors, builders, scientists, nurses, doctors, mathematicians, designers, creatives, and high-agency executors.
We achieve in 6 months what it takes our competitors 4 years to do. In just 12 months, 20 million patient consults were supported by Heidi, and we’re now powering more than 1 million consults every week.
With our most recent $16.6MM round of funding from leading VC firms, we’re geared up to supercharge our ambitious global growth, starting with the US, Canada, UK and Europe - and we need great people like you to get there.
The Role
Working as a key partner to our Engineering Manager and executive leadership, you’ll be the Staff AI Engineer for the Model Platform team. You are the technical cornerstone for all of Heidi's AI capabilities.
This is a role for a true builder and visionary, someone who operates with the ownership and drive of a founder.
Your mission is to set the long-term technical vision for our AI infrastructure, spearheading ambitious, 0-to-1 projects and acting as a force multiplier for the entire engineering organization. You won’t just build the factory; you’ll design the blueprint for the entire industrial park.
What you’ll do:
Define and Drive Technical Vision: You will own the long-term architectural roadmap for the Model Platform, making foundational decisions that will scale for years to come and anticipate future product needs.
Spearhead Strategic Initiatives: Lead the most complex and ambiguous technical projects from concept to production. This includes designing and building entirely new systems, such as our next-generation evaluation framework or pioneering novel agentic architectures.
Architect for Excellence: Design and write elegant, highly scalable, and reliable code for the most critical parts of our platform. Your work will be the gold standard that other engineers learn from.
Create Cross-Functional Synergy: Act as the primary technical liaison between the Model Platform, product leadership, and other engineering teams. You will translate business strategy into a clear technical strategy, ensuring alignment and creating powerful synergies across the company.
Mentor and Elevate: Level up our entire engineering team by mentoring senior engineers, leading by example, and championing a culture of technical rigor, innovation, and relentless execution.
What we will look for:
You have a deep, proven track record (e.g., 8-10+ years) of architecting, building, and shipping complex, large-scale AI/ML platforms and products. You've seen what world-class looks like and have built it yourself.
You are recognized as a technical authority in Python, cloud infrastructure (GCP or AWS), and distributed systems. Your system designs are robust, scalable, and pragmatic.
You possess a profound and nuanced understanding of the entire LLM ecosystem, from GPU-level optimisations and advanced fine-tuning techniques to the frontiers of agentic systems and evaluation theory.
You are a world-class communicator and strategist, capable of articulating a complex technical vision to engineers, product managers, and C-level executives with equal clarity and impact.
You have that founder-engineer mindset: a blend of high agency, strategic thinking, pragmatism, and an obsessive drive to build things that have a massive impact.
Bonus:
Direct experience building and scaling A/B testing platforms or data flywheel systems from scratch.
Experience scaling AI/ML teams or platforms through hyper-growth.
PhD or Masters in an AI-related field.
Contributions to open-source projects.
What do we believe in?
We create unconventional solutions to difficult problems and we build them fast. We want you to set impossible goals and make them happen, think landing a rocket but the medical version.
You'll be surrounded by a world-class team of engineers, medicos and designers to do your best work, inspired by our shared beliefs:
We will stop at nothing to improve patient care across the world.
We design user experiences for joy and ship them fast.
We make decisions in a flat hierarchy that prioritizes the truth over rank.
We provide the resources for people to succeed and give them the freedom to do it.
Why you will flourish with us 🚀?
Flexible hybrid working environment, with 3 days in the office.
Additional paid day off for your birthday and wellness days
Special corporate rates at Anytime Fitness in Melbourne, Sydney tbc.
A generous personal development budget of $500 per annum
Learn from some of the best engineers and creatives, joining a diverse team
Become an owner, with shares (equity) in the company, if Heidi wins, we all win
The rare chance to create a global impact as you immerse yourself in one of Australia’s leading healthtech startups
If you have an impact quickly, the opportunity to fast track your startup career!
Help us reimagine primary care and change the face of healthcare in Australia and then around the world.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: A/B testing Architecture AWS Distributed Systems Engineering GCP GPU Industrial LLMs Machine Learning ML infrastructure Open Source PhD Python Testing
Perks/benefits: Career development Flat hierarchy Flex hours Flex vacation Salary bonus Startup environment Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.