Staff Applied AI Scientist
Tasks
- Analyze AI performance regressions
- Build evaluation tooling and documentation
- Build longitudinal evaluation monitoring
- Design sampling systems
- Develop reusable evaluation frameworks
- Enable engineering teams to run evaluations
- Label de identified production traces
- Measure quality in production
- Own feedback loop for continuous improvement
- Recommend prompt changes
- Recommend system changes
- Run LLM as a judge evaluations
- Set up online evaluation and alerting
- Stay current with LLM evaluation research
Perks/Benefits
- Extended end of year break
- Home workspace setup budget
- Inclusive parental leave
- Learning programs and coaching
- MacBook provision
- Medical insurance coverage
- Monthly Wellbeing Allowance
- Quarterly Refresh Days
- Social impact days
Skills/Tech-stack
Agentic Systems | Data labeling | Human-in-the-loop | LLM Evaluation | LLM-as-a-Judge | LLMOps | Langfuse | Language Models | Large Language Models | Machine Learning | Metrics baselines | Observability | Orchestration | Production Monitoring | Prompt engineering | Python | Quality tracking | RAG | Regression Detection | Sampling | The Loop | Tracing | TypeScript
Education
Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science | PhD
Roles
AI | AI Scientist | Applied AI Scientist | Engineer | Learning Engineer | Machine Learning Engineer | Scientist
Regions
Countries
States
Cities
Related jobs
-
Senior Data Scientist - Product, Features & Growth AUD 119K-140KA/B | A/B Testing | B testing | Data Modeling | Data VisualizationFlexible leave options | Hybrid work flexibility | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeSydney, NSW, Australia R10h ago
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne10h ago
-
Staff Machine Learning Engineer - Recommendations AUD 119K-136KData-Driven Decision Making | Data-driven | Decision Making | Machine Learning | Model EvaluationEquity packages | Flexible leave options | Parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia11h ago
-
Data pipeline | Debugging | Inference Optimization | Java | KubernetesFlexible leave options | Flexible work hours | Inclusive parental leave | Office setup allowance | Remote friendly within AustraliaSenior-level Full TimeSydney, Australia13h ago
-
Applied AI Engineer AUD 70K-97KAgent architecture | CI/CD | Data pipeline | Docker | Infrastructure as CodeFlexible work arrangements | Leadership programs | Learning programs | Paid parental leave | Paid volunteering daysSenior-level Full TimeMelbourne, VIC, AU15h ago
-
Applied AI Specialist AUD 90K-118KAPI Integration | Artificial Intelligence | Data Contracts | Data schemas | JSONFlexible work arrangements | Learning and leadership programs | Market-leading parental leave | Paid volunteering days | Retail discountsSenior-level Full TimeMelbourne, VIC, AU15h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactorySenior-level Full TimeSydney, International House, 3 Sussex St, …15h ago
-
Adtech | Distributed Systems | Docker | Embeddings | JavaAccess to technical leadership | Collaborative engineering culture | Exposure to cutting edge generative AI | High autonomy and flexibility | High ownership and real world production impactEntry-level Full TimeAustralia R1d ago
-
Senior Data Scientist AUD 102K-125KA/B | A/B Testing | Anomaly Detection | B testing | Data ContractsConference support | Corporate discounts and vouchers | Home-office allowance | Hybrid work flexibility | In-house trainingSenior-level Full TimeMelbourne, Australia1d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipeline | Data ProcessingAsynchronous culture | Friendly atmosphere | Portfolio link support | Remote or distributed workMid-level Full TimeBrisbane, Australia1d ago
-
Cyber Security Data Engineer AUD 135K-165KArtificial Intelligence | Automation | Compliance reporting | Control assessments | Control mappingEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia1d ago
-
Lead Data Scientist AUD 150K-180KAccountability | CD4ML | Computer Vision | Data Mining | Data PreprocessingCareer development support | Learning and development programs | MentorshipSenior-level Full TimeMelbourne, Australia1d ago
-
Data Engineer-Medicare Mental Health Check In AUD 96K-119KAutomated testing | Azure | Azure Data | Azure Data Factory | CI/CDCompetitive salary packaging benefits | Hybrid working | Inclusive and supportive culture | Professional development and learning opportunitiesMid-level Full TimeVIC Group Office - Melbourne, Australia1d ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R1d ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R1d ago
-
Senior Data Scientist AUD 129K-142KData Engineering | Data Science | Data Transformation | Data Validation | Data extractionAnnual flu vaccinations | Discounted health and fitness memberships | Employee assistance program | Flexible working arrangements | Generous leave entitlementsSenior-level Full TimeSydney, NSW, AU, 20001d ago
-
AI Software Engineer AUD 111K-161KASP.NET Web | ASP.NET Web API | AWS ECS | AWS Lambda | AWS S3Additional time off | Flexible and hybrid working | Gym membership | Learning opportunities | Social eventsMid-level Full TimeSydney, New South Wales, Australia2d ago
-
Mid-level Full TimeHong Kong, Hong Kong; Sydney, Australia3d ago
-
Senior Manager - Responsible AI, Gen AI AUD 130K-143KAI Governance | Foundational models | Generative AI | Machine Learning | Model EvaluationFlexible working hours | In office collaboration at least half time per month | Job flexibility | Job-sharingSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …3d ago
-
Data Engineer AUD 125K-128KAI Agents | AWS | Automation | Azure | Data GovernanceCharity volunteering opportunities | EAP support | Financial planning support | Flexible work options | Generous leaveMid-level Full TimeNorwest, New South Wales 2153, Australia4d ago
-
Staff Data Scientist - International (CJKI) AUD 65K-80KA/B | A/B Testing | B testing | Data Science | Data WarehousingEquity packages | Flexible leave options | Inclusive parental leave | Vibe and Thrive allowanceEntry-level Full TimeSydney, Australia R4d ago
-
Data Engineer AUD 110K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Birthday day off | End-of-trip facilities | Flexible working | Paid parental leaveMid-level Full TimeSydney4d ago
-
Senior Software Engineer AUD 140K-143KAPI Design | Agile | Automated testing | CI/CD | Distributed SystemsFlexible working hours | Job share | Office connection at least half time per month | Part-time arrangementsSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Data Engineering Lead AUD 120K-125KAWS | Azure | CI/CD | Cloud Computing | Data ArchitectureCareer development opportunities | Discounted healthcare memberships | Employee counselling support | Employee discounts | Flexible leave optionsSenior-level Full TimeHead Office Sydney, Australia4d ago
-
Data Scientist, Network Fabric Engineering AUD 100K-126KAI systems | AWS Lambda | Amazon Athena | Amazon S3 | BenchmarkingMid-level Full TimeSydney, New South Wales, AUS4d ago