Staff Applied AI Scientist
Tasks
- Build LLM analysis for performance regression
- Design evaluation monitoring and alerting systems
- Enable teams through reusable evaluation frameworks and tooling
- Lead evaluation enablement for product teams
- Own prompt engineering evaluation and continuous improvement
- Partner with product data science and people science on measured quality
- Recommend prompt or system changes
- Stay current with evaluation observability and LLMOps research
Perks/Benefits
- Coaching
- Extended end of year break
- Home workspace setup budget
- Inclusive parental leave
- Learning programs
- Medical insurance coverage
- Monthly Wellbeing Allowance
- Quarterly Refresh Days
- Social impact days
Skills/Tech-stack
Agentic Systems | Data Labelling | Evaluation datasets | Human-in-the-loop | LLM-as-judge | LLMOps | Language Models | Large Language Models | Machine Learning | Observability | Production Monitoring | Prompt engineering | Prompt management | Python | RAG | Sampling | The Loop | TypeScript
Education
Related jobs
-
Staff Applied AI Scientist AUD 148K-180KAgentic Systems | Data labeling | Human-in-the-loop | LLM Evaluation | LLM-as-a-JudgeExtended end of year break | Home workspace setup budget | Inclusive parental leave | Learning programs and coaching | MacBook provisionSenior-level Full TimeSydney11h ago
-
Product Data Scientist AUD 120K-140KChurn Prediction | Common table expressions | DBT | Experiment design | GitEmployee assistance program | Fitness Passport membership | Hybrid work | Mental health support | Paid parental leaveMid-level Full TimeMelbourne, Victoria 3000, Australia R1d ago
-
Senior Data Scientist AUD 129K-140KAgentic AI | Data Science | GenAI | Language Models | Language ProcessingFlexible workingSenior-level Full TimeSydney, NSW - CBP South, 11 …1d ago
-
Senior AI Engineer (Sydney, Australia - Hybrid) AUD 146K-180KAI Observability | AWS Bedrock | AWS IAM | Agentic Frameworks | Amazon CloudWatchHybrid work | Relocation provided noneSenior-level Full TimeSydney, Australia R1d ago
-
Agentic Frameworks | CI/CD | Cloud Computing | Containers | Deep learningCareer growth support | Flexible work arrangement | Hybrid work arrangement | Inclusive engineering culture | Learning and development supportSenior-level Full TimeAustralia1d ago
-
AI Agents | API Integration | Language Models | Large Language Models | Next.jsAccess to cutting-edge technologies | Continuous learning | Fully remote | High autonomy | Location flexibilityMid-level Full TimeAustralia R2d ago
-
MATLAB | NumPy | Pandas | Python | RFlexible weekly hours | Part-time freelance | Project based workSenior-level FreelanceAustralia - Remote R4d ago
-
Azure AI Developer Consultant AUD 70K-80K.NET | API Management | App Service | Automated testing | Azure APIFlexible work environment | Present on customer site when required | Work from home optionSenior-level Full TimeSydney, NSW, AU4d ago
-
Azure AI Developer Consultant AUD 70K-80K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work environment | On site customer presence when required | Work from home optionSenior-level Full TimeBrisbane, QLD, AU4d ago
-
Senior Manager, AI Engineering Platforms AUD 116K-127KAgent Orchestration | Automation | C# | C++ | CI/CDCareer development | Employee wellbeing | Flexible working arrangementsSenior-level Full TimeMelbourne Support Centre4d ago
-
Lead AI Engineer AUD 167K-200KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeSydney, Australia R5d ago
-
Principal Data Scientist AUD 130K-150KAWS | Agentic Systems | Azure | CI/CD | ClassificationFlexible work hours | Work from engineering hubs within AustraliaSenior-level Full TimeEveleigh, NSW - 5-7 Central Ave, …5d ago
-
Legal AI Researcher/Analyst – Regulatory Compliance AUD 113K-142KAI Evaluation | Legal research | Metadata | Prompt engineering | Regulatory ComplianceFlexible working hours | Hybrid work | Remote work flexibilityMid-level Full TimeAustralia - (Sydney)5d ago
-
Data Engineer (AI Adoption) AUD 126K-143KAI Engineering | Azure | Azure Data | Azure Data Lake | Azure EventAdditional leave options | Employee discounts | Flexible work arrangements | Learning and development opportunities | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia6d ago
-
Senior Data Scientist AUD 125K-142KAlgorithms | Big Data | Cloud Computing | Data Mining | Data StructuresSenior-level Full TimeAUS - Melbourne, Australia6d ago
-
Research Associate - Data Scientist in Ecosystem Science AUD 113K-121KData Auditing | Data Transformation | Data Visualization | Data harmonization | Fair Principles17 percent superannuation | Annual leave loadingMid-level Full TimeSydney, NSW6d ago
-
Senior Consultant / Manager - Advanced Data Analyst - Planning and Infrastructure Economics AUD 60K-250KArcGIS | Dashboards | Demand Modeling | Demand forecasting | Energy DemandCareer breaks | Flexible hours | Health and wellbeing initiatives | Learning and growth opportunities | Paid parental leaveExecutive-level Full TimeMelbourne, VIC, Australia7d ago
-
Senior Consultant / Manager - Advanced Data Analyst - Planning and Infrastructure Economics AUD 60K-250KAPIs | ArcGIS | Demand forecasting | Energy System Modeling | GISCareer breaks | Flexible locations | Flexible working hours | Health and wellbeing initiatives | Learning and growth opportunitiesExecutive-level Full TimeMelbourne, VIC, Australia7d ago
-
Data Scientist, AI AUD 70K-138KAPI Integration | AWS | Agent planning | AgentOps | Agentic SystemsAccommodation discounts | Car hire discounts | Discounted flights | Discounts on retail and technology services | Discounts on travel insuranceMid-level Full TimeBrisbane, Sydney7d ago
-
Head of AI Engineering AUD 150K-200KAWS | Agentic Workflows | Application development | Artificial Intelligence | CI/CD4-day work week option | Competitive remuneration | Flexible working arrangements | Ongoing professional development | Work-life balanceExecutive-level Full TimeMelbourne8d ago
-
Senior Data Scientist AUD 130K-180KBias and fairness | Computer Vision | Data Mining | Data Preprocessing | Data PrivacyCareer development support | Learning and development programs | MentorshipSenior-level Full TimeMelbourne, Australia; Sydney, Australia8d ago
-
Langchain | MLOps | Machine Learning | Matplotlib | NumPyFreelance assignments | Part-time project work | Project-based employmentMid-level FreelanceAustralia - Remote R8d ago
-
Langchain | MLOps | Matplotlib | NumPy | PandasFlexible schedule | Part-time project-based work | Remote work opportunitiesMid-level FreelanceAustralia - Remote R8d ago
-
Forward Deployed AI Engineer AUD 95K-110KAPI Integration | Artificial Intelligence | Communication | Customer support | Data AnalysisCompany travel | Flexible working hours | Paid work trialMid-level Full TimeSydney, Australia HQ8d ago
-
Autoregressive models | Continuous Optimization | Density estimation | Experimental evaluation | Factor GraphsFully remote | High autonomy | Interdisciplinary research | Publication opportunity | Research focused teamSenior-level Full TimeAustralia R9d ago