Staff Applied AI Scientist
Tasks
- Analyze AI performance regressions
- Build evaluation tooling and documentation
- Build longitudinal evaluation monitoring
- Design sampling systems
- Develop reusable evaluation frameworks
- Enable engineering teams to run evaluations
- Label de identified production traces
- Measure quality in production
- Own feedback loop for continuous improvement
- Recommend prompt changes
- Recommend system changes
- Run LLM as a judge evaluations
- Set up online evaluation and alerting
- Stay current with LLM evaluation research
Perks/Benefits
- Extended end of year break
- Home workspace setup budget
- Inclusive parental leave
- Learning programs and coaching
- MacBook provision
- Medical insurance coverage
- Monthly Wellbeing Allowance
- Quarterly Refresh Days
- Social impact days
Skills/Tech-stack
Agentic Systems | Data labeling | Human-in-the-loop | LLM Evaluation | LLM-as-a-Judge | LLMOps | Langfuse | Language Models | Large Language Models | Machine Learning | Metrics baselines | Observability | Orchestration | Production Monitoring | Prompt engineering | Python | Quality tracking | RAG | Regression Detection | Sampling | The Loop | Tracing | TypeScript
Education
Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science | PhD
Roles
AI | AI Scientist | Applied AI Scientist | Engineer | Learning Engineer | Machine Learning Engineer | Scientist
Regions
Countries
States
Cities
Related jobs
-
Data Processing | Diffusion Models | Embedding Models | Experimentation | Fine TuningEquity packages | Flexible leave | Parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R8h ago
-
Data Platform Engineer AUD 103K-125KAI Foundry | Automated testing | Azure AI | Azure AI Foundry | Azure DataAccredited family friendly workplace | Additional inclusive leave | Bonus paid time off | Flexible work options | Hybrid workingMid-level Full TimeSydney, NSW, Australia10h ago
-
Data Platform Engineer AUD 103K-125KAI Foundry | Automated testing | Azure AI | Azure AI Foundry | Azure DataAdditional leave options | Flexible working options | Hybrid working | Inclusive leave optionsMid-level Full TimeMelbourne, VIC, Australia10h ago
-
Data Engineer AUD 140K-175KAWS | Access Control | Agile | Automated testing | AzureContinuous learning | Discount Store Financial Benefits | Employee assistance program | Flexible working options | Novated leasingSenior-level Full TimePerth, Western Australia, Australia12h ago
-
Staff Applied AI Scientist AUD 148K-180KAgentic Systems | Data Labelling | Evaluation datasets | Human-in-the-loop | LLM-as-judgeCoaching | Extended end of year break | Home workspace setup budget | Inclusive parental leave | Learning programsSenior-level Full TimeMelbourne13h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KAWS | CI | CI/CD | DevOps | NLPConference access | Corporate discounts and vouchers | Generous parental leave | Home office setup support | Hybrid workSenior-level Full TimeBrisbane, Australia13h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KAWS | CI/CD | Data Governance | Data Pipelines | Data QualityCommunity leave | Conferences and study assistance | Corporate discounts and vouchers | Home office stipend | Hybrid workSenior-level Full TimeSydney, Australia13h ago
-
Senior Data Engineer - Data & AI AUD 102K-120KCI/CD | Clean Code | Data Governance | Data Quality | Data pipelineConferences | Corporate discounts | Home office support | Hybrid workplace | In-house trainingSenior-level Full TimeMelbourne, Australia13h ago
-
Azure AI Developer Consultant AUD 120K-143K.NET | API Management | App Service | Automated testing | Azure APIFlexible work schedule | Presence on customer site when required | Work-from-home hybridSenior-level Full TimeMelbourne, VIC, AU20h ago
-
Junior MLOps Engineer AUD 65K-75KAlerting | CI/CD | Cloud infrastructure | Containerization | DockerCompany-wide events | Daily catered breakfast | Free coffee | Learning opportunities | Modern office spaceEntry-level Full TimeMelbourne, Australia1d ago
-
A/B | A/B Testing | AI Agents | B testing | Evaluation FrameworksAnnual company retreats | Family support benefits | Fully remote | High-trust culture | Home office setup stipendSenior-level Full TimeAustralia R1d ago
-
Product Data Scientist AUD 120K-140KChurn Prediction | Common table expressions | DBT | Experiment design | GitEmployee assistance program | Fitness Passport membership | Hybrid work | Mental health support | Paid parental leaveMid-level Full TimeMelbourne, Victoria 3000, Australia R1d ago
-
Mid-level Full TimeAU: Sydney (45 Clarence St)1d ago
-
Staff Machine Learning Engineer NZD 135K-165KAWS EMR | Airflow | Apache Spark | Dask | Distributed ProcessingSenior-level Full TimeAU: Sydney (45 Clarence St)1d ago
-
Senior Data Scientist AUD 129K-140KAgentic AI | Data Science | GenAI | Language Models | Language ProcessingFlexible workingSenior-level Full TimeSydney, NSW - CBP South, 11 …1d ago
-
Senior AI Engineer (Sydney, Australia - Hybrid) AUD 146K-180KAI Observability | AWS Bedrock | AWS IAM | Agentic Frameworks | Amazon CloudWatchHybrid work | Relocation provided noneSenior-level Full TimeSydney, Australia R1d ago
-
C# | MATLAB | NumPy | Numerical Simulation | PandasPart-time project-based workEntry-level FreelanceAustralia - Remote R1d ago
-
Electromagnetism | Mechanics | NumPy | Numerical Simulation | PandasPart time freelance projectsSenior-level FreelanceAustralia - Remote R1d ago
-
C# | MATLAB | NumPy | Pandas | PythonFreelance project based engagement | Part-time project workEntry-level FreelanceAustralia - Remote R1d ago
-
Backend Software Engineer – Human-Robot Interaction AUD 140K-175KC++ | Concurrency | Distributed Systems | Event Driven | Event-driven architecture401k contributions | Dental insurance | Federal Holidays | Health insurance | State HolidaysSenior-level Full TimeCharlestown, MA1d ago
-
Agentic Frameworks | CI/CD | Cloud Computing | Containers | Deep learningCareer growth support | Flexible work arrangement | Hybrid work arrangement | Inclusive engineering culture | Learning and development supportSenior-level Full TimeAustralia2d ago
-
AI Agents | API Integration | Language Models | Large Language Models | Next.jsAccess to cutting-edge technologies | Continuous learning | Fully remote | High autonomy | Location flexibilityMid-level Full TimeAustralia R2d ago
-
Embedded Linux Engineer AUD 100K-140KAI hardware | AI hardware optimization | Assembly | Automated Deployment | Bare MetalFlexible work options | Give back day | Global wellness paid day off | Health and wellbeing timeMid-level Full TimeSydney2d ago
-
Senior Robotics Simulation Engineer USD 190K-200KAPIs | C++ | CI/CD | Communication Interfaces | Embedded Systems401k | Accident insurance | Commuter benefits | Company-Paid Holidays | Critical illness insuranceSenior-level Full TimeBrisbane, CA3d ago
-
MATLAB | NumPy | Pandas | Python | RFlexible weekly hours | Part-time freelance | Project based workSenior-level FreelanceAustralia - Remote R4d ago