Staff Applied AI Scientist
Tasks
- Analyze AI performance regressions
- Build evaluation tooling and documentation
- Build longitudinal evaluation monitoring
- Design sampling systems
- Develop reusable evaluation frameworks
- Enable engineering teams to run evaluations
- Label de identified production traces
- Measure quality in production
- Own feedback loop for continuous improvement
- Recommend prompt changes
- Recommend system changes
- Run LLM as a judge evaluations
- Set up online evaluation and alerting
- Stay current with LLM evaluation research
Perks/Benefits
- Extended end of year break
- Home workspace setup budget
- Inclusive parental leave
- Learning programs and coaching
- MacBook provision
- Medical insurance coverage
- Monthly Wellbeing Allowance
- Quarterly Refresh Days
- Social impact days
Skills/Tech-stack
Agentic Systems | Data labeling | Human-in-the-loop | LLM Evaluation | LLM-as-a-Judge | LLMOps | Langfuse | Language Models | Large Language Models | Machine Learning | Metrics baselines | Observability | Orchestration | Production Monitoring | Prompt engineering | Python | Quality tracking | RAG | Regression Detection | Sampling | The Loop | Tracing | TypeScript
Education
Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science | PhD
Roles
AI | AI Scientist | Applied AI Scientist | Engineer | Learning Engineer | Machine Learning Engineer | Scientist
Regions
Countries
States
Cities
Related jobs
-
Signals Intelligence Specialist AUD 150K-180KAgent Orchestration | Artificial Intelligence | Data Infrastructure | Data Modeling | Data PipelinesSenior-level Full TimeSydney, Australia1h ago
-
A/B | A/B Testing | B testing | Cost Optimization | Data PipelinesEquity packages | Flexible leave | Parental leave | Remote within Australia | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R13h ago
-
PhD Graduate Machine Learning Engineer Graduate, Trust and Safety Engineering - 2026 Start AUD 65K-75KAlgorithms | Computer Vision | Data Mining | Data Structures | Language ProcessingEntry-level Full TimeSydney, New South Wales, Australia1d ago
-
Experimental Physics Consultant GBP 30K-34KData Analysis | Data acquisition | Electromagnetic systems | Environmental testing | Experimental DesignAnnual leave | Community charity initiatives | Company pension | Performance bonus | Private healthcareNone Full TimeMelbourn, United Kingdom1d ago
-
Senior Data Engineer AUD 116K-136KAWS | DBT | Data Modelling | DataOps | GitHubFlexible working arrangements | Hybrid workSenior-level Full TimeCity Campus, Australia1d ago
-
Senior Data Scientist AUD 131K-146KAPIs | AWS | Advertising metrics | CI/CD | ClassificationAccessibility support | Birthday leave | Career break leave | Company charity drives | Compassionate leaveSenior-level Full TimeNSW - SHS 2 Holt Street …1d ago
-
Senior Robotics Software Engineer USD 180K-200KC# | C++ | CAN | Concurrent programming | Design Patterns401k | Commuter benefits | Company-Paid Holidays | Dental insurance | Employer-paid life insuranceSenior-level Full TimeBrisbane, CA2d ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous work culture | Competitive compensation | Flexible management approach | Remote-friendly cultureMid-level Full TimeSydney, Australia2d ago
-
Specialist Solutions Architect AUD 145K-175KAWS | Anomaly Detection | Apache Spark | Azure | Change Data CaptureConference presentations | Continuous learning | Hackathons | Internal training | MentorshipSenior-level Full TimeSydney, Australia3d ago
-
BLE | Bare Metal | C++ | Coverity | DFMEA401k | Commuter benefits | Company-Paid Holidays | Dental insurance | Health coverageSenior-level Full TimeBrisbane, CA3d ago
-
Senior Databricks Consulting Engineer AUD 155K-200KAWS | Ansible | Apache Kafka | Apache NiFi | Apache SparkCertification support | Continuous learning support | Flexible working hours | Remote-friendly work environmentSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
Senior Quantum Engineer - Quantum Processors USD 130K-184KCryogenics | Data Analysis | Dilution refrigerator | Electronics instrumentation | Hardware InterfacesMid-level Full TimeSan Sebastián, ES, London, UK, Sydney, …4d ago
-
Amazon Web Services | Apache Spark | Big Data | Data Analysis | HadoopRemote workSenior-level Full TimeSydney, NSW, Australia R4d ago
-
Senior Data Engineer, CX AUD 147K-185KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon BedrockSenior-level Full TimeAustralia4d ago
-
Embedded Software Engineer GBP 30K-34KAutomated testing | Bare Metal | Bluetooth | C# | C++Annual leave | Community and charity initiatives | Company pension | Cycle to work | Give as you earnMid-level Full TimeMelbourn, United Kingdom4d ago
-
Senior Data Engineer AUD 118K-125KAWS | Airbyte | Airflow | Athena | AzureFlexible work options | Give back day | Global wellness benefits | Virtual yoga or meditation sessions | Wellness paid day offSenior-level Full TimeSydney4d ago
-
Staff Data Scientist, Cashalo SGD 161K-245KDeep learning | GitHub Copilot | Language Models | Large Language Models | LightGBMEquity | Flexible work support | Global team collaboration | Health insurance | Health plan subsidiesSenior-level Full TimeRemote - Australia R4d ago
-
Intern AI Engineer AUD 75K-80KAWS | Agile | Azure | CI/CD | CSSDiscounted health insurance | Employee assistance program | Flexible leave options | Mentoring | Novated leasingEntry-level Full Time InternshipAUS VIC DXC Melbourne 360 Collins …4d ago
-
Principal Data Engineer (AWS) AUD 150K-173KAWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftFlexible work arrangements | Flexible work location | Job share | Part-time arrangements | Supportive inclusive workplaceSenior-level Full TimeSydney, NSW - CBP North, 1 …4d ago
-
AI Solutions Architect – Azure AI Foundry & Agentic AI AUD 150K-180K.NET | AI Agents | AI Foundry | AI Governance | AI SearchSenior-level Full TimeMelbourne, 161 Collins Street, Level 5, …4d ago
-
AURIN Data Scientist AUD 111K-120KCI/CD | Cloud Computing | Containerization | Data Processing | Data ValidationCultural leave | Discounted services | Employee assistance program | Flexible work arrangements | Gender Affirmation LeaveMid-level Full TimeParkville, Australia4d ago
-
AWS | Azure | Cloud platform | DBT | Data VisualizationAdditional paid leave | Corporate partner discounts | Hybrid work | Learning opportunities | Mobile PlanSenior-level Contract Full Time TemporaryBarangaroo, NSW, AU4d ago
-
Senior ML Engineer AUD 75K-104KA/B | A/B Testing | Agentic AI | Azure | B testingGenerous salary packaging | Health and wellbeing incentives | Novated leasing | Onsite child care | Staff gym accessSenior-level Full TimeAustralia4d ago
-
Amazon Redshift | Cloud Computing | DBT | Data Architecture | Data EngineeringBuddy program | Career development | Coaching & mentoring | Continuous learning | Global career opportunitiesSenior-level Full TimeAustralia4d ago
-
Arbitrary waveform generator | Automation | Cryogenic measurement | Data Analysis | Data acquisitionCycle to work scheme | Life assurance | Pension | Private medical insuranceMid-level Full TimeSydney, AU, London, UK, San Sebastián, …4d ago