Senior LLMOps Engineer
Tasks
- Build deployment health dashboard
- Create feedback flywheel from Intercom tickets and CSAT
- Design model incident response and evaluation workflows
- Enable session to model lineage
- Filter high value feedback into training data
- Generate execution trace summaries for stakeholders
- Implement incident alerting and root cause analysis
- Integrate observability with ASR and model pipelines
- Measure per model unit economics and optimize model selection
- Monitor post deployment performance and improve models
Perks/Benefits
- Equity
- Fertility support
- Health and wellness allowance
- Home office budget
- Learning and development budget
- Paid parental leave
- Work from anywhere
Skills/Tech-stack
Alerting | Dashboarding | Data Modeling | Data Pipelines | Datadog | Distributed tracing | Evaluation | Feedback Triage | Incident Response | Intercom | LLM Agents | LLMOps | Machine Learning | Model Monitoring | Observability | Session Lineage | Tracing | Unit economics
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Computer Vision | Deep learning | Diffusion Models | Docker | Generative AIEquity package | Flexible leave options | Flexible work arrangements | Parental leave | Professional growth opportunitiesSenior-level Full TimeAustralia R3d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsFlexible work location | Fully remote | Ownership and leadership opportunities | Technical autonomySenior-level Contract Full TimeAustralia R3d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | CI/CD | Cloud platformClassPass membership | Culture Swap Days | Employee resource groups | Extra annual leave | Flexible work hoursSenior-level Full TimeSydney, Australia R4d ago
-
Senior Machine Learning Engineer AUD 144K-180KAWS | Algorithms | Anomaly Detection | Azure | CI/CDClassPass membership | Employee resource groups | Extra annual leave | Flexible work | Learning and developmentSenior-level Full TimeMelbourne, Australia R4d ago
-
AI Engineering Lead AUD 137K-143KAgile | Amazon Web Services | Docker | IAM | LoggingDiscounted flights | Discounts on accommodation | Discounts on car hire | Discounts on experiences | Discounts on lounge membershipSenior-level Full TimeBrisbane, Sydney R4d ago
-
Data Pipelines | Deep learning | Generative AI | Image Generation | Infrastructure EngineeringAnnual wellbeing allowance | Equity packages | Flexible leave options | Inclusive parental leaveSenior-level Full TimeSydney, Australia R5d ago
-
API Integration | Access Control | Audit Logging | Automated Quality | Automated quality gatesAnnual company offsite gatherings | Annual professional development budget | Coworking allowance | Dependent coverage support | Employee equityMid-level Full TimeAustralia R6d ago
-
Forward Deployed AI Engineer, Australia AUD 119K-161KAWS | Agentic Workflows | Apache Iceberg | Apache NiFi | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeAustralia-Sydney-Remote R7d ago
-
Senior Data Engineer AUD 150K-170KA/B | A/B Testing | AWS | Amplitude | B testingAnnual leave | Catered lunch | Equity and ownership | Flexible time off | Hybrid work modeSenior-level Full TimeSydney, New South Wales R10d ago
-
Senior Analyst, Data & Analytics AUD 60K-78KBusiness Intelligence | DBT | Data Governance | Data Modeling | Data PipelinesEmployee discount travel | Hybrid work model | Staff travel programSenior-level Full TimeMelbourne, Victoria, Australia R11d ago
-
Data Analysis | Machine Learning | Model Evaluation | Model Serving | NumPyEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia R12d ago
-
Agents | Artificial Intelligence | LLM | Language Processing | MLOpsEquity packages | Flexible leave options | Inclusive parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R12d ago
-
Senior Data Engineer - Automation & AI AUD 118K-127KAccess Control | Agentic Systems | Auditability | Batch Processing | ChunkingEmployee assistance program | Employee wellbeing platform | Extra days leave | Flexibility support | Hybrid work modelSenior-level Full TimeAustralia R16d ago
-
Senior Machine Learning Engineer AUD 148K-210KAccess Control | Agent systems | CI/CD | Capabilities Based Access Control | Error RecoveryHealth and wellness benefits | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R19d ago
-
Staff Machine Learning Engineer AUD 140K-185KAWS | Amazon ECS | Amazon ElastiCache | Amazon S3 | Audit LoggingSenior-level Full TimeAustralia - Melbourne - Hybrid R19d ago
-
Senior Machine Learning Engineer AUD 145K-186KAI Risk Management Framework | Agent systems | Agentic Workflows | Anomaly Detection | Content SafetyHybrid work model | Inclusive work environment | Reasonable accommodations | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R19d ago
-
A/B | A/B Testing | B testing | Cost Optimization | Data PipelinesEquity packages | Flexible leave | Parental leave | Remote within Australia | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R20d ago
-
Amazon Web Services | Apache Spark | Big Data | Data Analysis | HadoopRemote workSenior-level Full TimeSydney, NSW, Australia R23d ago
-
Senior Analytics Engineer - User Voice AUD 148K-170KAlerting | Analytics engineering | Census | DBT | Data GovernanceEquity packages | Flexible leave options | Hybrid work | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, Australia R27d ago
-
Enterprise Sales Engineer AUD 85K-100KAPM | AWS | Azure | Cloud platform | Distributed tracingBest in class onboarding | Continuous professional development | Employee stock purchase plan | Global benefits | Hybrid workMid-level Full TimeBrisbane, Australia R1mo ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R1mo ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R1mo ago
-
Senior Data & Analytics Engineer, Strategic Finance AUD 150K-222KDBT | Data Modeling | Data Pipelines | Data Quality | Dimensional ModelingEmployee stock options | Health insurance coverage | Hybrid work | Paid time off | Parental leaveSenior-level Full TimeMelbourne, VIC, Sydney, NSW R1mo ago
-
Senior Machine Learning Engineer - Research Optimisation AUD 121K-161KA/B | A/B Testing | AWS | B testing | BatchingFlexible leave options | Hybrid remote work | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R1mo ago
-
Finance BI & Data Engineer - 12 month FTC AUD 120K-130KAnomaly Detection | Artificial Intelligence | Data Architecture | Data Governance | Data ModelingHealth care support | Learning and development opportunities | Paid leaveMid-level Contract TemporaryAustralia (Remote) R1mo ago