LLM Quality Engineer
Tasks
- Benchmark LLM outputs
- Build test and evaluation frameworks for AI systems
- Collaborate on CI CD release pipeline quality gates
- Develop automated tests for AI driven software
- Evaluate prompts for language models
- Monitor production quality of AI systems
- Reduce regressions and improve reliability
Perks/Benefits
- N/A
Skills/Tech-stack
AI Evaluation | APIs | Benchmarking | CI/CD | Language Models | Monitoring | Prompt engineering | Pytest | Python | Regression testing | Test automation
Education
Roles
AI | AI Quality Engineer | Engineer | LLM Quality Engineer | Quality Engineer
Related jobs
-
Bash | Data Ingestion | Data Ingestion Pipelines | Data Processing | DockerAsynchronous culture | Remote/distributed team | Supportive team environmentMid-level Full TimeOslo, Norway3d ago
-
Data Scientist/ML Engineer NOK 450K-450KAWS SageMaker | Azure Databricks | Continuous Deployment | Continuous integration | Data ModelingCertification programs | Flexible working arrangements | Supportive team environment | Training and developmentSenior-level Full TimeBergen, Vestland, Norway5d ago
-
Data Engineer NOK 460K-460KAWS | Amazon SageMaker | Apache Flink | Apache Spark | AzureExtra vacation week | Flexible working arrangements | Inclusive work environment | Training and development programsEntry-level Full TimeBergen, Vestland, Norway5d ago
-
Data Engineer NOK 450K-450KAzure | Azure Data | Azure Data Factory | Azure ML | Data FactoryFlexible work schedule | Health related leave | Mentoring | Paid leave for travel | Personal development opportunitiesEntry-level Full TimeOslo, Norway5d ago
-
AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075KAWS | Anthropic | Azure | CI/CD | DockerAutonomy | Collaborative culture | Hybrid workingMid-level Full TimeTrondheim, Trøndelag, Norway6d ago
-
AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075KAWS | Agentic Workflows | Anthropic | Azure | CI/CDFlexible hybrid workingMid-level Full TimeFornebu, Akershus, Norway6d ago
-
AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075KAWS | Agent Frameworks | Azure | CI/CD | Cloud platformAutonomy | Flexible hybrid working | Knowledge sharingMid-level Full TimeBergen, Vestland, Norway6d ago
-
APIs | Anomaly Detection | Data Modeling | Data Pipelines | Docker100% remote work | Career growth opportunities | Flexible work environment | International team cultureMid-level Full TimeNorway R6d ago
-
Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DB | Azure DataHybrid work | Relocation package | Visa supportMid-level Full TimeOslo, Norway7d ago
-
Data Analysis | Deep learning | Diffusers | Experiment design | GPU ComputingAutonomy and ownership | Career growth opportunities | Continuous learning opportunities | Flexible globally distributed work environment | Fully remote work environmentMid-level Full TimeNorway R7d ago
-
Azure | CI/CD | Cloud Data | Cloud data platform | Data ModelingCourses and certifications | Five weeks vacation | Flexible work schedule | Inclusive social activitiesSenior-level Full TimeOslo7d ago
-
Data Engineer NOK 625K-625KAccess Control | BigQuery | CI/CD | Cloud platform | Data GovernanceConference access | Flexible work schedule | Home office option | Open source collaboration | Pension planMid-level Full TimeOslo7d ago
-
Senior Data Engineer NOK 795K-1037KAPI | Business Intelligence | Data Architecture | Data Modeling | Data PipelinesSenior-level Full TimeOslo, Norway12d ago
-
Mid-level Full TimeOslo, Norway13d ago
-
Senior Data Engineer NOK 850K-1075KAWS | Amazon Glue | Amazon MSK | Ansible | Apache FlinkAfter work drinks | Company trips | Game nights | Monthly team days | Sporting eventsSenior-level Full TimeOslo, Norway15d ago
-
Bli en del av Audit Analytics NOK 450K-450KArtificial Intelligence | Azure | Business Analytics | Data Automation | Data analyticsCareer development program | Flexible hours | Hybrid work | MentoringEntry-level Full TimeTrondheim18d ago
-
Senior AI Engineer NOK 450K-450KAI Agents | API Integration | Agent Orchestration | Azure | Cloud ComputingCentral office location | Competitive compensation | Flexible schedule | Hybrid work | Mentorship and coachingSenior-level Full TimeOSLO, Norge18d ago
-
Data Engineer NOK 625K-918KApache Airflow | Apache Kafka | Data Governance | Data Quality | PythonConference opportunities | Course access | Cultural activities | Employee discounts | Extra days offMid-level Full TimeOslo, Norge, 019118d ago
-
DataOps Engineer NOK 795K-1075KAgile | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | CD toolsCareer development | Coaching leadership | Flexible working arrangements | Hybrid work model | Supportive feedback cultureSenior-level Full TimeFornebu, Norway20d ago
-
AWS Data | AWS Data Ingestion | Amazon QuickSight | Amazon Web Services | CDCFull-time employment | Hybrid work modelSenior-level Full TimeOslo, Norway25d ago
-
Agentic Workflows | Artificial Intelligence | Cloud Computing | DevOps | Generative AIFlexible-hybrid work | Professional growth | Supportive collaborative teamSenior-level Full TimeTrondheim, Norway1mo ago
-
Senior AI & Data Engineer NOK 450K-450KAWS | Azure | Databricks | Generative AI | Google CloudFlexible work hours | Hybrid work model | Professional developmentSenior-level Full TimeOslo - Verkstedveien 3, Norway1mo ago
-
Data Engineer NOK 450K-450KAWS | Amazon Redshift | Azure | Azure Data | Azure Data FactoryBonus plan | Coaching | Flat organization | Flexible projects | Social eventsMid-level Full TimeOslo, Norway1mo ago
-
Data Engineer NOK 450K-450KAWS | Amazon Redshift | Azure Data | Azure Data Factory | BigQueryBonus plan | Coaching | Flat structure | Social events | Sports activitiesMid-level Full TimeOslo, Norway1mo ago
-
Data Engineer, Microsoft Fabric NOK 450K-450KAPIs | Azure Data | Azure Data Factory | CI/CD | Data FactoryCertification program | Extra vacation week | Flexible working hours | Training and developmentSenior-level Full TimeOslo, Norway1mo ago