AI QA Trainer - LLM Evaluation
Romania
R
A RON 258K-359K (estimate) Senior-level Contract Full Time
Tasks
- Analyze model failures
- Automate testing with scripts
- Build evaluation frameworks
- Collaborate on quality monitoring dashboards
- Conduct adversarial testing
- Create evaluation rubrics
- Design test plans
- Document root cause analysis
- Evaluate large language models
- Execute regression suites
- Maintain evaluation documentation
- Perform red teaming
- Recommend prompt and guardrail improvements
- Validate tool usage accuracy
- Verify retrieval augmented generation outputs
Perks/Benefits
Skills/Tech-stack
Adversarial Testing | Artificial Intelligence | Bias Assessment | Data Analysis | Hallucination detection | LLM Evaluation | Language Models | Large Language Models | Machine Learning | Prompt engineering | Python | RAG | Red Teaming | Regression testing | Retrieval-Augmented Generation | SQL | Safety testing | Test automation
Education
Roles
AI | AI QA | AI QA Engineer | Engineer | Learning Engineer | Machine Learning Engineer | QA Engineer
Related jobs
-
AWS | Agent systems | Amazon Bedrock | Azure | Cloud platformContract extension opportunity | Flexible consulting environment | Fully remote | US time zone overlapSenior-level Contract Full TimeRomania R1d ago
-
Senior Data Engineer - FanDuel, Hybrid RON 264K-288KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkAnnual leave | Career growth sessions | Company share scheme | Dental insurance | Extended health insuranceSenior-level Full TimeCluj-Napoca, Romania R2d ago
-
AI Trainer - Freelance Data Annotator RON 82K-107KArtificial Intelligence | Attention to detail | Communication | Data Annotation | Fact-checkingFlexible schedule | Freelance work | Part-time work | Remote workEntry-level FreelanceRomania - Remote R2d ago
-
AI Automation Team Lead (Remote, Contract) RON 272K-359KAI Agents | Automation workflows | Data Fluency | Integration development | Low CodeBirthday off | Paid time off | Reduced Friday hours | Remote work | Sick leaveSenior-level ContractRomania R2d ago
-
API Design | Backend architecture | Command Line | Command-line Interface | Database systemsCompany equipment | Continuous learning allowance | Flexible working hours | Fully remote | Health insurance allowanceSenior-level Full TimeRomania R3d ago
-
API Integration | Artificial Intelligence | Change Management | Data Privacy | Generative AIInclusive workplace | Innovation culture | Remote work | Travel for onsite collaborationExecutive-level ContractEurope R3d ago
-
AWS | Autoscaling | Bash | CI/CD | Data PipelinesFully remote work | Healthcare coverage | Paid parental leave | Relocation assistance | Technical ownershipMid-level Full TimeRomania R4d ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsFlexible schedule | Health insurance | Parental leave | Remote work | Service Donation MatchingSenior-level Full TimeRomania R4d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R4d ago
-
AI Engineer RON 264K-396KAPI Architecture | AWS | Agent systems | Apache Spark | Azure25 vacation days | Focus Fridays | Generous leave package | Hybrid work | LinkedIn LearningSenior-level Full TimeBucharest, Bucharest, Romania R4d ago
-
Alerting | Amazon Redshift | Anomaly Detection | Batch Processing | CI/CDContinuous improvement opportunities | Cross-functional collaboration | Exposure to modern data validation frameworks | Fully remote work | Ownership over data reliability strategySenior-level Full TimeRomania R4d ago
-
Senior Data Engineer EUR 70K-90KCI/CD | ClickHouse | Docker | Elasticsearch | KafkaFlexible working hours | Learning time | Location Based Social Benefits | Remote-first | Team eventsSenior-level Full TimeGermany /Spain / Romania (Remote) R5d ago
-
Senior Python Engineer (Gen AI) - L344Y638 USD 84K-95KAWS | CI/CD | Docker | EC2 | EKSCareer growth | Charity initiatives | Diversity and inclusion | Fully remote | Team-building activitiesSenior-level Full TimeBucharest, Romania R7d ago
-
Senior Data Engineer RON 264K-288KAPI Development | AWS | Access Control | Apache Kafka | Apache SparkAcademic teaching support | Company events | Flexible working hours | Health insurance | Knowledge sharing sessionsSenior-level Full TimeRomania - Remote R8d ago
-
Auto Scaling | Blue-Green Deployment | Blue/green | CI/CD | CUDAFully remote | High ownership and influence | Remote work flexibilitySenior-level Full TimeRomania R8d ago
-
APIs | Airtable | Analytics | Artificial Intelligence | AttributionAutonomy | Equity | Flexible hours | Fully remote | High ownershipMid-level Full TimePoland R8d ago
-
Auto Scaling | CI/CD | CUDA | Container Orchestration | Distributed SystemsEnglish language support | On-call support | Remote workSenior-level Full TimeUkraine R14d ago
-
Data Engineer (Databricks) in Development Romania Access & Business Intelligence team (hybrid) RON 173K-221KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2E-learning access | Flexible work schedule | Hybrid work option | Internal referral program | Meal ticketsMid-level Full TimeCalea Floreasca 246c, 014476 Bucharest R15d ago
-
Senior Data Engineer Interviewer RON 296K-396KAWS Glue | Airflow | Amazon Web Services | Apache Spark | AuthenticationFlexible interview based schedule | Part-time workSenior-level Contract Full TimeRomania - Remote R19d ago
-
AI Architect RON 258K-348KAPI Design | DevOps | Docker | Embeddings | GitLab CIBookster subscription | Extra days off | Free coffee | Free fruits | Hybrid workSenior-level Full TimeBucharest, Bucharest, Romania R22d ago
-
AWS Bedrock | Agents SDK | Langchain | Language Models | Large Language ModelsRemote work from BucharestMid-level Full TimeBucharest, Romania R22d ago
-
Senior Artificial Intelligence/Machine Learning Engineer RON 204K-278KAWS | Amazon SageMaker | Apache Beam | Azure | CI/CDMeal tickets | Medical subscription | Remote work optionSenior-level Full TimeRomania R22d ago
-
AWS | CI/CD | Cloud Functions | Cloud Storage | Cloud platform100 percent remoteSenior-level Full TimeBucharest, Romania R23d ago
-
AWS | Airflow | Amazon S3 | CI/CD | Cloud ComposerB2B contract | Enterprise-scale projects | International team | Professional growth | Remote workMid-level Full TimeBuharest, Romania R23d ago
-
Senior Data Engineer RON 295K-430KAgile | Apache Hive | Apache Spark | C# | C++Career Development Programs | Family-friendly policies | Health benefits | Hybrid work model | Learning and mentorshipSenior-level Full TimeBucharest, Romania R24d ago