Sr Engineer – GenAI Quality Assurance
ES023 Janssen Barcelona, Spain
EUR 60K-96K (estimate) Senior-level Full Time
Tasks
- Advocate GenAI architecture best practices
- Build evaluation pipelines
- Build regression tests
- Build test harnesses
- Collaborate with data scientists
- Collaborate with developers
- Collaborate with domain experts to validate solutions
- Design automated QA strategies for GenAI systems
- Document system design decisions
- Document test cases
- Establish testing standards for continuous integration and deployment
- Evaluate model behavior
- Execute tests and debug pipelines
- Generate synthetic test data
- Implement QA checkpoints in AI workflows
- Implement manual QA strategies for GenAI systems
- Lead system design reviews
- Measure evaluation metrics
- Perform code reviews
- Support deployment of GenAI products
- Validate prompt logic
Perks/Benefits
Skills/Tech-stack
AI Foundry | API Testing | AWS | AWS Bedrock | Azure | Azure AI | Azure AI Foundry | Bias and fairness | Continuous Deployment | Continuous integration | Data Pipeline Testing | Data Validation | Data pipeline | Docker | Evaluation Pipelines | GCP | Git | Google Cloud | Grafana | Graph | Jenkins | LLM APIs | Language Models | Large Language Models | MLOps | Machine Learning | Model Evaluation | Observability | OpenAI | Pipeline testing | Prometheus | Prompt engineering | Python | Quality Assurance | RAG | Regression testing | Safety testing | Software Quality Assurance | Software quality | SonarQube | Synthetic test data | Test Data | Test frameworks
Education
N/A
Related jobs
-
Apache Airflow | BI | DBT | Data Governance | Data ModelingCollaborative culture | Continuous learning | Flexible work locations | Inclusive workplace | Professional growthSenior-level Full TimeSpain21h ago
-
AI Foundry | AI Governance | AI Search | AI Security | AI complianceSenior-level Full TimeMadrid, Castellana 85, Spain1d ago
-
AI Engineer EUR 43K-65KAWS Bedrock | CI/CD | Docker | Git | KubernetesContinuous learning resources | Hybrid work model | Internal mobility | Structured development programsSenior-level Full TimeBarcelona, Spain1d ago
-
Entry-level Full TimeMadrid, Spain1d ago
-
Data Analysis | Data Visualization | Deep learning | DevOps | MLOpsEntry-level Full TimeMadrid, Spain1d ago
-
Algorithm Design | Computational optimization | Data analytics | Machine Learning | PythonEntry-level InternshipMadrid, Spain1d ago
-
Senior AI-First Data Engineer EUR 75K-125KApache Airflow | Business Intelligence | CRM | Customer Data | Customer data platformsRemote-friendlySenior-level Full TimeArmenia - Remote; Europe; Georgia - … R1d ago
-
APIs | Data Processing | Distributed Systems | Docker | Generative AIAccess to AI infrastructure | Conference attendance | Continuous training | Direct mentoring | Private medical insuranceEntry-level Full TimeVigo, Spain1d ago
-
Staff Software Engineer (AI/ML), Security/Privacy EUR 106K-109KAccess Management | Cloud Computing | Cybersecurity | Data Privacy | Distributed SystemsSenior-level Full TimeMálaga, Spain1d ago
-
Data Engineer EUR 55K-73KA/B | A/B Testing | AWS | Apache Airflow | Apache Iceberg25 days paid time off | 3 extra paid days off after 6 months | 8 weeks Parental Leave | Coaching counseling mental health support | Company eventsSenior-level Full TimeBarcelona, Spain1d ago
-
Data Engineer Python EUR 36K-36KElasticsearch | FastAPI | Git | GitHub | JavaAccident insurance | Continuous training | Discounts | Flexible benefits | Health insuranceEntry-level Full TimeMadrid, MD, Spain1d ago
-
AI Agents | API Design | Agent SDK | Agent systems | Automated testingExposure to emerging AI technologies | Flexible contractor schedule | Global Time Zone Flexibility | Professional networking | Professional recognitionSenior-level Contract FreelanceSpain R1d ago
-
AWS | Asynchronous programming | Database technologies | FastAPI | GitHub CopilotAutonomy | Career growth | Company-provided equipment | International travel temporarily | Remote-firstMid-level Full TimeSpain1d ago
-
Applied AI Engineer (Spain) EUR 40K-65KAutomation | CRM | Evaluation | Fintech | Fraud DetectionCompetitive healthcare benefits | Flexible working hours | Remote workMid-level Full TimeSpain1d ago
-
Applied AI Engineer - AI Neobank App (Spain) EUR 40K-65KAPI Integration | Agents | Cost Optimization | Evaluation | Fallback strategiesFlexible work environment | Remote workMid-level Full TimeSpain2d ago
-
Data Engineer / AWS & Big Data EUR 33K-59KAWS | AWS Glue | Amazon EMR | Amazon Redshift | Amazon S3Accident insurance | Flexible benefits | Flexible schedule | Hybrid work | Individualized training planSenior-level Full TimeSevilla, Bluenet, Spain2d ago
-
MLOps Engineer EUR 30K-40KAWS | Agentic AI | Artificial Intelligence | Azure | Azure DevOpsEmployee benefits club | Remote work | Unlimited training accessSenior-level Full TimeSpain - Remote R2d ago
-
Data Engineer EUR 30K-38KApache Spark | Git | Hive SQL | Python | SQLEmployee benefits discounts | Remote work | Unlimited training accessEntry-level Full TimeSpain - Remote R2d ago
-
Científico/a de datos senior EUR 36K-45KAlgorithms | CI/CD | Data Processing | Data Visualization | Deep learningContinuous training | Corporate university | Employee discounts | Flexible compensation | Life insuranceSenior-level Full Time0100510-TOMAS BRETON,53, Spain2d ago
-
Security Data Engineer (m/f/d) EUR 60K-60KDAX | DLP | Data Governance | Data Lineage | Data ModelingCareer development | Company bonus scheme | Digital learning programs | Employee discounts | Employee shares programSenior-level Full TimeBarcelona, B, ES, 080052d ago
-
AI Engineer (m/f/d) EUR 40K-49KAI Foundry | Agent Orchestration | Agentic AI | Asynchronous programming | Audit LoggingCompany bonus scheme | Digital learning programs | Employee discounts | Employee shares program | Flexible workingSenior-level Full TimeBARCELONA, B, ES, 080052d ago
-
AI Services | Amazon Bedrock | Anthropic | Azure AI | Azure AI ServicesCertification coverage | Flexible time off for appointments | Flexible work model (hybrid) | Free emotional legal and family support | Free language coursesSenior-level Full TimeMadrid, Spain2d ago
-
Senior Data Engineer I EUR 56K-84KABAC | Alerting | Amazon Web Services | Apache Airflow | Apache BeamCompetitive time off | Digital disconnect days | Employee stock purchase plan | Global induction program | Talent development programsSenior-level Full TimeValència, VC, Spain2d ago
-
Senior Platform Engineer - Data Infrastructure EUR 65K-88KAWS | Amazon Aurora | Amazon EKS | Amazon ElastiCache | Amazon MSKChildcare benefits | English classes reimbursement | Flexible hours | Gym subscription | Hybrid workSenior-level Full TimeMadrid, MD, Spain2d ago
-
Remote AI Engineer - Knowledge (m/f/d) EUR 85K-95KAPI | AWS | Access Control | DBT | DagsterBetterHelp Access | Birthday day off | Bonus vacation time | Co-working support | Extra days offMid-level Full TimeRemote Germany R2d ago