Sr Engineer – GenAI Quality Assurance
ES023 Janssen Barcelona, Spain
EUR 61K-101K (estimate) Senior-level Full Time
Tasks
- Build regression tests synthetic test data and evaluation pipelines
- Collaborate with data scientists and developers on quality checkpoints
- Conduct code reviews for design testability and maintainability
- Design QA strategies for GenAI systems
- Document system design decisions and test cases
- Establish testing standards for continuous integration and deployment
- Execute tests and debug pipelines
- Lead system design reviews for GenAI architecture and reliability
- Monitor and validate GenAI outputs after release
- Support deployment of GenAI products
- Validate prompt logic model behavior and evaluation metrics
Perks/Benefits
Skills/Tech-stack
AI Foundry | API Testing | AWS | AWS Bedrock | Azure AI | Azure AI Foundry | Cloud platform | Continuous Deployment | Continuous integration | Data Pipelines | Data Validation | Docker | Evaluation metrics | Git | Google Cloud | Google Cloud Platform | Google Gemini | Grafana | Graph Database | Jenkins | LLM APIs | Language Models | Large Language Models | MLOps | Machine Learning | Microsoft Azure | Monitoring | Observability | OpenAI | Prometheus | Prompt engineering | Python | Quality Assurance | Regression testing | Retrieval-Augmented Generation | Software Quality Assurance | Software quality | SonarQube | Synthetic test data | Test Data | Test harnesses
Education
N/A
Related jobs
-
AI Engineer - Generative AI - Accessibility EUR 75K-125KAccessibility | Claude | CrewAI | Figma | Generative AIEmotional support | Family support | Flexible remuneration | Free language courses | Gym discountsSenior-level Full TimeMadrid, Spain17h ago
-
Tupande AI Engineering Lead EUR 66K-85KAPI Integration | Analytics | Artificial Intelligence | Automation | Data platformsCareer Reviews | Comprehensive benefits | Health insurance | Housing | MentorshipSenior-level Full TimeFlexible: Poland, Spain, Portugal, Estonia, Romania, …21h ago
-
AI Agents | API Integration | Backend Development | Cloud Platforms | ContainerizationCoworking space access | Engineering autonomy | Healthcare coverage | Home-office equipment provided | Remote workMid-level Full TimeSpain R21h ago
-
Analista Mlops (Híbrido Madrid/Málaga) EUR 33K-40KAPI | Apache Spark | CI/CD | ETL | EnglishEmployee benefits club | Good work culture | Hybrid work | Technical team support | Unlimited trainingSenior-level Full TimeMADRID, MADRID R1d ago
-
Forward Deployed AI Engineer - Madrid EUR 35K-57KAI Act | API Integration | Agentic coding | Authentication | CCaaSCareer development plan | Career growth opportunities | Company retreat | Flexible work environment | High-quality equipmentMid-level Full TimeMadrid, Spain1d ago
-
Ultralytics LLM Engineer EUR 60K-76KAPI Development | AWS | Azure | Data Quality | DebuggingBirthday off | Home setup allowance | Hybrid work | Independent contractor eligibility | Local holidaysMid-level Full TimeMadrid, Remote EURO R1d ago
-
Staff AI Analytics Engineer EUR 55K-60KAWS | ClickHouse | Cube.js | DBT | Dimensional ModelingBreakfast in the office | Discounts | Free Coffee & Tea | Gym membership | Language classesSenior-level Full TimeBarcelona, CT, Spain3d ago
-
Analytics Engineer GBP 75K-90KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data ModellingEnglish language at office | In person 3 days per week | Relocation supportMid-level Full TimeLondon R3d ago
-
Analytics Engineer - dbt Expert EUR 33K-38KBigQuery | CI/CD | DBT | Data Observability | Data QualityBirthday day off | Flexible compensation | Health discounts | Hybrid work | International environmentSenior-level Full TimeEspaña, Spain3d ago
-
Senior Analytics Engineer EUR 55K-79KAirflow | CI/CD | Cloud Composer | DBT | Data ModelingFluency development support | Hybrid work environmentSenior-level Full TimeMadrid3d ago
-
Senior Data Engineer - Platform EUR 65K-90KBigQuery | Cloud Functions | Cloud Run | Cloud platform | Data GovernanceTraining and certificationSenior-level Full TimeMadrid3d ago
-
Snowflake Senior Data Engineer EUR 36K-45KCI/CD | DBT | Data Governance | Data Lineage | Data ModelingConference access | Flexible work schedule | Friday off | Hybrid work | Intensive Working HoursSenior-level Full TimeSantiago de Compostela, Spain R3d ago
-
Data Scientist – AI & ML EUR 36K-45KAUC | AWS | Artificial Intelligence | Azure | CI/CD100% remote | Career development | Continuous training | Flexible hours | Indefinite contractMid-level Full TimeMadrid, Spain R3d ago
-
AWS | Apache Airflow | Bash | Big Data | DockerFlexible hours | Gym allowance | Meal vouchers | Team-building activities | Training opportunitiesEntry-level Full TimeBarcelona, Barcelona4d ago
-
AI Engineer EUR 80K-105KAgent Orchestration | Asynchronous programming | Embeddings | LLM | MCPComprehensive health benefits | Equity participation program | Family leave | Language training | Leadership programsMid-level Full TimeValencia, Spain (Hybrid) R4d ago
-
Alerting | Apache Airflow | ClickHouse | DBT | Data MonitoringGenerous paid time off | Home office or coworking budget | Learning and development budget | Parental leave | Regular international team offsitesSenior-level Full TimeMadrid, Spain R4d ago
-
Senior Data Engineer I EUR 56K-86KABAC | Apache Airflow | Apache Beam | Apache Flink | CI/CDCompetitive time off | Digital disconnect days | Employee Stock Purchase Plan (ESPP) | Immersive global induction program | Talent and development programsSenior-level Full TimeValència, VC, Spain4d ago
-
Agile | C# | C++ | CAN | CI/CDSenior-level Full TimeSpain, Valencia, Cortes Valencianas5d ago
-
Agile | C# | C++ | CAN | CI/CDSenior-level Full TimeSpain, Valencia, Cortes Valencianas5d ago
-
Senior-level Full TimeES - Alicante, Spain5d ago
-
ML Engineer (Applied AI) EUR 50K-72KAWS Bedrock | AWS EC2 | AWS Lambda | AWS SageMaker | Anomaly DetectionHardware provided | Maternity & paternity leave | Paid Holidays | Paid sick leave | Paid vacationMid-level Full TimeSpain - Remote R5d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous work culture | Collaborative team environment | Inclusive workplace | Remote-friendly environmentMid-level Full TimeBarcelona, Spain5d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Remote/distributed workMid-level Full TimeBilbao, Spain5d ago
-
Senior Analytics Engineer EUR 55K-79KAirflow | CI/CD | Cloud Composer | DBT | Data GovernanceEnglish language fluency not required for employment | Hybrid work environmentSenior-level Full TimeMadrid5d ago
-
Machine Learning Ops and Data Engineer EUR 45K-67KAzure | CI/CD | Containerization | Data Warehouse | DockerCollaborative team culture | Continuous improvement culture | Learning opportunities | Modern technical environmentMid-level Full TimeMálaga, Spain5d ago