[ Job 28396] Mid-Senior QA Automation — Generative AI Testing, Brazil
Tasks
- Collaborate with development teams to debug and improve agent robustness
- Create prompt datasets and test cases for LLM validation
- Define test strategies for generative AI agent pipelines
- Develop automated unit functional regression adversarial tests
- Document testing procedures acceptance criteria and results
- Implement observability and automated evaluation for LLM outputs
- Monitor and analyze performance, accuracy, and security metrics
- Participate in agile rituals reviews and release strategy
Perks/Benefits
- Childcare assistance
- Continuous learning platform
- Dental insurance
- Discount club
- Extended parental leave
- Gympass Wellhub Partnership
- Health insurance
- Language learning platform
- Life insurance
- Meal allowance
- Online courses partnership
Skills/Tech-stack
Adversarial Testing | CI/CD | Continuous integration | Distributed Systems | Functional testing | Jailbreaking | Kafka | LLM | Langchain | Langsmith | Observability | Prompt injection | Promptfoo | Pytest | Python | Regression testing | TruLens | Unit Testing | Unittest
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Data Engineer BRL 120K-144KClassification | Clustering | DAX | Data Modeling | Data VisualizationCasual office dress code | Childcare subsidies | Clube Ben partnership | Days off | Dental insuranceMid-level Full TimeCampinas, São Paulo, Brazil13h ago
-
Senior Data Engineer BRL 304K-370KAWS Lambda | Amazon RDS | Amazon S3 | Amazon Web Services | Apache SparkEquipment stipend | Flexible PTO | Learning and development stipend | Paid certifications exams | Professional development planSenior-level Full TimeBRAZIL R15h ago
-
[job-28646] Developer Master IA (SDLC+GenAI) BRL 18K-18KAgent systems | Automated testing | CI/CD | Code review | Data PrivacyChildcare support | Dental insurance | Discount club | Extended parental leave | GympassSenior-level Full TimeBrazil15h ago
-
API Integration | AWS S3 | Apache Airflow | CI/CD | DBTEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapMid-level Full TimeCuritiba, Brazil20h ago
-
BI Dashboards | Compliance analytics | Excel | Fraud Detection | KPIsDental insurance | Gym membership | Health insurance | Home office | Hybrid workSenior-level Full TimeSão Paulo, Brazil22h ago
-
Airflow | Automated testing | BigQuery | CI/CD | Cloud ComposerRemote workMid-level Full TimeRemoto, Brasil R1d ago
-
Staff Data Engineer BRL 325K-443KAWS Glue | AWS Glue Catalog | Amazon MWAA | Amazon S3 | Apache AirflowRemote workSenior-level Full TimeSão Paulo, SP, Brazil R1d ago
-
Data Engineer - 131300 BRL 84K-84KAWS Glue | Amazon Athena | Amazon EMR | Amazon MSK | Amazon RedshiftSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0002d ago
-
Sr Analytics Engineer BRL 230K-295KAmazon Redshift | Apache Spark | DBT | Data Governance | Data MartsDental insurance | Health insurance | Home-office allowance | Language classes | Life insuranceSenior-level Full TimeBrazil - Remote R2d ago
-
CI/CD | Cloud Computing | Data Modeling | Dynamic Chunking | EmbeddingsChildcare support | Dental insurance | Fitness membership | Food Voucher | Health insuranceMid-level Full TimeSão Paulo, Brazil2d ago
-
Senior DataOps Engineer BRL 234K-275KAWS | Airflow | Alerting | CI/CD | DockerBirthday off | Discounts | English program | Extended maternity and paternity leave | Flexible hoursSenior-level Full TimeVitória, Espírito Santo2d ago
-
AWS Bedrock | AWS EKS | Agent systems | Apache Airflow | Apache SparkChildcare support | Dental insurance | Employee assistance program | Health insurance | Life insuranceMid-level Full TimeRio de Janeiro, Rio de Janeiro, …2d ago
-
DataOps Engineer BRL 234K-275KAWS | Alerting | Amazon EC2 | Amazon EKS | Amazon EMRDental insurance | Extended maternity leave | Extended paternity leave | Flexible hours | Health insuranceSenior-level Full TimeVitória, Espírito Santo2d ago
-
API Gateway | AWS Lambda | Agile methodologies | Circuit Breaker | Data PipelinesChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil2d ago
-
AI | JavaScript | MongoDB | Node.js | PostgreSQLFlexible hours | Fully remote | Modern stack projects | Strong JavaScript community | Work from anywhereMid-level Full Timeremote, Brazil (Remote) R2d ago
-
Engenheiro(a) de Dados Pleno BRL 23K-23KAWS | AWS Step Functions | Alerting | Apache Airflow | AzureDEI programs | Reward & recognition | Volunteering | Wellness | Work-life balanceEntry-level Full TimeSão Paulo, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksMid-level Full TimeSalvador, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeBelo Horizonte, Brazil2d ago
-
AWS | Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Paulo, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeRio de Janeiro, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimeCuritiba, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimePorto Alegre, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Bernardo do Campo, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimeBrasília, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterFlextime | Growth roadmaps | Mentorship | Office work options | Remote work optionsMid-level Full TimeRecife, Brazil2d ago