Team Lead
Tasks
- Collaborate with AI/ML engineers
- Design test plans and test cases
- Develop automated testing frameworks
- Identify, track, and report defects
- Monitor model performance metrics
- Perform functional testing
- Perform performance testing
- Perform regression testing
- Stay updated on AI LLM testing best practices
- Validate prompt engineering techniques
Perks/Benefits
Skills/Tech-stack
AI Model Evaluation | AI model | Functional testing | Generative AI | Java | Language Models | Large Language Models | Model Evaluation | Model Validation | NLP | Performance Testing | Prompt engineering | Pytest | Python | Regression testing | Selenium | Test automation
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R11h ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R11h ago
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R7h ago
-
Senior Data Scientist / AI Engineer - Generative AI SEK 686K-838KAgentic patterns | Evaluation | Experimentation | Generative AI | LLM APIsDiversity and inclusion initiatives | Hybrid working model | Work in English speaking environmentSenior-level Full TimeStockholm, SE, 111 44 R9h ago
-
Azure DevOps | CI/CD | DAX | Data Governance | Data IngestionFlexible schedule | Four weeks vacation | Health insurance | Hybrid work options | Paid leave optionsMid-level Full TimeMontréal, QC, CA R9h ago
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R11h ago
-
Forward Deployed Machine Learning Engineer USD 165K-200KCloud Computing | Deep learning | Experimentation | Language Models | Language ProcessingSenior-level Full TimeRemote R13h ago
-
Amazon ECS | Amazon EMR | Amazon Redshift | Apache Airflow | Apache SparkDistributed team collaboration | Remote workMid-level ContractArgentina (Remote); Brazil (Remote); Colombia (Remote); … R14h ago
-
Senior Applied Scientist, Scheduling and Optimization CAD 130K-170KAPI Development | Asynchronous programming | CP-SAT | CPLEX | Constraint Programming401k retirement plan | Dental insurance | Healthcare | PTO | Remote workSenior-level Full TimeCanada (Remote) R14h ago
-
Senior Machine Learning Engineer USD 200K-230KBatching | Cloud Inference | Computer Vision | Deep learning | Edge ComputingDental insurance | Flexible PTO | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, US or Canada - NYC … R14h ago
-
Senior Data Engineer USD 150K-165KAPIs | AWS | Automation | CI/CD | Data Pipelines401k matching | Birthday day off | Fitness stipend | Floating holidays | Health benefitsSenior-level Full TimeUnited States R14h ago
-
Senior Embedded Systems Engineer USD 170K-226KACAP | Ansible | Bash | Cellular networking | DNS401k match | Dental insurance | Medical insurance | PTO | Sick days without limitSenior-level Full TimeChicago / Remote R16h ago
-
Senior Data Engineer, Data Foundations & AI Platform USD 153K-207KAPIs | Alerting | Apache Spark | CI/CD | Data Lineage401k with company match | Disability insurance | Flexible time off | Health, dental, and vision insurance | Leave of absenceSenior-level Full TimeUnited States (Remote) R16h ago
-
AI/ML Engineering Manager USD 140K-185KAWS | AWS CDK | AWS CloudFormation | AWS Glue | Airflow100 percent remote work | Equipment and office stipend | Flexible PTO | Generous holidays | Individual professional development planMid-level Full TimeARGENTINA R16h ago
-
Applied AI Engineer, Agentic Systems INR 2755K-5500K.NET | API Development | Agent Orchestration | Anthropic API | C SharpSenior-level Full TimeRemote - India R16h ago
-
Machine Learning Lead (LLM) USD 165K-210KAgentic Workflows | Data Analysis | Deep learning | Docker | EmbeddingsDental coverage | Health coverage | Medical coverage | Meetups in NYC and DC | Remote-firstSenior-level Full TimeRemote R17h ago
-
Senior Data Engineer USD 160K-190KA/B | A/B Testing | B testing | Clickstream | DBT401k match | Health and welfare benefits | Hybrid work | Paid Holidays | Paid vacationSenior-level Full TimeUnited States R17h ago
-
Sr. Data Engineer II (6516) USD 152K-188KAWS | Apache NiFi | Cloudera | Data Architecture | Data Preparation401k matching | Dental insurance | Dependent care | Employee Assistance and Wellness Programs | Flexible work arrangementsMid-level Full TimeRemote R17h ago
-
AI Engineer - Model Performance USD 165K-250KAttention Backend | Audio Processing | Batching | CUDA | CUDA graphAsync communication | Innovation-focused culture | Remote work | Startup environment | Supportive teamMid-level Full TimeSF Hybrid R18h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeChicago, IL R18h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDenver, CO R18h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | Azure | C++401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeHouston, TX R18h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | C plus plus | Cassandra401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDallas, TX R18h ago
-
Senior AI Engineer, Agentic Evaluation & V&V USD 150K-250KAgentic AI | Artificial Intelligence | Benchmarking | Evaluation Frameworks | Experiment trackingGovernment Clearance Eligible | Remote workSenior-level Full TimeRemote R18h ago
-
Staff Software Engineer - Semantic Layer INR 3000K-4000KAPI Design | Amazon Redshift | Backwards Compatibility | BigQuery | CompilationSenior-level Full TimeIndia - Remote R19h ago