Lead Test Engineer - Scenario Coverage & Evaluation Datasets
Tasks
- Define analytics requirements
- Maintain ODD parameter space
- Maintain scenario taxonomy
- Own coverage model
- Own evaluation dataset
- Provide actionable feedback to labeling and analytics teams
- Report coverage and readiness for releases
- Review QA feedback
- Select methods to generate scenes
- Set QA mining agenda
- Track external coverage approaches
- Use internal mining tooling
Perks/Benefits
- N/A
Skills/Tech-stack
Active Learning | Analytics | Automation | Clustering | Criticality Analysis | Data Mining | Data Retrieval | Data labeling | Equivalence Class | LLM Triage | Labeling | Language Models | Large Language Models | Parameter Space | Python | Python Scripting | Risk-Based Testing | Risk-based | SQL | Scenario-based testing | Simulation | Software testing | Test Engineering | Test strategy
Education
N/A
Roles
Related jobs
-
Sr Data Engineer_ITDE1I USD 102K-170KAPI Integration | AWS | Automation | Azure | CI/CD401k match | Dental insurance | Disability insurance | Hybrid work policy | Life insuranceSenior-level Full TimeHOUSTON, US, 77056 R3h ago
-
Sr. Automation Engineer Robotics Software USD 115K-144KAutomation | Computer Vision | Databases | FastAPI | HMIDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeAnkeny, Iowa, US R3h ago
-
Web Analytics Lead USD 115K-174KAgile | Consent Management | Cookie Consent | Cookie consent management | Data Layer401k match | Dental insurance | Disability coverage | Life insurance | Medical insuranceSenior-level Full TimePiscataway, NJ, US3h ago
-
Machine Learning Engineer, Memory USD 125K-194KAgile | Computer Vision | Foundation Models | Horizon Modeling | Language Processing401k match | Coaching | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeCary,North Carolina,United States6h ago
-
A/AI Machine Learning Engineering Stf - E4 USD 135K-251KAI | AI RMF | Adversarial Machine Learning | Automation Testing | C#401k match | Dental insurance | EAP | Education assistance | Employee assistance programSenior-level Full TimeShelton, CT, US6h ago
-
PIIM Data Engineer USD 119K-182KAPI Integration | APIs | Azure Databricks | Data Governance | Data LakeFull Time Office Project Telework | Relocation assistanceMid-level Full TimeNew Albany, OH, US6h ago
-
Software Engineer, Data Platform Team USD 152K-179KApache Airflow | Data APIs | Data Catalog | Data Lineage | Data Modeling401k matching | Medical, dental, and vision | Quarterly in person surges | Remote-first work environmentMid-level Full TimeRemote - USA R7h ago
-
Senior Machine Learning Engineer USD 229K-360KAB Testing | APIs | Airflow | Algorithm Development | Amazon S3Disability benefits | Health insurance | Life insurance | Paid Equity Awards | Paid time offSenior-level Full TimeNew York, New York R7h ago
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowCommuter benefits | Disability benefits | Equity awards | Financial wellness support | Health insuranceSenior-level Full TimeSan Jose, California R7h ago
-
Senior AI Engineer – AI Platform USD 140K-175KAWS | Drift Detection | Embeddings | Evaluation Pipelines | Function CallingDaily group classes | Dry cleaning | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R7h ago
-
Senior ML Engineer – AI Platform USD 140K-175KCNN | Deep learning | Embeddings | Human-in-the-loop | Information ExtractionDaily group classes | Dry cleaning | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States7h ago
-
AI Engineer USD 220K-260KAPI Development | Agent Orchestration | Data Generation | Debugging | Fine Tuning401k matching | Dental insurance | Fertility and family building stipend | Flexible PTO | Health insuranceMid-level Full TimeSan Francisco R9h ago
-
Forward Deployed Engineer, Agentic AI USD 180K-180KAI Security | AWS Bedrock | Access Control | Agent Development | Anthropic ClaudeMid-level Full TimeUS - Remote R10h ago
-
Staff Machine Learning Engineer - Ads USD 164K-282KAWS | Airflow | Apache Spark | BigQuery | Cloud Computing401k plan with company match | AD&D insurance | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA10h ago
-
Agents | Golang | Information Retrieval | Language Models | Language Processing401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States R11h ago
-
ASIC | Agile | Automation frameworks | BDD | C#Senior-level Full TimeCupertino, California, USA11h ago
-
Data Engineer USD 63K-114KAWS Glue | Azure Synapse | Azure Synapse Analytics | CI/CD | Cloud DataprocCompany volunteering opportunities | Disability benefits | Employee learning programs | Medical and dental coverage | Paid leaveSenior-level Full TimeUSDALFRI - Dallas Frisco AI HUB …11h ago
-
Staff Machine Learning Engineer USD 176K-308KAlgorithms | Code Tuning | Design Patterns | High Performance | High-Performance Computing401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R11h ago
-
GTM AI Engineer USD 112K-140KAPI | Chunking | Compute cost management | Context windows | Cost Management401k matching | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeUnited States - Remote R12h ago
-
Principal Machine Learning Engineer - League of Legends USD 292K-437KAI | API Development | Auto-remediation | Automation | Cloud Native401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA12h ago
-
Mid-level Full TimeSan Francisco R12h ago
-
Founding Data & Analytics Engineer (NYC) USD 150K-300KDBT | FHIR | GraphQL | Language Processing | Machine LearningFlexible PTO | Health savings account | HealthAdvocate | Lunch and dinner | Medical/Dental/Vision insuranceSenior-level Full TimeNew York City (Soho)13h ago
-
Senior Backend Engineer, Data Ingestion USD 145K-230KAWS | Amazon SQS | Celery | Data Pipelines | Database Query401k | Commuter benefits | Daily catered lunch | Dental insurance | Flexible paid time offSenior-level Full TimeRemote R14h ago
-
Senior Staff Machine Learning Platform Engineer USD 295K-405KAWS | Airflow | CockroachDB | Databricks | DatadogHybrid office schedule | Mentoring and growth opportunities | Remote work up to 4 weeks per yearSenior-level Full TimeRemote - US; San Francisco, CA R14h ago
-
AI/ML Software Engineer USD 80K-80KAWS | Angular | Azure | CI/CD | Data Pipelines401k matching | Flexible PTO | Life insurance | Medical/Dental/Vision insurance | Paid parental leaveMid-level Full TimeCharlotte, NC14h ago