Senior Machine Learning Test Engineer
AMER - United States - Massachusetts - Boston - Drydock, United States
USD 146K-235K (estimate) Senior-level Full Time
Tasks
- Automate ML QA workflows
- Build quality gates for training and deployment pipelines
- Contribute to multi team projects and codebases
- Create and maintain test harnesses for ML services and APIs
- Define ML quality strategy and acceptance criteria
- Define structured rubrics for measurable evaluation gates
- Design and maintain model evaluation suites and metrics
- Document and present evaluation findings
- Evaluate CAD RL model outputs for geometric validity and policy stability
- Mentor teams on ML QA best practices
- Participate in code reviews
- Perform API testing
- Test ML models from product side
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | AWS | Agile | Airflow | Azure | CI/CD | Cloud platform | Data Drift | Data Drift Detection | Data Validation | Design Patterns | Drift Detection | Experiment tracking | GitHub Actions | Google Cloud | Google Cloud Platform | Great Expectations | Jenkins | MLOps | MLflow | Machine Learning | Metaflow | Model Evaluation | Model Monitoring | PyTorch | Python | Regression testing | Software Architecture | TensorFlow | Test Harness | Test automation | UAT
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Sr. Platform Software Engineer – AI and Innovation USD 142K-200KAgile | Apollo GraphQL | Cloud Architecture | Continuous Delivery | Distributed SystemsSenior-level Full TimeOak Brook, IL, United States5h ago
-
Senior-level Full TimeNashville, TN, United States7h ago
-
Jaeger Analytics / Development Engineer USD 200K-285KCI/CD | Distributed tracing | Grafana | Jaeger | MicroservicesRemote workMid-level ContractUnited States (Remote) R8h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 15+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 205K-211KAgile Development | Artificial Intelligence | Confluence | Jira | LLM401k retirement plan | Dental insurance | Federal Holidays | Health insurance | Life insuranceMid-level Full TimeFort George G Meade, United States8h ago
-
Software Engineer, Machine Learning USD 213K-293KAI ethics | API Design | Agent Orchestration | Artificial Intelligence | Bias MitigationSenior-level Full TimeSunnyvale, CA | Remote, US | … R11h ago
-
AI/HPC System Performance Engineer USD 152K-240KAI Workload Optimization | AI workload | Alerting | C++ | Capacity PlanningSenior-level Full TimeMenlo Park, CA11h ago
-
Operations Platform Engineer USD 125K-187KAPIs | Alerting | Anomaly Detection | Backpressure | BufferingSenior-level Full TimeRedmond, WA11h ago
-
Cloud Computing | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA11h ago
-
Senior Software Engineer, Data Cloud Frontier AI USD 174K-252KComputer Vision | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA11h ago
-
Staff Software Engineer, AI/ML, Google Distributed Cloud USD 207K-300KAI-assisted coding | Agent Debugging | Assisted coding | Cloud platform | Cross-Functional CollaborationSenior-level Full TimeSunnyvale, CA, USA11h ago
-
C++ | Data Analysis | Data Structures | Data structures algorithms | Distributed ComputingSenior-level Full TimeMountain View, CA, USA11h ago
-
Staff Software Engineer, Core, AI/ML Quality USD 207K-300KData Processing | Debugging | Feedback Training | Fine Tuning | Language ModelsSenior-level Full TimeSan Jose, CA, USA11h ago
-
Senior Staff Software Engineer, Google Cloud Storage USD 262K-365KAlgorithms | Data Structures | Distributed Systems | Large-Scale System Design | Large-scaleSenior-level Full TimeCambridge, MA, USA; Raleigh, NC, USA11h ago
-
Artificial Intelligence | Audio generation | C++ | Computer Vision | Data PreparationSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA11h ago
-
Staff Software Engineer, AI/ML GenAI, YouTube USD 207K-300KAlgorithms | Computer Vision | Data Processing | Data Structures | Distributed SystemsSenior-level Full TimeMountain View, CA, USA11h ago
-
Data Engineer II USD 106K-151KApache Spark | Data Analysis | Data Modeling | Data Pipelines | Data ProcessingSenior-level Full TimeBoulder, CO, USA; Atlanta, GA, USA11h ago
-
Senior Machine Learning Engineer USD 195K-303KA/B | A/B Testing | AI | B testing | Deep learningFinancial wellness support | Flexible remote work | Health and wellness support | Time offSenior-level Full TimeAustin, Texas18h ago
-
Senior Machine Learning Engineer USD 148K-361KA/B | A/B Testing | B testing | Deep learning | Discriminative modelsCommuter benefits | Disability benefits | Financial wellness support | Global mental health support | Health insuranceSenior-level Full TimeSan Jose, California18h ago
-
Senior Machine Learning Engineer, Search Assistant USD 361K-510KA/B | A/B Testing | Airflow | B testing | Bandit AlgorithmsDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California18h ago
-
Embedded Software Engineer-Innovation Team USD 90K-134KBare Metal | C# | C++ | CAN | Component datasheets401k | Dental insurance | Employee product discounts | Health insurance | Life insuranceMid-level Full TimeCottage Grove, WI, US20h ago
-
Senior Embedded Software Engineer-Innovation Team USD 115K-174KBare Metal | C# | C++ | CAN | Device Drivers401k | Dental insurance | Employee product discounts | Health insurance | International travelSenior-level Full TimeCottage Grove, WI, US20h ago
-
Lead Data Engineer (Sr. Palantir Engineer) USD 110K-160KAccess Control | Data Cleansing | Data Governance | Data Modeling | Data TransformationCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical/Dental/Vision insurance | Paid time offSenior-level Full TimeChicago, IL, US20h ago
-
Senior Robot Infrastructure Engineer USD 100K-300KAWS | Alerting | C plus plus | Cloud pipelines | EC2Senior-level Full TimeSan Francisco20h ago
-
Sr AI Engineer USD 124K-171KAPIs | Cause analysis | Code review | JavaScript | JiraCompany year end break | Flexible time off | Learning and development stipend | Medical/Dental/Vision insurance | Mental wellbeing resourcesSenior-level Full TimeRemote - United States R21h ago
-
Senior Forward Deployed AI Engineer, Enterprise USD 216K-270KA/B | A/B Testing | AWS | Agent systems | Artificial IntelligenceCommuter stipend | Health, dental, vision insurance | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY21h ago