Senior Machine Learning Test Engineer
AMER - United States - Massachusetts - Boston - Drydock, United States
USD 146K-235K (estimate) Senior-level Full Time
Tasks
- Automate ML QA workflows
- Build quality gates for training and deployment pipelines
- Contribute to multi team projects and codebases
- Create and maintain test harnesses for ML services and APIs
- Define ML quality strategy and acceptance criteria
- Define structured rubrics for measurable evaluation gates
- Design and maintain model evaluation suites and metrics
- Document and present evaluation findings
- Evaluate CAD RL model outputs for geometric validity and policy stability
- Mentor teams on ML QA best practices
- Participate in code reviews
- Perform API testing
- Test ML models from product side
Perks/Benefits
- N/A
Skills/Tech-stack
API Testing | AWS | Agile | Airflow | Azure | CI/CD | Cloud platform | Data Drift | Data Drift Detection | Data Validation | Design Patterns | Drift Detection | Experiment tracking | GitHub Actions | Google Cloud | Google Cloud Platform | Great Expectations | Jenkins | MLOps | MLflow | Machine Learning | Metaflow | Model Evaluation | Model Monitoring | PyTorch | Python | Regression testing | Software Architecture | TensorFlow | Test Harness | Test automation | UAT
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R4d ago
-
Forward Deployed AI Engineer USD 150K-180KAPI | Agent Orchestration | Conversational AI | Hugging Face | LLM401k matching | Community involvement | Dental insurance | Disability benefits | Flexible paid time offMid-level Full TimeItasca, Illinois, United States8h ago
-
APIs | AWS Glue | AWS Redshift | Amazon Web Services | Apache AirflowFully remote | Health insurance | On call production support | Paid time off | Retirement plansSenior-level Full TimeOrlando, FL, United States R8h ago
-
Mid-level Full TimeMiami Lakes, FL, United States12h ago
-
Data Engineer, Engineering & Operations USD 115K-145KAccess Control | Aggregation Thresholds | Airflow | Alerting | Anonymization401k | Dental insurance | Discounts | Fully remote | Medical insuranceMid-level Full TimeNew York, NEW YORK, United States R12h ago
-
Sr. Databricks Consultant USD 175K-250KAWS | Amazon S3 | Apache Spark | Azure | Azure DataRemote work | Travel as neededSenior-level Full TimeWork from home, VA, United States R12h ago
-
Agile | Apache Airflow | Kubernetes | Linux | PandasSenior-level Full TimeNew York, NY, United States14h ago
-
Ansible | C plus plus | C# | CMake | CUDAMid-level Full TimeBaltimore, MD, United States R14h ago
-
Senior Conservation Data Analyst/Engineer - R4458 USD 100K-119KAI coding | AI coding tools | AI-assisted workflows | AWS | ArcGIS EnterpriseSenior-level Full TimeWashington D.C., United States16h ago
-
GCP/Linux Data Engineer (Remote) USD 95K-170KAPIs | Agile | CI/CD | Cloud automation | Cloud platformFully remote | W2 Candidates OnlyMid-level Full TimeRochester, MN R16h ago
-
Hiring: Senior Principal AI Software Engineer – Agentic & Industry Solutions | Full-Time | Remote USD 138K-208KAWS | AWS Bedrock | Agent systems | Anthropic API | Autogen401k matching | Adoption Assistance | Dental insurance | Fertility treatments | Flexible work scheduleSenior-level Contract Full TimeRemote, OR, United States R16h ago
-
API Development | Agile | Azure | CI/CD | Data IngestionHybrid option | Onsite 4 days a week | Remote optionSenior-level Full TimeCalabasas, United States16h ago
-
A/B | A/B Testing | AI Model Deployment | AI model | App ServiceRemote workMid-level ContractHartford, United States R16h ago
-
Data and AI Solution Engineer USD 128K-214KAWS | AWS Bedrock | Agentic AI | Azure | Cloud ComputingSenior-level Full TimeUSA-VA-Herndon17h ago
-
AI Engineer - Nexus Black USD 90K-100KAPIs | Backend Services | CI/CD | Cloud Computing | Embeddings401k | Disability benefits | Flexible spending accounts | Flexible time off | Hybrid workSenior-level Full TimeItasca, Illinois, United States17h ago
-
Delivery Senior Consultant, Software Engineering Solutions, Identity & Gen AI Engineer USD 155K-265KAI Agents | AWS | Access Management | Ansible | AuthenticationHybrid work model | Onsite up to 5 days per week | Professional training and development | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; Charlotte, North …17h ago
-
AI Agents | AI Risk Management Framework | Access Management | Amazon Web Services | AnsibleSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …17h ago
-
AWS Data Engineer - Consultant USD 93K-170KAWS Glue | AWS Lambda | Amazon S3 | Cloud Engineering | Data ArchitectureMentorship | Professional developmentMid-level Full TimeHouston, Texas, United States17h ago
-
Data Engineer, Product Analytics USD 185K-204KAI workflows | C# | C++ | Data Compliance | Data ModelingCareer growthMid-level Full TimeLos Angeles, CA | Burlingame, CA18h ago
-
Business Support Engineer USD 159K-223KAPI Development | AWS | Agent Orchestration | Azure | Bias Mitigation24 7 Oncall RotationMid-level Full TimeMenlo Park, CA18h ago
-
Business Support Engineer USD 147K-203KAPI troubleshooting | AWS | Azure | Data Analysis | Debugging24 7 Oncall RotationMid-level Full TimeMenlo Park, CA18h ago
-
Business Support Engineer USD 141K-197KAI Agents | API troubleshooting | AWS | Agent Orchestration | Azure24 7 Oncall Rotation | Cross-functional collaborationSenior-level Full TimeMenlo Park, CA18h ago
-
Software Engineer, Machine Learning RecSys USD 170K-240KAgent Orchestration | BERT | Bias Mitigation | C++ | Code ReviewsSenior-level Full TimeSunnyvale, CA18h ago
-
Senior Software Engineer, Sensor AI/ML, Watch Software USD 174K-253KC# | C++ | Data Processing | Debugging | Deep learningSenior-level Full TimeMountain View, CA, USA18h ago
-
Staff Software Engineer, Cooling Optimization USD 207K-301KC++ | Control Theory | Data Structures | Data center | Data center architectureSenior-level Full TimeSunnyvale, CA, USA18h ago