Development Engineer in Test (SDET) – ML & LLM Systems
DC - Washington, 1325 G ST NW STE 300, United States
USD 82K-123K Mid-level Full Time
Tasks
- Analyze testing needs and define automation strategies
- Benchmark model accuracy and run regression testing
- Build automated test suites for functional regression and performance testing
- Coordinate QA and production build deployments
- Create automated validation pipelines for data ingestion and data quality checks
- Design develop and maintain automated test code
- Detect model drift and ensure reproducibility
- Execute automated and manual tests for build validation
- Implement test strategies and automation frameworks
- Investigate failing tests and implement fixes
- Perform model validation and verification
- Review automation code and provide feedback
- Triage and resolve integration and production issues
Perks/Benefits
- 401k savings plan
- Courtesy digital TV and internet
- Discount Theme Park Tickets and Hotel Rooms
- Life milestones support
- Medical & dental
- Paid time off
Skills/Tech-stack
API Testing | AWS | Agile | Amazon S3 | Anomaly Detection | CI/CD | Case management | Data Quality | Defect Tracking | Docker | Java | Jenkins | Kubernetes | LLM Evaluation | Language Model | Large Language Model | Linux | Machine Learning | MongoDB | NLP | NoSQL | Performance Testing | Python | REST | Regression testing | Schema Validation | Scrum | Spring Boot | Test Case | Test Case Management | Test Design | Test automation
Education
Regions
Countries
States
Related jobs
-
Senior AI Engineer USD 120K-180KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance checks401k match | Career growth | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R2h ago
-
Data Visualization Engineer USD 130K-140KAWS | Agile | Amazon QuickSight | Azure | DAXPublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States R2h ago
-
Customer Analytics | Customer decisioning | Data Engineering | Data Modeling | Data Standardization401k | Accident insurance | Dental insurance | Disability insurance | Health insuranceSenior-level ContractVienna, United States5h ago
-
Senior Insurance Data Science Consultant USD 180K-204KActuarial modeling | Data Validation | Decisioning Platforms | Insurance analytics | Machine LearningSenior-level Full TimeBoston, MA, US5h ago
-
AI Architect USD 130K-230KAgentic AI | Amazon Web Services | Azure | Bagging | CI/CDMentorship opportunities | Remote work environmentSenior-level Full TimeUnited States6h ago
-
SYSTEM ENGINEER - AI/ML - 15+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 205K-211KAgile Development | Artificial Intelligence | Confluence | Jira | Language Models401k retirement plan | Dental plan | Life insurance | Medical insurance | Paid time offMid-level Full TimeFort George G Meade, United States6h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Basic Ranking) - 2026 Start (BS/MS) USD 116K-177KComputer Vision | Deep learning | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSan Jose, California, United States7h ago
-
Behavior Modeling | CTR Prediction | CVR Prediction | Information Retrieval | Machine LearningSenior-level Full TimeSeattle, Washington, United States7h ago
-
Machine Learning Engineer, Search - Local Services Team USD 194K-355KClick Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Feature EngineeringEntry-level Full TimeSeattle, Washington, United States7h ago
-
Agios AI Foundation Software Engineer USD 165K-261KAgent Frameworks | Audio Processing | Autogen | Bias Mitigation | Computer VisionSenior-level Full TimeRedmond, WA8h ago
-
Senior Software Engineer, ML Infrastructure, Core Infra USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Artificial Intelligence | Data Analysis | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA8h ago
-
Senior Software Engineer, AI/ML, Youtube Ads USD 174K-252KData Processing | Data Storage | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA8h ago
-
C++ | CSS | Database Development | HTML | HTTPMid-level Full TimeAnn Arbor, MI, USA8h ago
-
Automated Monitoring | C++ | Cloud platform | Dashboards | Data ModelingEntry-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Staff Software Engineer, Applied AI USD 262K-365KAlgorithms | Artificial Intelligence | Data Processing | Data Structures | Distributed ComputingSenior-level Full TimeMountain View, CA, USA8h ago
-
Data Engineer, AI Solutions, Global Affairs USD 130K-187KData Modeling | Data Pipelines | ETL | LLM APIs | PythonMid-level Full TimeNew York, NY, USA; Chicago, IL, …8h ago
-
ATA | C# | C++ | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA8h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Evaluation | Experiment design401k matching | Health coverage | Paid time off | Parental leaveMid-level Full TimeSunnyvale, CA, United States13h ago
-
Senior Staff Machine Learning Engineer, Infrastructure USD 248K-310KA/B | A/B Testing | Agentic AI | Apache Airflow | Apache KafkaDisability accommodation support | Employee travel credits | Inclusion focused hiring | Remote eligibleSenior-level Full TimeUnited States14h ago
-
Software Engineer, Robotics & Autonomous Systems USD 180K-225K3D data | 3D data processing | AWS | Airflow | C++Commuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA16h ago
-
Senior Software Engineer (AI/ML) USD 150K-222KAPI Gateway | API Management | Cloud Native | Containers | Data Warehousing401k match | Dental insurance | Federal Holidays | Flexible PTO | Flexible spending accountSenior-level Full TimePatrick SFB, FL17h ago
-
Anomaly Detection | Automated testing | Benchmarking | Computer Vision | Data Preparation401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R18h ago
-
Senior Data Analyst USD 150K-175KAWS S3 | Amazon Athena | Amazon Aurora | Anomaly Detection | CTEDental insurance | Flexible PTO | Health insurance | Professional development budget | Vision insuranceSenior-level Full TimeUnited States18h ago
-
Senior Data Engineer USD 150K-175KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Amazon S3Continuing education support | Dental insurance | Flexible PTO | Health insurance | Professional development budgetSenior-level Full TimeUnited States18h ago