Software Development Engineer in Test (SDET) – ML & LLM Systems
DC - Washington, 1325 G ST NW STE 300, United States
USD 82K-123K Mid-level Full Time
Tasks
- Benchmark accuracy
- Build automated test suites for functional regression and performance
- Check reproducibility
- Collaborate to improve test coverage and automation effectiveness
- Communicate test results and risks
- Coordinate QA and production build deployments
- Define test automation strategies
- Design and implement test strategies and automation frameworks
- Design develop and maintain automated test code
- Detect drift
- Develop automated validation pipelines for data ingestion data quality and schema validation
- Execute automated and manual tests for build validation
- Investigate failing tests and fix root causes
- Perform model validation and verification
- Review automation code and provide feedback
- Stay current with test tools and industry trends
- Triage and resolve integration and production issues
Perks/Benefits
- 401k match
- Adoption Assistance
- Childcare resources
- Courtesy digital TV and internet
- Dental insurance
- Discount tickets for Universal Resorts
- Life milestones support
- Medical insurance
- Paid time off
- Pet insurance
Skills/Tech-stack
API Testing | AWS | Accuracy benchmarking | Agile | Amazon S3 | Anomaly Detection | CI/CD | Case Development | Data Quality | Defect Management | Docker | Drift Detection | Functional testing | Java | Jenkins | Kubernetes | LLM Evaluation | Language Models | Language Processing | Large Language Models | Linux | Machine Learning | Model Drift | Model Drift Detection | MongoDB | Natural Language | Natural Language Processing | Performance Testing | Python | REST API | Regression testing | Reproducibility Testing | Schema Validation | Scrum | Spring Boot | Test Case | Test Design | Test automation | Test case development | Test frameworks
Education
Regions
Countries
States
Related jobs
-
AWS EMR | Amazon Bedrock | Amazon DynamoDB | Amazon Kinesis | Apache SparkMid-level Full TimeSanta Monica, California, USA1d ago
-
Software Development Engineer, CreativeX USD 158K-213KAutoml | Computer Vision | Data Pipelines | Design Patterns | Diffusion ModelsMid-level Full TimeNew York, New York, USA1d ago
-
Big Data | Big Data Appliance | Big Data Service | Cloud infrastructure | Data Service401k matching | Health insurance | Paid time offSenior-level Full TimeUnited States1d ago
-
API Testing | AWS | Agile | Amazon S3 | Anomaly Detection401k savings plan | Courtesy digital TV and internet | Discount Theme Park Tickets and Hotel Rooms | Life milestones support | Medical & dentalMid-level Full TimeDC - Washington, 1325 G ST …2d ago
-
C++ | CUDA | Device Memory | File systems | High PerformanceBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara, United States3d ago
-
Software Development Engineer, Aurora Storage USD 168K-227KAWS | Database replication | Disaster Recovery | Distributed Systems | FailoverCareer growth | Flexible work arrangements | Inclusive team culture | Mentorship | Work-life balanceMid-level Full TimeRedmond, Washington, USA3d ago
-
Software Development Engineer - AI Core (Python) USD 123K-222KAPI Design | AWS | Asynchronous programming | Concurrency | Concurrent programmingFlexible work schedule | In office and remote hybrid flexibility | Mentoring and coaching | Remote work optionMid-level Full TimeUSA, GA, Atlanta, United States3d ago
-
Elasticsearch | Java | Multi-threaded | Multi-threaded programming | OLTPSenior-level Full TimeLexington, MA4d ago
-
Software Development Engineer (AI & ML) USD 110K-186KApache Airflow | Apache Kafka | Apache Spark | Data Processing | DockerOnsite workSenior-level Full TimeAlpharetta, Georgia, United States4d ago
-
Software Development Engineer - Cloud Native Databases USD 148K-300KBackup/Restore | Crash diagnostics | Database Schema | Database schema management | DebuggingOn-call rotationMid-level Full TimeSeattle, Washington, United States5d ago
-
Software Engineer Level 3-FFPP-8851 USD 78K-250KAccumulo | Algorithm Development | BSON | Bigtable | Data Querying401k match | Dental insurance | Employee referral programs | Flexible spending accounts | Health insuranceSenior-level Full TimeHanover, MD6d ago
-
Software Engineer Level 2 -FFPP-8849 USD 78K-250KC++ | HBase | HDFS | Hadoop | Hive401k match | Dental insurance | Employee referral program | Flexible spending accounts | Health insuranceSenior-level Full TimeHanover, MD6d ago
-
AWS | Automation | Distributed Systems | Java | LinuxMid-level Full TimeDenver, Colorado, USA6d ago
-
C++ | Continuous Deployment | Continuous integration | Deep learning | Distributed ComputingSenior-level Full TimeSeattle, Washington, USA6d ago
-
Budgeting | Change Management | Deployment Planning | Design Specifications | Development LifecycleMid-level Full TimeRensselaer, New York, United States R7d ago
-
Software Development Engineer, Kuiper Data Platform USD 143K-194KAWS | Audit trails | Data Classification | Data Ingestion | Data LakehouseMid-level Full TimeRedmond, Washington, USA8d ago
-
Software Development Engineer USD 130K-202KCloud platform | Containerization | Docker | FastAPI | GitMid-level Full TimeUnited States9d ago
-
Agentic solutions | Classification | Elasticsearch | Information Retrieval | Inverted indexesDental insurance | Medical insurance | Paid time off | Retirement savings options | Vision insuranceSenior-level Full TimeWork At Home-California, United States9d ago
-
Senior AI Algorithm Engineer in oneDNN USD 195K-275KAlgorithms | Assembly Programming | C++ | CUDA | DPC++Employee discounts | Employee recognition | Flexible working hours | Holiday card | Life insuranceSenior-level Full TimeUSA - OR - Hillsboro, United …10d ago
-
Director, Embedded Software Development USD 179K-322KAgile | C# | C++ | CI/CD | Critical SystemsIn office presence 4 days per week | On-site collaboration | Total rewards programExecutive-level Full TimeUSA CA - Irvine Laguna Canyon, …14d ago
-
AI Agents | APIs | AWS | Data Pipelines | Data publishingCareer growth | Flexible work | Mentorship | Work-life balanceMid-level Full TimeSeattle, Washington, USA14d ago
-
Agile | Back-end | Back-end development | Data Querying | Data indexingSenior-level Full TimeTempe, Arizona, USA14d ago
-
IT / AI Development Intern – Remote USD 40K-50KAPI Integration | Agile Development | Authentication | Automated testing | CI/CDCareer networking | Code learning exposure | Guided onboarding | Mentorship sessions | Portfolio developmentEntry-level InternshipUnited States - Remote R14d ago
-
Software Development Engineer - AI/LLM Network - Global Frontier Tech Research Program - 2027 Start USD 202K-368KC++ | Cause analysis | Fault Localization | High Availability | LinuxEntry-level Full TimeSeattle, Washington, United States17d ago
-
Manager, Software Development- SAS 9 Access USD 125K-198KAgile | C# | C++ | Confluence | Continuous integration401k plan | Childcare benefits | Health insurance | Paid Holidays | Paid sick daysMid-level Full TimeCary HQ, NC, United States21d ago