AI/ML Test Engineer
Tasks
- Capture data for evaluation
- Conduct operational validation for multiple models
- Detect data drift
- Develop data annotation workflows
- Document evaluation results and support briefings
- Execute AI ML evaluations in test evaluation environment
- Maintain automated evaluation pipelines
- Perform integration testing for AI ML workflows
- Troubleshoot workflow and data issues
- Validate operational datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Artificial Intelligence | Automated testing | CI Polygraph | Cloud Computing | Data Annotation | Data Capture | Data Drift | Data Drift Detection | Data Validation | DevSecOps | Drift Detection | Integration Testing | Machine Learning | Model Performance Assessment | Model performance | Operational testing | Performance Assessment | Test automation
Education
Roles
Related jobs
-
Agile | Automation | Electrical Engineering | Machine Vision | Mechanical Design401k | Dental insurance | Medical insurance | Paid sick leave | Vision insuranceSenior-level ContractTucson, United States12h ago
-
Generative AI Engineer III - State and Local Government USD 110K-218KArtificial Intelligence | Data Analysis | Data Pipelines | Generative AI | Language ModelsMentorship | Professional development | Travel opportunitiesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …13h ago
-
IT Data Engineer USD 117K-124KANSI X12 | ARM Templates | Automl | Azure | Azure DataBackground screening provided | Flexible work hours | Mentorship | Professional development opportunitiesSenior-level Full TimeUS - Remote R13h ago
-
Attention Mechanism | DPO | Data Generation | Data Preprocessing | Deep learningEntry-level InternshipCalifornia, Sunnyvale13h ago
-
Machine Learning Engineer Graduate (TikTok Trust and Safety-CV/NLP/Multimodal LLM) - 2026 Start (PhD) USD 136K-259KActive Learning | Computer Vision | Distributed Training | Language Models | Language ProcessingEntry-level Full TimeSeattle, Washington, United States13h ago
-
Atlassian Confluence | Atlassian Jira | Azure Data | Azure Data Factory | CI/CDOnsite work benefits | Potential project extensionsSenior-level Full TimeJuno Beach, FL14h ago
-
C++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeSan Diego, CA, USA14h ago
-
Senior Software Engineer, Generative AI, Core ML USD 174K-253KAgent systems | Computer Vision | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, USA14h ago
-
Software Engineer, AI/ML, Google Research USD 147K-211KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Distributed ComputingMid-level Full TimeMountain View, CA, USA14h ago
-
Staff Software Engineer, Generative AI USD 207K-301KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Staff Software Engineer, Google Cloud Agentic AI USD 207K-301KAgentic AI | Artificial Intelligence | C++ | Compliance | Distributed ComputingBonus | Equity | Health insurance | Paid time off | Retirement planSenior-level Full TimeNew York, NY, USA14h ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R1d ago
-
AI/ML Engineer USD 92K-97KApache Spark | Data Pipelines | Databricks | Feature Engineering | LLM401k retirement plan | Dental insurance | Employee assistance program | Medical insurance | Paid HolidaysSenior-level Full TimeUSA, NE, Work-at-Home, United States1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Data Quality | Data labeling100 percent remote work | Career growth opportunities | Visa transfer support for qualified candidatesMid-level Full TimeUnited States - Remote R1d ago
-
Data Engineer - Data & Analytics Technology USD 58K-142KBig Data | Business Intelligence | Data Architecture | Data Mining | Data ModelingMid-level Full TimeFirstside Center Bldg (PA373), United States1d ago
-
Big Data | Business Intelligence | Data Analysis | Data Architecture | Data Engineering401k matching | Dental insurance | Health insurance | Paid time off | Parental leaveMid-level Full TimeFirstside Center Bldg (PA373), United States1d ago
-
Quantitative Analytics Professional USD 105K-157KAgentic Workflows | Apache Spark | Generative AI | Language Models | Large Language ModelsMid-level Full TimeHeadquarters 4, United States1d ago
-
Principal Engineer, Data Engineering USD 129K-155KAPI | AWS | Agile | Azure | CI/CDHybrid work model | Life and disability benefits | Life insurance | Medical, dental, and vision insurance | Paid time offSenior-level Full TimeFL - Saint Petersburg - 880 …1d ago
-
Data Engineer USD 110K-166KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data ValidationContinuous learning resources | Employee ownership | Inclusive culture | Training and mentorshipMid-level Full TimeClient Site - Washington, D.C., United …1d ago
-
Principal Machine Learning USD 190K-342KData Analysis | Data Processing | Data pipeline | Distributed machine learning | Exploratory Data AnalysisFlexible workSenior-level Full TimeUSA, CA, Pleasanton, United States1d ago
-
Software Engineer (Remote) USD 50K-130KAgile | ETL | Git | Google BigQuery | Google DataformRemote workEntry-level Full TimeTEXAS - VIRTUAL - TX01, United … R1d ago
-
Senior Embedded Software Engineer USD 72K-115KADC | ARM | Assembly | Bug tracking | C#401k | Dental insurance | Disability insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeTowson MD USA - 701 E …1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Automated benchmarking | DPO | Dataset curation | Direct Preference OptimizationCareer growth potential | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Sr Lead Machine Learning Engineer USD 229K-262KBias Variance | CI/CD | Dask | Data Pipelines | Deep learningSenior-level Full TimeMcLean, VA, United States1d ago
-
Senior Data Engineer USD 90K-130KAPI Design | AWS | Access Control | Agile | Airflow401k match | Dental insurance | Free car washes | Health insurance | Life insuranceSenior-level Full TimeHouston, TX1d ago