AIML - Applied AI Scientist, Image Autograder Systems, Evaluation
Tasks
- Analyze and explain autograder quality
- Build autograders for image quality evaluation at scale
- Deploy and drive autograder adoption with engineering teams
- Develop autograder grading rubrics and gold annotation sets
- Develop scalable system to speed autograder training
- Evaluate and iterate grading prompts
- Fine tune visual language models to improve grading accuracy
Perks/Benefits
- N/A
Skills/Tech-stack
Artificial Intelligence | Data Annotation | Evaluation metrics | Fine Tuning | Image Quality Assessment | Image quality | Language Models | Machine Learning | Model Training | Prompt engineering | Python | Quality Assessment | Rubric Design | Visual Language Models | Visual language
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
DPO | Efficient Model Design | Fine Tuning | GRPO | Generative AIEntry-level Full TimeSeattle, Washington, United States3h ago
-
Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer USD 119K-177KAlgorithms | C++ | CUDA | Computer Systems | Continuous batchingDevelopment workshops | Hands-on industry experience | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States3h ago
-
Recommendation Architecture AI/ML Infrastructure Engineer Graduate (Data-Arch-TikTok Live) - 2027 Start USD 116K-177KAlgorithms | C++ | CUDA | Computer Systems | Continuous batchingEntry-level Full TimeSan Jose, California, United States3h ago
-
Staff Product Data Scientist, Google Play USD 192K-278KBusiness Intelligence | Dashboards | Data Pipelines | Experiment design | PythonSenior-level Full TimeMountain View, CA, USA4h ago
-
Affinity Analysis | Automation | Binding Studies | Biochemical assays | Biophysical assaysChildcare support | Coaching and mentoring | Health checks | Health seminars | Hybrid work modelSenior-level Full TimeWuppertal-Aprath, Nordrhein-Westfalen, DE7h ago
-
Senior Data Scientist - Authentication USD 221K-263KApache Airflow | Apache Spark | Causal Inference | Deep learning | HiveEquity compensationSenior-level Full TimeSan Mateo, CA, United States R9h ago
-
SAP Business AI Lead Architect USD 229KABAP | AI orchestration | AI/ML | APIs | AWS AI401k | Dental insurance | Flexible paid time off | Health insurance | Paid HolidaysSenior-level Full TimeHome-based, US R10h ago
-
Bayesian Data Scientist USD 90K-210KAlgorithm Development | Bayesian statistics | Big Data | C# | C++10 paid holidays | 401k match | Dental insurance | Health insurance | Life insuranceMid-level Full TimeCambridge, MA, Arlington, VA13h ago
-
Senior AI Engineer (NYC) USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Fine TuningHealth and wellness programs | Hybrid work flexibility | Mentorship | Paid time offSenior-level Full TimeNew York, NY, United States R16h ago
-
Senior Data Engineer USD 119K-258KArtificial Intelligence | Azure | Data Engineering | Data Visualization | Data analyticsSenior-level Full TimeUnited States, Washington, Redmond; United States, …17h ago
-
Senior Data Scientist, Trust (Inference) USD 179K-210KA/B | A/B Testing | B testing | Bayesian Modeling | Causal InferenceEmployee travel credits | Remote work eligibleSenior-level Full TimeRemote - USA R17h ago
-
Applied AI Engineer USD 122K-176KAI Agents | AWS | Automated testing | Azure | CI/CD401k match | Educational assistance program | Employee assistance program | Employee discounts | Employee referral programMid-level Full TimeRemote (United States) R17h ago
-
Director, AI Engagements USD 270K-325KAPI Integration | Agentic Workflows | Artificial Intelligence | Claude API | Data FlowExecutive-level Full TimeRemote, United States; UK - Remote R17h ago
-
Director of AI Engineering USD 180K-240KAPI Development | Agent systems | Deployment | JavaScript | Langchain401k | Annual bonus | Dental insurance | Equity incentive plan | Flexible vacationExecutive-level Full TimeU.S. Remote R17h ago
-
Legal AI Program Manager USD 315K-385KArtificial Intelligence | Change Management | Enterprise Architecture | Enterprise Software | EvaluationMid-level Full TimeRemote, United States; UK - Remote R17h ago
-
Data Scientist USD 84K-110KAnomaly Detection | CI/CD | Data Privacy | Databricks | Drift monitoringDiversity and inclusion working groups | Flexible working practices | Paid volunteer time off VTO | Parental leaveMid-level Full TimeAtlanta, GA - Remote R18h ago
-
Mid-level Full TimeRemote Worker - USA R18h ago
-
Senior Associate, Decision Science – Finance Analytics USD 170K-210KA/B | A/B Testing | Amazon Web Services | Artificial Intelligence | B testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States19h ago
-
AI Prompt Engineer / AI Application Engineer USD 84K-110KAgentic Workflows | Anthropic Claude | Authentication | Azure DevOps | CI/CDEntry-level Full TimeNew York, NY, United States R19h ago
-
Data Scientist USD 170K-300KA/B | A/B Testing | ANN | Approximate Nearest Neighbor | B testing401k | Dental insurance | Equity | Flexible vacation | Life insuranceSenior-level Full TimeLos Angeles, CA19h ago
-
2026 Fall Intern, Digital Health Algorithms USD 88K-126KAWS | Amazon SageMaker | Android | Artificial Intelligence | C++Entry-level Internship665 Clyde Avenue, Mountain View, CA, …19h ago
-
Agentic AI | CATE Estimation | Causal Inference | Causal Machine Learning | Data AnalysisSenior-level Full TimeCincinnati, Ohio, United States19h ago
-
Causal Inference | Experimental Methods | Experimentation | Incrementality testing | Language ModelsSenior-level Full TimeSan Francisco R20h ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | Apache Spark | B testing | Data MiningHealth and wellness programs | Hybrid work schedule | Time away from workSenior-level Full TimeMountain View, CA, United States R20h ago
-
Data & ML Engineer USD 150K-200KAWS Glue | Airflow | Apache Kafka | Apache Spark | Audit LoggingEmployer-paid health insurance | Flexible work environment | Fully remote | Paid parental leave | Unlimited PTOMid-level Full TimeRemote, USA R20h ago