AIML - Applied AI Scientist, Image Autograder Systems, Evaluation
Tasks
- Analyze and explain autograder quality
- Build autograders for image quality evaluation at scale
- Deploy and drive autograder adoption with engineering teams
- Develop autograder grading rubrics and gold annotation sets
- Develop scalable system to speed autograder training
- Evaluate and iterate grading prompts
- Fine tune visual language models to improve grading accuracy
Perks/Benefits
- N/A
Skills/Tech-stack
Artificial Intelligence | Data Annotation | Evaluation metrics | Fine Tuning | Image Quality Assessment | Image quality | Language Models | Machine Learning | Model Training | Prompt engineering | Python | Quality Assessment | Rubric Design | Visual Language Models | Visual language
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Staff Product Data Scientist, Google Play USD 192K-278KBusiness Intelligence | Dashboards | Data Pipelines | Experiment design | PythonSenior-level Full TimeMountain View, CA, USA3h ago
-
Affinity Analysis | Automation | Binding Studies | Biochemical assays | Biophysical assaysChildcare support | Coaching and mentoring | Health checks | Health seminars | Hybrid work modelSenior-level Full TimeWuppertal-Aprath, Nordrhein-Westfalen, DE6h ago
-
Senior Data Scientist - Authentication USD 221K-263KApache Airflow | Apache Spark | Causal Inference | Deep learning | HiveEquity compensationSenior-level Full TimeSan Mateo, CA, United States R8h ago
-
SAP Business AI Lead Architect USD 229KABAP | AI orchestration | AI/ML | APIs | AWS AI401k | Dental insurance | Flexible paid time off | Health insurance | Paid HolidaysSenior-level Full TimeHome-based, US R9h ago
-
Bayesian Data Scientist USD 90K-210KAlgorithm Development | Bayesian statistics | Big Data | C# | C++10 paid holidays | 401k match | Dental insurance | Health insurance | Life insuranceMid-level Full TimeCambridge, MA, Arlington, VA12h ago
-
Senior AI Engineer (NYC) USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Fine TuningHealth and wellness programs | Hybrid work flexibility | Mentorship | Paid time offSenior-level Full TimeNew York, NY, United States R15h ago
-
Senior Data Scientist, Trust (Inference) USD 179K-210KA/B | A/B Testing | B testing | Bayesian Modeling | Causal InferenceEmployee travel credits | Remote work eligibleSenior-level Full TimeRemote - USA R16h ago
-
Applied AI Engineer USD 122K-176KAI Agents | AWS | Automated testing | Azure | CI/CD401k match | Educational assistance program | Employee assistance program | Employee discounts | Employee referral programMid-level Full TimeRemote (United States) R16h ago
-
Director, AI Engagements USD 270K-325KAPI Integration | Agentic Workflows | Artificial Intelligence | Claude API | Data FlowExecutive-level Full TimeRemote, United States; UK - Remote R16h ago
-
Director of AI Engineering USD 180K-240KAPI Development | Agent systems | Deployment | JavaScript | Langchain401k | Annual bonus | Dental insurance | Equity incentive plan | Flexible vacationExecutive-level Full TimeU.S. Remote R16h ago
-
Legal AI Program Manager USD 315K-385KArtificial Intelligence | Change Management | Enterprise Architecture | Enterprise Software | EvaluationMid-level Full TimeRemote, United States; UK - Remote R17h ago
-
Data Scientist USD 84K-110KAnomaly Detection | CI/CD | Data Privacy | Databricks | Drift monitoringDiversity and inclusion working groups | Flexible working practices | Paid volunteer time off VTO | Parental leaveMid-level Full TimeAtlanta, GA - Remote R17h ago
-
Mid-level Full TimeRemote Worker - USA R17h ago
-
AI Prompt Engineer / AI Application Engineer USD 84K-110KAgentic Workflows | Anthropic Claude | Authentication | Azure DevOps | CI/CDEntry-level Full TimeNew York, NY, United States R18h ago
-
Data Scientist USD 170K-300KA/B | A/B Testing | ANN | Approximate Nearest Neighbor | B testing401k | Dental insurance | Equity | Flexible vacation | Life insuranceSenior-level Full TimeLos Angeles, CA18h ago
-
2026 Fall Intern, Digital Health Algorithms USD 88K-126KAWS | Amazon SageMaker | Android | Artificial Intelligence | C++Entry-level Internship665 Clyde Avenue, Mountain View, CA, …18h ago
-
Agentic AI | CATE Estimation | Causal Inference | Causal Machine Learning | Data AnalysisSenior-level Full TimeCincinnati, Ohio, United States18h ago
-
Causal Inference | Experimental Methods | Experimentation | Incrementality testing | Language ModelsSenior-level Full TimeSan Francisco R19h ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | Apache Spark | B testing | Data MiningHealth and wellness programs | Hybrid work schedule | Time away from workSenior-level Full TimeMountain View, CA, United States R19h ago
-
Data & ML Engineer USD 150K-200KAWS Glue | Airflow | Apache Kafka | Apache Spark | Audit LoggingEmployer-paid health insurance | Flexible work environment | Fully remote | Paid parental leave | Unlimited PTOMid-level Full TimeRemote, USA R19h ago
-
A/B | A/B Testing | AWS | B testing | CI/CD401k | Commuter benefits | Dental insurance | Educational assistance | Health savings accountSenior-level Full TimeNew York, United States R19h ago
-
Senior Data Scientist, Product Analytics - Creatives USD 173K-245KA/B | A/B Testing | Ad-Tech | Attribution Modeling | B testing401k match | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeMenlo Park, California, United States20h ago
-
Forward Deployed AI Lead USD 210K-232KAI Governance | Agentic AI | Anthropic Claude | Artificial Intelligence | CI/CD401(k) plan match | Company-provided laptop | Dental insurance | Disability insurance | Equipment stipendSenior-level Full TimeUSA R21h ago
-
Senior-level Full TimeBellevue R21h ago
-
Director, Computational HitGen / LeadGen Team Lead USD 156K-296KAffinity prediction | Artificial Intelligence | Binding Affinity Prediction | Computational Drug Discovery | Data Analysis401k | Dental insurance | Health insurance | Long-term incentive program | Paid time offExecutive-level Full TimeNorth Chicago, IL, United States21h ago