Machine Learning Engineer - Model Evaluation & Experimentation
Tasks
- Analyze implementation errors and experimental flaws
- Collaborate with AI researchers to improve evaluation consistency
- Design benchmark tasks based on research workflows
- Develop reinforcement learning benchmark tasks
- Document experimental methodologies and findings
- Evaluate model behavior and performance
- Implement machine learning solutions in Python
- Run training pipelines and experiments
- Translate research concepts into reproducible evaluation tasks
- Tune hyperparameters and validate results
Perks/Benefits
Skills/Tech-stack
Deep learning | Experimentation | Git | Hyperparameter Tuning | Language Models | Large Language Models | Machine Learning | Model Evaluation | Policy Optimization | Python | Reinforcement Learning | Reward Functions | Training dynamics
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R21d ago
-
Senior Applied AI Engineer USD 205K-238KAgentic Methodologies | Agentic Workflows | Deep learning | Fine Tuning | Generative AIFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R11h ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R13h ago
-
Staff Software Engineer (Tech Lead) USD 180K-230KBigQuery | Cloud Run | Cloud platform | Distributed Systems | Docker401k company match | Flexible PTO | GitHub | Health savings account | Hybrid workSenior-level Full TimeUnited States - Remote R13h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agile | Algorithms | C++ | CI/CDHybrid remote workSenior-level Full TimeWoburn, MA R14h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agent systems | Agentic AI | Agile | AlgorithmsHybrid work environment | Remote work flexibilitySenior-level Full TimeArlington, VA R14h ago
-
C++ | Data Movement | Data movement optimization | Distributed Systems | HPC job schedulingHigh-impact research projects | Hybrid work environmentMid-level Full TimeUS Broomfield, CO R15h ago
-
Experimental Dynamic Materials - Postdoctoral Researcher USD 123K-123KCondensed Matter Physics | Condensed matter | Data Analysis | Data Reduction | Diffraction analysis401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R15h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid environment | Remote work option | Security clearance supportSenior-level Full TimeDayton, OH R16h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid remote work | Security clearance supportSenior-level Full TimeArlington, VA R16h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work options | Security clearance supportSenior-level Full TimeWoburn, MA R16h ago
-
Principal, AI Research Engineering USD 171K-245KAPI Design | Artificial Intelligence | Data Governance | GPU Computing | LLM InferenceEducation reimbursement | Hybrid work | Parental leave options | Retirement options | Time off plansSenior-level Full TimeRemote - USA; San Jose, California, … R17h ago
-
Audio Variational Autoencoder | Audio Video Alignment | Audio generation | Audio/Video | C++401k retirement savings plan | Company equity | Complimentary lunch and snacks | Lifestyle spending account | Medical/Dental/Vision insuranceSenior-level Full TimeRemote (U.S. or Europe) R17h ago
-
Senior AI/ML Data Engineer USD 162K-226KAWS | Apache Airflow | BigQuery | CI/CD | Cloud ComposerCareer growth | Flexible remote days | In office five days per weekSenior-level Full TimeFrisco, TX, United States R18h ago
-
Mid-level Full TimeScott AFB, IL R18h ago
-
Forward Deployed Engineer, Data Platform USD 150K-170KAPI Integration | Apache Superset | Data Modeling | ELT | ETLPTO | Remote work optionsMid-level Full TimeBoston, MA / Remote R19h ago
-
Sr. Data Engineer USD 401KAWS | CI/CD | DBT | Data Engineering | Data Governance401k match | Disability insurance | Employee assistance program | Generous paid time off | Health insuranceSenior-level Full TimeUtah | Hybrid R20h ago
-
Embedded Software Engineer I USD 106K-170KC# | C++ | Code review | DHCP | DNS401k match | Dental insurance | Fitness programs | Learning and development programs | Medical insuranceMid-level Full TimeSeattle, Washington, United States R20h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Containerization | Docker | Drift DetectionCollaborative culture | Flexible hours | Learning budget | Mentorship | Remote workMid-level Full TimeCarrollton, United States R22h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftAnnual learning budget | Flexible hours | Local well being programs | Mentorship | Remote workMid-level Full TimeRichardson, United States R22h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment tracking100 percent remote work | Annual learning budget | Flexible hours | Internal TechTalks | MentorshipMid-level Full TimeLewisville, United States R22h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment trackingAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimePlano, United States R22h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipMid-level Full TimeArlington, United States R22h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Platforms | Docker | Drift Detection | Experiment trackingAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeMcKinney, United States R22h ago
-
MLOps Engineer ID72409 USD 125K-193KAutomation | CI/CD | Cloud Computing | Concept drift | Concept drift detectionAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeIrving, United States R23h ago