Staff Machine Learning Engineer – VLM/LLM Evaluation
Mountain View, CA, USA; San Francisco, CA, USA; Kirkland, WA, USA; New York City, NY, USA
USD 238K-302K Senior-level Full Time
Tasks
- Build foundation model evaluation systems
- Debug and analyze ML systems
- Develop end to end evaluation benchmarks
- Evaluate model quality safety and realism
- Implement large-scale data and evaluation pipelines
- Train evaluate and deploy machine learning models at scale
Perks/Benefits
- 401k match
- Dental insurance
- Disability insurance
- Health insurance
- Holidays
- Life insurance
- Paid time off
- Sick time
- Vision insurance
Skills/Tech-stack
C++ | Data Pipelines | Deep learning | Distributed Systems | Evaluation Frameworks | Generative Modeling | JAX | Language Models | Large Language Models | Machine Learning | PyTorch | Python | Reinforcement Learning | TensorFlow | Vision Language Models | Vision-language
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
ML Engineer, Foundation Model Infrastructure USD 175K-215KBayesian Inference | C++ | CI/CD | Distributed Systems | Experiment trackingSenior-level Full TimeMountain View, CA, USA; San Francisco, …10h ago
-
Agent Orchestration | Data Quality | Deep learning | Generative UI | GoSenior-level Full TimeMountain View, CALIFORNIA, United States13h ago
-
Context engineering | Deep learning | Dynamic Orchestration | Generative AI | Golang401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States13h ago
-
Data Quality | Deep learning | Experimentation | Golang | LLM EvaluationSenior-level Full TimeMountain View, CALIFORNIA, United States13h ago
-
Senior Software Engineer - Machine Learning (Remote US) USD 230K-270KAI workflows | APIs | Backend Development | Cloud Native | Context engineeringRemote workSenior-level Full TimeUSA R14h ago
-
Deployed Engineer (Chicago) USD 150K-250KAWS | Agent architecture | Azure | Cloud Computing | Containerization401k plan | Flexible vacation | Meals on in office days | Medical, dental, and vision coverage | Travel up to 40 percentSenior-level Full TimeChicago, IL14h ago
-
Bioinformatics | C++ | CUDA | Cloud Computing | Computer VisionSenior-level Full TimeBaltimore, MD, United States15h ago
-
Staff AI Engineer USD 228K-288KArtificial Intelligence | Cloud infrastructure | Data Science | Distributed Systems | Graph Databases401k match | Company-sponsored life and disability insurance | Flexible spending accounts | Learning and development stipend | Mental health resourcesSenior-level Full TimeOakland, California, United States15h ago
-
Staff Partner Engineer, AI Partnerships USD 150K-206KAI integration | Agent Frameworks | Architecture | Cost Optimization | EvaluationGlobal travelSenior-level Full TimeNew York City, New York; San …15h ago
-
Staff Embedded Software Engineer USD 160K-190KBare Metal | Bash | C# | C++ | CAN401k match | Education reimbursement | Flexible time off | Medical, dental, and vision coverage | Paid parental leaveSenior-level Full TimeIrvine, CA15h ago
-
Solution Engineer USD 138K-181KMachine Learning | Python | SQL401k | Flexible PTO | Health, dental, vision insurance | Professional development budgetSenior-level Full TimeUS-NY-New York16h ago
-
AI Research Engineer USD 200K-400KAgent systems | Constrained decoding | Data Curation | Evaluation Harness | Hugging FaceMid-level Full TimeNew York City16h ago
-
Data Engine & Annotation Systems Engineer USD 130K-190KAPIs | Active Learning | Auto-labeling | Bash | Computer VisionMid-level Full TimeSan Francisco Bay Area16h ago
-
Customer Facing Applied AI Engineer, Retail Perception USD 106K-128KComputer Vision | Data Engineering | Data Pipelines | Data Validation | GitMid-level Full TimeSan Francisco Bay Area16h ago
-
Senior Computer Vision / Applied AI Engineer USD 150K-235KActive Learning | Annotation QA | Barcode Decoding | CUDA | Computer VisionSenior-level Full TimeSan Francisco Bay Area16h ago
-
Principal / Staff Robotics Perception Engineer USD 150K-261KC++ | CUDA | Camera Calibration | Depth Estimation | Edge inferenceSenior-level Full TimeSan Francisco Bay Area16h ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Distributed ComputingFlexible work hybrid model | Health and wellness programs | Time away from workSenior-level Full TimeMountain View, CA, United States16h ago
-
Senior Machine Learning Engineer, Price Modeling USD 196K-227KData Analysis | Data Visualization | Machine Learning | Model Evaluation | PythonEmployee travel credits | Inclusion and belonging initiatives | Occasional travel | Remote eligibleSenior-level Full TimeUnited States17h ago
-
Lead Machine Learning Engineer USD 172K-276KAWS | Azure | CI/CD | Databricks | Distributed SystemsFlexible autonomy | Learning and development programs | MentorshipSenior-level Full TimeChicago, Illinois, USA R17h ago
-
Human Data Engineer USD 144K-270KData Annotation | Data Integrity | Data Quality | Dataset evaluation | Machine Learning401k retirement plan | Dental insurance | Disability insurance | Discounts | Life insuranceMid-level Full TimePalo Alto, California, United States17h ago
-
Senior 3D Print Optimization Engineer USD 115K-148K3D Printing | Cause analysis | Computer Aided Design | Experiment design | Fluid Dynamics401k matching | Dental insurance | Equity via RSUs | Flexible time off | Healthcare coverageSenior-level Full TimeBoston, MA17h ago
-
Senior 3D Print Optimization Engineer USD 115K-148K3D Printing | CAD | Cause analysis | Computer Aided Design | Experimental Design401k matching | Equity RSUs | Flexible time off | Healthcare coverage | On-site parkingSenior-level Full TimeSomerville, MA17h ago
-
3D Print Optimization Engineer USD 85K-125KCause analysis | Computer Aided Design | Experimental Design | Fluid Dynamics | Material characterization401k matching | Dental insurance | Health insurance | Paid parental leave | Paid sabbaticalSenior-level Full TimeSomerville, MA17h ago
-
3D Print Optimization Engineer USD 85K-125KCAD | Cause analysis | Computer Aided Design | Electronics | Experiment design401k matching | Equity program | Flexible time off | Healthcare coverage | On-site parkingSenior-level Full TimeBoston, MA17h ago