Machine Learning Engineer - LLM Evals + Observability
San Francisco Bay Area
USD 200K-300K Mid-level Full Time
Found 11h ago
Tasks
- Analyze eval results and feedback
- Build LLM judges
- Build evaluation pipelines
- Build observability infrastructure
- Collaborate across engineering teams
- Design evaluation datasets
- Evaluate models and product changes
Perks/Benefits
- 401k
- Dental
- Education stipend
- Home office stipend
- Medical
- Time off
- Vibrant culture
- Vision
- Wellness stipend
Skills/Tech-stack
Data Analysis | Data Pipelines | Distributed data | Distributed data pipelines | Go | Language Models | Language Processing | Large Language Models | Machine Learning | Natural Language | Natural Language Processing | Python | Reinforcement Learning | System design
Education
N/A
Language: en |
Views: 0 |
Clicks: 0
Related jobs
-
Staff Backline Engineer - Data & AI USD 157K-247KData Troubleshooting | Delta Lake | Distributed Systems | Dump analysis | ETL PipelinesDiversity and inclusion programs | Flexible working hours | Healthcare | Professional development opportunities | Remote work optionsSenior-level Full TimeDallas, Texas; San Francisco, California; Vancouver, …7h ago
-
Analytics Engineer USD 140K-200KAgile | DBT | Data Architecture | Data Modeling | Data QualityAutonomy | Flexibility | Global impact opportunityMid-level Full TimeChicago, IL9h ago
-
Staff Software Engineer, Data USD 144K-235KFlask | Python | RESTful APIs | Relational databases | SpringHealth and wellness programs | Inclusive work environment | Performance bonus | Stock optionsSenior-level Full TimeSunnyvale, CA, United States12h ago
-
AWS | Automation | Data analytics | Distributed Systems | EC2Career growth opportunities | Inclusive cultureMid-level Full TimeSeattle, Washington, USA12h ago
-
Principal Software Engineer Data USD 135K-160KAzure | Cloud Computing | Data analytics | Databricks | GitHub ActionsCareer growth opportunities | Remote work flexibilitySenior-level Full TimeAZ, US, 11111 R12h ago
-
Data Engineer USD 150K-210KAirflow | BigQuery | Business Intelligence | DBT | Data GovernanceCompany retreats | Flexible work | Health insurance | Paid time off | Travel opportunitiesMid-level Full TimeOakland13h ago
-
Forward Deployed Engineer (FDE) - Seattle USD 162K-280KDeployment | Full Stack | Full-Stack Development | Generative Models | JavaScriptHybrid work | Relocation assistance | Travel flexibilityMid-level Full TimeSeattle13h ago
-
Sr. Data Engineer, Engineering & Ops USD 140K-180KAI frameworks | Advanced SQL | Airflow | DBT | Data Architecture401k | Dental insurance | Medical insurance | Paid leave | Remote workSenior-level Full TimeNew York, NEW YORK, United States R14h ago
-
Analytics Engineer USD 25K-151KAirflow | DBT | Data Analysis | Data Modeling | Data Pipelines401k matching | Dental insurance | Equity stake | Family building support | Family leaveMid-level Full TimeNew York, New York R14h ago
-
Senior Staff Machine Learning Engineer USD 216K-269KAI strategy | Cloud infrastructure | Cost Optimization | Data Engineering | Data InfrastructureDental insurance | Disability insurance | Employee stock purchase | Flexible spending account | Health savings accountSenior-level Full TimeSan Jose, California, United States14h ago
-
BI Engineer USD 125K-150KData Analysis | Data Governance | Data Validation | Data Visualization | Data WarehouseSenior-level Full TimeDes Moines, Iowa15h ago
-
Data Engineering & Analytics Intern USD 60K-70KData Analysis | Data Normalization | Data Quality | Data cleaning | Data quality assessmentEntry-level InternshipUnited States15h ago
-
ML Features Solutions Engineer USD 155K-220KDeep learning | Hardware acceleration | Inference Optimization | JAX | Language ModelsCareer development | Flexible spending accounts | Health insurance | Paid time off | Well-being benefitsMid-level Full TimePalo Alto, California, United States15h ago
-
Senior Engineering Manager- AI/ML USD 170K-230KCommunication | Deep learning | Distributed Systems | Docker | KubernetesSenior-level Full TimeRemote, United States R16h ago
-
Enterprise Data Platform Engineer – Washington, DC USD 169K-299KAWS | CI/CD | Cloud Computing | Data Governance | DatabricksCollaborative work environment | Flexible work arrangements | Health insurance | Professional development opportunitiesSenior-level ContractFalls Church, VA, US | VA, …16h ago
-
Data & AI Strategy - Senior Advisor USD 150K-186KAI | AWS | Azure | Cloud Platforms | Data Architecture401k | Employee stock options | FSA | HSA | Health insuranceSenior-level Full TimeNew York, NY, United States17h ago
-
AWS | Azure | CI/CD | Deep learning | DockerHybrid or remote work | Professional growth opportunitiesSenior-level Full TimeSan Jose, California, United States17h ago
-
Google Cloud Data Engineer USD 90K-120KApache Airflow | BigQuery | Cloud Composer | Cloud Storage | Cloud platformFlexible PTO | Health, dental, vision insurance | Paid Holidays | Remote culture | Volunteer daysMid-level Full TimeRemote, US R18h ago
-
AI/ML DevOps Engineer (TS/SCI with Poly Required) USD 164K-274KCloud AWS | Docker | Elasticsearch | Git | JavaFlexible work hours | Health insurance | Tuition assistanceSenior-level Full TimeChantilly, Virginia, United States18h ago
-
Machine Learning Engineer - Insurance AI USD 75K-90KAPI Integration | AWS | Airflow | CI/CD | DBTFlexible leave days | Learning and development access | Parental leave | Private health insurance | Remote workEntry-level Full TimeLehi, Utah, United States18h ago
-
Senior Machine Learning - Avatar, Core AI USD 195K-242KDeep learning | Model Deployment | Model Optimization | PyTorch | PythonEquity benefits | Flexible work arrangementsSenior-level Full TimeSan Mateo, CA, United States18h ago
-
AI/ML DevOps Engineer (TS/SCI with Poly Required) USD 164K-274KAPI | AWS | Bash Scripting | C2S | CSSSenior-level Full TimeChantilly, Virginia, United States19h ago
-
Data Engineer USD 85K-115KAWS | Athena | Data Warehousing | EMR | ETLCompany meals | Competitive salary | Education reimbursement | Health benefits | Performance bonusMid-level Full TimeGreenwich, CT19h ago
-
Analytics Engineer II, Data Platform USD 101K-110KAWS | Airflow | DBT | Data APIs | Data Governance401k plan | Health insurance | Paid leave | Professional developmentMid-level Full TimeNew York, NY19h ago
-
Senior Analytics Engineer, Data Platform USD 124K-135KAWS | Airflow | DBT | Data APIs | Data ModelingFlexible work hours | Health benefits | Paid time off | Professional developmentSenior-level Full TimeNew York, NY19h ago