Machine Learning Enginer, Core Evaluations
Tasks
- Build automated evaluation dashboards
- Collaborate with data team on data needs
- Collaborate with model team on model improvements
- Collaborate with product manager on measurable requirements
- Convert requirements into evaluation metrics
- Design model evaluation pipelines
- Design user studies for subjective evaluations
- Lead evaluation team growth
- Statistically compare evaluation results
- Train and fine tune models for new evaluation metrics
Perks/Benefits
- N/A
Skills/Tech-stack
Automatic Speech Recognition | Dashboards | Data Pipelines | Fine Tuning | Machine Learning | Model Evaluation | Model Training | Speech Recognition | Statistical Analysis | Text to Speech
Education
N/A
Related jobs
-
Senior/Staff Data Analyst USD 180K-210KAnomaly Detection | Automated reporting | DBT | Dashboarding | Data Modeling401k | Disability coverage | Flexible time off | Health coverage | Home office supportSenior-level Full TimeRemote R9h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R12h ago
-
Mid-level Full TimePune - Tower 6, India R12h ago
-
Engenheiro(a) de dados Sênior BRL 54K-72KAWS | Apache Airflow | Apache Spark | Code review | Data CatalogSenior-level Full TimeRemote R12h ago
-
AI Value Partner, Customer Analytics USD 120K-160KA/B | A/B Testing | B testing | Causal Inference | Experimental DesignFlexible vacation time | Gym allowance | Lunch and dinners stipend | Medical, dental, vision plans | Paid parental leaveMid-level Full TimeUnited States (Remote) R14h ago
-
Senior Software Engineer, Data Platform USD 125K-156KAPI Development | AWS | Automation | CI/CD | Data Engineering401k benefits | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R14h ago
-
Action Chunking | Behavioral cloning | Data Versioning | Diffusion Models | Domain Randomization401k retirement plan | Comprehensive medical, dental and vision coverage | Daily free lunch | Employee referral bonuses | Flexible PTOMid-level Full TimeColumbus, Ohio R16h ago
-
Action Policy Learning | C++ | Data collection | Domain Randomization | Edge inference401k retirement plan | Dental insurance | Employee referral bonuses | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R16h ago
-
Data Engineer II USD 101K-153KAmazon RDS | Amazon Redshift | Apache Spark | DBT | Data GovernanceComprehensive health plans | Parental leave | Professional development stipend | Remote workMid-level Full TimeRemote - US R16h ago
-
Senior Software Engineer - Robotics USD 134K-184KAgent coordination | Agile | Algorithms | C++ | CI/CDRemote work flexibilitySenior-level Full TimeWoburn, MA R17h ago
-
Staff Machine Learning Engineer, AI Research USD 230K-275KComputer Vision | Feature Engineering | Fine Tuning | Hyperparameter Tuning | Kubeflow401k | Dental insurance | Equity | Fertility treatment benefit | Health insuranceSenior-level Full TimeRemote - United States R17h ago
-
Full-Stack Analytics Engineer II USD 95K-118KAirflow | BigQuery | CI/CD | DBT | Dagster401k match | Dental insurance | Educational reimbursement | Flexible schedule | Health insuranceMid-level Full TimeWashington DC R17h ago
-
Senior AI Engineer USD 180K-272KApache Airflow | Apache Flink | Apache Spark | Azure Databricks | Azure KubernetesBenefits | Career growth opportunitiesExecutive-level Full TimeRemote job R17h ago
-
Senior Machine Learning Engineer (Speech Synthesis) EUR 100K-100KData Processing | Diffusion Models | Distributed Training | Docker | Experiment trackingContinuous learning | Remote workSenior-level Full TimeDublin; Amsterdam; Krakow R18h ago
-
AI Engineer EUR 25K-33KAPI Gateway | AWS IAM | AWS Lambda | AWS Step Functions | Agent OrchestrationExtra vacation days | Flexible working hours | Hybrid or remote work | Meal allowance | Multisport card covered by employerEntry-level Full TimeZagreb, Croatia (Hybrid) R19h ago
-
Senior Machine Learning Engineer USD 180K-200KCloud Computing | Continuous integration | Fine Tuning | Generative AI | Language Models401k match | Dental insurance | Equity package | Health insurance | Hybrid workSenior-level Full TimeRemote - United States R19h ago
-
Senior Machine Learning Engineer, Roblox Assistant USD 196K-243KData Processing | Distributed data | Distributed data processing | Fine Tuning | Language ModelSenior-level Full TimeSan Mateo, CA, United States R20h ago
-
Sr. Staff AI Engineer (Remote) USD 229K-283KAWS | Agents | Amazon Bedrock | Anthropic | Data Pipelines401k plan access | Dental insurance | Disability insurance | Employee assistance program | FSASenior-level Full TimeRemote - United States R20h ago
-
Senior Operations Associate - Machine Learning USD 101K-119KAsana | Data Analysis | Data collection | Jira | LookerDental | Healthcare | Mental health support | Paid time off | Parental planning resourcesMid-level Full TimeUSA - Remote R20h ago
-
Senior AI/ML Developer USD 165K-258KAWS Bedrock | Anthropic API | Artificial Intelligence | CI/CD | Cloud deploymentCareer Development Programs | Collaborative culture | Flexible time off plans | Flexible work schedules | Health and wellness benefitsSenior-level Full TimeRemote- UK R21h ago
-
Sr. AI engineer (Remote) USD 50K-120KAWS | AWS CloudWatch | AWS SageMaker | Apache Spark | CI/CDRemote workSenior-level Full TimeIndia, Remote R21h ago
-
Business Intelligence | Cloud Computing | Data Engineering | Data Pipelines | Data SystemsRemote workSenior-level ContractRemote R21h ago
-
AI Engineer INR 2755K-4600KAI Safety | API Integration | Access Controls | Agent Orchestration | Data Leakage PreventionAsynchronous work | Continuous learning | High-performance culture | Knowledge sharing | Remote workSenior-level Full TimeRemote, Bangalore R22h ago
-
Machine Learning Engineer CAD 70K-100KAWS | Data cleaning | Django | GRPC | KubernetesBirthday off | Parental leave | Remote-first | Work anywhere up to 3 months | Work from home stipendMid-level Full TimeCanada - Remote, E. Europe - … R22h ago
-
AI Foundry | AI Security | API Design | API Security | Access ManagementComprehensive medical insurance | Generous annual leave | Remote work flexibilitySenior-level Full TimeBogotá, Bogota, Colombia R23h ago