Machine Learning Enginer, Core Evaluations
Tasks
- Build automated evaluation dashboards
- Collaborate with data team on data to improve performance
- Collaborate with model team to improve model design
- Collaborate with product team to ensure requirements are measured
- Convert requirements into measurable metrics
- Design model evaluation pipelines for development and production
- Design user studies for subjective model evaluations
- Lead and grow evaluation team
- Statistically compare evaluation results
- Train and fine tune models for new evaluation metrics
Perks/Benefits
- N/A
Skills/Tech-stack
Automatic Speech Recognition | Dashboard Development | Experiment design | Fine Tuning | Machine Learning | Machine Learning Pipelines | Model Evaluation | Python | Speech Recognition | Speech synthesis | Statistical Analysis | Study design | User Study | User Study Design
Education
N/A
Related jobs
-
ADLS Gen2 | Apache Spark | Auto Loader | Azure | Azure DataSenior-level Full TimeAlphaville - Barueri, BR, 06.454-000 R12h ago
-
Data Engineer PHP 1200K-1440KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Hive | Apache SparkAnnual leave | Bereavement leave | Birthday leave | Flexible work arrangement | Hybrid work arrangementSenior-level Full TimeTaguig, Metro Manila, Philippines R14h ago
-
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQueryFlexible schedule | Remote workMid-level Full TimePakistan - Remote R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R14h ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible schedule | Project based workSenior-level FreelanceUnited Kingdom - Remote R14h ago
-
Computer Science | MATLAB | NumPy | Pandas | PythonFlexible part-time hours | Project based workSenior-level FreelanceArgentina - Remote R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R14h ago
-
C# | MATLAB | NumPy | Pandas | PythonProject based workSenior-level FreelanceSpain - Remote R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 100K-100KMATLAB | NumPy | Pandas | Python | RPart time freelance assignments | Project based workSenior-level FreelanceFrance - Remote R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R14h ago
-
Senior-level FreelancePortugal - Remote R14h ago
-
AI | API | Airtable | Automation | Google SheetsFlexible work hours | Remote workMid-level Full TimePakistan - Remote R14h ago
-
Mid-level Full TimeRemote R14h ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R15h ago
-
Machine Learning Engineer - 1 USD 130K-228KCNN | Cross-validation | Data Pipelines | Deep learning | Document processingEquity options | Flexible-hybrid work | Medical, dental & vision coverage | Professional development budget | Team offsitesNone Full TimeHybrid - San Mateo, California R15h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R16h ago
-
Entry-level Full Time北京 R17h ago
-
AI Software Engineer - Greenwood Village, CO Office USD 80K-120KAI Agents | API | Automation | C# | Computer VisionCollaborative environment | Comprehensive benefits package | Employee ownership | Flexible workplace | Innovative cultureEntry-level Full TimeGreenwood Village, Colorado, United States R17h ago
-
Miclaw-端云协同调度专家 (Hybrid AI Architect) CNY 240K-480K5G | Cloud Computing | Consistency protocols | Data Compression | Distributed SystemsHybrid work modelSenior-level Full Time北京 R18h ago
-
Entry-level Full Time北京 R19h ago
-
Entry-level Full Time北京 R20h ago
-
Mid-level Full Time北京 R20h ago
-
Mid-level Full Time北京 R20h ago
-
Data Engineer - Costa Rica USD 86K-107KAWS | AWS Lambda | Azure | Data Lakes | Data WarehouseBereavement leave | Dental insurance | Disability insurance | Employee assistance program | Employee discount programMid-level Full TimeCosta Rica R20h ago