Computational Linguist, AI Evaluation
Tasks
- Analyze customer and usage data
- Automate annotation quality evaluation
- Automate automated scoring systems
- Build data pipelines
- Build model evaluation benchmarks
- Coordinate vendor partner labeling operations
- Create dashboards and reports
- Define evaluation protocols
- Design data collection and labeling projects
- Design human evaluation frameworks
- Maintain quality guidelines and feedback loops
- Translate insights into improvement plans
Perks/Benefits
- Co-working memberships
- Daily meals provided
- Flexible PTO
- Health, dental, vision benefits
- Learning and development stipend
- Parental leave
- Transportation stipend
- Wellness stipend
Skills/Tech-stack
AWS EC2 | AWS S3 | Analytics | Automated scoring | Benchmarking | Dashboards | Data labeling | Data pipeline | FFmpeg | Human evaluation | Language Models | Language Processing | Large Language Models | Machine Learning | Multimodal AI | Natural Language | Natural Language Processing | Project Management | Python | Vision Language Models | Vision-language
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Staff Machine Learning Engineer, DUE USD 238K-302KAnomaly Detection | C++ | Data Processing | Deep learning | Hugging FaceSenior-level Full TimeMountain View, CA, USA4h ago
-
AI Solutions Engineer USD 126K-176KArchitecture Design | Artificial Intelligence | Data Mapping | Data Templates | DataverseHybrid work arrangement | Relocation N/A | Travel opportunityMid-level Full TimePhoenix, AZ, US5h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R5h ago
-
Data Scientist ll - Digital Intelligence USD 140K-170KDatabricks | Experiment analysis | Feature Engineering | Machine Learning | Model EvaluationMid-level Full TimeHybrid - US R6h ago
-
Entry-level Full TimePittsburgh, PA10h ago
-
Staff Software Engineer, Agentic Applications USD 198K-272KApproval Workflow | Audit Logging | Behavioral Regression | Behavioral Regression Testing | Content ManagementSenior-level Full TimeMountain View, California11h ago
-
Data Engineer USD 120K-150KAPIs | Access Control | Airbyte | Amazon Redshift | Apache AirflowFully remote | Work independentlyMid-level Full TimeUnited States (Remote) R11h ago
-
Senior/Staff Machine Learning Engineer USD 223K-268KAPI Integration | Anomaly Detection | Class Imbalanced Modeling | Databases | Drift DetectionHealth benefits | Long-term incentives | Medical benefits | Performance bonusSenior-level Full TimeSan Jose, California, United States11h ago
-
Senior-level Full TimeMountain View, California; San Francisco, California11h ago
-
Staff Software Engineer- CXI USD 164K-225KAPIs | AWS | Agentic Automation | Azure | Backend DevelopmentSenior-level Full TimeMountain View, California; San Francisco, California12h ago
-
Senior Software Engineer, Foundation Model API USD 160K-225KCloud Native | Deployment Pipelines | Distributed Systems | GPU Orchestration | GoSenior-level Full TimeSan Francisco, California12h ago
-
Senior Software Engineer (Applied AI) USD 160K-200KAPIs | AWS | Agentic Workflows | Best practices | Cost monitoringCareer development | Discretionary performance bonus | Equity options | Health benefitsSenior-level Full TimeSeattle, New York City, Boston, or … R12h ago
-
Lead Data Scientist, Demand Forecasting USD 160K-192KBayesian Modeling | Data Pipelines | Data Quality | Hierarchical modeling | MLOps401k match | Dental insurance | Income protection | Medical insurance | Paid time offSenior-level Full TimeCharlotte, North Carolina, United States13h ago
-
Mid-level Full TimeLos Angeles, CA, United States; New …14h ago
-
Mid-level Full Time上海、圣何塞14h ago
-
Senior Software Engineer, Data & AI Platform USD 171K-224KApache Spark | Batch Processing | CI/CD | Cloud Native | Data Engineering401k retirement savings plan | Annual cash bonus | Equity grants | Flexible time off | Generous parental leaveSenior-level Full TimeRemote, USA R14h ago
-
Data Engineer USD 180K-235KAccess Control | BigQuery | Data Modeling | Data Warehouse | Data pipeline401k match | Medical, dental & vision coverage | Paid parental leave | Stipends | Unlimited PTOMid-level Full TimeNew York14h ago
-
Generative AI - ML System Engineering USD 175K-300KBF16 | C++ | CUDA | Data loading | Data-parallelComprehensive benefits package | Growth opportunities | In-office work | Silicon Valley work environmentSenior-level Full TimeBay Area Office14h ago
-
Staff Machine Learning Engineer USD 118K-136KCI/CD | Data Governance | Data Modeling | Data Pipelines | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R14h ago
-
Generative AI - 3D Foundation Model USD 175K-300KDiffusion Models | Flow matching | GPU Computing | Human Feedback | Jupyter NotebookComprehensive benefits package | In-office positionMid-level Full TimeBay Area Office15h ago
-
Senior Quantum Applications Engineer USD 185K-210KGit | Python401k matching | Catered lunches | Dependent care benefits | Drinks and snacks | FSASenior-level Full TimeBerkeley, CA15h ago
-
Associate Machine Learning AI Engineer USD 100K-138KAPI Design | API Key | API key management | AWS | Agent workflowsHealth insurance | Remote work option | Unlimited Paid Days OffMid-level Full TimeRemote - United States R15h ago
-
Staff/Senior Agentic AI Engineers (Multiple roles) USD 180K-250KAPI Design | AWS | Agent Orchestration | Agentic Architectures | Electronic Health RecordsSenior-level Full TimeSan Francisco, California15h ago