Computational Linguist, AI Evaluation
Tasks
- Analyze complex data and create quality reports
- Automate evaluation pipelines
- Build data pipelines
- Collaborate with external vendors and outsourcing partners
- Create analytical reports and dashboards
- Define dataset needs
- Design model evaluation frameworks
- Establish labeling guidelines
- Execute post training model evaluation
- Improve data tooling and infrastructure
- Manage resource allocation and timelines
- Monitor data quality
Perks/Benefits
Skills/Tech-stack
Amazon S3 | Data Analysis | Data Pipelines | Data Quality | Data labeling | Jupyter | Language Models | Large Language Models | Localization Testing | Machine Learning | Model Evaluation | Multimodal AI | Pandas | Project Management | Python | Red Teaming
Education
N/A
Roles
Analyst | Data Analyst | Data Scientist | Engineer | Learning Engineer | Machine Learning Engineer | Scientist
Regions
Countries
States
Related jobs
-
Featured Feat. Data Scientist USD 80K-157KAWS | Airflow | Annotation | Azure | ClassificationHybrid work mode | Professional development opportunitiesMid-levelGeorgetown University: Main Campus: Walsh School …6d ago
-
Machine Learning Engineer, Depot Automation USD 175K-215KFoundation Models | Industrial robotics | Machine Learning | Model Evaluation | Production DeploymentAnnual bonus | Company benefits program | Equity incentive plan | Hybrid work scheduleMid-level Full TimeMountain View, CA, US3h ago
-
Research Data Scientist 1 USD 95K-106KData Analysis | Data Wrangling | Data pipeline | Dimensional data | High Dimensional DataEquity compensation | Flexible work schedule | Health benefits | Hybrid work | Remote work optionMid-level Full TimeBellevue, WA R5h ago
-
AWS | Analytics | Data Mining | Generative AI | Machine LearningMentorship | Training | Work-life balanceSenior-level Full TimeArlington, Virginia, USA6h ago
-
API Integration | AWS | Autogen | Azure | Cloud platformHybrid work environmentSenior-level Contract Full TimeChicago, Illinois, United States8h ago
-
Senior/Staff Software Engineer - Perception & Sensing USD 195K-280K3D Object Detection | 3D segmentation | A/B | A/B Testing | B testingSenior-level Full TimeFoster City, CA8h ago
-
AI Engineer USD 103K-140KAI Agents | AI Studio | Access Control | Anthropic Claude | AuthenticationBonus eligibleSenior-level Full TimeDenver, CO, United States9h ago
-
Staff Software Engineer, GenAI Platform USD 208K-250KAPI | AWS EKS | Access Control | Agent Orchestration | Audit LoggingCatered lunches | Cultural and team offsites | Employee giving match | Flexible work schedule | Generous vacation policySenior-level Full TimeSan Francisco, CA, United States9h ago
-
Data Analyst USD 65K-65KAzure | DAX | Data Modeling | Data Quality | Data WarehousingEmployee assistance program | Flexible spending account | Flexible work schedule | High-yield HSA | Medical, dental, and vision insuranceEntry-level Full TimeHouston, TX, United States R10h ago
-
Data Engineering Analyst Lead/Scientist - Remote USD 90K-150KAWS | Data Compliance | Data Engineering | Data Privacy | PythonSenior-level Full TimeUnited States, UNITED STATES, United States R10h ago
-
Senior-level Full TimeCincinnati, OH, United States10h ago
-
Applied AI & Analytics Associate Opportunities USD 100K-125KAsana | Automation | BigQuery | Data Pipelines | Databricks401k matching | Dental insurance | Employee stock purchase program | Flexible Work N/A | Flexible spending accountsMid-level Full TimeNeedham, MA, United States11h ago
-
Bill of Materials | Change Management | Data Cleansing | Data Governance | Data Migration401k | Collaborative team environment | Cross training | Dental insurance | Medical insuranceMid-level Full TimeWichita, KS, United States11h ago
-
Robotic Orchestration Platform Software Engineer USD 125K-250KAWS | Agile | Azure | C# | CI/CDAgile environment | Remote supportSenior-level Full TimeSan Francisco, California11h ago
-
Atomic force microscopy | Data Analysis | Electron microscopy | Ellipsometry | Experiment designHealth savings account | Life and disability insurance | Medical, dental, and vision insurance | Paid sick leave | Paid vacationEntry-level Full TimeSan Jose, CA, United States12h ago
-
A/B | A/B Testing | B testing | Data Pipelines | Fine Tuning401k retirement plan | Health insurance | Meal allowance | Paid flexible holidays | Paid parental leaveSenior-level Full TimeNew York, NY12h ago
-
Senior Data Engineer USD 111K-124KAccess Control | Agile | Azure | CI/CD | Data Governance401k contributions | Education assistance | Life and disability coverage | Medical, dental, and vision coverage | Paid sabbaticalSenior-level Full TimeAtlanta, Georgia or Gainesville, FL12h ago
-
Senior-level Full TimeBoston, Massachusetts, United States13h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k with firm profit share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States13h ago
-
Financial Data Analyst USD 82K-90KMicrosoft Excel | PowerPoint | Python | R | SAS401k matching | Company events | Dental insurance | Gym access | Medical insuranceMid-level Full TimeChicago, IL (Southwest)13h ago
-
Quantitative Analyst USD 98K-155KC++ | Code optimization | Data analytics | Data extraction | Derivatives401k matching | Adoption and surrogacy reimbursement | Community programs | Dress code flexibility | Flexible time offMid-level Full TimeNew York, NY, United States13h ago
-
Analytics Engineer USD 60K-75KDBT | Data Architecture | Data Modeling | Data Pipelines | Data Quality401k employer match | Medical/Dental/Vision | Paid Holidays | Paid parental leave | SabbaticalMid-level Full TimeBoulder, Colorado, United States14h ago
-
Data Scientist, Modeler USD 100K-135KA/B | A/B Testing | API Integration | B testing | BigQuery401k match | 7 24 physician consultations | Dental insurance | Employee community groups | Employee mentorship programMid-level Full TimeLos Angeles, CA, United States R14h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R14h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R14h ago