Applied AI Researcher, Benchmarking
Tasks
- Analyze noisy empirical results
- Build prototypes
- Conduct human in the loop assessments
- Construct benchmarks
- Design evaluation frameworks
- Develop test suites
- Measure model or system performance
- Quantify emergent capability
- Run experimental evaluations
- Test adversarial robustness
- Track longitudinal performance
Perks/Benefits
- 100 percent covered health insurance
- 401k matching
- Access To State Of The Art Models
- Commuter benefits
- Dental insurance
- Equity
- In-office lunch
- Vision insurance
Skills/Tech-stack
A/B | A/B Testing | Adversarial Robustness | B testing | Deep learning | Experiment design | Human-in-the-loop | Language Processing | Machine Learning | Model Evaluation | Natural Language | Natural Language Processing | Python | Series analysis | Statistics | The Loop | Time Series | Time Series Analysis
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
AI Engineer at Lumion USD 148K-200KAPI Design | Data Modeling | Debugging | Guardrails | Language Models401k | Health dental vision reimbursement | MacBook Pro | Relocation support | Tech stipendMid-level Full TimeSouth Jordan, UT, US, CA, US9h ago
-
AI Research Scientist- GenAI USD 165K-185KC++ | Deep learning | Foundation Models | Inference Optimization | Language ModelsMid-level Full TimePittsburgh, PA, United States9h ago
-
AI Architect - Business Applications USD 138K-225KA/B | A/B Testing | API | B testing | ExperimentationHybrid work optionSenior-level Full TimeBellevue, WA, United States10h ago
-
Applied AI Engineering Intern USD 60K-120KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Data VisualizationEqual opportunity employer | Hybrid work environmentEntry-level InternshipSanta Clara13h ago
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States14h ago
-
Associate AI Solutions & Programs Lead USD 90K-115KArtificial Intelligence | Budget Monitoring | Business Process | Business process improvement | Change Management401k | Dental insurance | Employee discounts | Hybrid work schedule | Medical insuranceMid-level Full TimeNew York, NEW YORK, United States R14h ago
-
AWS | Agent systems | Apache Spark | Apache Spark SQL | AzurePeriodic onsite work | Remote work option | Travel as neededSenior-level Full TimeMaryland; Virginia; Washington, D.C.14h ago
-
Associate Consultant, Generative AI USD 80K-110KAWS | Azure | CI/CD | Chroma | Docker401k matching | Commuter benefits | Dental insurance | Employee assistance program | Flexible spending accountMid-level Full TimeNew York, NY, United States16h ago
-
AI Intern USD 50K-58KAccess Control | Artificial Intelligence | Cybersecurity | Data Privacy | Help deskEntry-level InternshipYork, United States17h ago
-
AI/ML Engineer USD 170K-220KBenchmarking | Cloud Computing | Containerization | Debugging | Distributed Systems401k match | Education & training benefits | Healthcare dental vision coverage | Paid Holidays | Paid time offSenior-level Full TimeRome, NY R18h ago
-
Senior-level Full TimeAustin, Texas, United States19h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …19h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …19h ago
-
Software Engineer, Systems ML - SW/HW Co-design USD 117K-173KAI infrastructure | Bias Mitigation | C# | C++ | Co-designSenior-level Full TimeSunnyvale, CA | Redmond, WA20h ago
-
Postdoctoral Researcher, AI and Systems Co-design Team USD 112K-145KAlgorithms | Compilers | Computer Architecture | Distributed Systems | Machine LearningEntry-level Full TimeMenlo Park, CA20h ago
-
Quantitative Trader USD 150K-216KAlgorithmic trading | Deep learning | Linear Models | Machine Learning | Quantitative AnalysisCollaborative work environment | Firmwide educational curriculum | Hands-on trainingMid-level Full TimeNew York, New York, United States20h ago
-
Quantitative Researcher USD 150K-200KDistributed Training | Feature Engineering | Hyperparameter Tuning | Machine Learning | PythonSenior-level Full TimeNew York, New York, United States20h ago
-
GTM Applied AI Architect, Google Cloud USD 153K-222KAgent Development | Agent Development Kit | Cloud platform | Function Calling | GeminiSenior-level Full TimeAustin, TX, USA; Boulder, CO, USA20h ago
-
Senior Staff AI Engineer USD 180K-240KA3C | Actor-critic | Adaptive computation | Benchmarks | C plus plusSenior-level Full TimeLos Altos, California,21h ago
-
Agentic AI Engineer USD 103K-158KAI Search | Agent Orchestration | Anthropic Claude | App Service | Autogen401k match | Flexible paid time off | Hybrid work flexibility | Medical/Dental/Vision | Paid parental leaveMid-level Full TimeGolden, CO, US22h ago
-
AI Principal Consultant, AI Services USD 155K-175KAI Governance | Agentic AI | Artificial Intelligence | Automation | Business case401k | Dental insurance | Medical insurance | Paid Holidays | Paid caregiver leaveSenior-level Full TimeUnited States1d ago
-
Sr Agentic AI Engineer USD 106K-178KAI Agents | AWS | Azure | C++ | Cloud deploymentDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceSenior-level Full TimePlano, TX, United States1d ago
-
Principal AI/ML Engineer USD 165K-226KC# | C++ | CI/CD | CUDA | Computer Vision401k match | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeRemote PA - PA PAR, United … R1d ago
-
AI Architect USD 130K-155KAI Governance | AI Search | AI architecture | API Integration | AWS AgentCoreHybrid work | Medical insurance | Paid time off | Professional development opportunities | Retirement planningSenior-level Full TimeUSA - Woburn (MA), United States1d ago
-
Senior Agentic AI Engineer USD 83K-203KArtificial Intelligence | Azure OpenAI | Cloud Computing | Code review | Data PipelinesDental insurance | Medical insurance | Paid time off | Retirement savings options | Vision insuranceSenior-level Full TimeWork At Home-Texas, United States1d ago