Applied AI Researcher, Benchmarking
Tasks
- Analyze noisy empirical results
- Build prototypes
- Conduct human in the loop assessments
- Construct benchmarks
- Design evaluation frameworks
- Develop test suites
- Measure model or system performance
- Quantify emergent capability
- Run experimental evaluations
- Test adversarial robustness
- Track longitudinal performance
Perks/Benefits
- 100 percent covered health insurance
- 401k matching
- Access To State Of The Art Models
- Commuter benefits
- Dental insurance
- Equity
- In-office lunch
- Vision insurance
Skills/Tech-stack
A/B | A/B Testing | Adversarial Robustness | B testing | Deep learning | Experiment design | Human-in-the-loop | Language Processing | Machine Learning | Model Evaluation | Natural Language | Natural Language Processing | Python | Series analysis | Statistics | The Loop | Time Series | Time Series Analysis
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior AI Engineer USD 216K-277KAWS | Agent systems | Autonomous Agents | Azure | By DesignCareer development | Home workspace stipend | MacBook provided | Medical, dental, and vision insurance | Mental health benefitsSenior-level Full TimeAustin, TX R9h ago
-
Argus | Artificial Intelligence | CRM Integration | Commercial Real Estate | Data analytics401k matching | Dental insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeManhattan, NY9h ago
-
AI Engineer at Lumion USD 148K-200KAPI Design | Data Modeling | Debugging | Guardrails | Language Models401k | Health dental vision reimbursement | MacBook Pro | Relocation support | Tech stipendMid-level Full TimeSouth Jordan, UT, US, CA, US10h ago
-
AI Research Scientist- GenAI USD 165K-185KC++ | Deep learning | Foundation Models | Inference Optimization | Language ModelsMid-level Full TimePittsburgh, PA, United States10h ago
-
AI Architect - Business Applications USD 138K-225KA/B | A/B Testing | API | B testing | ExperimentationHybrid work optionSenior-level Full TimeBellevue, WA, United States11h ago
-
Director, AI Enterprise Architect USD 175K-250KAPIs | AWS | Agentic Workflows | Anomaly Detection | AzureSenior-level Full TimeUnited States12h ago
-
Principal AI Engineer, AI Solutions USD 172K-216KAPI Design | AWS | Agent Frameworks | Automation | Data PipelinesCareer Development Programs | Commuting cost coverage | Daily free lunch | Employee resource groups | Equity grantsSenior-level Full TimeBoston, Massachusetts, United States R13h ago
-
Applied AI Engineering Intern USD 60K-120KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Data VisualizationEqual opportunity employer | Hybrid work environmentEntry-level InternshipSanta Clara14h ago
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States15h ago
-
Associate AI Solutions & Programs Lead USD 90K-115KArtificial Intelligence | Budget Monitoring | Business Process | Business process improvement | Change Management401k | Dental insurance | Employee discounts | Hybrid work schedule | Medical insuranceMid-level Full TimeNew York, NEW YORK, United States R15h ago
-
AWS | Agent systems | Apache Spark | Apache Spark SQL | AzurePeriodic onsite work | Remote work option | Travel as neededSenior-level Full TimeMaryland; Virginia; Washington, D.C.15h ago
-
Lead Quantitative UX Researcher USD 150K-185KA/B | A/B Testing | B testing | Bayesian statistics | Behavioral Modeling401k match | Annual bonus | Annual performance reviews | Career development support | Company equipmentSenior-level Full TimeAtlanta, GA preferred, Remote R16h ago
-
Associate Consultant, Generative AI USD 80K-110KAWS | Azure | CI/CD | Chroma | Docker401k matching | Commuter benefits | Dental insurance | Employee assistance program | Flexible spending accountMid-level Full TimeNew York, NY, United States17h ago
-
AI Intern USD 50K-58KAccess Control | Artificial Intelligence | Cybersecurity | Data Privacy | Help deskEntry-level InternshipYork, United States18h ago
-
AI/ML Engineer USD 170K-220KBenchmarking | Cloud Computing | Containerization | Debugging | Distributed Systems401k match | Education & training benefits | Healthcare dental vision coverage | Paid Holidays | Paid time offSenior-level Full TimeRome, NY R19h ago
-
Senior-level Full TimeAustin, Texas, United States19h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …20h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …20h ago
-
Software Engineer, Systems ML - SW/HW Co-design USD 117K-173KAI infrastructure | Bias Mitigation | C# | C++ | Co-designSenior-level Full TimeSunnyvale, CA | Redmond, WA21h ago
-
Postdoctoral Researcher, AI and Systems Co-design Team USD 112K-145KAlgorithms | Compilers | Computer Architecture | Distributed Systems | Machine LearningEntry-level Full TimeMenlo Park, CA21h ago
-
Quantitative Trader USD 150K-216KAlgorithmic trading | Deep learning | Linear Models | Machine Learning | Quantitative AnalysisCollaborative work environment | Firmwide educational curriculum | Hands-on trainingMid-level Full TimeNew York, New York, United States21h ago
-
Quantitative Researcher USD 150K-200KDistributed Training | Feature Engineering | Hyperparameter Tuning | Machine Learning | PythonSenior-level Full TimeNew York, New York, United States21h ago
-
GTM Applied AI Architect, Google Cloud USD 153K-222KAgent Development | Agent Development Kit | Cloud platform | Function Calling | GeminiSenior-level Full TimeAustin, TX, USA; Boulder, CO, USA21h ago
-
Senior Staff AI Engineer USD 180K-240KA3C | Actor-critic | Adaptive computation | Benchmarks | C plus plusSenior-level Full TimeLos Altos, California,22h ago
-
Agentic AI Engineer USD 103K-158KAI Search | Agent Orchestration | Anthropic Claude | App Service | Autogen401k match | Flexible paid time off | Hybrid work flexibility | Medical/Dental/Vision | Paid parental leaveMid-level Full TimeGolden, CO, US23h ago