Senior+ Software Engineer - Research Platform, Consumer Devices
Tasks
- Author and manage evaluation tasks rubrics graders suites and rollout configurations
- Automate evaluation runs and generate reports
- Build backend services and data models for evaluation systems
- Build web applications and APIs for AI research workflows
- Create measurable scenarios and automated graders
- Diagnose issues across application code workers model endpoints and deployments
- Implement health checks observability and automated verification
- Lead migrations across research tools and supporting services
- Onboard contributors to create evaluation and synthetic data workflows
- Run human evaluation campaigns
- Support synthetic data generation workflows for multimodal and conversational research
Perks/Benefits
Skills/Tech-stack
Application Programming | Application Programming Interfaces | Backend Services | Conversational AI | Data Generation | Data Modeling | Debugging | Distributed Systems | Generative AI | Health Checks | Machine Learning | Model Evaluation | Multimodal Models | Observability | Programming interfaces | Reproducibility | Synthetic Data Generation | Synthetic data | Web Applications
Education
N/A
Roles
Developer | Engineer | Full Stack | Full Stack Developer | Software Engineer
Regions
Countries
States
Related jobs
-
Mid-level Full TimeNew York, NY, US5h ago
-
Altium Designer | BLE | Bluetooth Low Energy | C# | C++401k matching | Corporate discounts | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeLos Angeles, CA, US R6h ago
-
AI Infra Engineer USD 175K-220KAPI Integration | Anthropic API | Asynchronous collaboration | CrewAI | Dashboard Development401k | Health insurance | Parental leave | Remote work environmentMid-level Full TimeNew York8h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KAuto-labeling | Backend integration | Computer Vision | Data Pipelines | Deep learningEquity compensation | Health benefits | Onsite work scheduleSenior-level Full TimeSan Mateo, CA, United States R9h ago
-
Staff Analytics Engineer USD 136K-216KBusiness Intelligence | DBT | Data Modeling | Data Pipelines | Data QualityConnectivity stipend | Coworking stipend | Energize Fridays | Flexible PTO | Learning and developmentSenior-level Full TimeUnited States10h ago
-
Senior Embedded Software Engineer USD 139K-201KAbstraction layer | Bare Metal | Board Support | Board Support Package | BootloaderIn-office presenceSenior-level Full TimePlaya Vista, California, United States11h ago
-
Senior Software Engineer - Data Platform USD 115K-145KAWS | Apache Airflow | Apache Spark | Azure | CI/CD401k plan | Coaching therapy professional development | Flexible spending account | Flexible vacation policy | Healthcare coverageSenior-level Full TimeUnited States R11h ago
-
Agentic AI | Conversational User Interfaces | Generative AI | Language Models | Language ProcessingSenior-level Full TimeMountain View, CALIFORNIA, United States12h ago
-
Senior Machine Learning Engineer, Agentic Application USD 123K-216KAgentic AI | Generative AI | Language Models | Language Processing | Large Language ModelsFlexible work persona | Remote work flexibilitySenior-level Full TimeMountain View, California, United States12h ago
-
Staff Machine Learning Engineer, Agentic Application USD 137K-241KAgentic AI | Conversational User Interfaces | Cross-Functional Collaboration | Cross-functional | Functional collaborationSenior-level Full TimeMountain View, CALIFORNIA, United States12h ago
-
Machine Learning Engineer, Agentic Application USD 116K-192KAPI Design | Clean Code | Debugging | Distributed Systems | Generative AIEntry-level Full TimeMountain View, CALIFORNIA, United States12h ago
-
Staff Machine Learning Engineer, Agentic Application USD 137K-241KAgentic AI | Conversational UI | Cross-Functional Collaboration | Cross-functional | Functional collaborationGlobal company opportunities | Learning and development opportunities | Remote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States12h ago
-
Senior AI Engineer USD 85K-130KAPI Integration | Google Cloud | Kubernetes | LLM API | LangchainCareer growth opportunities | Company paid life insurance | Company-paid disability insurance | Dental insurance | Employee assistance programSenior-level Full TimeAustin, TX12h ago
-
Senior Data Infra Engineer USD 175K-221KAWS | Apache Flink | Apache Hadoop | Apache Kafka | Apache Spark401k match | Commuter benefits | Dental insurance | FSA | HSASenior-level Full TimeMountain View, California, United States13h ago
-
Analytics Engineer, GFCO Analytics USD 152K-179KApache Airflow | Business Intelligence | DBT | Data Governance | Data ModelingQuarterly in person working sessions | Remote-first work environmentMid-level Full TimeRemote - USA R13h ago
-
Member of Technical Staff (AI Software Engineer, Agents) USD 220K-405KAI Evaluation | Browser Technology | Chrome DevTools | Chrome DevTools Protocol | Code QualitySenior-level Full TimeSan Francisco13h ago
-
Staff Compute & Storage Capacity Planner USD 195K-235KAutomation | Block Storage | CPU Benchmarking | Capacity Planning | Cloud infrastructureSenior-level Full TimeSan Francisco, CA - US14h ago
-
Machine Learning Engineer USD 128K-260KArtificial Intelligence | Cache optimization | Inference | KV cache | KV cache optimizationSenior-level Full TimeSanta Clara, California, United States14h ago
-
Senior Data Engineer, People Analytics USD 179K-210KAWS | Access Control | Airflow | Airtable | Audit LoggingSenior-level Full TimeUnited States14h ago
-
Data Scientist / ML Engineer USD 170K-210KAWS | Azure | Bias Evaluation | Cloud Computing | Cloud platformFlexible working hours | Remote workSenior-level Full TimeNew York, NY, US, Remote R14h ago
-
Senior-level Full TimeBeverly Hills, California, United States14h ago
-
Staff Data Scientist (AI/ML) USD 174K-278KAWS | Agile | Azure | BigQuery | Causal InferenceDental insurance | Flexible work options | Hybrid work schedule | Medical insuranceSenior-level Full TimeUS - Boston, MA ; US …14h ago
-
Autonomy | C++ | Code Quality | Debugging | LinuxSenior-level Full TimeIrvine, CA15h ago
-
Software Engineer, Data Engineering USD 153K-196KC# | C++ | Data Quality | Data pipeline | ETLCross-functional collaboration | Mentorship | OwnershipEntry-level Full TimeSan Mateo, CA, United States R15h ago
-
Software Engineer 2 USD 85K-132KBusiness Intelligence | Data Catalog | Data Flow | Data Flow Diagrams | Data GovernanceMid-level Full TimeSan Antonio15h ago