Senior+ Software Engineer - Research Platform, Consumer Devices
Tasks
- Author and manage evaluation tasks rubrics graders suites and rollout configurations
- Automate evaluation runs and generate reports
- Build backend services and data models for evaluation systems
- Build web applications and APIs for AI research workflows
- Create measurable scenarios and automated graders
- Diagnose issues across application code workers model endpoints and deployments
- Implement health checks observability and automated verification
- Lead migrations across research tools and supporting services
- Onboard contributors to create evaluation and synthetic data workflows
- Run human evaluation campaigns
- Support synthetic data generation workflows for multimodal and conversational research
Perks/Benefits
Skills/Tech-stack
Application Programming | Application Programming Interfaces | Backend Services | Conversational AI | Data Generation | Data Modeling | Debugging | Distributed Systems | Generative AI | Health Checks | Machine Learning | Model Evaluation | Multimodal Models | Observability | Programming interfaces | Reproducibility | Synthetic Data Generation | Synthetic data | Web Applications
Education
N/A
Roles
Developer | Engineer | Full Stack | Full Stack Developer | Software Engineer
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R5h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States11h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA11h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States12h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States12h ago
-
Director, Foundation Model Data Recipes USD 349K-431KBayesian Inference | Data Clustering | Data Filtering | Data Mining | Data PreprocessingBonus | Equity incentive plan | Health insuranceExecutive-level Full TimeMountain View, CA. USA; San Francisco, …13h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA13h ago
-
Senior Robotics Software Engineer USD 113K-151K3D simulation | AI | API Development | Agile | C++In-person office work | Lab workSenior-level Full TimeAustin, Texas, United States14h ago
-
Senior Firmware Engineer, Space Embedded Systems USD 191K-253KARM | Analog Sensors | Bare Metal | Best practices | Board Bring-upSenior-level Full TimeCosta Mesa, California, United States14h ago
-
API Design | Alerting | Data Modeling | Entitlement checks | Low LatencyHybrid work cultureSenior-level Full TimeHQ-San Francisco14h ago
-
API Design | Data Modeling | Low Latency | Low-Latency Systems | Rate LimitingHybrid work culture | In person meeting once per quarterSenior-level Full TimeHQ-San Francisco14h ago
-
API Design | Alerting | Data Modeling | Entitlement checks | Low LatencyHybrid work culture | In person once per quarter for remote rolesSenior-level Full TimeHQ-San Francisco14h ago
-
AI/ML Engineer USD 91K-184KAutomated Machine Learning | Continuous Deployment | Continuous integration | Data Pipelines | MLOpsMid-level Full TimeArlington, VA14h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA14h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R14h ago
-
Machine Learning Engineer - Vision USD 160K-250KActive Learning | Annotation tools | CAD/CAM | Computer Vision | Image Segmentation401k | Dental insurance | Equity | Flexible vacation | Health insuranceSenior-level Full TimeLos Angeles, CA15h ago
-
Machine Learning Engineer - Multimodal USD 160K-250KActive Learning | Computer Vision | Data Augmentation | Data loaders | Evaluation Frameworks401k | Equity | Flexible vacation policy | Medical/dental/vision/life insurance | Relocation supportSenior-level Full TimeLos Angeles, CA15h ago
-
Machine Learning Engineer - LLMs USD 160K-250KActive Learning | DPO | Data Augmentation | Data loaders | Document Classification401k | Equity | Flexible vacation policy | Medical/dental/vision/life insurance | Relocation supportSenior-level Full TimeLos Angeles, CA15h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA15h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R15h ago
-
AI | Application Programming | Application Programming Interfaces | Backend Development | Cloud ComputingFlexible-hybrid work | Hybrid schedule 3 days on site per weekSenior-level Full TimeSan Francisco, CA15h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas16h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R16h ago