Research Operations, Code
Tasks
- Balance quality throughput and cost
- Decompose frontier model capabilities
- Deliver clear consistent reporting
- Design human expert synthetic and hybrid pipelines
- Design labeling and evaluation flows
- Design task designs difficulty targets and quality specs
- Diagnose bottlenecks and restructure workflows
- Evaluate model outputs and benchmark performance
- Implement incentive systems and workflow re sequencing
- Manage end-to-end data pipelines
- Perform loss analysis to identify data improvements
- Prototype data generation and validation approaches
- Run daily internal syncs
- Serve as primary customer point of contact
- Source vet train and performance manage domain experts
Perks/Benefits
- Dental insurance
- Equity grant
- Free fitness membership
- Health insurance
- Housing bonus
- Laundry reimbursement
- Meals stipend
- Performance bonus
- Relocation bonus
- Vision insurance
- Wellness reimbursement
Skills/Tech-stack
Data pipeline | Experiment design | LLM | Language Processing | Machine Learning | Model Benchmarking | Natural Language | Natural Language Processing | Python | Quality Assurance | Synthetic data | Workflow automation
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R26d ago
-
AI Engineer USD 113K-180KAngular | Apache Kafka | CI/CD | Context Management | DevOps401k matching | Charitable matching | Community outreach groups | Flexible paid time off | Life insuranceMid-level Full TimeLeawood, KS, US R7h ago
-
Senior Data Science Engineer USD 116K-198KApache Airflow | CI/CD | DBT | Databricks | Databricks AutoloaderFlexible work optionsSenior-level Full TimeRemote (United States) R12h ago
-
Senior Embedded Software Engineer - Future Forward USD 134K-201KAuthentication | C# | C++ | CAN | CUDASenior-level Full TimeSunnyvale, CA, United States R15h ago
-
Senior SoC Power Analysis & Optimization Engineer USD 120K-600KAI workload | AI workload characterization | ASIC | Clock gating | Gate Level Analysis401k match | Company holidays | Flexible spending accounts | Health, dental, vision, and life insurance | Home tech setup reimbursementSenior-level Full TimeMountain View, CA R15h ago
-
Senior AI Engineer (m/f/d) USD 100K-140K.NET | AI Search | AIOps | API Integration | AWS100 percent salary during sick leave | 4 weeks remote work per year | Childcare support | Coursera access | Experience daysSenior-level Full TimeMadrid, MD, Spain R20h ago
-
Sr. Forward Deployed Engineer-Retail USD 182K-250KAI APIs | AWS | Apache Spark | Artificial Intelligence | AzureCustomer site travelSenior-level Full TimeRemote - California R20h ago
-
Data Engineer USD 105K-140KAPIs | AWS | Apache Airflow | Apache Iceberg | Apache Kafka401k plan with company match | Annual bonus | Company equipment provided | Company events and team outings | Company medical dental and vision plansMid-level Full TimeAtlanta, GA preferred, Remote R21h ago
-
Behavioral Data | Data Pipelines | Data Quality | Distributed Systems | Evaluation metricsGlobal annual leave policy | In-person onboarding | Remote work | Restricted stock units (RSUs)Senior-level Full TimeUnited States (Remote) R22h ago
-
AI Governance | AI platforms | API Integration | Agentic Systems | ComplianceEnglish classes | Paid time off | Performance coaching | Remote work | Training and developmentMid-level Full TimeRemote R1d ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Integration | Automation | Backend Development | Customer IntegrationDirect impact on company growth | Equity | Fast-moving startup environment | Hybrid work environment | Significant ownershipMid-level Full TimeKing of Prussia, PA, United States R1d ago
-
Computational Biology MLOps Engineer USD 125K-189KAWS | Alerting | CI/CD | Checkpointing | Cloud platformOnsite work three days per weekMid-level Full TimeSan Diego, CA / Indianapolis, IN … R1d ago
-
Software Engineer, AI Developer Experience USD 171K-190KAI | CLI Integration | Cloud Computing | Code review | Evaluation FrameworksCareer coaching and support | In-office culinary options | Inclusive family building benefits | Mental health wellness and fitness benefits | Retirement savings plansSenior-level Full TimeNew York City R1d ago
-
Artificial Intelligence | Automation | LLM integrations | Langchain | Language ModelsContractor | Fully remoteSenior-level ContractLos Angeles R1d ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R1d ago
-
Sr Data Engineer USD 91K-163KAI/ML | Azure DevOps | CI/CD | Code review | Data Compliance401k contribution | Career development opportunities | Comprehensive benefits | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior AI/ML Engineer - Remote (Central Time Zone) USD 91K-163KAWS App Runner | AWS AppSync | AWS Bedrock | AWS Lambda | Agents SDK401k contribution | Benefits package | Equity stock purchase | Incentive and recognition programs | Remote workSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior Applied AI Engineer USD 125K-230KAI Chatbot Development | AI chatbot | API Development | AWS | Amazon ConnectRemote work flexibilitySenior-level Full TimeAppliance Park KY US, United States R1d ago
-
API | Acoustic Echo Cancellation | Automated testing | Beamforming | BehaviorTree.CPPAnnual bonus | Dental insurance | Disability insurance | Equity awards | Health insuranceSenior-level Full TimeRemote - USA, United States R1d ago
-
Staff Data Engineer USD 227K-300KApache Airflow | Apache Kafka | Cloud platform | Data Modeling | Data WarehousingFinancial security support | Healthcare coverage | Hybrid work model | Mental health resources | Paid time offSenior-level Full TimeUSA - California - San Jose … R1d ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R1d ago
-
Senior Data Engineer USD 126K-180KAmazon Kinesis | Apache Airflow | Apache Beam | Apache Flink | Apache Spark401k match | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R1d ago
-
Senior Analytics Engineer USD 126K-180KAutomation | BI reporting | DBT | Data Modeling | Data Quality401k with company matching | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R1d ago