Research Engineer - MSL FAIR Foundations
Menlo Park, CA | Seattle, WA | New York, NY
USD 141K-208K (estimate) Mid-level Full Time
Tasks
- Build reusable evaluation pipelines
- Collaborate with data vendors for evaluation datasets
- Curate and integrate benchmarks for frontier model development
- Develop and implement evaluation environments
- Develop evaluation tooling for quality and reliability
- Execute benchmark implementation for research scientists
- Implement benchmark and evaluation suites at scale
Perks/Benefits
- N/A
Skills/Tech-stack
Audio Processing | Benchmarking | Code review | Data Pipelines | Deep learning | Distributed Systems | Evaluation metrics | Language Modeling | Language Processing | Machine Learning | Multimodal Learning | Natural Language | Natural Language Processing | PyTorch | Python | Reinforcement Learning | Testing | Version control | Vision-language | Vision-language modeling
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesExecutive-level Full TimeWashington, District of Columbia, 20004, United … R2h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 155K-306KAirflow | CI/CD | DBT | Data Modeling | DatabricksMentorship | Professional development | Travel for client workSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …3h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI | AWS | Agent Bricks | Airflow | Apache SparkSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …3h ago
-
Entry-level Full TimeArlington/Rosslyn, Virginia, United States3h ago
-
Databricks Senior Consultant USD 124K-207KAWS | Azure | Business Intelligence | Cloud Computing | Cloud platformSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …3h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 155K-265K.NET | AWS | Agile | Angular | AzureMentorship opportunities | Professional development | Travel reimbursementSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …3h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-170KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States3h ago
-
Azure Databricks Developer USD 126K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States3h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 155K-265K.NET | AWS | Agile | Angular | AzureMentorship | Professional development | Travel opportunitiesSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …3h ago
-
Generative AI Engineer III - Federal Health USD 110K-218KArtificial Intelligence | Data Engineering | Data Pipelines | Data Validation | DockerMentorship opportunities | Professional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States3h ago
-
Senior Forward Deployed Engineer, GenAI, YouTube USD 155K-225KAgent systems | C++ | CRM Integration | Developer Operations | Distributed SystemsSenior-level Full TimeSan Bruno, CA, USA; Chicago, IL, …4h ago
-
Software Engineer, Applied AI USD 147K-211KArtificial Intelligence | Continuous Deployment | Continuous integration | Data Processing | DebuggingMid-level Full TimeSunnyvale, CA, USA4h ago
-
APIs | Access Management | C++ | Cloud infrastructure | Code reviewSenior-level Full TimeNew York, NY, USA; Chicago, IL, …4h ago
-
Staff Software Engineer, AI/ML Storage Infrastructure USD 207K-301KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | Large-scaleSenior-level Full TimeSan Jose, CA, USA4h ago
-
Compute Technologies | Data Structures | Data structures algorithms | Distributed Systems | Hardware ArchitectureSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Senior Software Engineer, AI/ML, AI and Infrastructure USD 174K-253KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA4h ago
-
Software Engineer III, AI/ML, Core USD 147K-211KAlgorithms | Data Processing | Data Structures | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA4h ago
-
C++ | Data Structures | Data Structures and Algorithms | Distributed Systems | Generative AISenior-level Full TimeKirkland, WA, USA4h ago
-
Software Engineer III, AI/ML, Google Cloud AI USD 147K-211KC++ | Data Processing | Debugging | Language Processing | Machine LearningSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA4h ago
-
Mid-level Full TimeNew York, NY, US8h ago
-
AI Infra Engineer USD 175K-220KAPI Integration | Anthropic API | Asynchronous collaboration | CrewAI | Dashboard Development401k | Health insurance | Parental leave | Remote work environmentMid-level Full TimeNew York11h ago
-
Business Data Engineer USD 140K-170KAPIs | AWS | Data Automation | Data Ingestion | Data PipelinesFlexible working hours | Vacation policyMid-level Full TimeSan Jose, California or Remote R12h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KAuto-labeling | Backend integration | Computer Vision | Data Pipelines | Deep learningEquity compensation | Health benefits | Onsite work scheduleSenior-level Full TimeSan Mateo, CA, United States R12h ago
-
Staff Analytics Engineer USD 136K-216KBusiness Intelligence | DBT | Data Modeling | Data Pipelines | Data QualityConnectivity stipend | Coworking stipend | Energize Fridays | Flexible PTO | Learning and developmentSenior-level Full TimeUnited States13h ago
-
Senior Embedded Software Engineer USD 139K-201KAbstraction layer | Bare Metal | Board Support | Board Support Package | BootloaderIn-office presenceSenior-level Full TimePlaya Vista, California, United States14h ago