Research Engineer, Evaluations (Tech Leadership) - Meta Superintelligence Labs
Tasks
- Collaborate with data vendors
- Contribute evaluation tooling
- Curate and integrate benchmarks
- Develop evaluation environments
- Implement evaluation pipelines
- Mentor engineers
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Code review | Data Pipelines | Distributed Systems | Evaluation | Language Model | Language Model Evaluation | Machine Learning | Model Evaluation | Multimodal modeling | PyTorch | Python | Reinforcement Learning | Testing | Version control
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Agile | Azure Data | Azure Data Factory | CI/CD | Data FactoryHybrid work scheduleSenior-level ContractBurbank, United States1h ago
-
Data Engineer USD 114K-190KApache Iceberg | Apache Kafka | Apache Spark | ClickHouse | Data GovernanceHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-DC-Washington2h ago
-
AI Engineer USD 114K-190KAI orchestration | GPU Inference | GPU inference optimization | Inference Optimization | KubernetesDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-DC-Washington2h ago
-
API Design | C++ | CI/CD | CMake | Docker401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeNew York2h ago
-
APIs | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …4h ago
-
C++ | Code review | Compute Technologies | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Senior Software Engineer, AI/ML, AI and Infrastructure USD 174K-252KC++ | Data Processing | Data Storage | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA; Kirkland, WA, …4h ago
-
Software Engineer III, AI/ML, Google Workspace USD 147K-211KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalSenior-level Full TimeKirkland, WA, USA4h ago
-
AI Solution Engineer USD 109K-155KAPIs | AWS | Azure | Embeddings | GCP401k match | Basic life insurance | Dental insurance | Disability coverage | Medical insuranceMid-level Full TimePiscataway, NJ, US7h ago
-
Software Engineer, RL Training Infra USD 295K-445KAgent systems | Async systems | Debugging | Distributed Systems | Hardware ReliabilityMid-level Full TimeSan Francisco13h ago
-
Entry-level Full TimePalo Alto, CA, US, 9430413h ago
-
AWS | Agile | CI/CD | Code review | Distributed Systems401k match | Commuter benefits | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeSeattle, USA14h ago
-
AWS | Agile | CI/CD | Code review | Data Processing401k match | Commuter benefits | Electric Car Charging Station | Employee assistance program | Flexible spending accountsSenior-level Full TimeSeattle, USA14h ago
-
Junior Software Engineer USD 72K-110KDebugging | Problem Solving | Production Code | Python | Software ArchitectureEntry-level Full TimeUnited States or Canada14h ago
-
Robotics Software Engineer, Verification & Validation USD 191K-253KBare Metal | C++ | CANbus | CI/CD | Embedded LinuxEquity grants | Health benefits | Travel opportunityMid-level Full TimeCosta Mesa, California, United States14h ago
-
API Design | Bare Metal | C++ | Embedded Linux | GRPCHealth benefits | Recovery Benefits | Security clearance sponsorship | Travel opportunitiesSenior-level Full TimeCosta Mesa, California, United States14h ago
-
Agent systems | Automated benchmarking | Chain-of-Thought | DPO | Dataset curationMid-level Full TimePalo Alto, California, USA15h ago
-
Staff Advanced Concepts Optimization Engineer USD 130K-240KAdjoint methods | Automatic Differentiation | CasADi | Cloud Computing | Computational Fluid DynamicsSenior-level Full TimeSan Jose, California, United States16h ago
-
Researcher, Connectors - Agent Post-Training USD 250K-380KAPIs | Data Pipelines | Deep learning | Evals | ExperimentationSenior-level Full TimeSan Francisco16h ago
-
Researcher, Computer Use - Agent Post-Training USD 250K-380KAgent systems | Browser Automation | Computer use | Data Pipelines | Desktop AutomationSenior-level Full TimeSan Francisco16h ago
-
Researcher, Artifacts - Agent Post-Training USD 250K-380KData Pipelines | Evals | Evaluation | Experimentation | GradingMid-level Full TimeSan Francisco16h ago
-
Senior Machine Learning Engineer USD 198K-287KData Engineering | Fine Tuning | Foundation Models | GenAI | Incident ResponseOn-call rotationSenior-level Full TimeRemote - US R16h ago
-
Agentic AI Engineer USD 176K-265KAccess Control | Anthropic | Arize | Audit Logging | CI/CDHybrid work arrangement | On-site collaborationSenior-level Full TimeSan Francisco, CA16h ago
-
Forward-Deployed Engineer, Data Centers USD 140K-165KAPI Integration | Agent workflows | Azure | CI/CD | Deployment401k match | Dental insurance | Device purchase support | Disability insurance | Flexible spending accountsMid-level Full TimeCalifornia16h ago
-
Robotics Software Engineer, Behaviors USD 146K-194KArduPilot | Autonomy | Behavior Trees | C++ | Computer VisionMid-level Full TimeCosta Mesa, California, United States16h ago