Research Engineering Manager, Evaluations, Meta Superintelligence Labs
Tasks
- Align evaluation priorities with organizational goals
- Build mentor and grow evaluation engineering team
- Build reusable evaluation pipelines
- Communicate progress challenges and decisions
- Conduct performance reviews and career development
- Contribute hands-on to evaluation projects
- Curate and integrate benchmarks
- Define evaluation infrastructure roadmap
- Develop evaluation environments
- Develop evaluation tooling for quality and reliability
- Follow version control testing code review system design
- Lead evaluations team
- Provide technical mentorship
- Review code and unblock technical issues
- Set engineering standards and best practices
- Source and prepare evaluation datasets
- Translate research vision into engineering plans
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Code review | Data Pipelines | Distributed Systems | Evaluation Frameworks | Machine Learning | PyTorch | Python | Reinforcement Learning | System design | Testing | Version control
Education
Regions
Countries
States
Cities
Related jobs
-
Code review | Data Deduplication | Data Generation | Data Pipelines | Data ProcessingMid-level Full TimeMenlo Park, CA3h ago
-
Data Engineering Manager USD 223K-235KBusiness Intelligence | Data ETL | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeMenlo Park, CA3h ago
-
Data Engineering Manager USD 233K-279KDashboard Development | Data Architecture | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeBurlingame, CA3h ago
-
Agile | BigQuery | Business Intelligence | Cloud platform | Data PipelinesMid-level Full TimeMountain View, CA, USA3h ago
-
Data Engineering Manager, AIM, Enterprise Platform USD 186K-270KAttribution | Causal Inference | Dashboarding | Data Analysis | Data EngineeringSenior-level Full TimeMountain View, CA, USA3h ago
-
Engineering Manager, BigQuery Engine USD 207K-300KC# | C++ | Distributed Computing | Distributed Systems | JavaSenior-level Full TimeKirkland, WA, USA3h ago
-
Senior Data Cloud Blackbelt Manager, Data and AI USD 234K-325KAI/ML | AI/ML workflows | Agentic Frameworks | BigQuery | Cloud ArchitectureSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Product Owner - Data & Analytics USD 44K-58KAcceptance criteria | Agile | Amazon Redshift | Business Intelligence | Cloud DataDental benefits | Disability benefits | Health and wellness programs | Inclusive culture | Medical benefitsMid-level Full TimeAtlanta, GA, US, 303467h ago
-
Sr Mgr, AI/ML Software Engineering USD 177K-266KArtificial Intelligence | Cloud Computing | Data Pipelines | Data platform | Lifecycle ManagementSenior-level Full Time#, CA, US, # R8h ago
-
Product Manager - Data & Analytics USD 110K-145KAWS | Agile Scrum | Analytics | Azure | Business Intelligence401k | Dental insurance | Discounts | Medical insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States17h ago
-
Advanced Analytics | Claims Analysis | Data Analysis | Data Manipulation | Data Modeling401k | Dental insurance | Medical insurance | Paid time off | Short Term Incentive ProgramMid-level Full TimeMettawa, IL, United States17h ago
-
Senior Manager Fraud Strategy and Trend Analytics USD 135K-225KAgile | Authentication | Behavioral analytics | Behavioral biometrics | Case managementSenior-level Full TimeGlen Allen, Virginia, United States18h ago
-
Technical SETA, AI/ML - DSO USD 60K-97KKnowledge graphs | Knowledge representation | Language Models | Language Processing | Large Language ModelsDoD Secret clearance sponsorshipEntry-level Full TimeArlington, VA, United States22h ago
-
Manager - Data Science - Finance USD 103K-174KAgentic technologies | Artificial Intelligence | Cross-Functional Collaboration | Cross-functional | Financial AnalysisCareer development and training | Comprehensive health insurance | Employee counseling support | Free financial coaching | Hybrid work modelMid-level Full TimeUS-New York-New York1d ago
-
Manager - Adv Business Analytics - CX USD 110K-180KClustering | DBT | Data Governance | Data Modeling | Data Quality401k matching | Caregiver leave | Discount programs | Employee assistance program | Paid HolidaysMid-level Full Time500 Woodward Avenue, MI, 601 S. … R1d ago
-
Software Engineer Manager II, Health Database USD 207K-300KCode review | Compute Technologies | Database Design | Database Migration | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Artificial Intelligence | Artificial Intelligence Strategy | Cross-functional | Cross-functional leadership | Cycle managementSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1d ago
-
Senior product Manager, AI/ML, Google Global Network USD 192K-278KAs A Service Ordering Systems | As-a-Service | Bandwidth Management | Content Delivery Network | Content deliverySenior-level Full TimeThornton, CO, USA; Addison, TX, USA1d ago
-
Tech Lead Manager, Web Platform and Features, NotebookLM USD 262K-365KAI tools | AI workflows | C++ | CSS | Client-ServerSenior-level Full TimeMountain View, CA, USA1d ago
-
Engineering Manager, BigQuery BeyondSQL USD 207K-300KC# | C++ | Control Plane | Data Warehousing | Distributed SystemsSenior-level Full TimeKirkland, WA, USA1d ago
-
AI Governance | AI Product Development | AI strategy | Artificial Intelligence | AutomationAnnual incentive compensation | Dental insurance | Medical insurance | Professional development opportunities | Vision insuranceSenior-level Full TimeMaine R1d ago
-
Associate Director, Media Analytics USD 125K-150KAd Serving | Agile | Attribution | Cloud platform | DataOps401k with company contribution | Career growth | Generous PTO | Medical, dental, and vision insurance | Paid HolidaysMid-level Full TimeDenver1d ago
-
Architecture | Automated testing | CI/CD | Cloud infrastructure | Code review401k match | Anniversary gift | Company holiday | Flexible working model | International career developmentSenior-level Full TimeColorado R1d ago
-
Ablation Studies | Artificial Intelligence | Benchmarking | Computer Science | Edge ComputingSenior-level Full TimeBoston, MA1d ago
-
Senior Applied AI Manager USD 170K-234KAgent systems | Agentic Systems | Curriculum learning | Data Deduplication | Data mixingSenior-level Full TimeSan Mateo, CA1d ago