Research Engineering Manager, Evaluations, Meta Superintelligence Labs
Tasks
- Align evaluation priorities with organizational goals
- Build mentor and grow evaluation engineering team
- Build reusable evaluation pipelines
- Communicate progress challenges and decisions
- Conduct performance reviews and career development
- Contribute hands-on to evaluation projects
- Curate and integrate benchmarks
- Define evaluation infrastructure roadmap
- Develop evaluation environments
- Develop evaluation tooling for quality and reliability
- Follow version control testing code review system design
- Lead evaluations team
- Provide technical mentorship
- Review code and unblock technical issues
- Set engineering standards and best practices
- Source and prepare evaluation datasets
- Translate research vision into engineering plans
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Code review | Data Pipelines | Distributed Systems | Evaluation Frameworks | Machine Learning | PyTorch | Python | Reinforcement Learning | System design | Testing | Version control
Education
Regions
Countries
States
Cities
Related jobs
-
AI strategy | Client Relationship Management | Client relationship | Data Engineering | Generative AIGlobal flexibility | Travel requiredExecutive-level Full TimeRedmond, United States3h ago
-
Data Engineering | Dataset Management | Language Models | Large Language Models | Machine LearningMid-level Full TimeSan Jose, California, United States4h ago
-
Code review | Data Deduplication | Data Generation | Data Pipelines | Data ProcessingMid-level Full TimeMenlo Park, CA4h ago
-
Data Engineering Manager USD 223K-235KBusiness Intelligence | Data ETL | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeMenlo Park, CA5h ago
-
Data Engineering Manager USD 233K-279KDashboard Development | Data Architecture | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeBurlingame, CA5h ago
-
Agile | BigQuery | Business Intelligence | Cloud platform | Data PipelinesMid-level Full TimeMountain View, CA, USA5h ago
-
Data Engineering Manager, AIM, Enterprise Platform USD 186K-270KAttribution | Causal Inference | Dashboarding | Data Analysis | Data EngineeringSenior-level Full TimeMountain View, CA, USA5h ago
-
Engineering Manager, BigQuery Engine USD 207K-300KC# | C++ | Distributed Computing | Distributed Systems | JavaSenior-level Full TimeKirkland, WA, USA5h ago
-
Senior Data Cloud Blackbelt Manager, Data and AI USD 234K-325KAI/ML | AI/ML workflows | Agentic Frameworks | BigQuery | Cloud ArchitectureSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Product Owner - Data & Analytics USD 44K-58KAcceptance criteria | Agile | Amazon Redshift | Business Intelligence | Cloud DataDental benefits | Disability benefits | Health and wellness programs | Inclusive culture | Medical benefitsMid-level Full TimeAtlanta, GA, US, 303469h ago
-
Sr Mgr, AI/ML Software Engineering USD 177K-266KArtificial Intelligence | Cloud Computing | Data Pipelines | Data platform | Lifecycle ManagementSenior-level Full Time#, CA, US, # R10h ago
-
Alteryx | Apache Hadoop | Apache Hive | Apache Spark | Data QueryingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeNew York, NY, United States13h ago
-
Product Manager - Data & Analytics USD 110K-145KAWS | Agile Scrum | Analytics | Azure | Business Intelligence401k | Dental insurance | Discounts | Medical insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States18h ago
-
Advanced Analytics | Claims Analysis | Data Analysis | Data Manipulation | Data Modeling401k | Dental insurance | Medical insurance | Paid time off | Short Term Incentive ProgramMid-level Full TimeMettawa, IL, United States19h ago
-
Senior Manager Fraud Strategy and Trend Analytics USD 135K-225KAgile | Authentication | Behavioral analytics | Behavioral biometrics | Case managementSenior-level Full TimeGlen Allen, Virginia, United States20h ago
-
Manager, Compensation And Analytics USD 88K-110KADP | Analytics | Audit management | Benchmarking | Bonus Administration401k company match | Dental insurance | Free Health Plan Option | Gym membership reimbursement | Paid HolidaysMid-level Full TimeDeerfield Beach, FL, United States20h ago
-
Technical SETA, AI/ML - DSO USD 60K-97KKnowledge graphs | Knowledge representation | Language Models | Language Processing | Large Language ModelsDoD Secret clearance sponsorshipEntry-level Full TimeArlington, VA, United States23h ago
-
Artificial Intelligence | Cloud Computing | Data Catalog | Data Classification | Data GovernanceBackup childcare | Financial coaching | Health care coverage | Mental health support | On Site Health Wellness CentersSenior-level Full TimeNew York, NY, United States1d ago
-
Manager - Data Science - Finance USD 103K-174KAgentic technologies | Artificial Intelligence | Cross-Functional Collaboration | Cross-functional | Financial AnalysisCareer development and training | Comprehensive health insurance | Employee counseling support | Free financial coaching | Hybrid work modelMid-level Full TimeUS-New York-New York1d ago
-
Manager - Adv Business Analytics - CX USD 110K-180KClustering | DBT | Data Governance | Data Modeling | Data Quality401k matching | Caregiver leave | Discount programs | Employee assistance program | Paid HolidaysMid-level Full Time500 Woodward Avenue, MI, 601 S. … R1d ago
-
Software Engineer Manager II, Health Database USD 207K-300KCode review | Compute Technologies | Database Design | Database Migration | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Artificial Intelligence | Artificial Intelligence Strategy | Cross-functional | Cross-functional leadership | Cycle managementSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1d ago
-
Senior product Manager, AI/ML, Google Global Network USD 192K-278KAs A Service Ordering Systems | As-a-Service | Bandwidth Management | Content Delivery Network | Content deliverySenior-level Full TimeThornton, CO, USA; Addison, TX, USA1d ago
-
Tech Lead Manager, Web Platform and Features, NotebookLM USD 262K-365KAI tools | AI workflows | C++ | CSS | Client-ServerSenior-level Full TimeMountain View, CA, USA1d ago
-
Engineering Manager, BigQuery BeyondSQL USD 207K-300KC# | C++ | Control Plane | Data Warehousing | Distributed SystemsSenior-level Full TimeKirkland, WA, USA1d ago