Research Engineering Manager, Evaluations, Meta Superintelligence Labs
Tasks
- Align evaluation priorities with organizational goals
- Build mentor and grow research engineering team
- Build reusable evaluation pipelines
- Communicate progress, challenges, and decisions to leadership
- Conduct performance reviews and career development
- Curate integrate benchmarks for model development
- Develop evaluation tooling for quality and reliability
- Establish evaluation dataset partnerships
- Follow software engineering practices version control testing code review system design
- Influence evaluation infrastructure roadmap
- Maintain hands-on technical contributions
- Oversee evaluation environment development
- Provide technical mentorship and guidance
- Review code and unblock complex technical issues
- Set engineering standards and best practices
- Translate research vision into engineering plans
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Code review | Data Pipelines | Distributed Systems | Evaluation Frameworks | Evaluation metrics | Machine Learning | PyTorch | Python | Reinforcement Learning | System design | Testing | Version control
Education
Regions
Countries
States
Cities
Related jobs
-
Robotics Program Manager, Product Data Operations USD 134K-202KBash | Data Curation | Data Quality | Data Quality Management | Data pipelineOnsite workMid-level Full TimeBurlingame, CA5h ago
-
Partner Engineering GenAI - US USD 133K-203KAPIs | Artificial Intelligence | C plus plus | Claude | Cloud ComputingSenior-level Full TimeMenlo Park, CA | Seattle, WA …5h ago
-
Technical Program Manager, Office of the CEO USD 167K-230KAI product lifecycle | AWS | Agile | Azure | Cloud PlatformsMid-level Full TimeMenlo Park, CA5h ago
-
Code review | Data Deduplication | Data Pipelines | Data Processing | Data QualityMid-level Full TimeMenlo Park, CA5h ago
-
Research Data Program Manager, MSL USD 122K-196KAnnotation tooling | Data Operations | Data Quality | Data labeling | EvaluationsMid-level Full TimeMenlo Park, CA5h ago
-
Research Data Program Manager USD 143K-202KAnnotation tooling | Data Annotation | Data Quality | Data labeling | Language ProcessingMid-level Full TimeMenlo Park, CA5h ago
-
Access Management | Agentic AI | C++ | Cloud Computing | Cloud platformSenior-level Full TimeSan Francisco, CA, USA5h ago
-
Artificial Intelligence | Communication | English | Machine Learning | MarketingCoaching | Community access | Funding support | Team building support | Weekly founder sparringExecutive-level ContractPhiladelphia, United States R8h ago
-
IT Manager, Data & Analytics USD 170KAI machine learning | Automation | Azure | Azure Data | Azure Data FactorySenior-level Full TimeMilwaukee, WI, US, 53204-29418h ago
-
Gross To Net Data and Analytics Manager USD 99K-184KAudit Readiness | Chargebacks | Data Modeling | Data Pipelines | ETL401k savings plan | Dental insurance | Disability insurance | Employee assistance program | Flexible vacationMid-level Full TimePlainsboro, NJ, US8h ago
-
Principal AI Engineer - Core Platform USD 250K-290KAWS | Agents SDK | Anomaly Detection | Automated testing | Classification401k match | Company-provided phone | Health insurance | Hybrid work | PTOSenior-level Full TimeNew York, New York, United States12h ago
-
Analytics Solutions Manager USD 175K-201KAWS | Alteryx | Apache Hive | Automation | Big DataBackup childcare | Financial coaching | Health care coverage | Mental health support | Retirement savings planMid-level Full TimeWilmington, DE, United States13h ago
-
VP AI Engineering USD 190K-288KAWS | Apache Airflow | Azure | Azure ML | CI/CDComprehensive wellness program | Global travel health insurance | Life and disability insurance | Medical/dental/vision/life insurance | Paid HolidaysExecutive-level Full TimeUnited States15h ago
-
Sr. Project Manager, AI USD 150K-220KAgent Orchestration | Artificial Intelligence | Compliance | Data Flow | Data flow designHybrid work | Professional growth | Work-life balanceSenior-level Full TimeRemote, US R16h ago
-
Senior AI Solutions Builder, People USD 134K-192KAgent Development | Artificial Intelligence | Automation | Coding | Data GovernanceSenior-level Full TimeRemote, United States R17h ago
-
Marketing Analytics Automation & Enablement Manager USD 106K-156KAdobe Target | BigQuery | Business Intelligence | CDP | CTEGenerous time off | Health care insurance | Paid parental leave | Paid personal time off | Paid sick timeMid-level Full TimeRemote - US R17h ago
-
Manager, Forward Deployed Engineering USD 220K-320KAPI | Benchmarking | Data Engineering | Data Pipelines | Data ValidationSenior-level Full TimeNew York City, NY (Hybrid); Redwood … R17h ago
-
A/B | A/B Testing | Adobe Analytics | Amplitude | B testing401k match | Dental insurance | Discounts and perks | Medical insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States18h ago
-
Backtesting | Executive Communication | KPI Development | LLM Applications | Language ModelsBackup childcare | Financial coaching | Health care coverage | Mental health support | Onsite health and wellness centersSenior-level Full TimeJersey City, NJ, United States18h ago
-
Cross-Functional Collaboration | Cross-functional | Functional collaboration | Generative AI | MLOpsDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R18h ago
-
Manager, Solutions Engineering USD 280K-345KCloud Architecture | Generative AI | JavaScript | Machine Learning | Network ArchitectureHybrid work relocation assistanceSenior-level Full TimeSan Francisco19h ago
-
VP, AI Program Lead USD 130K-163KArtificial Intelligence | Audit Readiness | Data Governance | Data Management | Ethical AI401k match | Hybrid work | Paid subscriptions | Paid time off | Remote workSenior-level Full TimeChevy Chase, MD21h ago
-
Lead Data Engineer USD 125K-150KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon EMR401k matching | ADandD insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeFort Lauderdale, FL, United States22h ago
-
Manager, Business Intelligence USD 120K-140K.NET | Amazon Web Services | C Sharp | Data Dictionary | Data GovernanceMid-level Full TimeFort Lauderdale, FL, United States22h ago
-
Product Manager - Data Platform USD 143K-214KAI machine learning | Analytics | Cross-Functional Collaboration | Cross-functional | Data EngineeringDental insurance | Employee discounts | Matching 401k | Medical insurance | Paid time offMid-level Full TimeUnited States, San Mateo, CA23h ago