Research Engineering Manager, Evaluations, Meta Superintelligence Labs
Tasks
- Align evaluation priorities with organizational goals
- Build mentor and grow research engineering team
- Build reusable evaluation pipelines
- Communicate progress, challenges, and decisions to leadership
- Conduct performance reviews and career development
- Curate integrate benchmarks for model development
- Develop evaluation tooling for quality and reliability
- Establish evaluation dataset partnerships
- Follow software engineering practices version control testing code review system design
- Influence evaluation infrastructure roadmap
- Maintain hands-on technical contributions
- Oversee evaluation environment development
- Provide technical mentorship and guidance
- Review code and unblock complex technical issues
- Set engineering standards and best practices
- Translate research vision into engineering plans
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Code review | Data Pipelines | Distributed Systems | Evaluation Frameworks | Evaluation metrics | Machine Learning | PyTorch | Python | Reinforcement Learning | System design | Testing | Version control
Education
Regions
Countries
States
Cities
Related jobs
-
Robotics Program Manager, Product Data Operations USD 134K-202KBash | Data Curation | Data Quality | Data Quality Management | Data pipelineOnsite workMid-level Full TimeBurlingame, CA3h ago
-
Partner Engineering GenAI - US USD 133K-203KAPIs | Artificial Intelligence | C plus plus | Claude | Cloud ComputingSenior-level Full TimeMenlo Park, CA | Seattle, WA …3h ago
-
Technical Program Manager, Office of the CEO USD 167K-230KAI product lifecycle | AWS | Agile | Azure | Cloud PlatformsMid-level Full TimeMenlo Park, CA3h ago
-
Code review | Data Deduplication | Data Pipelines | Data Processing | Data QualityMid-level Full TimeMenlo Park, CA3h ago
-
Research Data Program Manager, MSL USD 122K-196KAnnotation tooling | Data Operations | Data Quality | Data labeling | EvaluationsMid-level Full TimeMenlo Park, CA3h ago
-
Research Data Program Manager USD 143K-202KAnnotation tooling | Data Annotation | Data Quality | Data labeling | Language ProcessingMid-level Full TimeMenlo Park, CA3h ago
-
Access Management | Agentic AI | C++ | Cloud Computing | Cloud platformSenior-level Full TimeSan Francisco, CA, USA4h ago
-
Artificial Intelligence | Communication | English | Machine Learning | MarketingCoaching | Community access | Funding support | Team building support | Weekly founder sparringExecutive-level ContractPhiladelphia, United States R6h ago
-
IT Manager, Data & Analytics USD 170KAI machine learning | Automation | Azure | Azure Data | Azure Data FactorySenior-level Full TimeMilwaukee, WI, US, 53204-29416h ago
-
Gross To Net Data and Analytics Manager USD 99K-184KAudit Readiness | Chargebacks | Data Modeling | Data Pipelines | ETL401k savings plan | Dental insurance | Disability insurance | Employee assistance program | Flexible vacationMid-level Full TimePlainsboro, NJ, US7h ago
-
Principal AI Engineer - Core Platform USD 250K-290KAWS | Agents SDK | Anomaly Detection | Automated testing | Classification401k match | Company-provided phone | Health insurance | Hybrid work | PTOSenior-level Full TimeNew York, New York, United States10h ago
-
VP AI Engineering USD 190K-288KAWS | Apache Airflow | Azure | Azure ML | CI/CDComprehensive wellness program | Global travel health insurance | Life and disability insurance | Medical/dental/vision/life insurance | Paid HolidaysExecutive-level Full TimeUnited States13h ago
-
Sr. Project Manager, AI USD 150K-220KAgent Orchestration | Artificial Intelligence | Compliance | Data Flow | Data flow designHybrid work | Professional growth | Work-life balanceSenior-level Full TimeRemote, US R15h ago
-
Senior AI Solutions Builder, People USD 134K-192KAgent Development | Artificial Intelligence | Automation | Coding | Data GovernanceSenior-level Full TimeRemote, United States R16h ago
-
Marketing Analytics Automation & Enablement Manager USD 106K-156KAdobe Target | BigQuery | Business Intelligence | CDP | CTEGenerous time off | Health care insurance | Paid parental leave | Paid personal time off | Paid sick timeMid-level Full TimeRemote - US R16h ago
-
Manager, Forward Deployed Engineering USD 220K-320KAPI | Benchmarking | Data Engineering | Data Pipelines | Data ValidationSenior-level Full TimeNew York City, NY (Hybrid); Redwood … R16h ago
-
A/B | A/B Testing | Adobe Analytics | Amplitude | B testing401k match | Dental insurance | Discounts and perks | Medical insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States17h ago
-
Cross-Functional Collaboration | Cross-functional | Functional collaboration | Generative AI | MLOpsDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R17h ago
-
Manager, Solutions Engineering USD 280K-345KCloud Architecture | Generative AI | JavaScript | Machine Learning | Network ArchitectureHybrid work relocation assistanceSenior-level Full TimeSan Francisco17h ago
-
VP, AI Program Lead USD 130K-163KArtificial Intelligence | Audit Readiness | Data Governance | Data Management | Ethical AI401k match | Hybrid work | Paid subscriptions | Paid time off | Remote workSenior-level Full TimeChevy Chase, MD20h ago
-
Lead Data Engineer USD 125K-150KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon EMR401k matching | ADandD insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeFort Lauderdale, FL, United States21h ago
-
Manager, Business Intelligence USD 120K-140K.NET | Amazon Web Services | C Sharp | Data Dictionary | Data GovernanceMid-level Full TimeFort Lauderdale, FL, United States21h ago
-
Product Manager - Data Platform USD 143K-214KAI machine learning | Analytics | Cross-Functional Collaboration | Cross-functional | Data EngineeringDental insurance | Employee discounts | Matching 401k | Medical insurance | Paid time offMid-level Full TimeUnited States, San Mateo, CA21h ago
-
Sr Manager, Media Analytics USD 170K-200KAttribution | Cohort Analysis | Dashboarding | Incrementality testing | LTVSenior-level Full TimeNew York, NY, United States22h ago
-
Business Analytics Manager USD 85K-150KDAX | Data Modeling | Data Pipelines | ETL | Power BIBonus plan | Dental insurance | Discounted stock purchase | Medical insurance | Paid time offMid-level Full TimeGoodyear, AZ, US22h ago