Research Engineering Manager, Evaluations, Meta Superintelligence Labs
Tasks
- Align evaluation priorities with stakeholders
- Build mentor and grow research engineering team
- Build reusable evaluation pipelines
- Communicate progress challenges and decisions
- Conduct performance reviews and technical mentorship
- Contribute hands-on to evaluation projects
- Create reinforcement learning environments
- Curate integrate benchmarks
- Define evaluation infrastructure roadmap
- Develop evaluation environments
- Develop evaluation tooling for quality and reliability
- Follow version control testing and code review
- Lead evaluations team
- Review code and unblock technical issues
- Set engineering standards and best practices
- Source and prepare evaluation datasets
- Translate research vision into engineering plans
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Code review | Data Pipelines | Distributed Systems | Evaluation metrics | Machine Learning | PyTorch | Python | Reinforcement Learning | System design | Testing | Version control
Education
Regions
Countries
States
Cities
Related jobs
-
Engineer Manager II, Annotations and Inference Platform USD 207K-300KArtificial Intelligence | Compute Technologies | Data Formats | Distributed Systems | GCSSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Program Manager III, AI/ML, Google Cloud USD 159K-231KArtificial Intelligence | Change Management | Machine Learning | Metrics | Program ManagementSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Batch Processing | BigQuery | Business Intelligence | Cloud platform | Data ArchitectureSenior-level Full TimeSeattle, WA, USA; Sunnyvale, CA, USA3h ago
-
Manager Data & Insights Analytics USD 146K-175KAWS | BigQuery | Data Modeling | Data Visualization | Data WarehousingBonus | Dental insurance | Health care | Paid time off | Retirement plansMid-level Full TimeWhippany, New Jersey, US R6h ago
-
Claims Analytics Manager USD 92K-130KAccuracy Analysis | Amazon Web Services | Apache Spark | Billing guidelines | Claims analyticsSenior-level Full TimeAtlanta or Remote R13h ago
-
Data Visualization | Google BigQuery | Microsoft Excel | Microsoft PowerPoint | MicrostrategyMid-level Full TimeLas Vegas, NV, United States14h ago
-
Sr. Manager, Growth Marketing Analytics and Insights USD 121K-136KA/B | A/B Testing | Attribution | B testing | Business Intelligence401k matching | Career development opportunities | Generous vacation policy | HSA | Health insuranceSenior-level Full TimeTexas - Remote, United States R14h ago
-
Senior Manager, Risk Analytics USD 172K-238KDashboards | Data Aggregation | Data Modeling | Data Pipelines | ETL401k matching | EAP | Financial wellness resources | Medical, dental & vision coverage | Paid family leaveSenior-level Full TimeUnited States | Remote R15h ago
-
Quant Analytics Manager - Vice President USD 225K-285KActivity-based costing | Capacity modeling | Data Analysis | Python | QlikSenseBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeChicago, IL, United States16h ago
-
Engineering Manager, Search Storage USD 217K-303KApproximate Nearest Neighbors | Backend Infrastructure | Distributed Systems | Full-text search | KubernetesComprehensive healthcare | Family planning support | Flexible vacation | Gender-affirming care | Mental health coachingMid-level Full TimeRemote - United States R16h ago
-
AI Engineering Director USD 169K-240KArtificial Intelligence | Compliance | Data Engineering | Databricks | Lifecycle ManagementCell phone allowance | Comprehensive health coverage | Equity for every employee | Growth-focused environment | Home office setup allowanceExecutive-level Full TimeRemote- US R18h ago
-
FLEX Senior Manager - Digital Analytics USD 96K-209KA/B | A/B Testing | Adobe Analytics | B testing | Causal analysis401-k plan | Childcare discounts | Commuter benefits | Disability insurance | Employee assistance planSenior-level Full TimeBethesda, MD, United States18h ago
-
Senior Product Manager, Replication & Storage Engines USD 118K-231KB-Tree | Cache Management | Cause analysis | Checkpointing | Database replication401k plan | Employee stock purchase program | Equity | Fertility and adoption assistance | Flexible paid time offSenior-level Full TimeNew York City; Seattle20h ago
-
Manager, Machine Learning Operations (MLOps) USD 170K-230KAWS | ArgoCD | CI/CD | Cost Optimization | DBT401k match | FSA options | Flexible PTO | Flexible hybrid work schedule | Life insuranceMid-level Full TimeMarina del Rey, CA21h ago
-
Strategic Project Lead - Code USD 200K-250KArtificial Intelligence | Data Pipelines | Fine Tuning | Human Feedback | LLM EvaluationFive-day workweek | Flexible working hours | Supportive work cultureSenior-level Full TimeSan Francisco, California, United States22h ago
-
Manager II, Engineering - Bring Your Own Cloud USD 234K-300KAmazon Simple Storage Service | Amazon Web Services | Azure | Cloud infrastructure | Cloud platformCommunity talks | Employee resource groups | Fitness reimbursements | Hybrid workplace | Inclusive company cultureMid-level Full TimeNew York, New York, USA22h ago
-
Analytics Manager, Consumer Analytics USD 191K-215KAutomation | Customer Segmentation | Dashboards | Data Analysis | Data InstrumentationDental and vision coverage | Employee stock purchase plan | Flexible spending wallet | Health care coverage | Remote-first workMid-level Full TimeRemote US R23h ago
-
Sr. Business Intelligence & Analytics Manager USD 120K-130KAirflow | Amazon Redshift | BI Dashboards | ClickHouse | DBT401k match | Flexible PTO | Health insurance | Paid parental leave | Professional development reimbursementSenior-level Full TimeRemote - US R23h ago
-
Senior Machine Learning Manager, TikTok Trust and Safety USD 154K-290KAlgorithms | Classification | Data Analysis | Language Models | Language ProcessingSenior-level Full TimeSan Jose, California, United States1d ago
-
Senior Staff Data Scientist Manager, AI Data USD 262K-365KData Curation | Data Quality | Data Requirements | Data Visualization | Database queryingSenior-level Full TimeMountain View, CA, USA1d ago
-
Vice President of Credit Risk & Analytics USD 121K-169KBusiness Analytics | Credit Risk | Customer Analytics | Data Governance | Data Science401k match | Dental benefits | Employee Assistance Program (EAP) | Flexible spending account | Learning stipendExecutive-level Full TimeSan Diego, CA1d ago
-
Manager of Data Science USD 130K-200KChurn modeling | Cohort Analysis | Customer Lifetime Value | Data Mining | Hypothesis TestingRelocation not specified | Remote workSenior-level Full TimeSeattle, Washington1d ago
-
ADLS Gen2 | API Gateway | AppDynamics | Autoscaling | AzurePaid time offSenior-level Full TimeAddison, United States1d ago
-
Data Integrity | Data Quality | Data Visualization | Java | Machine Learning401k | Annual discretionary bonus | Dental insurance | Holiday pay | Medical insuranceSenior-level Full TimeTPA ESC-4040 W Boy Scout Blvd, …1d ago
-
Lead Engagement Director USD 165K-222KAPI Integration | Agile | Cloud infrastructure | Generative AI | Machine LearningFlexible time off program | Global Employee Assistance Program EAP | Medical, dental, and vision insurance | Paid Holidays | Paid parental leaveSenior-level Full TimeRemote CA, United States R1d ago