Product Content Engineer
Menlo Park, CA | New York, NY | San Francisco, CA
USD 129K-187K (estimate) Mid-level Full Time
Tasks
- Build workflows for collecting annotating and analyzing AI outputs
- Collaborate cross functionally to align AI behaviors with user expectations
- Define content quality standards and evaluate AI model performance across products
- Design evaluation frameworks using qualitative and quantitative signals
- Design golden sets taxonomies and guidelines for repeatable content quality assessments
- Evaluate model releases using structured comparisons and documentation
- Synthesize evaluation results into error patterns and actionable recommendations
- Track content quality and model performance over time and flag regressions
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Annotation | B testing | Bias Mitigation | Content labeling | Dashboards | Data Analysis | Data Visualization | Ethical AI | Evaluation Framework | Human evaluation | Model as judge | Prompt engineering | Python | Red Teaming | Risk Assessment | SQL | Taxonomy
Education
Roles
Regions
Countries
States
Related jobs
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | Critical Systems401k | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R9h ago
-
Autonomy | C++ | Data Ingestion | Data Ingestion Pipelines | Deployment401k | Health insurance | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R9h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R9h ago
-
Staff Applied Scientist USD 244K-320KAgentic Systems | Artificial Intelligence | Benchmarking | CI/CD | Computer VisionEmployee communities | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States10h ago
-
Senior-level Full TimeCanada R10h ago
-
Capacity Analysis | Cloud Computing | Continuous Improvement | Data Visualization | Data Warehousing401k | Dental insurance | Discounts | Health insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States10h ago
-
AI Research Engineer USD 190K-280KDeep learning | Generative AI | Language Models | Language Processing | Large Language ModelsCareer development | Diversity and inclusion | Flexible work environmentMid-level Full TimeSeattle, Washington, United States; South San …10h ago
-
Sr. AI Engineer (Applied AI & ML Systems) USD 132K-165KAgentic AI | Context engineering | Continuous Improvement | Data Engineering | Data PipelinesE learning license | Hackathons | Healthcare benefits | Home office setup allowance | Identity theft protectionSenior-level Full TimeUnited States R11h ago
-
Data Engineer USD 95K-140KApache Spark | Automated testing | Azure Databricks | CI/CD | Data ModelingMid-level Full TimeUS Remote R12h ago
-
Senior Applied AI Engineer CAD 144K-165KAI SDK | AWS ECS | AWS ECS Fargate | AWS Key Management Service | AWS LambdaSenior-level Full TimeCanada12h ago
-
Analytics Engineer USD 150K-190KDBT | Data Governance | Data Modeling | Data Monitoring | Data Pipelines401k | Catered lunches | Dental insurance | Equity | Free coffee snacksMid-level Full TimeNYC Office12h ago
-
Bioinformatics Engineer USD 125K-150KBAM | BED | BWA | Batch | Bismark401k match | Dependent care assistance | Educational benefits | Employee referral bonus | Flexible spending accountMid-level Full TimeRockville, MD13h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R14h ago
-
Data Scientist I (Prescriptive AI) USD 99K-135KCPLEX | DB2 | Data Warehousing | Discrete Event Simulation | Discrete eventCross training | Onsite Work Authorization SupportMid-level Full TimeLittle Rock, AR14h ago
-
Software Engineer - Medical Applications & Algorithms USD 130K-150KAWS CodeBuild | AWS CodePipeline | Agile | Amazon Web Services | C++Cross-functional team collaboration | Hybrid work environment | Medical device industry domainMid-level Full TimeSan Francisco, California, United States15h ago
-
Senior-level Full TimeIrving, TX15h ago
-
Associate AI Engineer USD 144K-180K.NET | APIs | ASPNet | AWS | Azure401k matching | Dental insurance | Hybrid work model | Medical insurance | Paid time offMid-level Full TimeIrving, TX R15h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R16h ago
-
Sr AI Engineer USD 84K-105KC# | Deep learning | Digital Signal | Digital Signal Processing | Edge ComputingAccidental death and dismemberment | Commuter benefits | Dental insurance | Flexible spending account | Health savings accountSenior-level Full TimeColumbia, MARYLAND, United States16h ago
-
Senior Lead AI/ML and Full Stack Engineer - R01567102 USD 150K-237KAccess Control | Agent systems | Azure | CMDB | Context ManagementHybrid work environmentSenior-level Full TimeMiami, Florida, US R17h ago
-
Senior Healthcare Data Engineer USD 104K-199KConditional Aggregation | Data Modeling | Data Quality | Data Reconciliation | Data Validation401k matching | Employee assistance program | Family building benefits | Flexible spending accounts | HolidaysSenior-level Full TimeSeattle, Washington, United States R17h ago
-
Staff Machine Learning Engineer, Foundation - Seattle USD 208K-298KAWS | Artificial Intelligence | Azure | C++ | Code reviewCommunity groups | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States18h ago
-
Applied Research Scientist / Engineer USD 175K-250KData Curation | Deep learning | Diffusion Models | Distributed Training | Domain AdaptationMid-level Full TimeNew York, NY, SF Bay Area, …18h ago
-
Data Engineer USD 130K-165KAPI Development | Airflow | Amazon Redshift | Amazon S3 | AvroCollaborative work environment | Dental insurance | Equity | Health insurance | Retirement benefitsMid-level Full TimeWilmington, MA18h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Curation401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States; Remote U.S. R18h ago