LLM Red Team Specialist - Failure Modes & Edge Cases
Tasks
- Collaborate to refine benchmark tasks
- Design evaluation tasks for vulnerabilities
- Document reproducible evaluation findings
- Identify hidden failure modes and edge cases
- Investigate model failures across tasks
- Recommend changes to grading criteria
Perks/Benefits
Skills/Tech-stack
AI benchmarking | Adversarial Testing | Dataset creation | Evaluation Methodologies | Git | Language Models | Large Language Models | Machine Learning | Model Evaluation | Prompt engineering | Python | Security Research
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R21d ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftAnnual learning budget | Flexible hours | Local well being programs | Mentorship | Remote workMid-level Full TimeRichardson, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment tracking100 percent remote work | Annual learning budget | Flexible hours | Internal TechTalks | MentorshipMid-level Full TimeLewisville, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment trackingAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimePlano, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipMid-level Full TimeArlington, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Platforms | Docker | Drift Detection | Experiment trackingAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeMcKinney, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KAutomation | CI/CD | Cloud Computing | Concept drift | Concept drift detectionAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeIrving, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftCollaborative culture | Flexible hours | Learning budget | Mentorship | No micromanagementMid-level Full TimeDallas, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Containerization | Docker | Drift DetectionAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportMid-level Full TimeFrisco, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data Drift100 percent remote work | Annual learning budget | Collaborative culture | Flexible hours | Internal TechTalksMid-level Full TimeAllen, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment trackingAnnual learning budget | Collaborative culture | Flexible work hours | Mentorship | Remote workMid-level Full TimeGarland, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftCollaborative culture | Flexible hours | Learning budget | Mentorship | People focused supportMid-level Full TimeAddison, United States R7h ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud infrastructure | Docker | Drift Detection | Experiment trackingAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsMid-level Full TimeFort Worth, United States R7h ago
-
Staff ML Engineer, Agent Training & Environments USD 250K-280KApache Kafka | CI/CD | Cloud platform | Direct Preference Optimization | Google CloudCareer growth tied to impact | Hybrid work model | Ownership and autonomySenior-level Full TimeSan Francisco Bay Area R20h ago
-
Senior AI Engineer USD 170K-200KAPI Integration | Anomaly Detection | Artificial Intelligence | Caching | Embeddings401k match | Flexible paid time off | Gym access | HSA contribution | Medical, dental, and visionSenior-level Full TimeRemote, USA R20h ago
-
Open Source AI Engineer (Typescript) USD 185K-200KEmbeddings | Evaluation | Git | LLM | Machine Learning401k plan | Fully remote | Medical/Dental/Vision | Parental leave | Unlimited paid time offSenior-level Full TimeRemote (United States) R22h ago
-
Senior DataOps Engineer USD 94K-136KAWS | Access Control | Amazon Aurora | Amazon DynamoDB | Amazon RDS401k employer match | AD and D insurance | Dental insurance | LTD insurance | Life insuranceSenior-level Full TimeRemote, United States R22h ago
-
Sr. AI/ML Engineer II (6761) USD 152K-195KArtificial Intelligence | MLOps | Machine Learning | PyTorch | Python401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insurance | Paid time offMid-level Full TimeHybrid - Local to D.C. metro … R22h ago
-
Senior Applied ML Engineer USD 167K-231KAPI Development | Docker | Experimentation | Faiss | FastAPI401k match | Annual wellness allowance | Disability coverage | Employee assistance program | Employee resource groupsSenior-level Full TimeUnited States | Remote R23h ago
-
Data Engineer USD 120K-180KApache Spark | Data Governance | Data Modeling | Data Monitoring | Data PipelinesDental insurance | Health insurance | Paid time off | Retirement contributions | Vision insuranceSenior-level Full TimeBoston, MA R1d ago
-
Senior / Principal Infrastructure Engineer - ML Platform USD 278K-345KAWS | Automation | CI/CD | Cloud infrastructure | Cluster managementEquity compensation | Onsite work scheduleSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Data Engineer II - General Motors Insurance USD 58K-165KAWS | AWS CloudFormation | Agile | Artifactory | As-a-Service401k matching | Bonding Leave | Community service pay | Flexible remote work environment | Health benefits on day oneMid-level Full TimeFort Worth, TX, United States R1d ago
-
Senior Scientific Programmer USD 120K-165KAlgorithm Design | C++ | Desktop applications | Differential Equations | LLMSenior-level Full TimeRemote - US R1d ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | Distributed SystemsCareer coaching | Certifications coaching | Employee assistance programme | Flexible working hours | Healthcare benefitsEntry-level Full TimeRemote, United States R1d ago
-
Senior Machine Learning Engineer, GenAI Data USD 243K-295KAmazon S3 | Cloud Computing | Data Generation | Data Versioning | Data orchestrationEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States R1d ago