Senior WEM AQM Prompt Engineer
Tasks
- Build reusable prompt library
- Conduct precision recall analysis
- Deliver internal training and enablement
- Design and execute prompt validation frameworks
- Lead WEM AQM prompt engineering standards and methodology
- Lead prompt design on complex customer engagements
- Mentor prompt engineering team
- Perform prompt reviews and technical guidance
- Provide product feedback to AQM team
- Provide prompt evaluation metrics and documentation for QA
- Run A B prompt testing
- Serve as prompt engineering SME in pre sales
- Translate QM strategy and compliance into evaluation criteria
- Troubleshoot prompt performance failures
Perks/Benefits
Skills/Tech-stack
A/B | A/B Testing | API Integration | B testing | Calibration | Documenting Technical Requirements | Embeddings | Few-Shot Learning | Few-shot | Human-in-the-loop | LLM Evaluation | LLM-as-judge | Language Models | Large Language Models | NLP | Precision-recall | Prompt design | Prompt engineering | Python | Quality Scorecards | Quality management | Semantic similarity | Speech Analytics | Statistical Analysis | System Prompt | System prompt design | Technical Requirements | The Loop | Tokenization
Education
Related jobs
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeUnited States R10h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R11h ago
-
Senior Machine Learning (ML) Engineer USD 175K-200KAI Search | Artificial Intelligence | Attention Mechanisms | Autogen | Azure AI401k plan | Dental insurance | Flexible paid time off | Flexible work hours | Medical insuranceSenior-level Full TimeSeattle, WA R12h ago
-
Software Engineer, Data Runtime USD 29KAWS | Admission Policy | Arrow | Azure | Benchmarking401k | Additional company holidays | Enhanced parental leave | Generous vacation policy | Holiday breakSenior-level Full TimeSan Francisco, US (Hybrid) R12h ago
-
AI Engineer I USD 90K-119KAPI Integration | Azure | CI/CD | Docker | Embeddings401k match | Dental insurance | Holiday pay | Medical insurance | Paid time offEntry-level Full TimeRemote, CA, USA R13h ago
-
API | AWS | Automated testing | Cloud Computing | Code generation401k | Dental insurance | Discounts and perks | Fully remote | Medical insuranceSenior-level Full TimeUniversal City, CALIFORNIA, United States R13h ago
-
Staff Backend Engineer, Data Platform USD 140K-175KAsynchronous Service Design | Audit Logging | BigQuery | Cloud Run | Cloud Storage401k match | Company holidays | Dental insurance | Flexible paid time off | Health insuranceSenior-level Full TimeElizabeth, NJ R13h ago
-
Senior Software Engineer (Data Platform) USD 185K-185K.NET | AWS | Authentication | Authorization Code | Authorization Code GrantSenior-level Full TimeUnited States (EST) R14h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R14h ago
-
AI Enablement Engineer USD 111K-176KAI enablement | API Integration | Business Analysis | Claude Code | DevPodMid-level Full TimeUnited States R16h ago
-
Applied AI Research (Capabilities) USD 300K-405KDeep learning | Evals | Evaluation | Finetuning | Language ModelsCompetitive benefits | Flexible working hours | Generous vacation | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R17h ago
-
Senior-level Full TimeRemote, USA, United States R18h ago
-
Data Engineer USD 120K-150KAPIs | Access Control | Airbyte | Amazon Redshift | Apache AirflowFully remote workMid-level Full TimeUnited States (Remote) R18h ago
-
Enterprise - Software Engineer - Python, PySpark, AWS USD 185K-200KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySparkBirthday off | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeAnnapolis Junction, MD R18h ago
-
Junior Data Engineer USD 83K-105KAPI | AWS | Agile | Azure | CI/CDOn site work in SCIF | Top Secret SCI clearance requirementEntry-level Full TimeCamp Smith, HI R19h ago
-
Agent systems | Agentic Workflows | Amazon Web Services | Azure | C#Customer site travel | Remote workSenior-level Contract Full TimeJersey City, NJ, United States R19h ago
-
Agile | Angular | Azure DevOps | CSS | Cloud DataHybrid RemoteMid-level Full TimeTampa R20h ago
-
Associate software Engineer (Python AI) USD 80K-125KAWS | Azure | CI/CD | Claude Code | Cloud PlatformsCareer development opportunities | Remote work | Work from anywhereMid-level Full TimeUnited States R21h ago
-
AWS Glue | Amazon RDS | Amazon Redshift | Amazon S3 | Artificial Intelligence401k matching | Certification programs | Disability insurance | Employee resource groups | Fertility coverageEntry-level Full TimeRichmond, VA, United States R22h ago
-
Senior Full Stack & AI Engineer USD 100K-135K.NET | AI Foundry | Agile | Angular | Azure AIContinuous learning | Flexible schedule | Hybrid work modelSenior-level Full TimeMadrid, MD, Spain R1d ago
-
TECH211: Senior Data Engineer - ETL | Data Integration USD 130K-150KAPI Integration | Apps Script | Data Modeling | Data Quality | Dimensional ModelingRemote work flexibilitySenior-level Full TimeUnited States R1d ago
-
Machine Learning Engineer, Images USD 200K-265KAWS | Azure | CUDA | Cloud Computing | Cloud platform401k retirement plan | Commuter Lunch And Snacks | Dental insurance | Fertility support | Lifestyle spending accountMid-level Full TimeBay Area or Remote R1d ago
-
Software Engineer - Simulation & Robotics Engineer USD 170K-240KC++ | Debugging | Multithreading | Physics simulation | Python401k savings plan | Holiday pay | Paid vacation time | Relocation assistance | Sick leaveMid-level Full TimeSan Mateo, California, United States R1d ago
-
Senior Machine Learning Engineer USD 130K-200KAWS Lambda | AWS SageMaker | Amazon S3 | Apache Kafka | AuthorizationSenior-level Full TimeRemote, United States R1d ago
-
Data Science, Advisor USD 112K-179KAWS | Amazon Bedrock | Amazon Glue | Amazon Macie | Amazon QuickSightSenior-level Full TimeUnited States R1d ago