Senior WEM AQM Prompt Engineer
Tasks
- Build reusable prompt library
- Conduct precision recall analysis
- Deliver internal training and enablement
- Design and execute prompt validation frameworks
- Lead WEM AQM prompt engineering standards and methodology
- Lead prompt design on complex customer engagements
- Mentor prompt engineering team
- Perform prompt reviews and technical guidance
- Provide product feedback to AQM team
- Provide prompt evaluation metrics and documentation for QA
- Run A B prompt testing
- Serve as prompt engineering SME in pre sales
- Translate QM strategy and compliance into evaluation criteria
- Troubleshoot prompt performance failures
Perks/Benefits
Skills/Tech-stack
A/B | A/B Testing | API Integration | B testing | Calibration | Documenting Technical Requirements | Embeddings | Few-Shot Learning | Few-shot | Human-in-the-loop | LLM Evaluation | LLM-as-judge | Language Models | Large Language Models | NLP | Precision-recall | Prompt design | Prompt engineering | Python | Quality Scorecards | Quality management | Semantic similarity | Speech Analytics | Statistical Analysis | System Prompt | System prompt design | Technical Requirements | The Loop | Tokenization
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Artificial Intelligence | Automation | LLM integrations | Langchain | Language ModelsContractor | Fully remoteSenior-level ContractLos Angeles R7h ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R11h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R14h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R14h ago
-
WEM AQM Prompt Engineer USD 70K-195KAPI | Contact center | F1-score | Genesys | JSON401k employer matching | Basic life insurance | Company-Paid Holidays | Employee stock purchase plan | Health, dental, vision coverageMid-level Full TimeUnited States (Remote) R15h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R18h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 77K-176KAPI Development | Agile | Backend Development | Cloud Computing | Data Preparation401k | Employee discounts | Employee referral rewards | Flexible work schedule | Health savings accountMid-level Full TimeQuantico, VA, US R20h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R20h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Storage Operations Engineer - Multiple Openings USD 80K-110KAnsible | Bash | Ceph | Chef | Collectd401k match | Dental insurance | Gym reimbursement | Health insurance | Holiday payMid-level Full TimeRemote - United States R1d ago
-
Machine Learning Engineer (Platform) USD 156K-211KAWS | CPU Optimization | Data Processing | Data throughput | Distributed TrainingRemote workSenior-level Full TimeRemote-US R1d ago
-
AWS Devops Cloud Engineer USD 105K-151KAWS CDK | AWS CloudFormation | AWS EKS | AWS IAM | AWS LambdaHybrid workMid-level Full TimeIndianapolis, IN - Remote/Hybrid R1d ago
-
Principal Data Engineer USD 155K-184KAWS Glue | Alerting | Amazon Web Services | Apache Airflow | Automated testing401k retirement program | Company-Paid Holidays | Paid time offSenior-level Full TimeUnited States R1d ago
-
Sr. Software Engineer (Data)-0336 USD 132K-203KAWS | Apache Spark | ClickHouse | Databricks | GitHubEmotional support | Financial benefits | Health benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R1d ago
-
Sr Staff Software Engineer- Data Platform USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Access Control | AlgorithmsDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R1d ago
-
Lead Data Engineer USD 75KApache Airflow | Apache Beam | Autoscaling | BigQuery | CI/CD401k matching | Adoption reimbursement | Commuter benefits | Disability benefits | Discounts and savingsSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Principal Embedded Software Engineer USD 150K-175K4G | Battery Management | Battery Management Systems | Board Bring-up | Bring-upSenior-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago
-
Mid-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago
-
Fullstack Engineer USD 85K-134KETL | Hadoop | Hive | Java | Linux401k plan | Continuing Education/Professional Development | Dental insurance | Employee assistance program | Life insuranceEntry-level Full TimeRemote, CA, United States R1d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Alerting | Apache Spark | Azure HDInsightRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Streaming Data Engineer USD 100K-150KAccess Control | Access Control Lists | Ansible | Apache Kafka | Apache Kafka ConnectSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAPI Gateway | Abuse detection | Automated rollback | Autoscaling | C++Senior-level Full TimeUnited States - Remote R1d ago
-
AI Scientist USD 100K-150KAccelerator hardware | Computer Vision | Deep learning | Distributed Training | Experiment designRemote workSenior-level Full TimeUnited States - Remote R1d ago