Senior WEM AQM Prompt Engineer
Tasks
- Build reusable prompt library
- Conduct precision recall analysis
- Deliver internal training and enablement
- Design and execute prompt validation frameworks
- Lead WEM AQM prompt engineering standards and methodology
- Lead prompt design on complex customer engagements
- Mentor prompt engineering team
- Perform prompt reviews and technical guidance
- Provide product feedback to AQM team
- Provide prompt evaluation metrics and documentation for QA
- Run A B prompt testing
- Serve as prompt engineering SME in pre sales
- Translate QM strategy and compliance into evaluation criteria
- Troubleshoot prompt performance failures
Perks/Benefits
Skills/Tech-stack
A/B | A/B Testing | API Integration | B testing | Calibration | Documenting Technical Requirements | Embeddings | Few-Shot Learning | Few-shot | Human-in-the-loop | LLM Evaluation | LLM-as-judge | Language Models | Large Language Models | NLP | Precision-recall | Prompt design | Prompt engineering | Python | Quality Scorecards | Quality management | Semantic similarity | Speech Analytics | Statistical Analysis | System Prompt | System prompt design | Technical Requirements | The Loop | Tokenization
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Artificial Intelligence | Automation | LLM integrations | Langchain | Language ModelsContractor | Fully remoteSenior-level ContractLos Angeles R8h ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R10h ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R11h ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R12h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R15h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R15h ago
-
WEM AQM Prompt Engineer USD 70K-195KAPI | Contact center | F1-score | Genesys | JSON401k employer matching | Basic life insurance | Company-Paid Holidays | Employee stock purchase plan | Health, dental, vision coverageMid-level Full TimeUnited States (Remote) R15h ago
-
Staff Backend Engineer, AI Systems USD 181K-226KAPIs | Asynchronous processing | Azure OpenAI | Context retrieval | Distributed SystemsBenefits | Remote-first workSenior-level Full TimeUnited States Remote R16h ago
-
Staff Designated Support Engineer USD 122K-160KAI workflows | AWS | As-a-Service | Azure | Cloud DataSenior-level Full TimeUS-TX-Remote R17h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R19h ago
-
Azure ML | Batch Processing | Cloud Machine Learning | Data Pipelines | Data Versioning401k employer match | Discretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programsMid-level Full TimeScottsdale, Arizona, United States R19h ago
-
Senior Software Engineer II (TASER Data Science) USD 148K-237KAzure ML | Batch Processing | Data Engineering | Data Pipelines | Databricks401k employer match | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsMid-level Full TimeWashington, United States R19h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 77K-176KAPI Development | Agile | Backend Development | Cloud Computing | Data Preparation401k | Employee discounts | Employee referral rewards | Flexible work schedule | Health savings accountMid-level Full TimeQuantico, VA, US R21h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R21h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Storage Operations Engineer - Multiple Openings USD 80K-110KAnsible | Bash | Ceph | Chef | Collectd401k match | Dental insurance | Gym reimbursement | Health insurance | Holiday payMid-level Full TimeRemote - United States R1d ago
-
Machine Learning Engineer (Platform) USD 156K-211KAWS | CPU Optimization | Data Processing | Data throughput | Distributed TrainingRemote workSenior-level Full TimeRemote-US R1d ago
-
AWS Devops Cloud Engineer USD 105K-151KAWS CDK | AWS CloudFormation | AWS EKS | AWS IAM | AWS LambdaHybrid workMid-level Full TimeIndianapolis, IN - Remote/Hybrid R1d ago
-
Principal Data Engineer USD 155K-184KAWS Glue | Alerting | Amazon Web Services | Apache Airflow | Automated testing401k retirement program | Company-Paid Holidays | Paid time offSenior-level Full TimeUnited States R1d ago
-
Sr. Software Engineer (Data)-0336 USD 132K-203KAWS | Apache Spark | ClickHouse | Databricks | GitHubEmotional support | Financial benefits | Health benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R1d ago
-
Sr Staff Software Engineer- Data Platform USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Access Control | AlgorithmsDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R1d ago
-
Lead Data Engineer USD 75KApache Airflow | Apache Beam | Autoscaling | BigQuery | CI/CD401k matching | Adoption reimbursement | Commuter benefits | Disability benefits | Discounts and savingsSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Principal Embedded Software Engineer USD 150K-175K4G | Battery Management | Battery Management Systems | Board Bring-up | Bring-upSenior-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago