Prompt Engineer
New York, New York, United States
A USD 119K-160K (estimate) Senior-level Full Time
Tasks
- Define evaluation scenarios and validation datasets
- Define templates for different lines of business
- Design context injection strategies
- Design prompts for risk insights
- Design prompts for summarization
- Ensure outputs are grounded and aligned with underwriting logic
- Evaluate prompt performance using A B testing
- Improve retrieval quality
- Incorporate domain language risk indicators and business rules
- Maintain prompt library and versioning
- Optimize prompts for accuracy grounding and consistency
- Refine prompts based on model performance and user feedback
- Translate underwriting workflows into prompt logic
- Use LLM as judge for response evaluation
Perks/Benefits
Skills/Tech-stack
A/B | A/B Testing | AI Search | API Integration | Azure AI | Azure AI Search | Azure OpenAI | B testing | Benchmarking | Chain-of-Thought | Chain-of-Thought prompting | Context design | Evaluation Frameworks | Few-Shot Learning | Few-shot | Grounding | Hallucination reduction | JSON | LLM-as-judge | Language Models | Large Language Models | Nemo Guardrails | Output Validation | PII Redaction | Presidio | Prompt engineering | Python | Responsible AI | Retrieval-Augmented Generation | Structured prompting
Education
Roles
AI Engineer | Engineer | Generative AI Engineer | Prompt Engineer
Regions
Countries
States
Cities
Related jobs
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States2h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence3h ago
-
Cause analysis | Cloud Computing | Data Enrichment | Data Monitoring | Data Processing401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York3h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States3h ago
-
Senior-level Full TimeDallas, Texas, United States3h ago
-
As-a-Service | C++ | Cloud Functions | Cloud platform | Compute TechnologiesSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …4h ago
-
Manufacturing Test Engineer, Data Center USD 120K-172KBSCAN | Bash | Bring-up | Calibration | Correlation studyMid-level Full TimeAtlanta, GA, USA4h ago
-
Software Engineer, Compiling, Quantum AI USD 147K-211KC++ | Classical coding theory | Coding theory | Compiler architecture | CompilersMid-level Full TimeMountain View, CA, USA; Los Angeles, …4h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA4h ago
-
Software Engineer, Decoding, Quantum AI USD 147K-211KC++ | Concurrency | Device Driver Development | Device driver | Driver DevelopmentMid-level Full TimeLos Angeles, CA, USA; Goleta, CA, …4h ago
-
Research Scientist, Biomedical AI, DeepMind USD 147K-211KArtificial Intelligence | Benchmarking | Computational pipeline | Data Analysis | EvaluationMid-level Full TimeMountain View, CA, USA4h ago
-
C# | C++ | Co-design | Compiler technology | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA4h ago
-
ALB | ALB/NLB | AWS | AWS CDK | AWS CloudSenior-level Full TimeDallas, Texas, United States13h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R16h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R16h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R16h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R16h ago
-
API Integration | Agent systems | Asynchronous processing | Chunking | Cost OptimizationCompetitive salary based on experience | High-impact role | Opportunity to scale AI systems | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R16h ago
-
AI Full Stack Engineer - KS001 USD 160K-225KAds API | Agent systems | Anthropic Claude | Cost monitoring | EmbeddingsHigh-impact role | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R16h ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R16h ago
-
Software Engineer I/II, Machine Learning USD 129K-190KAWS | Amazon S3 | Apache Airflow | Apache Arrow | CI/CD401k matching | Flexible spending account | Health insurance | Hybrid work | Life insuranceMid-level Full TimeBoston Office17h ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R17h ago
-
Machine Learning Engineer - 1 USD 130K-228KCNN | Cross-validation | Data Pipelines | Deep learning | Document processingEquity options | Flexible-hybrid work | Medical, dental & vision coverage | Professional development budget | Team offsitesNone Full TimeHybrid - San Mateo, California R17h ago
-
Data Scientist Lead USD 175K-210KAWS | Apache Spark | Data Governance | Data Modeling | DatabricksBackup childcare | Financial coaching | Health care coverage | Mental health support | Onsite wellness centersSenior-level Full TimeOH, United States18h ago