Applied AI Prompt Engineer
Tasks
- Build evaluation rubrics and test cases for AI output quality
- Collaborate with HR student services academics IT product and security teams to design AI processes
- Communicate evaluation findings to non technical audiences
- Create prompt datasets for accuracy tone consistency and policy alignment
- Curate manage and update document ingestion embeddings and knowledge bases
- Design and optimize prompts for enterprise AI platforms
- Ensure AI usage follows institutional policies compliance and risk standards
- Implement safety guardrails to minimize hallucinations and policy violations
- Maintain operational runbooks and documentation
- Maintain retrieval augmented generation pipelines
- Mitigate bias tone safety and factual accuracy issues
- Monitor AI usage output quality retrieval performance and drift
- Perform regression testing and safe rollback for prompt and agent changes
- Prototype and iterate prompt variants using evaluation metrics
- Stay current on prompting techniques and LLM platform enhancements
- Translate business workflows into prompt strategies
Perks/Benefits
- 401k match
- Career development
- Comprehensive health coverage
- Flexible remote work
- Paid time off
- Parental leave
- Tuition assistance
- Volunteer time off
Skills/Tech-stack
A/B | A/B Testing | AIOps | B testing | Bias Mitigation | Change Control | Code Development | Compliance | Document ingestion | Embeddings | Evaluation metrics | Incident Response | JSON | Knowledge Base | Knowledge base management | Language Models | Large Language Models | Low Code | Low code development | Operational runbooks | Prompt engineering | Python | Regression testing | Retrieval-Augmented Generation | Risk Management | Safety Guardrails | Version control
Education
N/A
Roles
AI | AI Prompt Engineer | Applied AI Prompt Engineer | Engineer | Prompt Engineer
Related jobs
-
Data Engineer USD 117K-195KAWS | Cloud Security | Cloud infrastructure | Data Governance | Data LakesHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-Remote Work R7h ago
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R13h ago
-
Access Control | Airflow | Amazon Redshift | BigQuery | CI/CDFlexible working hours | Remote workSenior-level Full TimeArgentina - Remote R20h ago
-
Senior Data & ML Engineer USD 151K-205KDBT | Data Governance | Data Observability | Data Quality | Data Security401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R20h ago
-
Senior Machine Learning Engineer USD 198K-287KArtificial Intelligence | Data Engineering | Fine Tuning | Foundation Models | GenAIOccasional travel for offsites | On-call rotation participation | Reasonable accommodation for applicantsSenior-level Full TimeRemote - US R20h ago
-
Head of AI, North America USD 173K-250KAI Agents | AWS Bedrock | Artificial Intelligence | Azure | BigQueryExecutive-level Full TimeRemote R22h ago
-
Senior AI Technologist USD 122K-180KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R22h ago
-
Senior AI Systems Engineer USD 122K-188KAlerting | Bash | CI/CD | CMMC | Cause analysisFully remote option | Hybrid option | Onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R22h ago
-
Machine Learning Engineer Intern (100% Remote) USD 138K-219KData Processing | Data Visualization | Deep learning | Distributed Computing | Fine Tuning3 to 6 month contract | Remote workSenior-level InternshipRemote job R23h ago
-
Sr. Data Platform Engineer I (6476) USD 170K-239KAccess Control | Agile | Auditing | Automation | CI/CDSenior-level Full TimeHybrid - Local to D.C. metro … R23h ago
-
Staff AI Engineer USD 170K-200KAWS | Agent Orchestration | Agentic Workflows | ClickHouse | Distributed SystemsHealth benefits | Parental leave | Tuition reimbursement | Unlimited PTOSenior-level Full TimeRemote (CAN) R23h ago
-
Senior AI Engineer USD 140K-170KAWS | Agent Orchestration | CI/CD | ClickHouse | Data StructuresHealth benefits | Parental leave | Tuition reimbursement | Unlimited PTOSenior-level Full TimeRemote (CAN) R23h ago
-
Senior AI Engineer USD 170K-205KAWS | Agent Orchestration | Agentic Workflows | CI/CD | ClickHouseHealth benefits | Parental leave | Stock options | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (NYC Metro) R23h ago
-
Senior AI Engineer USD 160K-185KAWS | Agent Orchestration | CI/CD | ClickHouse | ContainerizationHealth benefits | Parental leave | Stock options | Tuition reimbursement | Unlimited PTOSenior-level Full TimeRemote (US) R23h ago
-
AI Engineering Intern USD 54K-66KAPI Development | AWS | Azure | C++ | Code reviewAbility to travel for onsite orientation | Dedicated buddy | Intern workshops | Internship showcase | Remote internshipEntry-level InternshipUS-Remote R1d ago
-
AI Security Intern USD 50K-77KAWS Bedrock | Blue Teaming | Data leakage | Guardrails | Input validationDedicated buddy | Executive panel discussions | Intern events | Intern workshops | Internship showcase presentationEntry-level InternshipUS-Remote R1d ago
-
Staff Software Engineer, Data Infrastructure CAD 254K-268KAWS | Access Control | Apache Airflow | Apache Flink | Apache IcebergAnnual refresh grants | Equity grant | Flex first remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R1d ago
-
Staff Software Engineer, Data Infrastructure USD 221K-279KAWS | Apache Airflow | Apache Flink | Apache Iceberg | Apache KafkaAnnual refresh grants | Equity grants | In-person events | Remote work flexibilitySenior-level Full TimeUnited States - Remote R1d ago
-
Senior Staff AI Software Engineer, Platform USD 165K-202KAWS Lambda | Amazon EKS | Amazon Managed Kafka | Anthropic Claude | CI/CD401k retirement savings | Commuter benefits | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeRemote R1d ago
-
Agile | Code review | Debugging | Java | JavaScriptMentorship | Paid apprenticeship | Remote workEntry-level Apprenticeship ContractRemote (United States) R1d ago
-
Agile | Data Analysis | Data Science | Machine Learning | PythonMentorship | Paid apprenticeship | Remote workEntry-level ContractRemote (United States) R1d ago
-
AWS | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCareer advancement | Collaborative culture | Flexible scheduling | Fully remote | Professional developmentSenior-level Full TimeGermany R1d ago
-
Lead ML Engineer - Mapping USD 225K-275K3D Reconstruction | Active Learning | Auto-labeling | BEV | C++Dental insurance | Disability insurance | Flexible vacation | Health insurance | Life insuranceSenior-level Full TimeAnywhere R1d ago
-
Senior AI Engineer USD 126K-200KAWS | Anthropic API | Azure | Azure OpenAI | CI/CDEducation opportunities | Feedback and mentoring | Flexible working hours | Indefinite contract | Indefinite period contractSenior-level Full TimeRemote, Serbia (Remote) R1d ago
-
Staff Embedded Systems Engineer - US Based Remote USD 150K-175KAWS IoT | CAN | CI/CD | Data Telemetry | DockerSenior-level Full TimeUT; Remote (United States) R1d ago