Staff Applied AI Engineer, Product & Agent Performance
Tasks
- Author evaluation rubrics and quality heuristics
- Build and run evaluations on production conditions
- Create prompt and context templates
- Design agent behavior for production workflows
- Design escalation paths for human review
- Design retrieval and context architecture
- Implement memory and state handling for multi turn agents
- Improve agent performance with experimentation
- Maintain product level AI documentation
- Optimize cost latency reliability and accuracy
- Perform model change baselining and comparative evaluations
Perks/Benefits
Skills/Tech-stack
AWS Bedrock | Accuracy Optimization | Agentic Systems | Amazon SageMaker | Context engineering | Cost Optimization | Evaluation Frameworks | Experimentation | Few-Shot Learning | Few-shot | Human-in-the-loop | Language Models | Large Language Models | Latency optimization | Machine Learning | Prompt engineering | RAG | Retrieval-Augmented Generation | The Loop | Tool use | Uncertainty calibration
Education
N/A
Roles
AI | AI Engineer | Applied AI Engineer | Engineer | Staff Applied AI Engineer
Related jobs
-
Manager Applied AI Architecture, Financial Services USD 315K-380KAI Safety | API Integration | Artificial Intelligence | Consultative Sales | Cross-functionalFlexible working hours | Generous vacation | Optional equity donation matching | Parental leaveSenior-level Full TimeNew York City, NY; San Francisco, … R8h ago
-
AI Adoption Strategy | AI adoption | API Integration | Adoption strategy | Artificial IntelligenceFlexible working hours | Generous vacation | Optional equity donation matching | Parental leave | Visa sponsorship supportSenior-level Full TimeNew York City, NY; San Francisco, … R8h ago
-
Senior Backend Engineer, Experimentation USD 182K-263KA/B | A/B Testing | APIs | Alerting | B testingDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R9h ago
-
Biometrics | C++ | Computer Vision | Machine Learning | Multimodal LearningOffice three days per week | Relocation assistanceMid-level Full TimeSan Francisco R9h ago
-
Backend Engineer, AI Engineering: Duo Chat USD 115K-194KAPI Design | GraphQL | Langchain | Langgraph | Language ModelsEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, United States R12h ago
-
Machine Learning Engineer USD 210K-240KA/B | A/B Testing | B testing | Data Pipelines | Data Processing401k plan | Commuter benefits | E Bike Transportation | Generous PTO | Learning and development stipendMid-level Full TimeSan Francisco, CA (Hybrid) R12h ago
-
Data Engineer II USD 130K-150KAWS | Airflow | CI/CD | CloudWatch | Containerization401k matching | Employee equity plan | Fertility and adoption reimbursement | Flexible time off | Health insuranceMid-level Full TimeUnited States R13h ago
-
Senior Algorithms and Simulation Software Engineer USD 95K-145KC++ | CI/CD | Control Systems | Git | Hardware-in-the-loopSenior-level Full TimeDevens, MA R14h ago
-
Machine Learning Engineer USD 162K-170KComputer Vision | Data Pipelines | Deep learning | Experiment design | Machine Learning401k plan | Dental insurance | Flexible work hours | Long-term disability | Medical insuranceMid-level Full TimeRemote, United States R14h ago
-
APIs | Anomaly Detection | Classification Pipeline | Evaluation | HuggingFace Transformers100 percent remote | BYOD | Eastern Time overlap | USD paymentSenior-level Full TimeRemote R15h ago
-
AI Solutions Lead, Customer Onboarding USD 88K-140KAPI Integration | Agent Orchestration | Atlassian Rovo | Compliance Management | CryptographyBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, United States R15h ago
-
Staff Machine Learning Engineer USD 176K-308KA2A | Asyncio | Embeddings | FastAPI | Java401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, California, United States R16h ago
-
Associate AI Engineer, Finance Transformation USD 145K-167KAPI Integration | Agent Frameworks | Data dashboards | LLM APIs | Language ModelsMid-level Full TimeSan Francisco - CA; New York … R16h ago
-
Senior-level Full TimeRemote or VA, VA, United States R17h ago
-
AI Software Engineering Intern USD 54K-70KAgile | Angular | Artificial Intelligence | Business Analysis | Business RequirementsHybrid workEntry-level InternshipDurham, NC R18h ago
-
Practice Architect AI/ML USD 136K-204KAWS | Agent Orchestration | Agentic Workflows | AutoGen Orchestration | Autogen401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeHanover, Maryland, USA R18h ago
-
AI DevOps Engineer USD 140K-175KAWS | AWS Control Tower | AWS Organizations | Amazon Bedrock | Amazon SageMakerEducation reimbursement | Health plans | Hybrid option | In-office perks | Parental leaveMid-level Full TimeRemote - USA; San Jose, California, … R19h ago
-
Senior Solution Engineer, Financial Services USD 165K-216KCloud Computing | Data Lake | Data Warehouse | Data fabric | Data meshSenior-level Full TimeUS-NY-New York City-Remote R22h ago
-
Sr. Automation Engineer Robotics Software USD 115K-144KAutomation | Computer Vision | Databases | FastAPI | HMIDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeAnkeny, Iowa, US R1d ago
-
Senior Machine Learning Engineer USD 229K-360KAB Testing | APIs | Airflow | Algorithm Development | Amazon S3Disability benefits | Health insurance | Life insurance | Paid Equity Awards | Paid time offSenior-level Full TimeNew York, New York R1d ago
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowCommuter benefits | Disability benefits | Equity awards | Financial wellness support | Health insuranceSenior-level Full TimeSan Jose, California R1d ago
-
Senior AI Engineer – AI Platform USD 140K-175KAWS | Drift Detection | Embeddings | Evaluation Pipelines | Function CallingDaily group classes | Dry cleaning | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R1d ago
-
AI Engineer USD 220K-260KAPI Development | Agent Orchestration | Data Generation | Debugging | Fine Tuning401k matching | Dental insurance | Fertility and family building stipend | Flexible PTO | Health insuranceMid-level Full TimeSan Francisco R1d ago
-
Forward Deployed Engineer, Agentic AI USD 180K-180KAI Security | AWS Bedrock | Access Control | Agent Development | Anthropic ClaudeMid-level Full TimeUS - Remote R1d ago
-
Staff Machine Learning, GAI Search Relevance - Moveworks USD 176K-308KGolang | Information Retrieval | Language Processing | Log Analysis | Machine Learning401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States R1d ago