Principal Engineer - Architect (AI Agents)
Tasks
- Build evaluation harness
- Catch silent failures
- Deploy live agents
- Design agent runtime
- Drive engineering roadmap
- Ensure observability
- Implement offline evaluations
- Implement online evaluations
- Instrument tracing and monitoring
- Mentor engineers
- Monitor live agents
- Own cloud infrastructure for AI agents
- Own system architecture end to end
- Recover failed agents
- Review engineering work
- Set technical direction
- Use LLM as judge scoring
Perks/Benefits
Skills/Tech-stack
AI Agents | AWS | Agent memory | Agent workflows | Azure | Cause analysis | Containers | Distributed Systems | Docker | Evaluation Frameworks | Function Calling | GCP | Go | Hermes | Incident Response | Infrastructure as Code | Kubernetes | LLM Evaluation | LLM integration | LLM-as-judge | Language Models | Large Language Models | MCP | Monitoring | Multi Provider LLM | Multi Provider LLM Integration | Multi provider | Multi-Agent | Multi-agent workflows | Multi-tenancy | Observability | Ollama | OpenAI | OpenClaw | Prompt orchestration) | RAG | Root Cause Analysis | Root cause | Structured Output | Terraform | Tool orchestration | Tracing | VLLM | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R5d ago
-
Senior Software Engineer - Data & Analytics Federation USD 160K-240KApache Arrow | Asynchronous frameworks | C++ | Distributed Systems | Linux401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimePrinceton1h ago
-
Data Engineer, Employee Technology Support USD 110K-130KCause analysis | Data Governance | Data Modeling | Data Monitoring | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York1h ago
-
Security Engineer III - AI/ML USD 170K-215KAPI Development | AWS | Anomaly Detection | Azure | BERTSenior-level Full TimePlano, TX, United States2h ago
-
Software Engineer, Storage USD 174K-253KData Structures | Data Structures and Algorithms | Distributed Systems | Firmware | KernelSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Staff Software Engineer, Search Local Ads Data Platform USD 207K-301KArtificial Intelligence | C++ | CSS | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior AI Solutions Deployment Developer, Applied AI USD 152K-222KAPI tools | Agentic AI | Architecture | Cloud Architecture | Cloud platformSenior-level Full TimeWaterloo, ON, Canada; Cambridge, MA, USA2h ago
-
Senior Software Engineer, AI/ML, Workspace USD 174K-253KComputer Vision | Data Analysis | Data Processing | Debugging | Deep learningBonus | Equity | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Software Engineer III, AI/ML, Gmail Ads Quality USD 147K-211KC++ | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior Software Engineer USD 221K-253KAlgorithm Design | Audio technologies | C++ | Cause analysis | Code ReviewsBonus | Equity | Health benefits | Hybrid work scheduleSenior-level Full TimeMountain View, CA, USA R2h ago
-
C++ | CI/CD | Cloud Computing | Distributed Systems | DockerSenior-level Full TimeWaterloo, ON, Canada; Toronto, ON, Canada2h ago
-
Staff Software Engineer, Core, AI/ML Quality USD 207K-301KComputer Vision | Data Processing | Debugging | Distributed Computing | Fine TuningHealth insurance | Paid time off | Parental leave | Retirement planSenior-level Full TimeSan Jose, CA, USA2h ago
-
Software Engineer, AI/ML GenAI, Geo USD 147K-211KComputer Vision | Data Preparation | Data Processing | Data Storage | DebuggingBonus | Equity | Health insurance | Paid time off | Retirement planMid-level Full TimeMountain View, CA, USA2h ago
-
Senior Software Engineer, AI/ML, Gen AI, Geo USD 174K-253KComputer Vision | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingBonus | Equity | Health benefits | Paid time off | Professional developmentSenior-level Full TimeMountain View, CA, USA2h ago
-
AI | Autonomous Systems | C++ | Computer Vision | DockerContinuous learning | Fully remote | Knowledge sharing | Opportunity to contribute to open-source projectsSenior-level Full TimeBrazil R8h ago
-
Async Programming | Backend Development | Distributed Systems | Evaluation | Failure recoveryFlexible arrangements | Fully remote work | Inclusive and diverse work environment | Learning and growth opportunitiesSenior-level Full TimeBrazil R8h ago
-
AWS | Azure | CI/CD | Databricks | Databricks SQL100 percent remote within Latin America | Long term project extension potential | Professional growthSenior-level Full TimeBrazil R8h ago
-
Principal Data Engineer USD 160K-170KAWS | Amazon Redshift | Apache Airflow | BigQuery | Cloud platform401k match | Dental insurance | Health insurance | Paid time off | Remote workSenior-level Full TimeRemote (United States) R13h ago
-
Lead AI Integration Engineer EUR 48K-75KAI Foundry | API Integration | Agile | Agile Software Development | Agile softwareBereavement leave | Direct deposit of payroll | Discounts in local shops | Graduation leave | Life insuranceSenior-level Full TimeCosta Rica13h ago
-
Lead AI Integration Engineer EUR 54K-75KAI Act | AI Foundry | AI RMF | Agent Orchestration | AgileDirect deposit of payroll | Discounts in local shops | Life insurance | Maternity leave | Medical insuranceSenior-level Full TimeGuatemala13h ago
-
Lead AI Integration Engineer MXN 934K-1320KAI Foundry | API Integration | Agent Orchestration | Agile | AnonymizationDirect Deposit Payroll | Food tickets | Life insurance | Maternity leave | Medical insuranceSenior-level Full TimeMexico13h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkEmployee travel credits | Remote work eligibilitySenior-level Full TimeUnited States13h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Experimentation | A/B Testing | Airflow | B testingMid-level Full TimeUnited States13h ago
-
AI Solutions Engineer CAD 173K-233KAPIs | Authentication | CI/CD | Circuit Breakers | ContainersDental insurance | Employee stock purchase plan | Flexible spending accounts | Health insurance coverage | Paid time offMid-level Full TimeRemote Canada R14h ago
-
AI Solutions Engineer USD 195K-280KAPIs | Authentication | CI/CD | Containerization | DBTDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote work flexibilityMid-level Full TimeRemote US R14h ago