Principal Engineer - Architect (AI Agents)
Tasks
- Build evaluation harness
- Catch silent failures
- Deploy live agents
- Design agent runtime
- Drive engineering roadmap
- Ensure observability
- Implement offline evaluations
- Implement online evaluations
- Instrument tracing and monitoring
- Mentor engineers
- Monitor live agents
- Own cloud infrastructure for AI agents
- Own system architecture end to end
- Recover failed agents
- Review engineering work
- Set technical direction
- Use LLM as judge scoring
Perks/Benefits
Skills/Tech-stack
AI Agents | AWS | Agent memory | Agent workflows | Azure | Cause analysis | Containers | Distributed Systems | Docker | Evaluation Frameworks | Function Calling | GCP | Go | Hermes | Incident Response | Infrastructure as Code | Kubernetes | LLM Evaluation | LLM integration | LLM-as-judge | Language Models | Large Language Models | MCP | Monitoring | Multi Provider LLM | Multi Provider LLM Integration | Multi provider | Multi-Agent | Multi-agent workflows | Multi-tenancy | Observability | Ollama | OpenAI | OpenClaw | Prompt orchestration) | RAG | Root Cause Analysis | Root cause | Structured Output | Terraform | Tool orchestration | Tracing | VLLM | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R5d ago
-
AI | Autonomous Systems | C++ | Computer Vision | DockerContinuous learning | Fully remote | Knowledge sharing | Opportunity to contribute to open-source projectsSenior-level Full TimeBrazil R6h ago
-
Async Programming | Backend Development | Distributed Systems | Evaluation | Failure recoveryFlexible arrangements | Fully remote work | Inclusive and diverse work environment | Learning and growth opportunitiesSenior-level Full TimeBrazil R6h ago
-
AWS | Azure | CI/CD | Databricks | Databricks SQL100 percent remote within Latin America | Long term project extension potential | Professional growthSenior-level Full TimeBrazil R6h ago
-
Lead AI Integration Engineer EUR 48K-75KAI Foundry | API Integration | Agile | Agile Software Development | Agile softwareBereavement leave | Direct deposit of payroll | Discounts in local shops | Graduation leave | Life insuranceSenior-level Full TimeCosta Rica11h ago
-
Lead AI Integration Engineer EUR 54K-75KAI Act | AI Foundry | AI RMF | Agent Orchestration | AgileDirect deposit of payroll | Discounts in local shops | Life insurance | Maternity leave | Medical insuranceSenior-level Full TimeGuatemala11h ago
-
Lead AI Integration Engineer MXN 934K-1320KAI Foundry | API Integration | Agent Orchestration | Agile | AnonymizationDirect Deposit Payroll | Food tickets | Life insurance | Maternity leave | Medical insuranceSenior-level Full TimeMexico11h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkEmployee travel credits | Remote work eligibilitySenior-level Full TimeUnited States12h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Experimentation | A/B Testing | Airflow | B testingMid-level Full TimeUnited States12h ago
-
AI Solutions Engineer CAD 173K-233KAPIs | Authentication | CI/CD | Circuit Breakers | ContainersDental insurance | Employee stock purchase plan | Flexible spending accounts | Health insurance coverage | Paid time offMid-level Full TimeRemote Canada R12h ago
-
AI Solutions Engineer USD 195K-280KAPIs | Authentication | CI/CD | Containerization | DBTDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote work flexibilityMid-level Full TimeRemote US R12h ago
-
Senior Data Engineer USD 185K-200KAWS Glue | Amazon Athena | Amazon Bedrock | Amazon OpenSearch | Amazon S3401k company match | Comprehensive health coverage | Equity purchase option | Flexible work schedule | Generous time offSenior-level Full TimeLos Angeles Office R12h ago
-
Solutions Architect - Financial Services USD 161K-225KAWS | Apache Spark | Azure | Cloud platform | DSSTravel opportunities | Work with open source communitiesSenior-level Full TimeMassachusetts; New Jersey; New York13h ago
-
AI Solution Architect USD 150K-181KAWS | Agent-based | Agent-based systems | Azure | Data ModelingEquity | Health and wellness packagesSenior-level Full TimeNew York City13h ago
-
DevOps, MLOps & Security Engineering Lead - San Jose, CA USD 165K-260KAPI Security | AWS | Automated testing | Bash | CI/CDSenior-level Full TimeCalifornia13h ago
-
Software Engineer, Data Platform USD 193K-215KAccess Control | Airflow | Audit Readiness | Compliance | DBT401k employer match | Commuter allowance | Creative education stipend | Dental insurance | Equity packageSenior-level Full TimeBoston14h ago
-
Staff Deep Learning Engineer USD 230K-299KCI/CD | Cloud deployment | Computer Vision | Computer vision models | Deep learningSenior-level Full TimeSan Francisco HQ Office14h ago
-
Data Engineer USD 169K-175KAPI Development | Apache Airflow | Apache Beam | Bash | BigQuery401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeParamus, NJ, United States14h ago
-
Health IT Data Engineer USD 125K-135KAzure | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsRemote work within continental United States | US federal security suitability requiredSenior-level Full TimeContinental United States R14h ago
-
Software Engineer, Data Infrastructure USD 190K-202KApache Beam | BigQuery | C++ | Data Analysis | Data PipelinesSenior-level Full TimePalo Alto, California15h ago
-
Staff Machine Learning Infrastructure Engineer USD 224K-280KContinuous integration | Data Engineering | Data Ingestion | Data Pipelines | Distributed Computing401k | Commuter benefit | Dental insurance | Disability insurance | EquitySenior-level Full TimeSan Francisco, CA15h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeChicago, Illinois, USA R16h ago
-
Senior / Staff Software Engineer, AI Engineering USD 220K-280KAI APIs | Agentic Workflows | Full Stack | Full-Stack Development | LLMComprehensive benefits | Equity packageSenior-level Full TimeBoston16h ago
-
Mid-level Full TimeRemote, Brazil R16h ago
-
Data Engineer USD 118K-118KAWS | Amazon Redshift | Amazon S3 | Amazon SQS | Business Intelligence401k match | Free onsite gym | Paid charity and volunteer days | Paid medical/dental/vision | Parental leaveMid-level Full TimeLos Angeles, California17h ago