Backend Infrastructure & Agentic AI Software Engineer
USA, DC, Washington (1301 K St), United States
USD 99K-225K Senior-level Full Time
Tasks
- Build LLM evaluation pipelines and safety checks
- Build agent to agent communication patterns
- Build and operate Azure serverless services
- Build and operate RAG pipelines
- Build infrastructure as code
- Communicate technical decisions clearly
- Define and enforce availability and reliability SLOs
- Design LLM orchestration routing and multi model switching
- Design data storage retrieval pipelines
- Establish coding standards and testing practices
- Implement MCP server hosting and tool lifecycle
- Implement authentication and access control
- Implement document indexing and knowledge search
- Implement fallback retry circuit breaker patterns
- Implement monitoring alerting logging distributed tracing and SLOs
- Implement tool calling infrastructure and observability
- Manage secrets and credential rotation
- Mentor and unblock engineers
- Optimize token economics and cost per query
- Own CI/CD pipelines and deployment automation
- Own backend infrastructure end to end
- Own incident response runbooks and on call
Perks/Benefits
- Dependent care
- Health insurance
- Paid leave
- Professional development
- Recognition awards program
- Retirement benefits
- Tuition assistance
- Work-life programs
Skills/Tech-stack
API Management | Active Directory | Alerting | Async | Azure API | Azure API Management | Azure Active Directory | Azure Container | Azure Container Apps | Azure Functions | Azure OpenAI | Azure OpenAI Service | CI/CD | Caching | Circuit Breaker | Circuit Breaker Pattern | Compliance | Container Apps | Containerization | Data Pipelines | Distributed Systems | Distributed tracing | Embeddings | Entra ID | Incident Response | Infrastructure as Code | Java | LLM orchestration | Logging | Microsoft Azure | Model switching | Monitoring | Multi Model Switching | Multi-model | OAuth 2 | OAuth 2 0 | OIDC | Observability | OpenAI Service | Python | RAG | REST APIs | Retry Pattern | Routing | SLO | Secrets management | Security | Semantic Search | Token Economics | Vector Databases | “as-code”
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R2d ago
-
Big Data Engineer / Sr. Level - GCP USD 88K-174KAPI Development | API Versioning | Apigee | Avro | Big DataContract-to-hireSenior-level Full TimeNashville, TN, United States4h ago
-
Senior Python AI/ML Developer USD 140K-170KAsynchronous programming | CI/CD | Django | DynamoDB | FastAPISenior-level Full TimeUS-NJ-Jersey City6h ago
-
Mid-level Full TimeUS-NJ-Jersey City6h ago
-
Software Engineer, Machine Learning RecSys USD 147K-208KArtificial Intelligence | BERT | Bias Mitigation | C# | C++Mid-level Full TimeSunnyvale, CA | Bellevue, WA | …8h ago
-
C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learningSenior-level Full TimeBurlingame, CA8h ago
-
Software Engineer Leadership, Machine Learning RecSys USD 170K-244KAgent Orchestration | Artificial Intelligence | BERT | Bias Mitigation | C#Senior-level Full TimeSunnyvale, CA8h ago
-
Senior Staff Software Engineer, Knowledge Catalog For AI USD 262K-365KBig Data | C++ | Computer Vision | Data Governance | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Asynchronous programming | BigQuery | C++ | Concurrency | Data ProcessingSenior-level Full TimeKirkland, WA, USA8h ago
-
Agent Frameworks | Application Performance Tuning | Application performance | C++ | Cloud ArchitectureSecret clearanceSenior-level Full TimeReston, VA, USA; Boulder, CO, USA8h ago
-
Senior Software Engineer, AI/ML Computer Vision, Pixel USD 174K-253KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA8h ago
-
Staff Software Engineer, Infrastructure, Google Cloud AI USD 207K-301KCompute Technologies | Data Structures | Data Structures and Algorithms | Distributed Systems | Network ArchitectureSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R8h ago
-
Senior Power BI Developer USD 133K-163KALM Toolkit | Azure DevOps | Azure Synapse | BI Desktop | BI Report Server401k with company match | Accrued vacation time off | Career advancement opportunities | Dental insurance | Long-term disabilitySenior-level Full TimeDENVER, CO, US14h ago
-
Embedded Engineer USD 100K-200KARM Cortex | ARM Cortex-M | Altium Designer | Analog circuit | Analog circuit design401k employer matching | Daily catered lunches | Flexible paid time off | Health insurance | Paid HolidaysMid-level Full TimeEl Segundo, California, United States; Redmond, …15h ago
-
Senior Data Engineer, Public Sector USD 150K-259KBusiness Intelligence | DBT | Data Mart | Data Modeling | Data PipelinesCommuter stipend | Generous PTO | Health, dental and vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeWashington, DC16h ago
-
Data Engineer USD 132K-165KAWS | Azure | Cassandra | Data Governance | Data Lakes401k match | Dental insurance | Employee assistance program | Life insurance | Medical insuranceSenior-level Full TimePlano, TX, US17h ago
-
Forward Deployed AI Engineer, Operations USD 112K-300KC++ | Data Pipelines | Data analytics | Java | JavaScriptDental insurance | Medical insurance | Paid time off | Travel up to 50% | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Data Platform Engineer, Infrastructure USD 70K-300KAWS | Alerting | Audit Logging | CI/CD | Capacity PlanningFlexible hours | Onsite work | Work-life balanceMid-level Full TimeIrvine, CA19h ago
-
AWS | Azure | CI/CD | Cloud Native | Distributed SystemsCareer development support | Flexible working models | Health and wellbeing benefits | Hybrid work | MentoringEntry-level InternshipSan Ramon, CA, US, 945 8319h ago
-
AI Software Engineering Intern USD 60K-68KAPI Integration | Caching | Claude | Codex | Data Engineering401k matching | Cell phone reimbursement | Dental insurance | Disability insurance | Employee recognition programEntry-level InternshipMenlo Park, California, United States19h ago
-
Secure Data Pipeline Data Engineer USD 139K-209KAccess Control | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsMid-level Full TimeIN-INDIANAPOLIS, 220 VIRGINIA AVE, United States19h ago
-
Data Platform Engineer, Autonomy Analytics USD 110K-144KAirbyte | Airflow | BigQuery | CDC | Cloud Object StorageMid-level Full TimeIrvine, CA19h ago
-
Data Platform Engineer, Data Pipelines USD 70K-300KAirbyte | Airflow | BigQuery | CDC | DBTFlexible hours | Fully onsite collaboration | Work-life balanceMid-level Full TimeIrvine, CA19h ago
-
Senior Applied AI Engineer USD 139K-201KAPI Development | Agent workflows | Debugging | Document processing | Information RetrievalSenior-level Full TimePlaya Vista, California, United States19h ago