AI/ML Infrastructure Software Development Engineer
USD 86K-198K Senior-level Full Time
Tasks
- Build and maintain CI/CD deployment automation
- Build and operate RAG and knowledge pipelines
- Design LLM orchestration and multi model routing
- Drive secure compliant system design through reviews mentoring and documentation
- Implement agentic and protocol infrastructure and tool calling
- Manage LLM cost token economics and optimizations
- Manage secrets monitoring logging tracing and incident response
- Own backend infrastructure components for AI models on Azure
Perks/Benefits
Skills/Tech-stack
API Management | Alerting | Async Programming | Audit Logging | Authentication | Azure | Azure Entra | Azure Entra ID | Azure Functions | Azure OpenAI | Azure OpenAI Service | CI/CD | Container Apps | Cost Optimization | Data Pipelines | Distributed Systems | Docker | Embeddings | Entra ID | Fallback strategies | Identity Management | Incident Response | Infrastructure as Code | Input validation | Kubernetes | LLM orchestration | Logging | Model routing | Monitoring | Multi-model | Multi-model routing | OAuth2 | OpenAI Service | OpenID Connect | Output Sanitization | Python | RAG | REST APIs | SLOs | Secrets management | Security | Semantic Search | Token Economics | Tracing | Vector Search | “as-code”
Education
Roles
AI | AI Engineer | Engineer | Learning Engineer | Machine Learning Engineer | Software Engineer
Regions
Countries
States
Related jobs
-
Data Engineer- Consumer/Small Business USD 76K-125KAWS | AWS EC2 | AWS Glue | Adobe Analytics | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States6h ago
-
Lead CyberSecurity Engineer USD 119K-258KAlation | BigID | Cloud apps | Data Classification | Data GovernanceHybrid work | In-person collaboration | Work-life balanceSenior-level Full TimeAlpharetta, GA, United States6h ago
-
Senior Data Engineer USD 119K-180KANSI SQL | AWS S3 | Amazon Redshift | Azure Container | Azure Container AppsSenior-level Full TimeOrlando, FL, United States6h ago
-
Senior-level ContractBellevue, United States8h ago
-
API Integration | Asynchronous processing | Containerization | Data Pipelines | Deep learningSenior-level ContractAnnapolis, United States R8h ago
-
Manager - Data , Analytics, & AI USD 110K-180KA/B | A/B Testing | AI Governance | AWS | B testing401k matching | Employee assistance program | Employee stock purchase plan | Health insurance | Healthcare FSAMid-level Full Time500 Woodward Avenue, MI, 601 S. … R10h ago
-
AI Datacenter & Infrastructure Consultant USD 93K-155KAI Ops | Ansible | Automation | Compliance | DCIMMid-level Full TimeRaleigh, North Carolina, United States10h ago
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationSenior-level Full TimeBellevue, WA11h ago
-
AI Agents | C++ | Data Structures | Data Structures and Algorithms | Generative AISenior-level Full TimeNew York, NY, USA11h ago
-
ML Engineer, Query Understanding, Search Ads USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Deep learningMid-level Full TimeMountain View, CA, USA11h ago
-
Customer Engineer, Data Analytics, Financial Services USD 153K-222KApache Spark | Batch Processing | Big Data | Cloud Computing | Cloud platformSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …11h ago
-
BigQuery | Cloud platform | Data Processing | Deep learning | Distributed SystemsMid-level Full TimeKirkland, WA, USA11h ago
-
Staff Software Engineer, AI/ML, YouTube USD 207K-300KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Distributed SystemsSenior-level Full TimeSan Bruno, CA, USA; Mountain View, …11h ago
-
Software Engineer III, AI/ML, Google Play USD 147K-211KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Software Engineer, AI/ML, Payments Platform USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA11h ago
-
Staff Software Engineer, AI/ML Machine Repairs USD 207K-300KArtificial Intelligence | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Senior ML/AI Software Engineer, Chrome AI USD 174K-252KAgent Orchestration | Algorithms | Automated testing | C++ | Computer VisionSenior-level Full TimeMountain View, CA, USA11h ago
-
Staff Software Engineer, AI/ML, Agent Assist USD 207K-300KAgentic AI | Cloud Computing | Data Processing | Debugging | Deep learningSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Mid-level Full TimeIndianapolis, IN, 46254, USA12h ago
-
Sr. Data Engineer USD 131K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityConvenient location | Group insurance | Hospitalization insurance | Meal vouchers | Open company cultureSenior-level Full TimeUnited States, FL, US, 56007616h ago
-
Embedded Systems Engineer USD 100K-200KC# | C++ | CAN | Circuit design | Debugging Tools401k | Dental insurance | Disability insurance | Employee stock ownership plan | Employer paid medical insuranceSenior-level Full TimeGoleta, CA, US17h ago
-
Senior AI Engineer USD 170K-200KAWS | Agentic Workflows | Airflow | Data Pipelines | Data TransformationOnsite collaborationSenior-level Full TimeSeattle, Washington, United States19h ago
-
Senior AI Engineer USD 170K-200KAWS | Airflow | Anthropic | Datadog | EmbeddingsOnsite 4 days per weekSenior-level Full TimeLos Angeles, California, United States19h ago
-
Senior AI Engineer USD 170K-200KAWS | Agentic Workflows | Airflow | Anthropic | Data Pipelines401k plan | Bonus plans | Disability coverage | Healthcare benefits | Life insuranceSenior-level Full TimeNew York, New York, United States19h ago
-
Machine Learning Engineer, API Multicloud USD 295K-445KAWS | Data Pipelines | Data Structures | Data structures algorithms | Deep learningSenior-level Full TimeSan Francisco20h ago