Cloud Inference Engineer
Tasks
- Build Helm charts
- Build LLM inference platform
- Collaborate on kernel and serving optimizations
- Deploy disaggregated inference
- Deploy multi cloud services
- Develop Kubernetes operators
- Implement autoscaling
- Implement high throughput batch processing
- Improve request-to-kernel observability
- Manage distributed KV cache
- Optimize cold starts
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | Cold Start | Cold Start Optimization | Distributed KV Cache | Distributed Systems | Go | Helm | High Performance | High-Performance Computing | High-performance networking | KV cache | Kubernetes | Machine Learning | Multi-cloud | Observability | Performance Computing
Education
N/A
Related jobs
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R7h ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R23h ago
-
Sr Staff AI Engineer - Veza USD 190K-334KAgent Orchestration | Algorithms | C++ | Data Structures | Distributed Systems401k plan with match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeMinneapolis, Minnesota, United States R1d ago
-
AI/ML Engineer USD 152K-220K3D Reconstruction | 3D Scene | 3D Scene Understanding | AI Agents | Cloud ComputingAgile team collaboration | Fully remote | Production monitoring ownershipMid-level Full TimeSan Francisco, CA (Hybrid) or United … R1d ago
-
Data Science Engineer USD 121K-154KData Visualization | Documentation | Entity Resolution | Fine Tuning | Git401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R1d ago
-
AI Architect USD 120K-197KAI orchestration | Automation | Cloud Computing | Data Governance | Distributed SystemsWeekly earned wage access optionSenior-level Full TimeDurant, OK, United States R1d ago
-
800-37 | 800-53 | AI Governance | AI orchestration | AI red teaming401k | Dental insurance | Disability insurance | Employee assistance program | Hybrid work scheduleSenior-level Full TimeWashington, DC R1d ago
-
IAA - Principal Data Engineer USD 171K-256KAzure | Azure Synapse | Azure Synapse Analytics | CI/CD | Data GovernanceHybrid work schedule | Onsite expectation 2 days per weekSenior-level Full TimeChicago, IL (Hybrid) R1d ago
-
Software Engineer I USD 97K-122KBatch inference | Cloud infrastructure | Docker | GPU Optimization | GoConference reimbursement | Education reimbursement | Employee assistance program | Flexible time off | Hybrid workEntry-level Full TimeSeattle R1d ago
-
Backend Engineer, Multi-cloud Inference Platform USD 234K-319KAmazon Web Services | Backend Engineering | Cloud platform | Distributed Systems | GenAI401k matching | Flexible paid time off | Health insurance | Local meetups | Remote workMid-level Full TimeUnited States / Canada R1d ago
-
Data Scientist USD 160K-170KAPI Integration | APIs | Agentic Workflows | Anomaly Detection | Artificial Intelligence401k retirement plan | Employee assistance program | Health Savings Account (HSA) | Life insurance | Long-term disabilityMid-level ContractPhoenix, Arizona, USA R1d ago
-
AWS | Agent systems | Apache Spark | Azure | Cloud platformOn site customer collaboration | Remote work | Travel for customer visitsSenior-level Full TimeWashington, D.C. R1d ago
-
AWS | Agent systems | Apache Spark | Apache Spark SQL | AzureConference presentations | Periodic onsite work | Remote work possible | Travel every 4 to 8 weeksSenior-level Full TimeVirginia R1d ago
-
AI Integrations Staff Engineer USD 150K-230KAI Models | Agent SDKs | Back-end | Back-end development | Data ModelingAutomatic 401k contribution | Bi-annual company retreats | Employee referral program | Equity | Home office setupSenior-level Full TimeRemote R1d ago
-
Senior AI Engineer - Observability USD 151K-205K.NET | A/B | A/B Testing | AI Search | Agentic WorkflowsSenior-level Full TimeUnited States R1d ago
-
Lead Software Engineer (.Net Core + LLM's) USD 150K-225K.NET | AKS | ASP.Net Core | Airflow | Application Insights401k matching | Childcare assistance | Dental insurance | Disability insurance | Education reimbursementSenior-level Full TimeDallas, Texas, United States R1d ago
-
Senior Data Platform Engineer USD 180K-220KAKS | Airflow | Apache Spark | Azure | Azure SQL401k matching | Childcare assistance | Dental insurance | Disability insurance | Education reimbursementSenior-level Full TimeDallas, Texas, United States R1d ago
-
Argo CD | ArgoCD | CSI | CSI driver | FluxExecutive-level Full TimeRemote, USA, United States R1d ago
-
AI/ML Engineer USD 100K-187KAWS | Algorithms | Computer Vision | Data Structures | Deep learning401k | Annual bonus | Apple hardware ecosystem | Dental insurance | Disability insuranceMid-level Full TimeSan Francisco R1d ago
-
Agent systems | Backend Development | Bias Testing | Cost Optimization | Data Science401k | Flexible paid time off | Healthcare | Home office stipend | Inclusive cultureSenior-level Full TimeCanada R1d ago
-
AI workflow | AI workflow tuning | API Development | AWS | Agentic AIRemote United StatesSenior-level Contract Full TimeChicago, IL / CA, US / … R1d ago
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Data Engineer USD 195K-352KAWS | Apache Airflow | Apache Spark | Batch Processing | Cloud platformCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeAustin, Texas R1d ago
-
Senior Machine Learning Engineer, Search USD 361K-510KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Disability benefits | Equity awards | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R1d ago
-
AI Engineer, Product Analytics CAD 82K-132KA/B | A/B Testing | AWS | Azure | B testingFlexible vacation | Flexible work arrangements | Headspace app access | Hybrid work model | Mental health daysMid-level Full TimeCanada, Toronto, Ontario R1d ago