Software Engineer Graduate (AML-Engine-Orchestration) - 2027 Start (PhD)
San Jose, California, United States
USD 162K-316K Entry-level Full Time
Tasks
- Apply topology aware scheduling and KV cache affinity
- Build Kubernetes operators and container lifecycle management
- Build autoscaling and disaster recovery orchestration
- Create online model serving lifecycle orchestration
- Design machine learning orchestration capabilities
- Develop multi tenant resource and quota systems
- Implement cross cluster scheduling and preemption
- Implement serving traffic management and request routing
- Manage QoS and SLA
- Manage model image distribution deployment upgrades rollback
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster scheduling | Disaster Recovery | FinOps | KV cache | Kubernetes | Kubernetes Operators | Model Serving | Multi-tenancy | Preemption | Quality of Service | Quota Management | Request Routing | Resource pooling | Resource scheduling | Service Level | Service Level Agreement | Topology Aware Scheduling | Traffic Management
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Mid-level Full TimeBedminster, United States2h ago
-
Autoscaling | Containerd | Disaster Recovery | Docker | FinOpsEntry-level Full TimeSan Jose, California, United States4h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSan Jose, California, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | FinOps | GPU UtilizationEntry-level InternshipSan Jose, California, United States4h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSeattle, Washington, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | Fair Sharing | FinOpsDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | Docker | ElasticityEntry-level Full TimeSeattle, Washington, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | FinOps | KubernetesEntry-level Full TimeSeattle, Washington, United States4h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 157K-256KBGP | CI/CD | ClickHouse | Deep learning | DockerMid-level Full TimeSan Jose, California, United States5h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 157K-256KAgentic Systems | Anomaly Detection | BGP | CI/CD | Cause analysisMid-level Full TimeSeattle, Washington, United States5h ago
-
Autoscaling | Containerization | Disaster Recovery | FinOps | GPU resource managementEntry-level Full TimeSan Jose, California, United States5h ago
-
Software Engineer, GDC AI Applications and Agents USD 147K-210KAPIs | Cloud Computing | Data Structures | Data Structures and Algorithms | Distributed SystemsBenefits | Bonus target | EquityMid-level Full TimeSunnyvale, CA, USA6h ago
-
API Design | Autoscaling | Data analytics | Databases | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Staff Software Engineer AI/ML USD 163K-253KA/B | A/B Testing | Autogen | B testing | Batched Inference401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environmentSenior-level Full TimeSan Jose, California, United States12h ago
-
Senior Data Scientist / ML Engineer (Gen AI)_Boston USD 60K-210KA/B | A/B Testing | AI Foundry | AI Governance | AWS Bedrock401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay and incentivesSenior-level Full TimeUnited States14h ago
-
Senior Agentic AI Engineer (Python)_Boston USD 48K-168KAsynchronous services | Docker | Generative AI | Guardrails | Kubernetes401k retirement plan | Dental benefits | Medical benefits | Paid Holidays | Paid time offSenior-level Full TimeUnited States14h ago
-
Agent Orchestration | Agentic AI | Apache Airflow | Argo Workflows | Artifact versioning401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R16h ago
-
Staff Software Engineer, Backend (Online Storage) USD 230K-290KAWS | Capacity Planning | Database Benchmarking | Disaster Recovery | Distributed SQLDental and vision coverage | Employee stock purchase plan | Flexible spending wallets | Health care coverage | Remote work flexibilitySenior-level Full TimeRemote US R18h ago
-
Staff Machine Learning Engineer - Moloco Commerce Media USD 172K-244KA/B | A/B Testing | B testing | CTR Prediction | Conversion Rate401k company match | Flexible time off | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeMenlo Park, California, United States19h ago
-
Data Engineer - Databricks USD 172K-237KACID transactions | Airflow | Auto Loader | Azure Data | Azure Data FactoryMid-level Full TimeChicago, IL, United States19h ago
-
AWS and Azure Data Governance Engineer USD 116K-146K800-53 | AWS CLI | AWS CloudFormation | AWS CloudWatch | AWS Cost ExplorerSenior-level Full TimeWashington, DC20h ago
-
AWS and Azure Data Governance Engineer USD 116K-146KAWS CLI | AWS CloudFormation | AWS CloudWatch | AWS Cost Explorer | AWS EC2Senior-level Full TimeWashington, DC20h ago
-
Senior Database Engineer USD 114K-195KAWS CloudFormation | AWS RDS | Access Control | Always On | Always On AvailabilitySenior-level Full TimeUS Remote R21h ago
-
Senior Site Reliability Engineer - Storage USD 267K-356KAlertmanager | Amazon S3 | Ansible | ArgoCD | BuildkiteSenior-level Full TimeSan Francisco Office (Fremont St) R22h ago
-
Staff AI Engineer - Enterprise Architecture USD 123K-215KAWS | Asynchronous programming | Autonomous Systems | CrewAI | EmbeddingsSenior-level Full TimePhoenix, AZ, United States22h ago