Senior ML Infrastructure Engineer, Inference Platform
GM Automation - Sunnyvale - GM Automation - Sunnyvale, United States
USD 155K-205K Senior-level Full Time
Tasks
- Build monitoring observability and metrics
- Contribute to open-source projects
- Design and implement ML inference platform components
- Implement autoscaling for accelerators
- Lead model serving strategy decisions
- Manage caching and model versioning
- Optimize inference reliability performance and resource usage
- Orchestrate inference workloads
- Provide technical leadership and best practices
- Research and integrate model serving frameworks and distributed computing techniques
Perks/Benefits
- Employee assistance program
- Flexible spending accounts
- Health savings account
- Life insurance
- Medical/Dental/Vision
- Paid Vacation & Holidays
- Relocation assistance
- Remote/hybrid work
- Tuition assistance
Skills/Tech-stack
Autoscaling | C++ | Caching | Data Processing | Distributed Systems | GPU Acceleration | High Performance | High-Performance Computing | Large Scale Data | Large-scale | Large-scale Data Processing | ML inference | Machine Learning | Metrics | Model Orchestration | Model Serving | Model versioning | Monitoring | Observability | Performance Computing | Python | Ray | Ray Serve | Telemetry | Triton | VLLM
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R11d ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R3h ago
-
Senior Software Engineer, Observability USD 200K-280KAWS | Ansible | Azure | CI/CD | ClickHouseHealth insurance | Remote work flexibility | Startup equitySenior-level Full TimeSan Francisco8h ago
-
GenAI / Agentic AI Developer USD 130KAI Search | AWS Bedrock | Agent Orchestration | Agent systems | Anthropic ClaudeMid-level Full TimeNew York, US8h ago
-
Machine Learning Engineer, Agentic Systems - Moveworks USD 116K-192KAsyncio | Backpressure | Distributed locking | Distributed tracing | DynamoDBFlexible work location | Remote flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States8h ago
-
Senior Staff Machine Learning Engineer, Trust USD 244K-305KA/B | A/B Testing | API Design | Agentic AI | Anomaly DetectionEmployee travel credits | Inclusion and belonging support | Remote work eligibleSenior-level Full TimeRemote - USA R9h ago
-
Strategic Artificial Intelligence (AI) Engineer USD 97K-176KComputer Vision | Configuration Management | Cybersecurity | Language Processing | Machine LearningHybrid workMid-level Full TimeFort Meade, MD10h ago
-
Agentic AI Engineer USD 130K-170KAWS | AWS IAM | AWS Lambda | Agent Orchestration | Amazon Bedrock401k plan | Autonomous work | Discretionary time off | Fertility benefit | Flexible work arrangementMid-level Full TimeSalt Lake City, Utah10h ago
-
Agentic AI Engineer USD 130K-170KAWS Identity | AWS Identity and Access Management | AWS Lambda | Access Management | Agent Orchestration401k plan access to crypto | Autonomous work | Discretionary time off | Fertility benefit | Flexible work arrangementsMid-level Full TimeSeattle, Washington10h ago
-
Sr. Software Engineer (Data Science/Data Engineering) USD 160K-225KAngular | C Sharp | CI/CD | Calculus | Continuous integrationExtended hours | Travel When Needed | Weekend workSenior-level Full TimeBastrop, TX11h ago
-
AI | Azure Data | Azure Data Explorer | Azure DevOps | C#Cross-functional collaboration | Hybrid work environmentSenior-level Full TimeRedmond, WA11h ago
-
Senior Machine Learning Engineer, Insights USD 150K-210KAPIs | AWS | Batch Processing | CI/CD | DebuggingOn-call rotationsSenior-level Full TimeBoston, MA11h ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | BigQuery | CI/CD | Cloud IAMFlexible work approach | On-call support rotation | Remote-first work environmentSenior-level Full TimeCanada R11h ago
-
Lead Site Reliability Engineer - Ceph Storage USD 118K-231KAnsible | BlueStore tuning | Bluestore | CRUSH | CSI401k retirement plan | Generous time off | Healthcare insurance | Life insurance | Long-term disabilitySenior-level Full TimeUnited States R11h ago
-
Site Reliability Engineer - Ceph Storage USD 98K-192KAnsible | CRUSH | CSI | Ceph | CephFSGenerous time off | Healthcare insurance | Paid parental leave | Paid wellness days | Remote work optionSenior-level Full TimeUnited States R12h ago
-
Senior Data Engineer USD 105K-120KAPIs | Automated testing | CI/CD | DBT | Data Quality401k | Insurance & Health | Insurance dental | Insurance vision | Life insuranceSenior-level Full TimeRemot, USA, United States R12h ago
-
Senior Algorithms Engineer USD 144K-200KAWS | Bayesian Inference | CI/CD | Code review | Django3-day weekend | 4-day work week | Fully remote within the United States | Mentoring and training | Travel 1 to 3 times per yearSenior-level Full TimeCary, NC, United States R12h ago
-
*nix | Bazel | C++ | CI/CD | CMake401k employer match | Basic life insurance | Commuter benefits | Disability insurance | Family-forming assistanceSenior-level Full TimeSan Francisco, CA12h ago
-
Senior Embedded Software Engineer USD 126K-148KBoard Support | Board Support Package | C++ | DDS | Device Drivers401k match | Certification assistance | Comprehensive medical dental life disability coverage | Flexible workplace | Hybrid work optionsSenior-level Full TimeCedar Rapids, IA13h ago
-
Sr. Machine Learning Software Engineer USD 153K-206KAWS | Airflow | Amazon EC2 | Amazon S3 | Amazon SageMakerAccess to office locations | Remote work option | Travel for team meetings and cross functional projectsSenior-level Full TimeDenver, Colorado, United States; New York, … R13h ago
-
Sr. Full-Stack Engineer, AI Data Platform USD 180K-260KAWS DynamoDB | Cassandra | Cloud platform | Google Cloud | Google Cloud PlatformHybrid work scheduleSenior-level Full TimeSan Francisco Bay Area R13h ago
-
Machine Learning Co-Op (Summer 2026) USD 115K-172KCloud Data | Cloud Data Tools | DAX | Data Tools | Deep learningMid-level Full TimeCanton, OH, United States15h ago
-
Machine Learning Co-Op (Fall 2026) USD 104K-172KCloud Data | Cloud Data Tools | DAX | Data Tools | Deep learningMid-level Full TimeCanton, OH, United States15h ago
-
Lead Data Engineer USD 130K-174KAlerting | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage ADLSSenior-level Full TimeColumbus, GA, United States16h ago
-
Software Engineer, Gen AI USD 180K-225KElasticsearch | Human Feedback | MongoDB | Node.js | PythonCommuter stipend | Comprehensive health coverage | Dental coverage | Generous PTO | Learning and development stipendMid-level Full TimeSan Francisco, CA; New York, NY16h ago