Backend Engineer, Multi-cloud Inference Platform
Tasks
- Build fault tolerant low toil services
- Build multi cloud multi tenant inference platform
- Develop Helm charts and Kubernetes operators
- Implement request to kernel observability
- Optimize cold start performance
Perks/Benefits
Skills/Tech-stack
AWS | Distributed Systems | Golang | Google Cloud | Helm | Kubernetes | LLM Inference | Machine Learning | Microsoft Azure | Observability | Service Oriented | Service-Oriented Architecture
Education
N/A
Roles
Related jobs
-
Senior AI Engineer USD 131K-195KAmazon Comprehend | Amazon SageMaker | Anomaly Detection | Chatbots | ElasticsearchSenior-level Full TimeFalls Church, VA, United States2h ago
-
Senior-level Full TimeAuburn Hills, MI, United States3h ago
-
Data Scientist (Graph analysis) USD 135K-185KCypher | Data Ingestion | Data Processing | Docker | ETLOn-site workMid-level Full TimeColumbia, MD, United States4h ago
-
Lead Researcher, Large Language Models/LLM, TikTok USD 224K-410KData Processing | Deep learning | Inference Optimization | Language Models | Large Language ModelsSenior-level Full TimeSan Jose, California, United States7h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Azure | Bias Mitigation | C plus plus | Cloud PlatformsEntry-level Full TimeMenlo Park, CA8h ago
-
Adversarial ML | Benchmarking | Data Mining | Environment Design | Function CallingMid-level Full TimeMountain View, CA, USA; New York, …8h ago
-
Software Engineer III, AI/ML, gUP Customer Support USD 147K-211KAgile | C++ | Code review | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Computer Vision | Data Processing | Debugging | Deep learning | GenAISenior-level Full TimeMountain View, CA, USA8h ago
-
Staff Software Engineer, Deep Data Research, Applied AI USD 207K-300KComputer Vision | Data Processing | Debugging | Fine Tuning | Language ModelingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Software Engineer, Database Internals AlloyDB USD 174K-252KC plus plus | C# | Code optimization | Compute Technologies | Concurrency ControlEntry-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud AI USD 174K-252KC++ | Cloud AI | Computer Vision | Data Processing | Google CloudSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
Computer Vision | Data Processing | Debugging | Distributed Computing | Generative AIMid-level Full TimeMountain View, CA, USA8h ago
-
Staff Software Engineer, AI-Powered GRC Automation USD 207K-300KCloud Platforms | Cloud platform | Continuous controls monitoring | Controls monitoring | Data PipelinesSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
Senior Staff Software Engineer, BigQuery Core Analytics USD 262K-365KBigQuery | C plus plus | C++ | CI/CD | Distributed SystemsSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA8h ago
-
Staff Machine Learning Engineer, Embeddings USD 253K-354KA/B | A/B Testing | B testing | C++ | Cloud ComputingCaregiving support | Comprehensive healthcare benefits | Employer 401k match | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R15h ago
-
ML Engineer, Surrogate Modeling (Vehicle Engineering) USD 125K-175KActive Learning | Adaptive Sampling | CFD | Continuous integration | Data Pipelines401k retirement plan | Employee stock purchase plan | Life insurance | Long-term disability insurance | Long-term incentivesEntry-level Full TimeHawthorne, CA15h ago
-
Lead ML Inference Engineer, Advertising USD 246K-486KCo-design | Distributed Systems | GPU Acceleration | Hardware-Software Co-design | Hardware/softwareDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California15h ago
-
Senior Software Engineer (Search / Retrieval) USD 180K-240KBM25 | Distributed Systems | Elasticsearch | Entity recognition | Language ProcessingFlexible work environment | Remote work opportunitySenior-level Full TimePalo Alto, California18h ago
-
Software Engineer - Developer Products (AI) USD 170K-240KAPI Design | APIs | CLIs | Data Structures | Data Structures and AlgorithmsEmployee benefits package | Remote-friendly work environmentSenior-level Full TimeSan Francisco, California18h ago
-
Senior-level Full TimePalo Alto, California18h ago
-
Staff AI Engineer USD 215K-285KA/B | A/B Testing | B testing | Behavioral signals | Distributed SystemsSenior-level Full TimePalo Alto, California; San Francisco, California18h ago
-
AI Software Engineer (Vehicle Engineering) USD 125K-175K3D Reconstruction | Agent systems | Agentic AI | Anomaly Detection | CI/CD401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Life insurance coverageSenior-level Full TimeHawthorne, CA19h ago
-
Data Engineer CAD 117K-141KAWS ECS | AWS Glue | AWS Lambda | Anomaly Detection | Apache SparkAutonomy on projects | Career advancement opportunities | Job stability | Positive impact for customers and communities | Professional growth opportunitiesMid-level Full Time100 New Park Place 500,Vaughan,ON, Canada19h ago
-
AWS | AWS Glue | AWS IAM | AWS Lake Formation | AWS LambdaHybrid workSenior-level Full TimeSt. John's - 18 Hebron Way, …19h ago
-
Mid-level Full TimeAMER - Canada - Ontario - …19h ago