Staff Backend Engineer, ML Inference Systems
Tasks
- Deploy production grade inference infrastructure
- Design backend services and distributed systems
- Ensure low latency high throughput serving
- Implement backend service development testing deployment monitoring best practices
- Lead inference platform technical direction
- Manage and optimize GCP infrastructure
- Monitor and troubleshoot using observability tools
- Orchestrate workloads with Kubernetes
- Partner with ML engineers for scalable online serving
Perks/Benefits
- Commute subsidy
- Comprehensive health insurance
- Disability insurance
- Employee resource groups
- Employee stock ownership
- Generous vacation
- Global employee assistance program
- Life insurance
- Mental health & wellbeing programs
- Office Food Snacks
- Retirement pension plans
- Training and development programs
- Volunteering and donation matching program
Skills/Tech-stack
CI/CD | Docker | GCP | Go | Grafana | Inference Serving | Kubernetes | Machine Learning | Microservices | Monitoring | Observability | Prometheus | Real Time | Real-time Personalization
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States12h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R14h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R14h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States14h ago
-
kdb+ Contractor (Capital Markets) USD 150K-200KAWS | Azure | Electronic Trading | GCP | Kdb PlusContract opportunities | On site work 5 days per week | Permanent opportunitiesSenior-level ContractNew York, NY, United States15h ago
-
Senior kdb+ Engineer USD 150K-200KAI Tooling | AWS | Azure | Capital Markets | Electronic TradingFlexible holiday allowance | Healthcare and wellbeing | Hybrid working | Leadership development | Paid certificationsSenior-level Full TimeNew York, NY, United States15h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R15h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York17h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton17h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …17h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI Integration | AWS | Airflow | Apache Spark | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …17h ago
-
GenAI Engineer USD 73K-105KAWS Bedrock | Amazon SageMaker | Amazon Web Services | Data integration | Fine TuningCompetitive benefits package | Onsite work | Travel 0 to 25 percentEntry-level Full TimeArlington/Rosslyn, Virginia, United States17h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …17h ago
-
Databricks Senior Consultant USD 113K-188KAWS | Azure | Business Intelligence | Cloud platform | Data EngineeringSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …17h ago
-
TikTok Shop - E-commerce Anti-Fraud Data Scientist USD 156K-296KA/B | A/B Testing | Analytics | B testing | Big DataMid-level Full TimeSeattle, Washington, United States17h ago
-
Software Engineer, Systems ML - SW/HW Co-design USD 117K-173KAI infrastructure | Bias Mitigation | C# | C++ | Co-designSenior-level Full TimeSunnyvale, CA | Redmond, WA18h ago
-
Software Engineer, Machine Learning USD 213K-293KAPI Design | Agent Orchestration | Artificial Intelligence | Bias Mitigation | C++Senior-level Full TimeSunnyvale, CA | Remote, US | … R18h ago
-
Acoustics | Algorithm Integration | Audio Software | Bring-up | C++Senior-level Full TimeMountain View, CA, USA18h ago
-
Senior Software Engineer, Generative AI, Google Ads USD 174K-252KComputer Vision | Data Processing | Debugging | GenAI | Information RetrievalSenior-level Full TimeMountain View, CA, USA18h ago
-
Staff Software Engineer, AI/ML Performance USD 207K-300KAlgorithms | Auto sharding | C++ | Code debugging | Code generationSenior-level Full TimeSunnyvale, CA, USA18h ago
-
C++ | Data Processing | Debugging | Deep learning | Few-Shot LearningSenior-level Full TimeMountain View, CA, USA18h ago
-
Software Engineer III, Generative AI, Payments Risk USD 147K-211KAgent systems | Algorithms | Analytics | Big Data | Computer VisionSenior-level Full TimeMountain View, CA, USA18h ago
-
C++ | Data Analysis | Data Processing | Deep learning | EmbeddingsSenior-level Full TimeMountain View, CA, USA18h ago
-
Agentic AI Engineer USD 103K-158KAI Search | Agent Orchestration | Anthropic Claude | App Service | Autogen401k match | Flexible paid time off | Hybrid work flexibility | Medical/Dental/Vision | Paid parental leaveMid-level Full TimeGolden, CO, US20h ago
-
CAN | DNP3 | Data Visualization | Docker | Firmware Over The AirSenior-level Full TimeSan Francisco, California, United States22h ago