Staff Backend Engineer, ML Inference Systems
Tasks
- Deploy production grade inference infrastructure
- Design backend services and distributed systems
- Ensure low latency high throughput serving
- Implement backend service development testing deployment monitoring best practices
- Lead inference platform technical direction
- Manage and optimize GCP infrastructure
- Monitor and troubleshoot using observability tools
- Orchestrate workloads with Kubernetes
- Partner with ML engineers for scalable online serving
Perks/Benefits
- Commute subsidy
- Comprehensive health insurance
- Disability insurance
- Employee resource groups
- Employee stock ownership
- Generous vacation
- Global employee assistance program
- Life insurance
- Mental health & wellbeing programs
- Office Food Snacks
- Retirement pension plans
- Training and development programs
- Volunteering and donation matching program
Skills/Tech-stack
CI/CD | Docker | GCP | Go | Grafana | Inference Serving | Kubernetes | Machine Learning | Microservices | Monitoring | Observability | Prometheus | Real Time | Real-time Personalization
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Computer Vision AI & ML Engineer USD 100K-300K3D Geometry | 3D Scene | 3D Scene Understanding | Computer Vision | Data AugmentationEntry-level Full TimeSan Mateo, CA6h ago
-
Amazon Redshift | Data Modeling | Data Pipelines | ETL | ExperimentationMid-level Full TimeBellevue, Washington, USA8h ago
-
AI Engineer at Lumion USD 148K-200KAPI Design | Data Modeling | Debugging | Guardrails | Language Models401k | Health dental vision reimbursement | MacBook Pro | Relocation support | Tech stipendMid-level Full TimeSouth Jordan, UT, US, CA, US9h ago
-
Enterprise AI Platform Engineer USD 130K-150KAPI Gateway | AWS | AWS IAM | Audit Logging | Azure401k | Dental insurance | Flexible PTO | Growth opportunities | Medical insuranceSenior-level Full TimeAustin, TX9h ago
-
Software Engineer, Storage USD 140K-265KAlerting | Autoscaling | C++ | Cloud Native | Databases401k contribution | Dental insurance | Education stipend | Healthy lunches | Home office improvement stipendMid-level Full TimeMountain View, CA9h ago
-
Software Engineer II, Machine Learning USD 145K-175KAWS | Airflow | CI/CD | Data Preparation | Experimentation401k employer match | Commuter subsidy | Concierge medical membership | Dental insurance | Fitness membership subsidyMid-level Full TimePalo Alto, California10h ago
-
AI Architect - Business Applications USD 138K-225KA/B | A/B Testing | API | B testing | ExperimentationHybrid work optionSenior-level Full TimeBellevue, WA, United States10h ago
-
Senior Data Engineer USD 165K-216KAWS | Apache Airflow | BI Integration | CI/CD | Cloud Computing401k match | Company events | Dental insurance | Employee discount | Free swagSenior-level Full TimeBeverly Hills12h ago
-
Staff Machine Learning Engineer USD 200K-220KAWS | Alerting | Auto Scaling | Automated retraining | CI/CD401k match | Dental insurance | Disability insurance | EAP support | Life insuranceSenior-level Full TimeWaltham, MA13h ago
-
Staff Machine Learning Engineer USD 200K-220KAWS | Artificial Intelligence | Automated retraining | CI/CD | Cloud Computing401k match | Bonding Leave | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeNorth Bethesda, MD13h ago
-
Data Engineer USD 81K-97KAWS | AWS Lambda | Apache Airflow | CI/CD | DBT401k | Flexible spending accounts | Health/vision/dental insurance | Hybrid work model | Paid disability benefitsMid-level Full TimeChicago - RAPP R13h ago
-
AWS | Anomaly Detection | Databricks | Docker | Explainability401k | Dental insurance | Equity compensation | Healthcare | Paid time offSenior-level Full TimeSan Francisco (Remote) R14h ago
-
Alerting | Automation | Classifier evaluation | Dashboards | Data InfrastructureHybrid work model | Resilience supportSenior-level Full TimeSan Francisco14h ago
-
Senior AI Product Engineer, Frameworks USD 166K-225KAgentic Workflows | Anthropic API | Chunked HTTP | Context Management | Data Processing401k plan | Healthcare concierge services | Hybrid work model | In office Tuesday through Thursday | Life and disability insuranceSenior-level Full TimeHybrid - San Francisco R14h ago
-
Algorithms | Data Governance | Data Structures | Databases | Distributed SystemsSenior-level Full TimeBellevue, Washington; Seattle, Washington14h ago
-
Algorithms | Cost Optimization | Data Governance | Data Structures | Database systemsSenior-level Full TimeMountain View, California; San Francisco, California14h ago
-
Quantitative Developer USD 135K-150KAPI Integration | C# | Compliance | Financial Data | Java401k match | Educational reimbursement | Gym subsidy | Health benefits | PTOMid-level Full TimeRemote - US R14h ago
-
Embedded Software Engineer II - (C++) Realtime Platform USD 150K-225KARM | ARM TrustZone | ASPICE | Automotive Ethernet | Bazel401k match | Adoption surrogacy support program | Backup child and elder care support | Commuter benefits | Daily meals and snacksMid-level Full TimePittsburgh, PA, Palo Alto, CA, Detroit, …14h ago
-
Senior-level Full TimeChantilly, VA14h ago
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States14h ago
-
AWS | Agent systems | Apache Spark | Apache Spark SQL | AzurePeriodic onsite work | Remote work option | Travel as neededSenior-level Full TimeMaryland; Virginia; Washington, D.C.14h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R16h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R16h ago
-
Sr. Software Engineer (Computational Geometry) USD 140K-200KC++ | CAD/CAM | CNC machining | Computational Geometry | Geometric analysisImpact on aerospace production | Mentorship opportunities | Startup environmentSenior-level Full TimeHuntington Beach16h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States17h ago