Cloud Inference Engineer
Tasks
- Build Helm charts
- Build LLM inference platform
- Deploy multi cloud systems
- Deploy multi node large model inference
- Develop Kubernetes operators
- Implement autoscaling
- Implement high throughput batch processing
- Improve request-to-kernel observability
- Integrate kernel serving optimizations
- Manage distributed KV cache
- Optimize cold starts
Perks/Benefits
- 401k matching
- Flexible paid time off
- Health insurance
- Remote work option
- Team events onsite and meetups
Skills/Tech-stack
Autoscaling | Batch Processing | Cache Management | Distributed Systems | Go | Helm | High Performance | High-performance networking | KV cache | KV-cache management | Kubernetes | Language Models | Large Language Models | Machine Learning | Multi-cloud | Observability
Education
N/A
Related jobs
-
Senior Software Engineer (Storage) - remote in the US USD 100K-175KArgoCD | CSI | FluxCD | GitOps | GoSenior-level Full TimeRemote, USA, United States R4h ago
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-210KAI/ML | AI/ML model development | Artificial Intelligence | C++ | CI/CDSenior-level Full TimeAustin, TX, USA5h ago
-
Imaging Machine Learning Engineer USD 132K-189K3A Tuning | Algorithm Development | Benchmarking | C++ | CalibrationMid-level Full TimeMountain View, CA, USA5h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KC++ | Code review | Data Processing | Data Storage | DebuggingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Développeur II - IA Vision par ordinateur - MLOps CAD 81K-135KAgile | Apache Spark | Azure | Big Data | CI/CDFlexible schedule | Health insurance | Hybrid telework | Life insurance | Retirement planMid-level Full TimeMontréal, QC, CA9h ago
-
Staff Machine Learning Engineer, Gen AI | Voice & Speech USD 150K-220KBigtable | Cloud Computing | Cloud Native | Cloud-native infrastructure | Data integrationRemote US basedSenior-level Full TimeUS Remote R11h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …15h ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …15h ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …15h ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R23h ago
-
Airflow | Decision Trees | Deep learning | Docker | EnsemblesSenior-level Full TimeSan Francisco, California, United States1d ago
-
💎 Computational Materials Scientist 💎 USD 90K-140KAWS EC2 | Artificial Intelligence | Bash | Enterprise Linux | GPU ComputingFree food and snacks | Health care plan | Life insurance | Long-term disability | Paid time offMid-level Full TimeWalnut Creek, California, United States R1d ago
-
Principal Machine Learning Engineer, ML Platform USD 212K-287KAgent workflows | Amazon SageMaker | Artifact management | Autoscaling | Batch inferenceCharity donation match | Coaching | Company offsites | Dental coverage | Flexible working hoursSenior-level Full TimeRemote (United States) R1d ago
-
Full Stack Gen AI Engineer USD 128K-197KAWS Bedrock | AWS Fargate | Amazon ECS | Amazon Web Services | CI/CDSenior-level Full TimeDallas, Texas, United States1d ago
-
Senior Software Engineer, AI Developer Experience USD 200K-400KAlerting | Build systems | CI/CD | Caching | DashboardsDaily lunches & snacks | Disability benefits | Life insurance | Medical/Dental/Vision insurance | Parental leaveSenior-level Full TimeSan Francisco1d ago
-
Machine Learning Engineer USD 129K-220KC++ | Computer Vision | Data Curation | Dataset Preparation | Deep learning401k | Flexible working hours | Free Coffee, Drinks & Snacks | Health insurance | Life insuranceEntry-level Full TimeArlington, Virginia1d ago
-
Machine Learning Engineer USD 129K-190KComputer Vision | Deep learning | Language Processing | Machine Learning | Multi-object Tracking401k | Flexible working hours | Free coffee | Free drinks | Free snacksMid-level Full TimeClifton Park, New York1d ago
-
Senior Data Engineer USD 140K-216KAPI Integration | Airflow | Alerting | Amplitude | BigQuery401k match | Casual dress environment | Development dollars | Disability insurance | Life insuranceSenior-level Full TimeEdmond, OK1d ago
-
API Development | Ablation Studies | Agent systems | CI/CD | Cloud ComputingDonation matching | Flexible PTO | Health insurance | Lunch stipend | Team building eventsEntry-level InternshipBerkeley, California, United States; San Francisco, …1d ago
-
Senior Storage Engineer (Hybrid) USD 101K-188KAPI | Ansible | Auditability | Azure DevOps | BashHybrid work environment | Medical, dental, vision and life insurance | Retirement plan with 401(k) matchingSenior-level Full TimeManassas, United States1d ago
-
Senior Algorithm Engineer USD 186K-316KArtificial Intelligence | C++ | Computational electromagnetics | Computational imaging | Computer Vision401k matching | Dental | Employee assistance program | Employee stock purchase program | Life insuranceSenior-level Full TimeUSA-CA-Milpitas-KLA, United States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior Algorithm Engineer USD 170K-190KContinuous Delivery | Continuous integration | Data labeling | Deep learning | Device SoftwareRemote workSenior-level Full TimeBoston, MA / Remote R1d ago
-
Agentic Systems | BGP | DNS | Distributed Systems | EnvoyBerlitz tutoring | Catered meals | Flexible learning support | Language tutoring | MentorshipSenior-level Full TimeMontreal, Quebec; Toronto, Ontario; Remote, Canada; … R2d ago