Cloud Inference Engineer
Tasks
- Build Helm charts
- Build LLM inference platform
- Deploy multi cloud systems
- Deploy multi node large model inference
- Develop Kubernetes operators
- Implement autoscaling
- Implement high throughput batch processing
- Improve request-to-kernel observability
- Integrate kernel serving optimizations
- Manage distributed KV cache
- Optimize cold starts
Perks/Benefits
- 401k matching
- Flexible paid time off
- Health insurance
- Remote work option
- Team events onsite and meetups
Skills/Tech-stack
Autoscaling | Batch Processing | Cache Management | Distributed Systems | Go | Helm | High Performance | High-performance networking | KV cache | KV-cache management | Kubernetes | Language Models | Large Language Models | Machine Learning | Multi-cloud | Observability
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States3h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA5h ago
-
Applied AI Research Engineer USD 140K-200KGPU Programming | KV cache | Model Inference | PyTorch | QuantizationConference events | Dental insurance | Fitness stipend | Health insurance | Learning budgetMid-level Full TimeNew York, NY, US / San … R5h ago
-
Mid-level Full TimeNew York, NY, US5h ago
-
Applied AI/ML [Multiple Positions Available] USD 165K-195KAI Governance | AI governance framework | AWS | Azure | BM25Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States7h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton7h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton7h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Software Engineer, Machine Learning, Travel Ads USD 147K-211KA/B | A/B Testing | Adbrain | B testing | C++Mid-level Full TimeMountain View, CA, USA9h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA9h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA9h ago
-
Algorithms | Backend software | C++ | Control Plane | Data StructuresSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Material Science Research Engineer, DeepMind USD 147K-211KCalculus | Data Analysis | Deep learning | JAX | Linear AlgebraMid-level Full TimeMountain View, CA, USA9h ago
-
Research Engineer, Pretraining, DeepMind USD 174K-253KArtificial Intelligence | Fine Tuning | Inference Optimization | JAX | Language ModelsMid-level Full TimeNew York, NY, USA9h ago
-
Algorithms | C++ | Cloud Storage | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Research Engineer, Humanoids, DeepMind USD 147K-211KC++ | Debugging | Foundation Models | JAX | Language ProcessingMid-level Full TimeMountain View, CA, USA9h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …9h ago
-
Senior Staff Engineer, GDC AI Inference Platform USD 262K-365KAgent coordination | C++ | Cloud infrastructure | Containerization | Data StructuresBonus | Equity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA9h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935513h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US15h ago
-
Senior-level Full TimeSeattle, Washington, United States; USA - …15h ago
-
Senior Robotics Systems Engineer USD 121K-165KActuator integration | Cause analysis | Circuit design | Debugging | Device Drivers401k plan | Dental insurance | Fully stocked kitchen | Green card support | Health insuranceSenior-level Full TimeMilpitas, CA16h ago
-
Principal AI Engineering Architect USD 224K-308KAWS | Data Processing | Docker | Google Cloud | High AvailabilityAdoption and surrogacy reimbursement | Cancer Care Program | Employee Assistance Program (EAP) | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R16h ago
-
Customer Support Engineer USD 140K-270KBash | File systems | High Performance | High-Performance Computing | LinuxHoliday coverage | Rotational weekend shift | Travel opportunitiesSenior-level Full TimeDallas, Texas16h ago