Software Engineer- BIS (Baseten Inference Stack)
Tasks
- Build routing autoscaling scheduling observability capabilities
- Collaborate on inference optimizations
- Debug production systems in Kubernetes networking and GPU workloads
- Define best practices for testing and release automation
- Deliver end to end engineering from architecture to monitoring and iteration
- Deploy and manage distributed LLM inference
- Develop inference orchestration systems
- Improve reliability scalability and usability
Perks/Benefits
- Company 401K
- Family building stipend
- Flexible PTO
- Medical/Dental/Vision insurance
- Paid parental leave
- Winter break
Skills/Tech-stack
Autoscaling | Backend Engineering | Distributed Runtime | Distributed Systems | GPU Workloads | Kubernetes | Networking | Observability | Routing | Scheduling
Education
Roles
Regions
Countries
States
Related jobs
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …2h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …2h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA2h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA2h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA2h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA2h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino8h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States13h ago
-
Gen AI - CVS - Dallas USD 36K-126KAPI Gateway | Aiohttp | Amazon Web Services | Asyncio | CI/CD401k retirement plan | Medical, dental, vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesMid-level Full TimeUnited States14h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States14h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States15h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA16h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R16h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle17h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA17h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R17h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA18h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas18h ago
-
Machine Learning Engineer III, Core Agents USD 175K-219KAWS Bedrock | Amazon SageMaker | Embedding Models | Evaluation | IndexingSenior-level Full TimeRedwood City, CA18h ago
-
Senior-level Full TimeRemote - United States R18h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …19h ago
-
Senior MLOps Engineer I USD 170K-180KAWS | CI/CD | Canary deployments | Data Versioning | Deployment PipelinesAutonomy | Dental insurance | HSA Eligible | Inclusive culture | Medical insuranceSenior-level Full TimeSan Francisco, California, United States19h ago
-
Senior MLOps Engineer I USD 170K-180KAPI Integration | AWS | CI/CD | Canary Deployment | Computer VisionDental insurance | HSA options | Health insurance | Paid training | Stock options (eligibility)Senior-level Full TimeBoston, Massachusetts, United States19h ago
-
AI Developer USD 99K-198KAWS | Agentic AI | Azure | CI/CD | Data LakesHybrid work schedule | Leadership development | Professional developmentMid-level Full TimeWashington, DC19h ago
-
Robotic Software Engineer USD 191K-253KAgent systems | Autonomy | Behavior Trees | C++ | Computer VisionHealth benefits | Travel opportunitiesMid-level Full TimeCosta Mesa, California, United States19h ago