Software Engineer- BIS (Baseten Inference Stack)
Tasks
- Build routing autoscaling scheduling observability capabilities
- Collaborate on inference optimizations
- Debug production systems in Kubernetes networking and GPU workloads
- Define best practices for testing and release automation
- Deliver end to end engineering from architecture to monitoring and iteration
- Deploy and manage distributed LLM inference
- Develop inference orchestration systems
- Improve reliability scalability and usability
Perks/Benefits
- Company 401K
- Family building stipend
- Flexible PTO
- Medical/Dental/Vision insurance
- Paid parental leave
- Winter break
Skills/Tech-stack
Autoscaling | Backend Engineering | Distributed Runtime | Distributed Systems | GPU Workloads | Kubernetes | Networking | Observability | Routing | Scheduling
Education
Roles
Regions
Countries
States
Related jobs
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R9h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R9h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York12h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton12h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …13h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …13h ago
-
Software Engineer, Systems ML - SW/HW Co-design USD 117K-173KAI infrastructure | Bias Mitigation | C# | C++ | Co-designSenior-level Full TimeSunnyvale, CA | Redmond, WA14h ago
-
Software Engineer III, Infrastructure, Infra Spanner USD 147K-211KC++ | Concurrency | Consensus Algorithms | Data Corruption | Data corruption diagnosisSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Apache Flume | C++ | Data Modeling | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA14h ago
-
CAN | DNP3 | Data Visualization | Docker | Firmware Over The AirSenior-level Full TimeSan Francisco, California, United States18h ago
-
Robot Autonomy Engineer-Federal USD 70K-120KC++ | Cloud infrastructure | Containerization | Debugging | Diagnostic toolsFlexible working hours | On-site work | Travel opportunities | U S Person eligibilityMid-level Full TimeIrvine, CA21h ago
-
Senior Machine Learning Engineer USD 229K-360KAB Testing | AWS SageMaker | Airflow | Amazon S3 | Apache FlinkDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California21h ago
-
Software Engineer, Data Infrastructure USD 155K-185KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeMountain View, CA23h ago
-
AWS | Airflow | Ansible | Apache Spark | ArgoCDAdditional vacation days | English courses | Flexible remote options | Health insurance | Hybrid work optionsMid-level Full TimeGeorgia1d ago
-
Sr. Software Development Engineer, Aurora Storage USD 168K-227KAWS | Amazon Aurora | Cross Region | Cross-region replication | Distributed SystemsLearning opportunities | Mentorship | Work-life balanceSenior-level Full TimeRedmond, Washington, USA1d ago
-
Sr. Software Development Engineer, Aurora Storage USD 168K-227KAWS | Auto Scaling | Auto-healing | Cross Region | Cross-region replicationCareer growth resources | Flexible work | Mentorship | Work-life balanceSenior-level Full TimeRedmond, Washington, USA1d ago
-
Gen AI Engineering Analyst - Vice President USD 113K-170KAWS | Accuracy | Apache Kafka | Apache Spark | Azure401k | Accident insurance | Disability insurance | Life insurance | Medical, dental, and vision coverageExecutive-level Full Time14000 CITI CARDS WAY BUILDING C …1d ago
-
APIs | Compliance | Distributed Systems | Enterprise Integration | Generative AIOccasional evening calls | Remote workSenior-level Full TimeRemote - US Based R1d ago
-
AV Safety Engineering Analytics Engineer (GPSSC) USD 160K-246KCI/CD | Dash | Docker | GitHub | JenkinsRemote workMid-level Full TimeWork From Home - United States, … R1d ago
-
Senior AI Engineer USD 74K-147KAI Builder | API Development | AWS | Azure | Azure MLFlexible remote work policy | Flexible work-life balance | Knowledge sharing | Professional development | Supportive environmentSenior-level Full TimeChicago, United States1d ago
-
AI Software Development Engineer USD 170K-275KAPI Development | Agent AI | Automation | C# | CI/CDHealth benefits | Hybrid work model | Retirement benefits | VacationMid-level Full TimeUSA - AZ - Chandler, United …1d ago
-
Senior Software Engineer (Analytics Services) USD 176K-332KAPM | APM Concepts | Aggregation | Caching | Composite AggregationsSenior-level Full TimeUSA VA Reston (Client Site), United …1d ago
-
Senior Software Engineer, AI USD 171K-210KAirflow | Amazon Web Services | Apache Hive | Apache Impala | C#Career development access | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-California-Remote, United States R1d ago
-
Staff Software Engineer - AI USD 184K-230KAI Inference | C# | CSS | Fine Tuning | Foundation ModelsCareer development | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeUS-California-San Jose, United States1d ago
-
Senior Software Engineer USD 144K-192KAWS | Angular | Apache Spark | Azure | BuildahCareer development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R1d ago