Software Engineer- BIS (Baseten Inference Stack)
Tasks
- Build routing autoscaling scheduling observability capabilities
- Collaborate on inference optimizations
- Debug production systems in Kubernetes networking and GPU workloads
- Define best practices for testing and release automation
- Deliver end to end engineering from architecture to monitoring and iteration
- Deploy and manage distributed LLM inference
- Develop inference orchestration systems
- Improve reliability scalability and usability
Perks/Benefits
- Company 401K
- Family building stipend
- Flexible PTO
- Medical/Dental/Vision insurance
- Paid parental leave
- Winter break
Skills/Tech-stack
Autoscaling | Backend Engineering | Distributed Runtime | Distributed Systems | GPU Workloads | Kubernetes | Networking | Observability | Routing | Scheduling
Education
Roles
Regions
Countries
States
Related jobs
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States7h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States9h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas13h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …13h ago
-
Senior MLOps Engineer I USD 170K-180KAWS | CI/CD | Canary deployments | Data Versioning | Deployment PipelinesAutonomy | Dental insurance | HSA Eligible | Inclusive culture | Medical insuranceSenior-level Full TimeSan Francisco, California, United States13h ago
-
Senior MLOps Engineer I USD 170K-180KAPI Integration | AWS | CI/CD | Canary Deployment | Computer VisionDental insurance | HSA options | Health insurance | Paid training | Stock options (eligibility)Senior-level Full TimeBoston, Massachusetts, United States13h ago
-
AI Developer USD 99K-198KAWS | Agentic AI | Azure | CI/CD | Data LakesHybrid work schedule | Leadership development | Professional developmentMid-level Full TimeWashington, DC13h ago
-
Staff Software Engineer, Data Products USD 171K-224KAWS | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k retirement savings plan | Flexible time off | Generous parental leave | Health, dental, and vision insurance | Lifestyle spending account mental health support solutionsSenior-level Full TimeRemote, USA R14h ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsCompany-matched 401k | Flexible schedule | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeUnited States R15h ago
-
Algorithms | Concurrent programming | Data Structures | Distributed Systems | ESQL401k match | Flexible schedule | Generous vacation days | Health coverage | Parental leaveSenior-level Full TimeUnited States R15h ago
-
AI Application Engineer USD 127K-167KAWS | Agentic Applications | Automation | C++ | CI/CD401k | Daily Cafeteria Stipend | Dental insurance | Health insurance | Onsite gymMid-level Full TimeBoston, MA16h ago
-
Algorithms | Concurrency | Data Structures | Distributed Systems | Engine technologyCompany-matched 401k | Donation matching | Employee stock program | Flexible schedule | Health coverageSenior-level Full TimeUnited States R16h ago
-
Reindeer- Software Engineer (Infrastructure) USD 180K-250KAPI Integration | AWS | Authentication | Authorization | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL19h ago
-
Forward Deployed Engineer IV, Applied AI, Google Cloud USD 207K-301KAPI Integration | Agent systems | Cloud platform | Conversational AI | DebuggingTravel up to 50%Senior-level Full TimeSan Francisco, CA, USA; Austin, TX, …21h ago
-
Robotics Integration Engineer USD 150K-193KC++ | CAN bus | CI/CD | Calibration | Camera401k | Commuter benefits | Daily lunches | Flexible vacation policy | Health ConciergeMid-level Full TimeMountain View, CA1d ago
-
Expert Data Scientist/Systems Engineer USD 190K-225KAgile | Cloud infrastructure | Cypher | Data Analysis | Data ModelingSenior-level Full TimeChantilly, VA, United States1d ago
-
Mid-level Full TimeRichardson, TX, United States1d ago
-
Lead AI Solutions Systems Engineer USD 142K-188KAPI Design | Agentic AI | Artificial Intelligence | Bias detection | CI/CDSenior-level Full TimeHerndon, VA, United States1d ago
-
Senior Data Engineer - AVP USD 120K-175KAML | AWS | AWS Glue | AWS Lambda | Amazon EC2Medical Dental Vision 401k Life Insurance Paid LeaveSenior-level Full TimeBuilding 400-Whippany Campus, Jefferson Park, United …1d ago
-
AI/ML Software Engineer USD 95K-140KAWS | Agent systems | Agentic Workflows | Autogen | AzureDisability insurance | Life insurance | Paid parental leave | Paid time off | Retirement plan matchSenior-level Full TimeEvendale, United States R1d ago
-
APIs | Amazon Web Services | Azure | Cloud Architecture | Cloud Native401k plan | Accidental death insurance | Adoption reimbursement | Critical illness coverage | Disability benefitsSenior-level Full TimeBothell, Washington1d ago
-
Amazon Web Services | Azure | Cloud Native | Cloud Native Architecture | Distributed Systems401k plan | Adoption reimbursement | Disability benefits | Disability insurance | Employee assistance programSenior-level Full TimePlano, Texas1d ago
-
API performance | AWS | Azure | Cloud Native | Distributed Systems401k plan | Adoption reimbursement | Disability benefits | Employee assistance program | Employee discountsSenior-level Full TimeSan Ramon, California1d ago
-
Lead, Software Engineer - Data Analyst TS/SCI 1 USD 110K-218KAWS | Angular | CI/CD | CSS | CloudFormation9/80 schedule | Every other Friday off | Onsite workSenior-level Full TimePatrick Air Force Base, FL1d ago
-
Specialist, Software Engineer - Data Analyst TS/SCI USD 92K-177K.NET | AWS | Angular | Automated testing | CI/CDMid-level Full TimeMelbourne, FL1d ago