Software Engineer- BIS (Baseten Inference Stack)
Tasks
- Build routing autoscaling scheduling observability capabilities
- Collaborate on inference optimizations
- Debug production systems in Kubernetes networking and GPU workloads
- Define best practices for testing and release automation
- Deliver end to end engineering from architecture to monitoring and iteration
- Deploy and manage distributed LLM inference
- Develop inference orchestration systems
- Improve reliability scalability and usability
Perks/Benefits
- Company 401K
- Family building stipend
- Flexible PTO
- Medical/Dental/Vision insurance
- Paid parental leave
- Winter break
Skills/Tech-stack
Autoscaling | Backend Engineering | Distributed Runtime | Distributed Systems | GPU Workloads | Kubernetes | Networking | Observability | Routing | Scheduling
Education
Roles
Regions
Countries
States
Related jobs
-
Senior Software Engineer, Generative AI, Core ML USD 174K-253KAgent systems | Computer Vision | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, USA6h ago
-
Staff Software Engineer, Generative AI USD 207K-301KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Azure | Caching | Cloud platform | Data Management401k match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeSanta Clara, CALIFORNIA, United States12h ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R16h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R17h ago
-
Staff Applied Scientist USD 244K-320KAgentic Systems | Artificial Intelligence | Benchmarking | CI/CD | Computer VisionEmployee communities | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States17h ago
-
Sr. AI Engineer (Applied AI & ML Systems) USD 132K-165KAgentic AI | Context engineering | Continuous Improvement | Data Engineering | Data PipelinesE learning license | Hackathons | Healthcare benefits | Home office setup allowance | Identity theft protectionSenior-level Full TimeUnited States R18h ago
-
Sr. Software Engineer - Analytics USD 160K-215KAPI Design | Computational Linguistics | Data Modeling | Elasticsearch | Java401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSomerville, MA20h ago
-
C# | C++ | CI/CD | Containerization | Data PipelinesMid-level Full TimeRedmond, WA, US22h ago
-
AI Engineer/Forward-Deployed Engineer USD 125K-250K.NET | APIs | Access Management | Agent Orchestration | Angular401k match | Annual paid time off | Dental insurance | Health insurance | Health savings accountSenior-level Full TimeAustin, TX, United States23h ago
-
Software Engineer, Data Platform USD 140K-260KAWS | Access Control | Azure | ClickHouse | DBTVisa sponsorshipSenior-level Full TimeNew York, New York23h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
Machine Learning Engineer USD 153K-222KC plus plus | C# | Computer Vision | Data Generation | Data PipelinesMid-level Full TimeSan Francisco, CA, United States1d ago
-
Applied Research Scientist / Engineer USD 175K-250KData Curation | Deep learning | Diffusion Models | Distributed Training | Domain AdaptationMid-level Full TimeNew York, NY, SF Bay Area, …1d ago
-
Senior Assistant Vice President USD 128K-188KAWS Bedrock | AlloyDB | Amazon Web Services | Azure | Azure OpenAISenior-level Full TimeUnited States1d ago
-
Senior Software Engineer - San Francisco (Onsite) USD 130K-220KAWS | Amazon EMR | Amazon S3 | Apache Flink | Apache SparkFast-paced startup environment | Onsite work environment | Rapid hiring process feedback | Relocation supportSenior-level Full TimeSan Francisco, CA, US1d ago
-
Machine Learning Engineer USD 223K-260KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | BigQuery401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeNew York City, NY1d ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus | Collaborative culture | Distributed-first environmentMid-level Full TimeCanada R1d ago
-
AI/ML Engineer - Supply Chain USD 99K-192KAI Platform | API Authentication | API authorization | Autogen | CI/CDChild care subsidy | Community service time | Dental insurance | Employee resource groups | Health insuranceMid-level Full TimeDearborn, MI, United States1d ago
-
Staff Software Engineer (Applied AI) USD 240K-300KAI Agents | APIs | Data Modeling | Distributed Systems | KafkaCommuter benefit | DashPass | Dinner Provided | Gympass Benefit | HSASenior-level Full TimeNew York City, NY1d ago
-
Software Engineer 2/3-BY-SIG-02 USD 78K-250KAccumulo | BSON | Bigtable | Docker | HBase401k match | Diverse inclusive workplace | Employee referral programs | Flexible work arrangements | Mental health supportSenior-level Full TimeHanover, MD1d ago
-
Senior Software Engineer (Applied AI) USD 200K-240KAPI Design | Distributed Systems | Evaluation | Kafka | LLM integrationCommuter benefit | Gympass Benefit | HSA | Health, dental, vision coverage | HealthAdvocateSenior-level Full TimeNew York City, NY1d ago
-
GenAI Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerProfessional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States1d ago
-
Generative AI Engineer III USD 110K-218KArtificial Intelligence | Data Analysis | Data Pipelines | Docker | KubernetesDiscretionary annual incentive program | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …1d ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Docker | Generative AI | KubernetesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …1d ago