Software Engineer- BIS (Baseten Inference Stack)
Tasks
- Build routing autoscaling scheduling observability capabilities
- Collaborate on inference optimizations
- Debug production systems in Kubernetes networking and GPU workloads
- Define best practices for testing and release automation
- Deliver end to end engineering from architecture to monitoring and iteration
- Deploy and manage distributed LLM inference
- Develop inference orchestration systems
- Improve reliability scalability and usability
Perks/Benefits
- Company 401K
- Family building stipend
- Flexible PTO
- Medical/Dental/Vision insurance
- Paid parental leave
- Winter break
Skills/Tech-stack
Autoscaling | Backend Engineering | Distributed Runtime | Distributed Systems | GPU Workloads | Kubernetes | Networking | Observability | Routing | Scheduling
Education
Roles
Regions
Countries
States
Related jobs
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Azure | Caching | Cloud platform | Data Management401k match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeSanta Clara, CALIFORNIA, United States10h ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R14h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R15h ago
-
Staff Applied Scientist USD 244K-320KAgentic Systems | Artificial Intelligence | Benchmarking | CI/CD | Computer VisionEmployee communities | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States15h ago
-
Sr. AI Engineer (Applied AI & ML Systems) USD 132K-165KAgentic AI | Context engineering | Continuous Improvement | Data Engineering | Data PipelinesE learning license | Hackathons | Healthcare benefits | Home office setup allowance | Identity theft protectionSenior-level Full TimeUnited States R16h ago
-
Sr. Software Engineer - Analytics USD 160K-215KAPI Design | Computational Linguistics | Data Modeling | Elasticsearch | Java401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSomerville, MA18h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R22h ago
-
Machine Learning Engineer USD 153K-222KC plus plus | C# | Computer Vision | Data Generation | Data PipelinesMid-level Full TimeSan Francisco, CA, United States22h ago
-
Applied Research Scientist / Engineer USD 175K-250KData Curation | Deep learning | Diffusion Models | Distributed Training | Domain AdaptationMid-level Full TimeNew York, NY, SF Bay Area, …23h ago
-
Senior Software Engineer - San Francisco (Onsite) USD 130K-220KAWS | Amazon EMR | Amazon S3 | Apache Flink | Apache SparkFast-paced startup environment | Onsite work environment | Rapid hiring process feedback | Relocation supportSenior-level Full TimeSan Francisco, CA, US1d ago
-
Machine Learning Engineer USD 223K-260KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | BigQuery401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeNew York City, NY1d ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus | Collaborative culture | Distributed-first environmentMid-level Full TimeCanada R1d ago
-
AI/ML Engineer - Supply Chain USD 99K-192KAI Platform | API Authentication | API authorization | Autogen | CI/CDChild care subsidy | Community service time | Dental insurance | Employee resource groups | Health insuranceMid-level Full TimeDearborn, MI, United States1d ago
-
Software Engineer 2/3-BY-SIG-02 USD 78K-250KAccumulo | BSON | Bigtable | Docker | HBase401k match | Diverse inclusive workplace | Employee referral programs | Flexible work arrangements | Mental health supportSenior-level Full TimeHanover, MD1d ago
-
GenAI Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerProfessional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States1d ago
-
Generative AI Engineer III USD 110K-218KArtificial Intelligence | Data Analysis | Data Pipelines | Docker | KubernetesDiscretionary annual incentive program | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …1d ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Docker | Generative AI | KubernetesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …1d ago
-
Generative AI Data Engineer III USD 131K-218KAlgorithm Development | Artificial Intelligence | Data Analysis | Data Modeling | Data PipelinesMentorship | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; New York, …1d ago
-
APIs | CI/CD | Cloud platform | Compliance | ContainersAnnual leave | Dental coverage | Health coverage | High autonomy | Home office setup supportSenior-level Full TimeCanada R1d ago
-
A/B | A/B Testing | Asynchronous programming | B testing | Canary ReleasesEngineering autonomy | Inclusive work environment | Mentorship | Remote-first flexibility | Technical leadership developmentSenior-level Full TimeCanada1d ago
-
Networking AI Technical Lead USD 207K-301KAlgorithms | Artificial Intelligence | C++ | Compute Technologies | Data StructuresSenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA1d ago
-
Senior Quantum Applications Engineer - QEC USD 119K-258KCUDA-Q | Docker | End to End | End-to-End Testing | Error correctionSenior-level Full TimeNew Haven, CT1d ago
-
AWS | Access Control | Apache Spark | Azure | CI/CD401k retirement plan | Comprehensive benefits | Dental insurance | Employee assistance program | Medical insuranceSenior-level Full TimeUSA, TX, Work-at-Home, United States R1d ago
-
AWS | Azure | C# | C++ | ExperimentationSenior-level Full TimeNew York, NY, United States1d ago
-
Sales Data & Analytics Product Manager USD 131K-190KAmazon Web Services | Analytics reporting | Apache Airflow | Apache Kafka | Apache Spark401k | Bonus | Dental coverage | Holidays | Medical coverageMid-level Full TimeUS, MA, Wilmington, United States1d ago