Senior Software Engineer, Foundation Model API
Tasks
- Build LLM infrastructure
- Collaborate with platform and ML teams
- Design deployment pipelines and observability
- Develop scalable APIs for model inference
- Implement real time and batch inference services
- Improve reliability latency efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
Cloud Native | Deployment Pipelines | Distributed Systems | GPU Orchestration | Go | Machine Learning | Machine Learning Infrastructure | Python | Real Time | Real-time Serving | Scala | Scalable APIs | Service Oriented | Service-Oriented Architecture | System Observability
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Staff Machine Learning Engineer, DUE USD 238K-302KAnomaly Detection | C++ | Data Processing | Deep learning | Hugging FaceSenior-level Full TimeMountain View, CA, USA5h ago
-
AI Solutions Engineer USD 126K-176KArchitecture Design | Artificial Intelligence | Data Mapping | Data Templates | DataverseHybrid work arrangement | Relocation N/A | Travel opportunityMid-level Full TimePhoenix, AZ, US6h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R6h ago
-
Data Scientist ll - Digital Intelligence USD 140K-170KDatabricks | Experiment analysis | Feature Engineering | Machine Learning | Model EvaluationMid-level Full TimeHybrid - US R7h ago
-
Forward Deployed Engineer (FDE) - Intern - 2026-2027 USD 120K-155KA/B | A/B Testing | Asyncio | B testing | Cloud infrastructureEntry-level InternshipSan Francisco11h ago
-
Entry-level Full TimePittsburgh, PA11h ago
-
Forward Deployed Engineer (FDE) - New Grad - 2026-2027 USD 125K-178KA/B | A/B Testing | Asyncio | B testing | Cloud infrastructureEntry-level Full TimeSan Francisco11h ago
-
Senior Software Engineer, AI Native Web Platform USD 159K-219KAccessibility Standards | Accessibility testing | Automated testing | Build systems | CI/CDSenior-level Full TimeMountain View, California11h ago
-
Staff Software Engineer, Agentic Applications USD 198K-272KApproval Workflow | Audit Logging | Behavioral Regression | Behavioral Regression Testing | Content ManagementSenior-level Full TimeMountain View, California11h ago
-
Software Engineer, Web Products USD 136K-204KBuild systems | CI/CD | CSS | Component architecture | Content ManagementMid-level Full TimeMountain View, California11h ago
-
Data Engineer USD 120K-150KAPIs | Access Control | Airbyte | Amazon Redshift | Apache AirflowFully remote | Work independentlyMid-level Full TimeUnited States (Remote) R12h ago
-
Senior/Staff Machine Learning Engineer USD 223K-268KAPI Integration | Anomaly Detection | Class Imbalanced Modeling | Databases | Drift DetectionHealth benefits | Long-term incentives | Medical benefits | Performance bonusSenior-level Full TimeSan Jose, California, United States12h ago
-
Senior-level Full TimeMountain View, California; San Francisco, California12h ago
-
Staff Software Engineer- CXI USD 164K-225KAPIs | AWS | Agentic Automation | Azure | Backend DevelopmentSenior-level Full TimeMountain View, California; San Francisco, California12h ago
-
Computational Linguist, AI Evaluation USD 140K-160KAWS EC2 | AWS S3 | Analytics | Automated scoring | BenchmarkingCo-working memberships | Daily meals provided | Flexible PTO | Health, dental, vision benefits | Learning and development stipendSenior-level Full TimeSan Francisco13h ago
-
Senior Software Engineer (Applied AI) USD 160K-200KAPIs | AWS | Agentic Workflows | Best practices | Cost monitoringCareer development | Discretionary performance bonus | Equity options | Health benefitsSenior-level Full TimeSeattle, New York City, Boston, or … R13h ago
-
Staff Data Platform Engineer USD 213K-245KAWS | AWS Lambda | CDK | CI/CD | Code Quality401k match | Catered lunches | Dental insurance | Flexible work schedule | HackathonsSenior-level Full TimeRemote, United States R14h ago
-
Senior Software Engineer, Perception Architecture USD 184K-296KC++ | Computer Vision | Data pipeline | Deep learning | Machine LearningSenior-level Full TimePittsburgh, PA or Remote R14h ago
-
Lead Data Scientist, Demand Forecasting USD 160K-192KBayesian Modeling | Data Pipelines | Data Quality | Hierarchical modeling | MLOps401k match | Dental insurance | Income protection | Medical insurance | Paid time offSenior-level Full TimeCharlotte, North Carolina, United States14h ago
-
Mid-level Full TimeLos Angeles, CA, United States; New …14h ago
-
Mid-level Full Time上海、圣何塞14h ago
-
Senior Software Engineer, Data & AI Platform USD 171K-224KApache Spark | Batch Processing | CI/CD | Cloud Native | Data Engineering401k retirement savings plan | Annual cash bonus | Equity grants | Flexible time off | Generous parental leaveSenior-level Full TimeRemote, USA R15h ago
-
Data Engineer USD 180K-235KAccess Control | BigQuery | Data Modeling | Data Warehouse | Data pipeline401k match | Medical, dental & vision coverage | Paid parental leave | Stipends | Unlimited PTOMid-level Full TimeNew York15h ago