Staff Software Engineer, Foundation Model API
Tasks
- Build LLM infrastructure for large scale inference
- Collaborate with platform, infra, and ML teams
- Deliver end to end experiences for data apps and AI agents
- Improve reliability latency and efficiency of distributed AI workloads
- Shape FMAPI product roadmap and execution
Perks/Benefits
- N/A
Skills/Tech-stack
Cloud Native | Cloud-native infrastructure | Deployment Pipelines | Distributed Systems | GPU Orchestration | Go | Machine Learning | Machine Learning Infrastructure | Python | Real Time | Real-time Serving | Scala | Scalable APIs | Service Oriented | Service-Oriented Architecture | System Observability
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R7d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R20d ago
-
ASE | Apptainer | Binding Site Identification | CI/CD | CheminformaticsHealth insurance | Paid time off | Remote work flexibility | Retirement contributionsSenior-level Full TimeSan Jose, California, US, 951342h ago
-
Senior Software Engineer - Machine Learning USD 152K-186KApache Flink | Apache Storm | Deep learning | Generative AI | Go401k match | Dental insurance | Equity awards | Health plan | Life insuranceSenior-level Full TimeChicago, IL 60607, United States5h ago
-
Senior-level Full TimeSan Francisco, California, United States5h ago
-
Software Development Staff Engineer Senior USD 184K-232KAWS | AWS CodeCommit | AWS CodeDeploy | AWS CodePipeline | AWS DocumentDBSenior-level Full TimeCosta Mesa, CA, United States6h ago
-
Development and Operations Engineer I USD 102K-125KAWS | AWS CloudFormation | AWS CodeBuild | AWS CodePipeline | Amazon EC2Comprehensive benefits | TelecommuteSenior-level Full TimeCosta Mesa, CA, United States6h ago
-
Database Developer Expert USD 183K-202KAlteryx | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web ServicesSenior-level Full TimeCosta Mesa, CA, United States7h ago
-
Alerting | Cloud Computing | Compute Optimization | Data Quality | Distributed Training401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ7h ago
-
Artificial Intelligence Machine Learning Engineer 2 USD 130K-270KArtificial Intelligence | Data Modeling | Data Quality | Data Structures | Iterative design401k contribution | 401k vested from day 1 | AD&D insurance | Dental insurance | HSA contributionSenior-level Full TimeAnnapolis Junction, MD8h ago
-
Software Engineer 2 - Python/PySpark/AWS USD 130K-270KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySpark401k contribution | AD and D insurance | Employee Dental Insurance | Employee Medical Insurance | Employee Vision InsuranceSenior-level Full TimeAnnapolis Junction, MD8h ago
-
Machine Learning Engineer II USD 75K-85KAPI Development | AWS | Algorithms | Azure | Big Data401k match | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeSaint Charles, MO, United States9h ago
-
Data Analytics - Associate USD 110K-150KA/B | A/B Testing | B testing | DBT | Data EngineeringEmployer-Matched Retirement Plan | Flexible remote work Friday | Parental leave | Subsidized healthcare | TelemedicineSenior-level Full TimeNew York, New York, United States R10h ago
-
Software Engineer, Platform USD 180K-225KAWS Step Functions | Amazon Web Services | Authentication and Authorization | CI/CD | CircleCICommuter stipend | Generous PTO | Health, dental and vision coverage | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY11h ago
-
Data Engineer (Java) - IFS Loops USD 115K-125KAPI Authentication | API Keys | API rate-limiting | AWS | Azure401k company contribution | Community involvement and volunteering events | Disability benefits | Flexible paid time off | Flexible spending accountsMid-level Full TimePalo Alto, California, United States11h ago
-
Airflow | Amazon Web Services | Apache Flink | Apache Spark | Cloud platformRemote work | US time zone flexibilityEntry-level Full TimeColumbia - Maryland11h ago
-
AWS | Airflow | Crawling | Cypher | Data VisualizationRemote work | US only work authorization without sponsorshipMid-level Full TimeColumbia - Maryland11h ago
-
Object Storage Product Engineer USD 204K-280KAPIs | Distributed Systems | Go | Key-Value Datastore | Key-value401k plan | Commuter benefits | Continuous learning benefits | Employer paid dental coverage | Employer paid vision coverageSenior-level Full TimeRemote: United States R11h ago
-
Senior-level Full TimeNew York11h ago
-
Software Engineer 1 - AI/ML/Terraform/C++/AWS/GPU USD 130K-270KAI | Amazon Web Services | C++ | GPU | Golang401k | Accidental death and dismemberment | Dental insurance | Health savings account | Life insuranceSenior-level Full TimeAnnapolis Junction, MD11h ago
-
Principal AI Engineer USD 200K-220KAWS | Agent Orchestration | Authentication | Authorization | CI/CDCareer advancement | Employee recognition | LinkedIn Learning Platform | Open PTO | Paid parental leaveSenior-level Full TimeRemote US R12h ago
-
Applied AI Engineer USD 145K-200KAPI Development | Agent architecture | Artificial Intelligence | Backend Development | Data Pipelines401k Employer Fee Coverage | Commuter benefits | Disability insurance | FSA | HSA contributionsSenior-level Full TimeSan Francisco13h ago
-
Sr Salesforce Health Cloud Data Engineer USD 120K-176KAzure | Azure Data | Azure Data Factory | Data Factory | Data Loader401k match | Accident insurance | Critical illness insurance | Daycare FSA | Dental insuranceSenior-level Full TimePhoenix, Arizonia13h ago
-
Engineer Embedded System Engineering USD 87K-116K8D | A3 | Blink Codes | Bus Traces | Bus analyzer401k plan | Employee assistance program | Paid sick leave | Paid vacation time | Tuition reimbursementEntry-level Full TimeIrvine, CA, United States13h ago
-
Staff Software Engineer, Cloud Data Storage USD 212K-286KAWS | Caching | Cassandra | ClickHouse | Cloud platform401k plan | Disability insurance | Health Dental Vision Premium Coverage | In-home office setup | Internet stipendSenior-level Full TimeUnited States - Remote Opportunity R14h ago