Staff Backend Software Engineer- (AI Platform)
Tasks
- Build routing caching observability and autoscaling components
- Collaborate with product platform and research teams to deliver serving systems
- Design and implement core systems and APIs for model serving
- Drive architectural decisions for CPU and GPU inference performance
- Establish best practices for code quality, testing, and operational readiness
- Improve latency availability and cost effectiveness
- Mentor engineers through design reviews and technical guidance
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | Algorithms | Autoscaling | Caching | Data Structures | Distributed Systems | Docker | High Throughput | Inference | Low Latency | Machine Learning | Model Serving | Observability | Performance Tuning | Routing | System design
Education
N/A
Regions
Countries
States
Related jobs
-
AWS | Azure | CI/CD | Data Engineering | DockerCross-functional collaboration | Documentation support | Flexible teamwork environment | MentorshipEntry-level InternshipIrvine, CA, US3h ago
-
Senior Software Engineer, Data Platform & AI Enablement USD 158K-260KAI infrastructure | Checkpointing | Distributed Systems | Exactly once | Exactly-once semanticsSenior-level Full TimeUS - San Francisco5h ago
-
Staff Backend Software Engineer- (AI Platform) USD 192K-260KAPI Development | Algorithms | Autoscaling | Data Structures | Distributed SystemsSenior-level Full TimeSan Francisco, California7h ago
-
Staff Backend Software Engineer- (AI Platform) USD 192K-260KAPI Design | APIs | Algorithms | Autoscaling | CachingSenior-level Full TimeSan Francisco, California7h ago
-
Staff Backend Software Engineer- (AI Platform) USD 166K-225KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPUSenior-level Full TimeSan Francisco, California7h ago
-
Senior-level Full TimeNew York City or Chicago9h ago
-
Data Engineer - Finance USD 130K-204KApache Airflow | Business Intelligence | DBT | Dagster | DashboardingIn-office 5 days a weekMid-level Full TimeSan Francisco Bay Area11h ago
-
Principal Data Engineer - League Studios USD 209K-293KApache Airflow | Apache Spark | Batch Processing | DBT | Data Governance401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA11h ago
-
Langchain | Language Models | Large Language Models | MLOps | Machine LearningFreelance project based engagement | Part-time project workMid-level FreelanceNew York, United States - Remote R11h ago
-
Big Data | Feature Engineering | Langchain | MLOps | Machine LearningFreelance work | Part-time projects | Project based workMid-level FreelanceUnited States - Remote R11h ago
-
LLM | Langchain | MLOps | Machine Learning | MatplotlibEnglish proficiency assessment | Flexible hours | Part-time project work | Project-based employmentMid-level FreelanceTexas, United States - Remote R11h ago
-
Generative AI | Langchain | Language Models | Large Language Models | MLOpsPart-time project-based workMid-level FreelanceUnited States - Remote R11h ago
-
AI Search | AWS Bedrock | Agent systems | Amazon SageMaker | Anthropic401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States11h ago
-
Principal Machine Learning Engineer USD 220K-300KCUDA | Continuous Learning | Data Preparation | Drift monitoring | Embedding401k | Employee assistance program | Employee stock purchase plan | Health savings account | Medical/Dental/Vision insuranceSenior-level Full TimeUnited States | Remote R11h ago
-
Software Engineer - System Performance, Robot Software USD 170K-259KCPU caches | Computer Architecture | Databricks | Datadog | GrafanaHybrid work policyEntry-level Full TimeSunnyvale12h ago
-
Sr. Solutions Engineer - GSI's and FinTech Data USD 152K-209KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data EngineeringTravel opportunitiesSenior-level Full TimeGeorgia; Illinois; Massachusetts; New Jersey; New …12h ago
-
Senior Machine Learning Engineer, Voice AI USD 200K-260KAudio codecs | Audio signal processing | Automatic Speech Recognition | Batching | CUDAHealth insurance | Startup equitySenior-level Full TimeSan Francisco12h ago
-
Machine Learning Engineer, Growth USD 150K-180KA/B | A/B Testing | AWS | Airflow | B testing401k plan | Disability coverage | Healthcare benefits | Life insurance | Office in person at least four days per weekEntry-level Full TimeSeattle, Washington, United States13h ago
-
APIs | Agent Orchestration | Agentic Systems | Air-gapped | Air-gapped environments401k option | Comprehensive health care | Equity Incentives Option | FSA option | Mental health benefitsSenior-level Full TimeSeattle, WA or McLean, VA or … R13h ago
-
Staff Conversational AI Engineer USD 171K-213KAPI Integration | Agent Assist | CCAI Insights | Conversational Design | Dialogflow401k | Courses | Flexible work arrangements | Health insurance | Mentorship programsSenior-level Full TimePlano, TX13h ago
-
Staff AI Engineer – Agentic AI and Automaton USD 155K-243KAWS | Amazon SQS | Batch Processing | Cloud platform | Data Lineage401k | Health insurance | Hybrid work | Paid time offSenior-level Full TimeSan Francisco, CA | Lehi, UT …13h ago
-
Senior DevOps Engineer USD 150K-175KAWS | AWS Lambda | AWS VPC | Amazon CloudWatch | Amazon EC2Flexible hybrid work culture | Professional growth opportunitiesSenior-level Full TimeUSA, Berkeley Office13h ago
-
Senior Robotics C++ Engineer — Controls Platform USD 130K-201KC++ | Code review | Configuration Management | Container Builds | DDSSenior-level Full TimeLos Angeles, California14h ago
-
AI/Machine Learning Engineer Intern USD 55K-86KAPIs | Artificial Intelligence | Benchmarking | Evaluation | LLM APIsFun events | Leadership speaker series | Mentorship | Professional network | Training and developmentEntry-level InternshipUnited States - Remote R15h ago
-
Data Engineer USD 115K-148KAWS | Agile | Amazon S3 | Automation | AzureHealth benefits | Lifestyle spending account | Professional benefits | Social eventsMid-level Full TimeTampa15h ago