Application Software Engineer, Inference
Tasks
- Architect model serving infrastructure
- Benchmark and accelerate inference engines
- Build reliable high concurrency serving systems
- Collaborate to integrate inference into systems
- Create CI CD infrastructure
- Develop inference systems
- Develop tools for tracing and replay
- Optimize inference latency and throughput
- Own request routing and rate limiting
Perks/Benefits
- 401k plan
- Employee stock purchase plan
- Long-term incentives
- Medical, dental & vision coverage
- Onsite Palo Alto
- Paid Holidays
- Paid parental leave
- Paid vacation
Skills/Tech-stack
Agent Orchestration | Agent SDK | Auto Scaling | Batch scheduling | C++ | CI/CD | ClickHouse | Continuous batching | Continuous integration | Distributed Systems | Docker | GPU Kernel | GRPC | Global KV Cache | Go | Inference | KV cache | Kubernetes | Language Models | Large Language Models | Load Balancing | MongoDB | Observability | Performance optimization | PostgreSQL | Profiling | Python | Quantization | REST | Rust | Speculative decoding
Education
Regions
Countries
States
Cities
Related jobs
-
Machine Learning Engineer USD 130K-170KAirflow | CI/CD | DBT | Docker | ELT401k match | Dental insurance | Disability coverage | Life insurance | Medical insuranceSenior-level Full TimeNew York, NY, US3h ago
-
Senior Machine Learning Engineer, Applied AI Modeling USD 139K-218KClassification | Embeddings | Evaluation | Fine Tuning | Hugging FaceHome office stipend | Medical, dental & vision coverage | Paid Holidays | Paid parental leave | Professional development budgetSenior-level Full TimeRemote US R6h ago
-
Senior Principal Engineer- MLOps & AI Machinery, ADAS/AV USD 240K-320KASIL | Automation | Automotive Safety | Automotive hardware | Automotive safety standards401k match | Dental insurance | Flexible spending account | Health insurance | Health savings accountExecutive-level Full TimeSunnyvale, CA, United States6h ago
-
AI Software Engineer USD 100K-180KAgile | CI/CD | Code Analysis | Confluence | Data EngineeringCareer progression | World-class benefitsMid-level Full TimeAnnapolis Junction, Maryland, United States7h ago
-
AI Software Engineer-Senior USD 124K-195KAgile | Code Analysis | Confluence | Continuous Delivery | Continuous DeploymentCareer progression | World-class benefitsSenior-level Full TimeAnnapolis Junction, Maryland, United States7h ago
-
Senior-level Full TimeAnnapolis Junction, Maryland, United States7h ago
-
AI Analytic Software Engineer-Senior USD 130K-195KAWS Amplify | AWS Bedrock | Confluence | Docker | ElasticsearchCareer progression | World-class benefitsSenior-level Full TimeAnnapolis Junction, Maryland, United States7h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic Frameworks | Auditability | CI/CD | Cloud Native401-k match | Dental insurance | Expense Reimbursement for Home Office | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R8h ago
-
AI Solutions Engineer (Fixed-Term) USD 70K-300KAgentic Systems | Application development | Customer discovery | LLM Application Development | LLM applicationMid-level TemporaryIrvine, CA9h ago
-
Senior Analytics Engineer USD 159K-200KAWS | Airflow | DBT | Dagster | Data ObservabilityAutonomy | Fully remote | High-impact work | Use of AI toolsSenior-level Full TimeRemote US R9h ago
-
Data Platform Engineer USD 125K-188KAPI Gateway | AWS | AWS Glue | AWS Kinesis | AWS LambdaEmployee discounts | Matching 401-K | Medical/Dental/Vision | Paid time off | Wellness programMid-level Full TimeUnited States, San Mateo, CA11h ago
-
Senior Machine Learning Engineer USD 185K-255KApache Spark | CI/CD | Docker | Drift Detection | Feature EngineeringEvents and activities | Healthcare coverage | Hybrid work flexibility | Self-managed PTO | SnacksSenior-level Full TimeSeattle, WA11h ago
-
C++ | Dataset design | Deep learning | Generative AI | JavaSenior-level Full TimeSunnyvale, California, USA11h ago
-
Senior Machine Learning Operations Engineer USD 166K-208KAlerting | CI/CD | Canary Deployment | Champion Challenger | Drift DetectionSenior-level Full TimeSan Francisco, CA, New York, NY, … R12h ago
-
Adjunct Instructor, Applied AI Engineering - Howard University - Fall 2026 (In-Person, Master’s Degree Required) USD 150K-150KAI Assisted Development | Codebase Management | Generative AI | Language Models | Large Language Models401k | Employee assistance program | Exclusive marketplace savingsMid-level Full TimeWashington DC, United States13h ago
-
Senior Analytics Engineer I USD 101K-127KAWS | Agile | Azure | Azure Data | Azure Data Factory401k match | Dental insurance | Disability insurance | Equity compensation | Food and drinksSenior-level Full TimeLong Beach, CA13h ago
-
AI Lead Developer - Aerospace USD 145K-175KAPIs | AWS | Agent systems | Agentic AI | CI/CDCareer growth opportunities | Comprehensive benefits | Hybrid work schedule | MentorshipSenior-level Full TimeHerndon, Virginia14h ago
-
Senior Machine Learning Platform Engineer USD 170K-220KAWS SageMaker | Alerting | Amazon ECS | CI/CD | Container OrchestrationNYC office onsite | On-call rotationSenior-level Full TimeNew York, NY14h ago
-
Senior Conservation Data Analyst/Engineer USD 100K-145KAWS | ArcGIS | ArcGIS Enterprise | ArcGIS Online | AzureSenior-level Full TimeWashington D.C., United States14h ago
-
Senior Software Engineer II, Applied AI USD 185K-232KAPI Design | Driven systems | Edge-to-cloud | Evaluation Framework | Event Driven401k match | Employee equity program | Flexible PTO | Health, dental, vision coverage | Retirement benefitsSenior-level Full TimeSeattle, Washington, United States14h ago
-
Staff ML/LLM Ops Engineer USD 213K-272KAPI Design | Argo | CI/CD | Cost monitoring | Deployment and Rollback401k match | Flexible PTO | Health, dental, vision coverage | Retirement benefitsSenior-level Full TimeSeattle, Washington, United States14h ago
-
Senior Software Engineer, Content Storage Gateway USD 198K-248KAmazon Web Services | Cloud Computing | Cloud platform | Distributed Systems | GoSenior-level Full TimeRedwood City, CA14h ago
-
Software Engineer, Data Platform USD 160K-200KAWS | Airflow | Azure | Dagster | Data WarehousingReasonable accommodations during interview process | Relocation assistanceMid-level Full TimeSan Francisco Bay Area15h ago
-
Staff Analytics Engineer USD 109K-125KAmazon Redshift | Automated testing | BigQuery | CI/CD | Cloud Data401k plan | Coaching | Flexible spending account | Flexible vacation policy | Healthcare coverageSenior-level Full TimeUnited States R15h ago
-
Senior-level Full TimeUnited States (Remote) R15h ago