Senior Software Engineer
Seattle - United States - Seattle, Washington United States; Remote - Remote; San Francisco - United States - San Francisco, California 94104 United States
R
USD 151K-235K (estimate) Senior-level Full Time
Tasks
- Architect model serving infrastructure
- Benchmark and accelerate inference engines
- Build high concurrency serving systems
- Create CI CD infrastructure for model deployment
- Fine tune and deploy open source large language models
- Implement GPU kernels for inference
- Optimize inference latency and throughput
Perks/Benefits
Skills/Tech-stack
Auto Scaling | Batch scheduling | C++ | CI/CD | Continuous batching | GPU | Global KV Cache | Inference Server | KV cache | Load Balancing | Parallelism | Quantization | Rust | SGLang | Speculative decoding | TensorRT-LLM | Triton Inference | Triton Inference Server | VLLM
Education
N/A
Regions
Countries
States
Related jobs
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R18h ago
-
Embedded Hardware Systems Engineer USD 130K-150KAltium Designer | BLE | Bluetooth Low Energy | Bring-up | C++401k matching | Corporate discounts | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeSan Jose, CA, US R1d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R1d ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R1d ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R1d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R1d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R1d ago
-
Sr Staff AI Engineer - Veza USD 190K-334KAgent Orchestration | Algorithms | C++ | Data Structures | Distributed Systems401k plan with match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeMinneapolis, Minnesota, United States R1d ago
-
Software Engineer, Database Reliability & Performance USD 100K-168KAI tools | Automated testing | C++ | CI/CD | CircleCI401k | Annual professional development budget | Financial planning and legal advice | Flexible time off | Life insuranceMid-level Full TimeRemote US R1d ago
-
Staff Diagnostics and Embedded Cyber Security Engineer USD 150K-283KAUTOSAR | Automotive Ethernet | BLE | C# | C++Employee resource groups | Flexible family care days | Paid parental leave | Paid time off | Subsidized back-up child careSenior-level Full TimePalo Alto, CA, United States R1d ago
-
Senior Data Engineer USD 190K-210KAccess Control | Alerting | CI/CD | DBT | Data Governance401k | Flex PTO | Learning and development reimbursement | Medical, dental, vision plans | Paid parental leaveSenior-level Full TimeRemote (US) R1d ago
-
Agile | C# | C++ | Change Management | Configuration Management401k match | Dental insurance | Disability insurance | Educational assistance | Employee assistance programSenior-level Full TimePhoenix, AZ, United States R1d ago
-
IAA - Principal Data Engineer USD 171K-256KAzure | Azure Synapse | Azure Synapse Analytics | CI/CD | Data GovernanceHybrid work schedule | Onsite expectation 2 days per weekSenior-level Full TimeChicago, IL (Hybrid) R1d ago
-
Full-Stack AI Engineer USD 150K-200KAWS | Authentication | Azure | CI/CD | CSSD E And I Initiatives | Fertility and menopause leave | Fitness allowance | Health benefits | Hybrid workingMid-level Full TimeNew York R1d ago
-
Cloud Inference Engineer USD 166K-273KAutoscaling | Cold Start | Cold Start Optimization | Distributed KV Cache | Distributed SystemsMid-level Full TimeUnited States / Canada R1d ago
-
Mid-level Full TimeRemote, US R1d ago
-
Data Engineer USD 153K-207KAirflow | Automated testing | CI/CD | DBT | Data GovernanceFlexible hybrid schedule | Hybrid work arrangement | Onsite Days Per WeekMid-level Full TimeSan Francisco, CA R1d ago
-
AI Security Engineer USD 150K-160KAPI Gateway | AWS | Adversarial Testing | Azure | CI/CD401k retirement plan | Employee assistance program | Health savings account | Life insurance | Medical, dental, and visionMid-level ContractBolingbrook, Illinois, USA R1d ago
-
.NET | AI Foundry | AI Services | Action Planning | Agent FrameworkContract-to-hire | GC sponsorship available | Hybrid work | US C sponsorship availableSenior-level ContractDallas, United States R1d ago
-
Senior AI Engineer - Observability USD 151K-205K.NET | A/B | A/B Testing | AI Search | Agentic WorkflowsSenior-level Full TimeUnited States R1d ago
-
Lead Software Engineer (.Net Core + LLM's) USD 150K-225K.NET | AKS | ASP.Net Core | Airflow | Application Insights401k matching | Childcare assistance | Dental insurance | Disability insurance | Education reimbursementSenior-level Full TimeDallas, Texas, United States R1d ago
-
AI Software Engineer in Test USD 115K-145KAzure DevOps | Bias Testing | CI/CD | Cypress | Data Validation401(k) retirement benefits | Disability insurance | Life insurance | Medical/Dental/Vision insurance | Paid HolidaysMid-level Full TimeAlpharetta, GA, United States R2d ago
-
Senior Embedded Software Engineer USD 120K-160KAADL | ADA | ARINC 653 | Agile | Atlassian Bitbucket401k match | Career development | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeDenver, CO R2d ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Confluence | Atlassian Jira | Atlassian Suite | Bare Metal | Bitbucket401k match | Employee assistance program | Medical/Dental/Vision | Paid Holidays | Paid time offSenior-level Full TimeMarietta, GA R2d ago
-
Staff AI Engineer, GenAI USD 200K-230KAgentic AI | Apache Spark | Azure DevOps | Azure ML | CI/CDPaid caregiver leave | Paid sick leave | Paid vacationSenior-level Full TimeUSA - NY - Remote, United … R2d ago