Senior Software Engineer, CoreAI Workload Engines
Redmond, WA, US; Mountain View, CA, US
USD 119K-304K Senior-level Full Time
Tasks
- Build experimentation capabilities
- Design inference serving architectures
- Ensure inference serving availability and efficiency
- Improve observability diagnostics and performance regression detection
- Integrate high performance networking for distributed inference
- Optimize inference engines for LLMs
- Provide technical leadership and design reviews
- Run end to end experiments
- Scale inference engines across GPU generations
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | B testing | Benchmarking | C# | C++ | CUDA | Canary Releases | Java | JavaScript | KV offload | Kubernetes | Multi Token Prediction | NCCL | NVIDIA GPU | Profiling | PyTorch | Python | Quantization | Scheduling | Tensor Parallelism
Education
Regions
Countries
States
Related jobs
-
Data Engineer USD 119K-200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseMid-level Full TimeCenter, Center District, IL7h ago
-
Cloud Software Engineer II USD 150K-250KAngular | Apache Lucene | Apache Solr | Aspect-Oriented Programming | Aspect-orientedSenior-level Full TimeAnnapolis Junction, MD8h ago
-
Cloud Software Engineer II USD 150K-250KAngular | Apache Hadoop | Apache Lucene | Apache Solr | Aspect-Oriented ProgrammingSenior-level Full TimeAnnapolis Junction, MD8h ago
-
Senior-level Full TimeAnnapolis Junction, MD8h ago
-
Senior Software Engineer, AI Coding Tools USD 244K-588KDeep learning | Distributed Training | Fine Tuning | GPU Computing | Inference OptimizationSenior-level Full TimeSan Jose, California, United States9h ago
-
Software Engineer, AI Agent USD 199K-340KAgent systems | Agentic Workflows | Attribution Modeling | Bidding strategy | Chain-of-ThoughtSenior-level Full TimeSan Jose, California, United States10h ago
-
Adversarial Training | Computer Vision | Dataset curation | Distributed Training | GPU ComputingEntry-level Full TimeMenlo Park, CA10h ago
-
Partner Engineering GenAI - US USD 136K-203KAPIs | C++ | Claude | Cloud Computing | Data integrationSenior-level Full TimeMenlo Park, CA | Seattle, WA …10h ago
-
API Design | Agentic Workflows | C# | C++ | Code reviewSenior-level Full TimeRedmond, WA10h ago
-
AI Specialist - Product and Applied Research USD 180K-200KC++ | Computer Vision | Crawling | Data Mining | Data RegressionMid-level Full TimeMenlo Park, CA | New York, …10h ago
-
Senior-level Full TimeMenlo Park, CA10h ago
-
Senior Software Engineer, AI/ML, Platforms and Devices USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingBonus | Equity | Health insurance | Learning and development | Paid time offSenior-level Full TimeMountain View, CA, USA; United States11h ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeKirkland, WA, USA; New York, NY, …11h ago
-
Apache Beam | Apache Kafka | BigQuery | Cloud Storage | Cloud platformCampus facilities | Completion bonus | Consultant support | Multiple project extensions | Onsite workMid-level Full TimeJuno Beach, FL11h ago
-
Full Stack AI Software Engineer USD 216K-283KAPI contracts | AWS | Azure | Classification | Data PipelinesAdoption leave | Commuter benefits | Dental insurance | Disability insurance | Equity ESPPExecutive-level Full TimeSan Mateo, CA, United States15h ago
-
Machine Learning Engineer, AI Agent Platform USD 110K-230KAPI Development | Benchmarking | Distributed Systems | Evaluation | LLM orchestrationHealth insurance | Paid time off | Parental leaveSenior-level Full TimeBay Area20h ago
-
CI/CD | Data Engineering | Data Processing | Docker | ERPFlexible hours | Hybrid work | Onsite remote splitSenior-level Full TimeHouston, TX, United States21h ago
-
ARINC | Abstraction layer | Analog circuits | Assembly Language | Atmel StudioMid-level Full TimeShawnee, OK, United States21h ago
-
Entry-Level AI / ML Software Engineer USD 60K-74KAgile | Algorithms | Code review | Data Structures | Deep learningEntry-level Full TimeHopkins, MN, United States22h ago
-
Senior, Data Scientist (Machine Learning Engineer) USD 117K-234KAirflow | Azure | Batch inference | CI/CD | CNNSenior-level Full Time(USA) Crossman Respect Building CA SUNNYVALE …22h ago
-
MLOps Engineer II USD 105K-189KAWS | AWS CDK | AWS CloudFormation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeInnovation Point, United States22h ago
-
Senior Machine Learning Engineer USD 134K-168KA/B | A/B Testing | B testing | CI/CD | DatabricksGaming license requiredSenior-level Full TimeRemote - US, United States R22h ago
-
Senior Embedded Software Engineer USD 82K-220KC# | C++ | Configuration Management | Core Processing | DMADiscounts to local museums | Employee clubs | Finance workshops | Government security clearance requirement | Health workshopsSenior-level Full TimeMA - Cambridge, United States22h ago
-
Embedded Real-time Software Engineer I USD 57K-108KAlgorithms | C# | C++ | Cyber Security | Data StructuresRelocation assistanceSenior-level Full TimeUS-AZ-TUCSON-805 ~ 1151 E Hermans Rd …22h ago
-
Senior AI/ML Engineer USD 149K-188KAPI Design | AWS | AWS Glue | Amazon SageMaker | AzureHybrid workSenior-level Full TimeMalvern, PA, United States22h ago