Staff Software Engineer - GenAI inference
Tasks
- Architect inference engine
- Architect routing batching and scheduling
- Build instrumentation profiling and tracing tools
- Design model serving stack
- Ensure reliability reproducibility and fault tolerance
- Implement GPU and accelerator performance optimizations
- Manage memory and dynamic loading
- Optimize latency throughput and memory
- Orchestrate distributed inference across nodes
- Perform A B launches rollback and model versioning
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Attention Mechanism | B testing | CUBLAS | CUDA | CUDNN | Distributed Systems | Fault Tolerance | GPU Programming | Instrumentation | Machine Learning | Memory partitioning | Mixture of Experts | NCCL | Profiling | Quantization | Queuing | RPC | Sharding | Sparse operations | Tracing
Education
Roles
Regions
Countries
States
Related jobs
-
Senior Software Engineer, Data Platform USD 130K-280KCompliance | Dashboard Design | Data Engineering | Data Pipelines | Data ProcessingCommuter benefits | FSA options | Flexible PTO | HSA contributions | Healthy lunches provided dailySenior-level Full TimeSan Mateo, CA United States6h ago
-
Senior Machine Learning Engineer, Content Platform USD 141K-360KApache Spark | Cloud Computing | Generative AI | Language Models | Large Language ModelsDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R8h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-510KA/B | A/B Testing | B testing | Continuous Improvement | Feature EngineeringCommuter benefits | Disability benefits | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeNew York, New York R8h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-435KDistributed Systems | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts R8h ago
-
Machine Learning Engineer, Ads USD 165K-230KA/B | A/B Testing | B testing | Bidding | Conversion PredictionDirect impact | Hybrid work model | International team collaboration | Professional growth opportunities | Remote work flexibilityMid-level Full TimeSan Francisco Bay Area, USA R9h ago
-
Senior Computer Vision Engineer USD 191K-292KComputer Vision | Data Engineering | Dataset development | Deep learning | Edge ComputingHealth benefits | Recovery BenefitsSenior-level Full TimeWashington, District of Columbia, United States12h ago
-
Applied AI Lead USD 130K-150KAI Agents | AWS | AWS Bedrock | Azure | Azure AI401k match | College savings | Company paid life and AD D insurance | EAP | FSA optionSenior-level Full TimeHouston, TX, United States14h ago
-
Applied AI Lead USD 140K-160KAI Agents | AWS | AWS Bedrock | Anthropic Claude | Automation401k match | Cell phone stipend | College savings | EAP | FSA optionsSenior-level Full TimePhiladelphia, PA, United States14h ago
-
AWS | Cloud infrastructure | Compute | Data Curation | Distributed Systems401k match | Daily lunches and snacks | Health insurance covered | Hybrid work schedule | Learning and development stipendSenior-level Full TimeRedwood City R14h ago
-
Sr. Forward Deployed Engineer (FDE) - Public Sector USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeWashington, D.C.14h ago
-
Sr. Forward Deployed Engineer (FDE) - Public Sector USD 182K-250KAI APIs | AWS | Apache Spark | CI/CD | Cloud platformCustomer-facing role | Hybrid work | Secret clearance required | Travel 20 to 25 percentSenior-level Full TimeAlabama; Arkansas; Florida; New York; Tennessee R14h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAgent systems | Evaluation | Experiment design | Language Models | Large Language Models401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States14h ago
-
Lab Automation - Robotics Engineer USD 150K-180KAPI Integration | Accelerated inference | Automation | Behavior Trees | C#Entry-level Full TimeSouth San Francisco, California, United States15h ago
-
AI and Computational Geometry Engineer USD 200K-250KABAQUS | ANSYS | BREP | Boolean Operations | CAEL toolsEquity | Health benefits | Paid time offMid-level Full TimeEmeryville, California15h ago
-
Sr. Staff Machine Learning Systems Engineer USD 240K-265KAdversarial Testing | Calibration | Data Engineering | Data Ingestion | Data Pipelines401k employer matching | Company holidays | Comprehensive health benefits | Employee stock purchase program | Offsite team retreatsSenior-level Full TimeUS Remote R15h ago
-
CUPED | Causal Graphs | Causal Inference | Contextual Bandits | Counterfactual evaluation401k plan | Basic life insurance | Commuter benefits match | Disability insurance | Family-forming assistanceSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA; Los …15h ago
-
Junior AI Engineer (Open to remote) USD 110K-135KAPIs | Agent SDK | Agentic coding | Arize | Google ADK401k | Commuter benefits | Dental insurance | Educational assistance | Medical insuranceExecutive-level Full TimeNew York, United States R16h ago
-
Senior-level Full TimeCalifornia; Remote - California; San Francisco, … R16h ago
-
Research Engineer-Data & Analytics USD 80K-122KCloud Computing | Code review | Data Modeling | Data analytics | Distributed ComputingMid-level Full TimeRaleigh, North Carolina, United States17h ago
-
Principal Machine Learning Engineer, Geometric Vision USD 407K-460K3D Computer Vision | 3D representations | Auto-labeling | C++ | CalibrationSenior-level Full TimeSunnyvale R17h ago
-
Media Software Engineer, Speech (Senior-Staff Levels) USD 180K-270KAndroid | Asynchronous I/O | Audio streaming | C# | C++401k retirement savings plan | Company holidays | Complimentary lunch and snacks | Fertility support | Lifestyle spending accountSenior-level Full TimeSunnyvale R17h ago
-
AI/ML Engineer USD 100K-150KAPI Design | Asynchronous programming | Claude Code | Cloud platform | Cursor401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractDearborn, Michigan, USA R17h ago
-
Machine Learning Engineer, Detection and Tracking USD 160K-210KByteTrack | DETR | Data Augmentation | DeepSORT | Faster R-CNNFlexible paid time off | Hybrid work | Medical insurance | Paid Holidays | Remote workMid-level Full TimeWashington, DC R17h ago
-
Sr. Forward Deployed Engineer (FDE) - Public Sector USD 182K-250KAI APIs | AWS | Apache Spark | Architecture Design | AzureHybrid work | Travel 20 to 25 percentSenior-level Full TimeRemote - Virginia; Remote - Washington … R18h ago
-
Sr. Forward Deployed Engineer (FDE) - Public Sector USD 182K-250KAWS | Apache Spark | Azure | CI/CD | Data IngestionSenior-level Full TimeVirginia18h ago