Staff Software Engineer, GPU Inference
Tasks
- Build performance and correctness infrastructure
- Debug across system layers
- Drive reliability in production
- Ensure numerical correctness
- Establish GPU operational readiness
- Improve inference performance
- Optimize model serving behavior
- Productionize GPU inference stack
Perks/Benefits
- N/A
Skills/Tech-stack
Asynchronous execution | Benchmarking | C++ | CI/CD | CUDA | Cache Management | Collective communication | Concurrency | Continuous batching | Determinism | Distributed Systems | Distributed systems debugging | Docker | Expert parallelism | Failure recovery | GPU Performance | GPU Synchronization | GPU performance profiling | HIP | KV cache | KV-cache management | Kernel Launches | Kubernetes | Linux | Memory Management | Multithreading | Numerical validation | Observability | Performance Profiling | Pipeline parallelism | Prefix caching | Profiling | PyTorch | Python | Quantization | RDMA | ROCm | Scheduling | Systems debugging | Tensor Parallelism | VLLM
Education
Roles
Regions
Countries
States
Related jobs
-
.NET | AI Assisted Development | AI-Assisted Development Tools | API Integration | Automation401k | Employee discounts | Paid time offSenior-level Full TimeBrooklyn, NY, US20h ago
-
API Gateway | AWS | AWS Step Functions | Agile | Airflow401k match | Career development | Dental insurance | Employee referral bonuses | Health insuranceSenior-level Full TimeFort Meade, MD; Annapolis Junction, MD; …22h ago
-
Data Scientist - Mentorship and Training USD 49K-290KAPI Security | Apache Spark | Certificates | Code review | CondaReferral bonus | Training and mentoringSenior-level Full TimeMcLean, VA23h ago
-
Agentic AI / Data Engineer - DC GPU CAD 131K-170KAgent Orchestration | Context engineering | Data Quality | Data poisoning | Embedding pipelinesSenior-level Full TimeCA,ON,Home Office23h ago
-
Senior-level ContractDowntown Toronto (Richmond / Adelaide / … R1d ago
-
Senior-level Full TimeHuntsville, United States1d ago
-
Senior Data Engineer USD 165K-184KAWS | Apache NiFi | Apache Spark | Data Modeling | Data PipelinesSenior-level Full TimeHuntsville, United States1d ago
-
Agile | Amazon Web Services | Apache Hive | Apache Spark | Apache ZeppelinMid-level ContractPortland, United States1d ago
-
Apache Flink | Apache Hive | Apache Kafka | Apache Spark | Apache ZookeeperSenior-level ContractPortland, United States1d ago
-
Amazon DynamoDB | Apache Hive | Java | NoSQL | Object-OrientedSenior-level ContractBeaverton, United States1d ago
-
Security Data Engineer USD 128K-214KAI | API Integration | API scaling | Anomaly Detection | Automated MonitoringDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-VA-Herndon1d ago
-
Data Engineer USD 94K-157KAWS | Air-gapped | Air-gapped environments | Bash | CRISP-DMHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Arlington, USA-Remote Work1d ago
-
Palantir MSS Developer / Engineer USD 84K-140KData Engineering | Data Modeling | Data Pipelines | Data Visualization | ELTMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …1d ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Apache Spark | Artificial Intelligence | Data Modeling | Data PipelinesDiscretionary annual incentive program | Mentorship | Professional development | Travel opportunitySenior-level Full TimeRosslyn, Virginia, United States1d ago
-
A/B | A/B Testing | B testing | Deep learning | Information RetrievalEntry-level Full TimeSeattle, Washington, United States1d ago
-
AWS | Accuracy | Apache Flink | Azure | Bias MitigationSenior-level Full TimeLos Angeles, California, United States1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States1d ago
-
Agent Orchestration | Artificial Intelligence | BERT | C# | C++Entry-level Apprenticeship Full TimeRemote, Canada R1d ago
-
Software Engineer III, Storage Infrastructure USD 147K-210KC++ | Code Reviews | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeNew York, NY, USA1d ago
-
Staff Software Developer, Embedded Systems/Firmware CAD 216K-221KAbstraction layer | Android | Android Wearable Computing | Android platform | BootloaderBonuses | Equity | Health benefits | Paid time offSenior-level Full TimeWaterloo, ON, Canada1d ago
-
Software Engineer, Search, AI/ML USD 147K-210KC++ | Data Governance | Data Governance Framework | Data Management | Data PrivacyMid-level Full TimeCambridge, MA, USA1d ago
-
C++ | Cloud Storage | Compute Technologies | Data Structures | Data Structures and AlgorithmsBonus | Equity | Health insurance | Paid time offSenior-level Full TimeNew York, NY, USA1d ago
-
Software Engineer, AI/ML, Google Research USD 147K-210KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Language ProcessingMid-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer III, Computer Vision, Pixel Camera USD 147K-210KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan Diego, CA, USA1d ago
-
Software Engineer III, Infrastructure, Infra Bigtable USD 147K-210KAsynchronous processing | Back-end | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1d ago