Inference Software Engineer
Tasks
- Build scale inference runtime
- Manage inference state and error handling
- Optimize multi node inference communication
- Optimize routing using collective communication
- Port machine learning models to custom architecture
- Profile performance and debug bottlenecks and correctness issues
Perks/Benefits
- Daily meals
- Housing subsidy
- Medical, dental & vision coverage
- Relocation support
- Unlimited compute budget
- Wellness benefits
Skills/Tech-stack
C++ | Compilers | Consensus Algorithms | Consistency models | Debugging | Distributed Systems | High speed | High-Speed Interconnects | Infiniband | JAX | Linux | Mixture of Experts | NVLink | Network Programming | Performance Profiling | PyTorch | Rust | SIMD | Transformer Architectures
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Computer Scientist V - Senior Software Systems Engineer USD 140K-190KAgile | Artificial Intelligence | C# | C++ | Cloud Platforms401k match | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeEdwards AFB, CA, United States1d ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …1d ago
-
Agent Development | Agent Orchestration | Air-gapped | Air-gapped systems | Cloud ComputingOn-site work | Travel opportunitySenior-level Full TimeWashington D.C., DC, USA; Fort Meade, …1d ago
-
2D Games | 3D Games | Algorithms | Context Assembly | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-23551d ago
-
Staff Software Engineer, Code RL USD 405K-625KAPI Design | Async Programming | Client Libraries | Concurrency | ContainerizationSenior-level Full TimeSan Francisco, CA | New York …1d ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R1d ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAutoscaling | Batching | C++ | Caching | Capacity PlanningSenior-level Full TimeUnited States - Remote R1d ago
-
Robotics Engineer USD 100K-150KC++ | Concurrent programming | Control | Gazebo | Isaac SimCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Staff Software Engineer - Infrastructure, Data Platform USD 260K-350KApache Kafka | Apache Spark | Cloud infrastructure | Data Processing | Data Streaming401k matching | Collaborative work environment | Employee stock purchase plan | Hybrid work schedule | Medical, dental & vision coverageSenior-level Full TimeSan Francisco, California, United States1d ago
-
Staff Software Engineer- Foundation Model Inference USD 190K-265KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPU OrchestrationSenior-level Full TimeSan Francisco, California1d ago
-
Software Engineer, Product USD 150K-250KAPI Development | APIs | AWS S3 | Application development | Backend Services401k match | Catered meals | Commuter benefit | Dental insurance | Flexible PTOSenior-level Full TimeSan Francisco2d ago
-
Software Engineer, Fleet Simulation (Core Data Science) USD 160K-226KDispatch) | Distributed Systems | Git | Metrics | MicroservicesMid-level Full TimeFoster City, CA2d ago
-
Research Engineer, Robot Intelligence USD 163K-324K3D Mapping | 3D Perception | 3D Reasoning | C++ | CUDASenior-level Full Time665 Clyde Avenue, Mountain View, CA, …2d ago
-
Senior AI Engineer, Real-World Data USD 137K-175KAI orchestration | AWS | AWS Fargate | AWS Lambda | AWS S3401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R2d ago
-
Data Center Operations Systems Engineer II (Chicago) USD 89K-119KCable Management | Capacity Planning | DCIM | Environmental monitoring | JiraOvertime eligibility | Travel for new data center locationsMid-level Full TimeElk Grove Village, IL - Data …2d ago
-
Senior AI Engineer USD 188K-258KAgentic Systems | Agile | Cloud Architecture | Code review | Configuration ManagementCell phone allowance | Comprehensive health coverage | Equity for every employee | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R2d ago
-
Staff Data Engineer USD 237K-270KAmazon EMR | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R2d ago
-
Member of Technical Staff (AI Software Engineer, Agents) USD 220K-405KAI Evaluation | Browser Extension | Browser extension development | Chrome DevTools | Chrome DevTools ProtocolSenior-level Full TimeSan Francisco2d ago
-
Senior-level Full TimeCupertino2d ago
-
Treasury Finance AI and Quantitative Analytics, Americas USD 156K-235KAI Applications | AWS | Azure | Dash | Data Pipelines401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsSenior-level Full TimeNYC2d ago
-
Data Engineer, CPU & Storage USD 293K-385KAsynchronous workloads | Automated Validation | Data Ingestion | Data Modeling | Data QualityMid-level Full TimeSan Francisco2d ago