AI Software Engineer
Tasks
- Customize inference frameworks
- Deploy model packaging and serving API
- Design inference serving systems
- Implement inference optimizations
- Monitor latency SLOs and manage incidents
- Profile and debug throughput regressions
- Translate model changes into inference implementations
- Tune kernel performance
Perks/Benefits
Skills/Tech-stack
C++ | CUDA | CUDA kernels | Continuous batching | FP8 | INT4) | INT8 | KV cache | Memory Optimization | Mixture of Experts | Multi node inference | Multi-node | Nsight | ONNX Runtime | Prefill Decode | Prefill decode disaggregation | Python | Quantization | SGLang | Speculative decoding | TensorRT-LLM | Transformer Models | VLLM
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeKing George, VA, United States9h ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R9h ago
-
DNS | FC | Fibre Channel | Isilon | LinuxRemote work | Unlimited growthSenior-level Full TimeUnited States, United States R11h ago
-
Artificial Intelligence | Competency Mapping | Content Review | Curriculum Development | Data ScienceCross-cultural work experience | Free in-house training | Networking opportunities | Opportunities to develop as a public expert | Remote workSenior-level Part TimeBoston, US13h ago
-
Artificial Intelligence | Data Science | Language Models | Large Language Models | Machine LearningFree training | Networking | Professional development opportunities | Remote workSenior-level Part Timegeorgia, georgia, GE13h ago
-
Senior Engineer, Big Data USD 90K-140KAmbari | Apache HBase | Apache Hive | Apache Impala | Apache KafkaSenior-level Full TimeUnited States14h ago
-
Senior Software Engineer, Generative AI, Ads Safety USD 174K-252KAI Agents | Algorithms | C++ | Computer Vision | Context learningSenior-level Full TimeMountain View, CA, USA14h ago
-
C++ | Compute Optimization | Deep learning | GPU | JAXSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA14h ago
-
Software Engineer III, Storage for Analytics USD 147K-211KC++ | Data analytics | Databases | Distributed Systems | ExperimentationSenior-level Full TimeKirkland, WA, USA14h ago
-
AI Governance | Agent systems | Architecture | Context engineering | Data SovereigntySenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA14h ago
-
Forward Deployed Engineer II, Applied AI, Cloud USD 127K-183KAPIs | Agent systems | Agentic Workflows | Conversational AI | DebuggingTravel 50% timeSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …14h ago
-
Data Engineer, Geo 3P and Developer Data Operations USD 106K-151KArtificial Intelligence | BigQuery | C++ | Cloud Dataflow | Data MiningEntry-level Full TimeMountain View, CA, USA14h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | File systemsSenior-level Full TimeSeattle, WA, USA14h ago
-
Senior Data Engineer USD 150K-220KAmazon Redshift | Apache Hudi | Apache Iceberg | Apache Pinot | Autovacuum401k match | Dental insurance | Hardware provided | Health insurance | Unlimited PTOSenior-level Full TimeNew York20h ago
-
Staff Engineer, Datacenter Server Lifecycle USD 320K-405KAWS | Asset tracking | Coreboot | Decommissioning | Firmware verificationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …20h ago
-
AI & Robotics Data Collection Engineer (Intern) USD 68K-82KContainerization | Linux | Python | ROS2 | Shell ScriptingFully stocked kitchen | Meals provided | Onsite workEntry-level InternshipMilpitas, CA21h ago
-
Mid-level Full TimeTysons, VA, United States21h ago
-
Mid-level Full TimeRemote, United States R21h ago
-
Senior AI Infrastructure Engineer - Training Platform USD 216K-270KAWS | Admission controllers | C++ | CUDA | Custom ResourcesCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …22h ago
-
Data Analyst, Payments Performance USD 124K-187KCode review | Data Visualization | Data analytics | Git | Python401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsSenior-level Full TimeSeattle, WA22h ago
-
Analytics Engineer USD 124K-187KCode review | Data Visualization | Git | Python | SQL401k plan | Company bonus | Dental benefits | Equity | Medical benefitsSenior-level Full TimeSeattle, WA22h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | Data AnalysisCommuter benefits | Generous time off | Healthcare benefits | Income protection | Mental health resourcesSenior-level Full TimeCosta Mesa, California, United States23h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | GazeboCaregiver leave | Commuter benefits | Dental benefits | Fertility coverage | Healthcare benefitsSenior-level Full TimeQuincy, Massachusetts, United States23h ago
-
Principal Sales Engineer – Warehouse Robotics Systems USD 100K-300KAPI | AutoCAD | AutoMod | EDI | Emulate3DTravel to customer sitesSenior-level Full TimeSan Mateo, CA1d ago
-
Software Engineer USD 100K-150KAmazon Simple Queue Service | Amazon Web Services | Bedrock | Data Pipelines | Distributed Systems401k retirement plan | Dental insurance | Health insurance | Unlimited vacation | Vision insuranceSenior-level Full TimeLos Angeles, CA, US1d ago