Inference Software Engineer
Tasks
- Build scheduling logic for continuous batching and real time inference
- Collaborate with AI researchers and product teams
- Contribute to architecture and design of host software stack
- Implement distributed networking primitives for multi server inference
- Implement high performance modular code
- Implement inference time acceleration techniques
- Interface with firmware and drivers teams
Perks/Benefits
Skills/Tech-stack
C++ | CUDA | Continuous batching | Distributed Systems | KV cache | Networking | Parallel Programming | Python | Rust | Speculative decoding | Transformer | Tree search
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Snowflake (Data Engineer) USD 128K-154KAWS | Analysis Services | Data Modeling | Data Warehousing | Data integration401k plan | Accident insurance | Critical illness insurance | Daycare FSA | Dental insuranceMid-level Full TimeNashville, TN7h ago
-
Artificial Intelligence | Automated testing | C++ | Containers | Distributed Systems401k company match | Dental insurance | Flexible work schedule | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA; Mercer Island, USA9h ago
-
Machine Learning Engineer II - Unpublished R&D Product USD 143K-201KAI Planning | Agent systems | C++ | Data Science | Decision Making401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceMid-level Full TimeLos Angeles, USA; Mercer Island, USA9h ago
-
Agentic AI | C# | C++ | Client-Server | Client-server systemsEntry-level InternshipSan Mateo, CA, United States10h ago
-
Senior Software Engineer - Data Lake & BI USD 162K-242KApache Iceberg | Apache Spark | Avro | C++ | CI/CD401k match | Disability insurance | Employee stock purchase program | Flexible PTO | Flexible spending accountSenior-level Full TimeSunnyvale, CA / Bellevue, WA10h ago
-
Machine Learning Engineer, Foundation Model USD 129K-247KAutonomous Driving | Autoregressive modeling | Behavior Prediction | C plus plus | Data PipelinesSenior-level Full TimeSan Jose10h ago
-
Software Engineer, Database Migration Service USD 143K-194KC++ | Data Structures | Distributed Systems | Hibernate | JavaCode review feedback | Knowledge sharing | Learning opportunities | Mentorship | Work-life balanceMid-level Full TimeBoston, Massachusetts, USA10h ago
-
Engineering Manager, Machine Learning (Caper) USD 201K-253KBigQuery | CI/CD | Computer Vision | Deep learning | DockerRemote workSenior-level Full TimeUnited States - Remote R11h ago
-
API | Data Modeling | Data Visualization | ETL | Power BIRemote workEntry-level Full Time InternshipRancho Cordova, CA, United States11h ago
-
Senior Generative AI Consultant USD 136K-136KAWS | Azure | CI/CD | Cloud platform | Deep learning401k matching | Dental insurance | Flexible spending account | Gym reimbursement | HealthcareSenior-level Full TimeSan Francisco, CA, United States11h ago
-
Mid-level Full TimeMiami, Florida, United States12h ago
-
Senior Software Engineer (San Francisco, CA) USD 157K-222KAWS EC2 | AWS ECS | AWS EMR | AWS Fargate | AWS GlueSenior-level Full TimeSan Francisco, CA12h ago
-
Senior LLM Software Engineer USD 191K-287KAWS | Agentic Systems | Computer Vision | Data Pipelines | Event Driven401k match | Commuter benefits | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeSeattle, Washington, United States12h ago
-
Senior Data Engineer USD 160K-195KAWS Lambda | AWS Step Functions | Alerting | Amazon EMR | Amazon KinesisSenior-level Full TimeRemote - US R13h ago
-
Senior-level Full TimeTampa, FL13h ago
-
Corporate AI Engineer USD 75K-230KAnthropic | Data integration | Embeddings | Enterprise SaaS | Generative AI401k match | Business travel accident insurance | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R13h ago
-
Senior Data Engineer USD 172K-215KAirflow | Apache Flink | Apache Spark | Backpressure | Batch ProcessingCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation and personal days | Global employee assistance programSenior-level Full TimeSan Francisco, CA, USA13h ago
-
Senior Applied AI Engineer - Energy Industry USD 146K-183KAWS Bedrock | Access Management | Agent Orchestration | Azure AI | Data integrationCompany equity (RSUs) | Comprehensive benefits | Counseling | Gym subsidies | Hybrid workSenior-level Full TimeRaleigh, US, North Carolina13h ago
-
Senior Applied AI Engineer - Energy Industry USD 146K-183KAWS Bedrock | Agent Orchestration | Azure AI | Few-Shot Learning | Few-shotCompany equity | Counseling | Gym subsidies | Hybrid working | Paid time offSenior-level Full TimeRemote, US, Texas R13h ago
-
Senior Software Engineer II - Authoring Apps USD 196K-270KAWS | Kubernetes | Node.js | Python | React401k contribution | Healthcare | Home office stipend | Paid parental leave | Remote workMid-level Full TimeUS - Remote R13h ago
-
Systems Engineer, Algorithm Development USD 110K-240KAlgorithm Development | C++ | DSP | Data Analysis | Digital Signal Processing401k | Casual dress code | Dental insurance | FSA | Free daily lunchSenior-level Full TimeHawthorne, California, United States14h ago
-
Senior Systems Engineer, Algorithm Development USD 110K-240KAlgorithm Development | C plus plus | Clutter rejection | Data Analysis | Digital Signal Processing401k | Casual dress code | FSA | Free daily lunch | HSASenior-level Full TimeHawthorne, California, United States14h ago
-
Senior Principal Systems Engineer, Algorithm Development USD 110K-240KAlgorithm Development | C++ | Clutter rejection | DSP | Data Analysis401k | Casual dress code | Dental insurance | FSA | Free lunchSenior-level Full TimeHawthorne, California, United States14h ago
-
Principal Data Engineer USD 124K-206KAPI Architecture | AWS | AWS Step Functions | Access Control | Amazon Redshift401k plan | Commuter benefits | Life insurance | Medical, dental & vision coverage | Paid HolidaysSenior-level Full TimeUS - Remote R14h ago
-
Systems PhD - Software Engineer USD 140K-180KData Security | Data Storage | Database systems | Distributed Systems | Query OptimizationNone Full TimeBellevue, Washington; Seattle, Washington14h ago