Staff AI Engineer
Tasks
- Customize inference frameworks for production needs
- Design and build inference serving systems
- Drive technical design for inference engineering practices
- Implement and tune inference optimizations
- Monitor latency SLOs and respond to incidents
- Own end to end model deployment and serving
- Translate model architecture changes into inference implementations
- Write and profile CUDA kernels and custom ops
Perks/Benefits
Skills/Tech-stack
C++ | CUDA | CUDA kernel | CUDA kernel development | Cache Management | Continuous batching | FP8 | INT4) | INT8 | KV cache | KV-cache management | Kernel development | Memory Optimization | MoE Models | Multimodal Models | NVIDIA Nsight | ONNX Runtime | Prefill Decode | Prefill decode disaggregation | Profiling | Python | Quantization | SGLang | Speculative decoding | TensorRT-LLM | Transformer Models | VLLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
AI | AI Engineer | Engineer | Learning Engineer | Machine Learning Engineer | Software Engineer
Related jobs
-
Software Engineer 2 - (Python, LLM, Machine Learning) USD 201K-246KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland R3h ago
-
AI/ML | AKS | Audit Logs | Azure DevOps | Azure MonitoringLocal only candidates required | Onsite 2 days per week | Remote 3 days per weekSenior-level Full TimeAustin, TX R3h ago
-
Machine Learning Experts: Linear Algebra Exam Audit USD 150K-180KComponent analysis | Eigenvalues | JSON | Linear Algebra | Matrix OperationsRemote workSenior-level Full TimeUnited States R12h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R12h ago
-
Software Engineer, Embedded Systems USD 197K-270KAAC | AC3 | API Design | AV1 | Adaptive streamingCommuter benefits | Disability benefits | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R15h ago
-
Staff AI Engineer - Zoom AI Services Platform USD 177K-387KAI Inference | AI Platform | AI Platform Engineering | API Design | C++Hybrid work | Remote workSenior-level Full TimeSeattle (WA), United States R19h ago
-
Senior AI Engineer USD 113K-182KAWS | AWS CDK | Agent Orchestration | Autogen | AzureDental insurance | Employer-funded retirement | Free tuition program | Medical insurance | Mental health resourcesSenior-level Full TimeRemote (United States), United States R19h ago
-
Data Engineer, Mid USD 77K-176KAgentic AI | Apache Spark | Artificial Intelligence | Data Mining | Data ModelingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, CO, Aurora (3855 Lewiston St), … R19h ago
-
Scientific Data Engineer Consultant USD 134K-180KAWS | Amazon Aurora | Amazon Glue | Amazon Redshift | Data IngestionMid-level Full TimeRaleigh, United States R19h ago
-
Staff Software Engineer - Agentic AI Platform USD 165K-209KAWS | Agent systems | Agile | Apache Spark | C#Career development | Employee resource groups | Flexible WFH policy | Generous PTO policy | Paid volunteer timeSenior-level Full TimeUS-Texas-Austin, United States R19h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Pipelines | Fine TuningDiscretionary paid time off | Emotional and mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R19h ago
-
Senior Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehouse | Data fabricTravelSenior-level Full TimeUS-GA-Remote R20h ago
-
Assembly | C# | C++ | Continuous Deployment | Continuous integration401k match | Dental insurance | Educational assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimePhoenix, AZ, United States R21h ago
-
Embedded Software Engineer USD 79K-113KARM | Agile | Algorithms | Bare Metal | C#10 percent travel | Relocation assistanceSenior-level Full TimeWest Melbourne, FL, United States R22h ago
-
AI Ops Engineer USD 160K-220KAccess Control | Agent systems | Agentic AI | Autogen | CMDB401k match | Career coaching | Employee assistance programme | Employer-paid life insurance | Flexible working hoursMid-level Full TimeRemote, United States R22h ago
-
Senior Staff Software Engineer - AI/ML - Veza USD 171K-300KAPI Integration | Agent Orchestration | Agent systems | Algorithms | C++401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeMinneapolis, Minnesota, United States R23h ago
-
Senior Staff Machine Learning Engineer - Agentic AI USD 201K-352KAPI Development | Agent Orchestration | Agent systems | C++ | Compliance401(k) plan match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, CALIFORNIA, United States R23h ago
-
Senior Data Engineer USD 120K-180KAWS CloudFormation | AWS DynamoDB | AWS Glue | AWS Lambda | AlertingFlexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R1d ago
-
Senior AI Engineer, Unstructured AI USD 204K-255KAPI Design | Apache Spark | Artificial Intelligence | Context engineering | Data CatalogingFlex Fund monthly stipend | Health coverage | Hybrid work | Pension/401K | Time offSenior-level Full TimeNew York, New York, USA R1d ago
-
Azure DevOps | BLE | Batch | Bluetooth Low Energy | C#Dental insurance | Employer-matched 401k | Flexible paid holiday | Health insurance | Life insuranceMid-level Full TimeRedmond, WA, United States R1d ago
-
Senior Machine Learning Engineer, Infrastructure USD 212K-318KData Validation | Distributed Systems | Feature Engineering | Feature Store | Live Inference401(k) plan matching | Commuter benefits | Company holidays | Flexible time off | HealthcareSenior-level Full TimeNew York R1d ago
-
Senior Data Engineer II, Finance USD 192K-242KAirflow | Amazon Redshift | Apache Spark | Cloud Data | Cloud data warehousingFlexible work location | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Database Engineer USD 140K-160KAWS | Aurora | CI/CD | Database security | Flyway401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractFoster City, California, USA R1d ago
-
Controls and Robot Learning Engineer GBP 100KC++ | Computed Torque | Control Systems | Direct Kinematics | Embedded SystemsMid-level Full TimeSan Francisco, CA R1d ago
-
Senior AI Engineer USD 204K-255KAgent Orchestration | Checkpointing | Concurrent Requests | Data Validation | Graph DatabasesSenior-level Full TimeNew York, New York, USA R1d ago