Senior Engineer 2: Inference Optimizations
Tasks
- Advise on hardware procurement and integration
- Collaborate with product teams on feature development
- Contribute to open source AI communities
- Engineer solutions for GPU kernel performance
- Implement cutting-edge AI inference techniques
- Lead performance optimization for inference engine
- Mentor team through code reviews
Perks/Benefits
- Employee assistance program
- Flexible time off
- Health benefits
- Learning and training budget
- Professional development resources
- Remote work
- Stock options
Skills/Tech-stack
AI infrastructure | BF16 | Bandwidth Optimization | Batch size optimization | CUDA | FP8 | GPU Programming | High Performance | High-Performance Computing | Kernel Fusion | Memory bandwidth | Memory bandwidth optimization | Model Inference | OpenAI Triton | Parallelization | Performance Computing | ROCm | Size optimization | TensorRT | Transformers
Education
Roles
Related jobs
-
Machine Learning Engineer USD 180K-250KAWS | Azure | CUDA | DDP | Distributed Training401k employer match | Health, dental, vision insurance | Paid time off | Professional development | Work-life balanceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R1d ago
-
Machine Learning Engineer - Computer Vision USD 220K-250KAmazon Bedrock | Cloud ML | Cloud ML services | Computer Vision | Convolutional Neural NetworksCareer growth mindset | Equity | Meaningful impact on product and users | Remote-first work environmentMid-level Full TimeRemote (U.S.) R1d ago
-
Cloud Machine Learning Engineer - US remote USD 150K-200KAWS CloudWatch | Accelerate | Amazon EC2 | Amazon S3 | Amazon SageMakerConference reimbursement | Flexible paid time off | Flexible working hours | Health, dental, and vision benefits | Parental leaveMid-level Full TimeUnited States - Remote R2d ago
-
Machine Learning Engineer USD 138K-183KAWS | Airflow | Amazon Redshift | Amazon SageMaker | Apache Flink401k retirement savings | Health care insurance | Occasional travel for meetings | Paid parental leave | Paid sick timeMid-level Full TimeRemote - US R5d ago
-
Senior Inference Engineer - AI USD 100K-204KAPI Design | API Integration | AWS | Azure | C++Career development | Flexible work hours | Hybrid work model | Mental health days | Retirement savingsSenior-level Full TimeUnited States of America, Eagan, Minnesota R5d ago
-
Principal AI Lead – Surgical AI USD 157K-271KArtificial Intelligence | Auditability | Cloud Computing | Computer Vision | Convolutional Neural NetworksSenior-level Full TimeUS328 CA Santa Clara - 5490 … R6d ago
-
Senior, Machine Learning Engineer - End-to-End USD 226K-271KBEV Models | Computer Vision | Diffusion Models | Distributed Training | Imitation Learning401k matching | AD and D insurance | Company holiday office closures | Flexible schedule | Life insuranceSenior-level Full TimeRemote - U.S, Ann Arbor, MI R6d ago
-
Data Science Engineer USD 146K-222KAnomaly Detection | Computer Vision | Cybersecurity Analytics | Data Analysis | Data Visualization401k | Education reimbursement | Flexible schedule | Hybrid work | Relocation assistanceMid-level Full TimeLivermore, CA, United States R7d ago
-
Senior Machine Learning Engineer USD 205K-270KA/B | A/B Testing | Agent systems | B testing | BenchmarkingCommuter benefits | Flexible PTO | In-office meal program | Medical, dental, and vision insurance | Paid parental leaveSenior-level Full TimeUnited States (Remote) R7d ago
-
AWS EKS | AWS Lambda | Actor Model | Agentic Applications | Apache FlinkSenior-level Full TimeSan Francisco, CA, United States R8d ago
-
CUDA | Diffusion Models | Distributed Systems | GANs | KubernetesSenior-level Full TimeSan Jose, United States R8d ago
-
Senior / Staff ML Optimization Engineer USD 141K-249KBazel | C++ | CPU Profiling | CUDA | Distributed TrainingCatered meals | Dental insurance | Flexible hours | Health insurance | Social eventsSenior-level Full TimeRemote US & Canada R10d ago
-
Senior / Staff Perception Engineer USD 158K-269K3D Object Detection | C++ | CUDA | Computer Vision | Data setsDental insurance | Equity awards | Flexible hours | Health insurance | Unlimited vacationSenior-level Full TimeRemote US & Canada R10d ago
-
Senior Software Embedded Engineer USD 141K-225KABI | ARM | C++ | CUDA | Embedded LinuxEmployee resource groups | Fitness programs | Learning and development | Medical/Dental/Vision | Mental wellness supportSenior-level Full TimeWashington, United States R11d ago
-
Engineer, Applied AI USD 129K-149KAPI Orchestration | Chatbots | Chroma | Conversational AI | DBTGrowth opportunities | Leadership programs | Mentorship programsMid-level Full TimeUnited States R12d ago
-
Senior Engineer, Applied AI USD 150K-173KAI Agents | API Integration | Chatbots | Chroma | Conversational AILeadership programs | Mentorship programsSenior-level Full TimeUnited States R12d ago
-
Principal Engineer, Applied AI USD 171K-196KAPI Orchestration | Chroma | DBT | Faiss | Generative AILeadership programs | Mentorship programsSenior-level Full TimeUnited States R12d ago
-
Senior Machine Learning Engineer - Edge AI USD 205K-242KC++ | Computer Vision | Convolutional Neural Networks | Deep learning | Edge AIComprehensive health plans | Flexible working model | Parental leave plans | Professional development stipend | Remote workSenior-level Full TimeRemote - US R12d ago
-
AI Solution Engineer - Operations and Implementation USD 89K-175K800-171 | AWS | Airflow | Azure | CUI401k match | Certification programs | Childcare option | Flexible spending account | Flexible work scheduleMid-level Full TimeRemote - Alabama, United States R13d ago
-
AI Research Engineer: Vision AI / VLM / Physical AI USD 140K-150K3D Reconstruction | CI/CD | CUDA | CUDA profiling | Computer VisionHealth benefits | Mentorship | Paid time off | Remote work optionSenior-level Full TimeRemote Work( USA), United States R13d ago
-
Senior Forward Deployed AI Engineer USD 160K-226KData Pipelines | DevOps | Distributed Systems | Edge Computing | JAX401k match | Continuing education support | Function health subscription | Health & wellness stipend | Health, dental, vision benefitsSenior-level Full TimeAustin, TX R13d ago
-
Senior ML Engineer - Agentic AI USD 140K-150KA/B | A/B Testing | Anthropic API | Autogen | B testing401-K matching | Dental insurance | Employee assistance program | Fitness club discounts | Flexible paid time offSenior-level Full TimeWaltham MA - 10 CityPoint, United … R14d ago
-
Staff, ML Engineer - BEV USD 219K-329K3D Scene | 3D Scene Understanding | BEV Modeling | Camera | Data Augmentation401k match | ADandD insurance | Company holidays | Flexible schedule | Life insuranceSenior-level Full TimeRemote - US, Ann Arbor, MI R14d ago
-
AI Infrastructure Engineer USD 170K-210KC++ | CI/CD | CUDA | Container Orchestration | Datadog401k match | Dental insurance | Health insurance | Paid time off | Remote workMid-level Full TimeUnited States - Remote R15d ago
-
Machine Learning Engineer USD 72K-166KLanguage Models | Large Language Models | Learning algorithms | Machine Learning | Machine learning algorithmsHybrid workMid-level Full TimeUS Remote, United States R15d ago