Software Engineer, Model Inference
Tasks
- Bring machine learning research into production
- Build tools to monitor bottlenecks and instability
- Design and implement solutions for high priority inference issues
- Improve performance latency throughput efficiency of inference stack
- Optimize code and cloud instances for GPU utilization
- Optimize model inference for low latency high availability
Perks/Benefits
- N/A
Skills/Tech-stack
CUDA | Debugging | Distributed Systems | HPC | High Availability | High Volume | High-volume systems | Infiniband | MPI | NCCL | NVIDIA GPUs | NVLink | Performance optimization | PyTorch | Python | Volume Systems
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
Software Engineer, Data Engineering USD 70K-200KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeIrvine, CA10h ago
-
Embedded Software Engineer, Perception (All Levels) USD 154K-212KARM | C++ | CSI-2 | CUDA | Device treeMid-level Full TimeLos Angeles, CA11h ago
-
Staff Software Engineer - Streaming USD 182K-247KApache Spark | Data Storage | Database systems | Distributed Systems | Latency optimizationSenior-level Full TimeSeattle, Washington12h ago
-
Staff Frontier Agents Engineer (Applied AI) USD 252K-315KA/B | A/B Testing | AWS | Ablation Studies | AzureCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …12h ago
-
Senior Frontier Agents Engineer (Applied AI) USD 216K-270KA/B Testing | AWS | Ablation Studies | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …12h ago
-
Frontier Agents Engineer (Applied AI) USD 180K-225KA/B | A/B Testing | AWS | Ablation Studies | Agent FrameworksCommuter stipend | Dental insurance | Health insurance | Learning and development stipend | Paid time offMid-level Full TimeSan Francisco, CA; Seattle, WA; New …12h ago
-
Software Engineer, API Multimodal USD 293K-385KConcurrency | Distributed Systems | Go | Latency | ObservabilitySenior-level Full TimeSan Francisco12h ago
-
Computer Vision Engineer USD 140K-260KC++ | CUDA | Cloud processing | Computer Vision | Deep learningSenior-level Full TimeSan Jose, California, United States13h ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R13h ago
-
Algorithm Engineer USD 140K-260KAgent systems | C++ | Decision Making | Decision making under uncertainty | Distributed coordinationOnsite work in United States | Reasonable accommodations providedEntry-level Full TimeSan Jose, California, United States13h ago
-
Software Engineer, ML Infra (Junior & New Grad) USD 125K-175KAWS | Azure | Bug tracking | C++ | Cloud ComputingEntry-level Full TimeMountain View, California, United States13h ago
-
Senior Embedded Software Engineer USD 191K-253KARM | Bare Metal | Board Bring-up | Bring-up | Build systemsComprehensive benefits | On-site work opportunities | U.S. Secret security clearance sponsorshipSenior-level Full TimeCosta Mesa, California, United States13h ago
-
AI Programmer Analyst - Need 11+ Exp USD 120K-154KAI Agents | AIOps | Anomaly Detection | Automated Incident Remediation | Azure AIMid-level Contract Full TimeDallas, TX, United States14h ago
-
Staff Machine Learning Engineer, Applied Research USD 189K-389KC++ | Graph Neural Networks | Information Retrieval | Java | Language ProcessingSenior-level Full TimeSan Francisco, CA, US; Remote, US R14h ago
-
Machine Learning Engineer I, Network USD 151K-189KClassification | Data Pipelines | Deep learning | Experiment tracking | Feature Engineering401k match | Commuting support | Flexible PTO | Free lunch | Gym accessSenior-level Full TimeSan Francisco, CA14h ago
-
Senior Software Engineer, Data Lake USD 196K-230KAWS S3 | Apache Flink | Apache Kafka | Apache Spark | Change Data Capture401k matching | Disability insurance | Fertility benefits | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA14h ago
-
Consultant – Compliance Data Science & AI USD 98K-122KAPI | AWS | Anthropic | Azure | Dashboards401k match | Cell phone stipend | College savings | EAP | HSA & FSA optionsMid-level Full TimeSan Francisco, CA, United States14h ago
-
Director, Data Analyst/BI Engineer USD 138K-175KAWS | Access Control | Aggregated Event Measurement | Airflow | BigQuery401k match | Healthcare Dental Vision | PTO | Paid Holidays | Parental leaveExecutive-level Full TimeUnited States R14h ago
-
Principal AI Engineer USD 185K-265KAPI Integration | Agent systems | Artificial Intelligence | Cloud Native | Cloud-native ArchitecturesEducation reimbursement | Health plans | Paid time off | Parental leave | Remote workSenior-level Full TimeRemote - USA R15h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Cloud Computing | Data Association401k match | Dental insurance | Emotional & mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSeattle, Washington, United States R15h ago
-
AI Engineer - FDE (Forward Deployed Engineer) USD 152K-210KAWS | Agent systems | Apache Spark | Azure | Databricks Intelligence PlatformRemote work | Travel opportunitiesSenior-level Full TimeUnited States15h ago
-
Senior Data Engineer II, AI Native USD 148K-216KAmazon Web Services | Apache Airflow | Apache Spark | Azure | BigQuery401k matching | Dental insurance | Disability insurance | Employee assistance program | Equipment reimbursementSenior-level Full TimeRemote, USA R15h ago
-
Senior Production Engineer, Storage USD 172K-209KAnsible | Backup and Restore | Block Storage | C# | Data replication401k match | Calm subscription | Cell phone reimbursement | Commuter benefit | HSA employer contributionSenior-level Full TimeSunnyvale, CA - US15h ago
-
API Design | AWS | Access Control | Amazon S3 | Apache AirflowEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNashville, TN15h ago