Staff Software Engineer, On-Device Machine Learning Infrastructure
Tasks
- Anticipate scaling bottlenecks
- Coordinate cross team performance and evaluation workflows
- Create API roadmaps
- Design SDKs and tools for LLM workflows
- Design resilient robust systems
- Optimize generative AI performance on heterogeneous hardware
- Provide technical mentorship
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Accelerated inference | Android | CPU | Data Processing | Debugging | Developer tools | Device Machine Learning | Distributed Systems | Fine Tuning | GPU | Generative AI | Hardware-accelerated inference | Language Processing | ML Infrastructure | ML compilation | ML runtime | Machine Learning | Model Deployment | Model Evaluation | NPU | Natural Language | Natural Language Processing | On-device Machine Learning | Reinforcement Learning | SDKs | Software Architecture | Software Design | Software testing | Speech Processing | System design | TPU
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Agentic technology | C++ | Data Mining | Human Feedback | Information RetrievalSenior-level Full TimeMenlo Park, CA2h ago
-
Data Engineer, Analytics (Ranking, AI) USD 182K-204KAgent Orchestration | C# | C++ | Dashboards | Data GovernanceCareer growth opportunitiesSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …2h ago
-
Principal Engineer, AI and Business Intelligence, Looker USD 307K-427KBusiness Intelligence | Data Governance | Data Modeling | ETL | Embedded AnalyticsCareer growth | Mentorship | Risk managementSenior-level Full TimeKirkland, WA, USA2h ago
-
C++ | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Senior Software Engineer USD 226K-252KC++ | Cause analysis | Machine Learning | Model Deployment | Model EvaluationSenior-level Full TimeMountain View, CA, USA3h ago
-
Senior Software Engineer, AI/ML, Ads and Commerce USD 174K-252KCloud platform | Data Pipelines | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, USA3h ago
-
Software Engineer USD 149K-211KAlgorithms | C# | C++ | Code Reviews | Data ProcessingHybrid scheduleMid-level Full TimeSunnyvale, CA, USA R3h ago
-
Senior Research Engineer USD 174K-252KC++ | Data Curation | Deep Neural Networks | Deep learning | JAXBenefits | Bonus | Equity | Hybrid work scheduleSenior-level Full TimeNew York, NY, USA R3h ago
-
Research Engineer USD 147K-211KAlgorithm Design | C++ | Experimental Design | Machine Learning | PythonHybrid scheduleMid-level Full TimeLos Angeles, CA, USA R3h ago
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-210KAI/ML | AI/ML Model Deployment | AI/ML model development | Artificial Intelligence | C++Senior-level Full TimeAustin, TX, USA3h ago
-
Software Engineer III, Manufacturing AI Infrastructure USD 147K-210KAgentic AI | Data Ingestion | Data Processing | Data Storage | DebuggingSenior-level Full TimeMountain View, CA, USA3h ago
-
Cost Optimization | Data Pipelines | Feature Engineering | Infrastructure Engineering | Machine LearningEquity compensationSenior-level Full TimeSan Mateo, CA, United States R7h ago
-
Software Engineer, Applied AI / Product USD 160K-220KAgentic AI | Data indexing | Evaluation | GraphQL | GuardrailsMid-level Full TimeSan Francisco Bay Area9h ago
-
C++ | DDS | Debugging | Hypervisor | Kernel Modules401k plan | Dental insurance | Equity programs | Green card support | Health insuranceSenior-level Full TimeMilpitas, CA9h ago
-
Software Engineer (Applied AI) USD 177K-220KBackend Development | Drift Detection | ETL | Go | HTTP APIsSenior-level Full TimeCupertino10h ago
-
Senior ML Ops Engineer (Machine Learning Infrastructure) USD 150K-250KAWS | Amazon SageMaker | Apache Airflow | Azure | CI/CDHybrid work | Onsite in Los Angeles at least 1 week per monthSenior-level Full TimeLos Angeles, CA12h ago
-
AMD x86 | AOSP | Android | BSP | Bring-upSenior-level Full TimePalo Alto, California, United States14h ago
-
Audio Processing | Data Pipelines | Data Wrangling | Deep learning | Fine Tuning401k matching | Company refill days | Employer paid medical/dental/vision | Health insurance | Unlimited paid time offSenior-level Full TimeSan Francisco14h ago
-
Robotics Software Engineer BRL 120K-145KAutonomous Navigation | C++ | Controls systems | Embedded Systems | Hardware-in-the-loopCareer growth | Comprehensive benefits | MentorshipMid-level Full TimeNorth Reading, MA15h ago
-
Software Engineer, Data Engineering, LOKI USD 166K-220KAPIs | Algorithms | Apache Tinkerpop | BOM | C++Health benefits | On-call rotation support | Recovery BenefitsMid-level Full TimeSanta Ana, California, United States15h ago
-
Senior Robotics Engineer - Undersea Dominance USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | LidarSenior-level Full TimeCosta Mesa, California, United States15h ago
-
Robotics Software Engineer - Undersea Dominance USD 191K-253KAnomaly Detection | C++ | Cameras | Computer Vision | GazeboMid-level Full TimeCosta Mesa, California, United States15h ago
-
Applied AI Engineer, Advertising Agents (New Grad) USD 135K-155KAgent Orchestration | Artificial Intelligence | Asynchronous programming | Concurrent programming | Data Modeling401k matching | Commuter benefits | Dental insurance | FSA | HSAEntry-level Full TimeMountain View, California, United States15h ago
-
Machine Learning Engineer, Ops USD 125K-165KCI/CD | GPU Acceleration | Go | Inference Optimization | Inference Server401k matching | Company equity | Dental insurance | Fertility support | Health insuranceMid-level Full TimeRemote (U.S. or Europe) R15h ago