Sr Software Engineer, AI Tools – On-Device Generative AI Model Optimization
San Diego, California, United States of America
USD 140K-211K Senior-level Full Time
Tasks
- Adapt model architecture to hardware execution constraints
- Build developer diagnostics for model lowering and runtime efficiency
- Build extension points for new architectures in the pipeline
- Collaborate with compiler teams on graph level optimization and model level reauthoring
- Collaborate with quantization engineers to align architecture decisions
- Contribute stages to a multi stage model preparation pipeline
- Convert research prototypes into production deployments
- Develop reauthoring strategies for custom OEM models
- Integrate inference acceleration techniques in the model preparation pipeline
- Optimize model preparation for SoC context length latency and memory constraints
- Reauthor generative AI architectures for on device execution
Perks/Benefits
- N/A
Skills/Tech-stack
Attention Mechanism | Cursor | DSP | Diffusion Models | Edge inference | Efficient Attention | Export Tracing | GitHub Copilot | Graph optimization | HuggingFace Transformers | Inference Optimization | LLM Inference | Language Models | Large Language Models | LiteRT | Memory-efficient attention | Model Optimization | Multimodal Models | NPU | ONNX | ONNX Graph | ONNX Graph Optimization | ONNXRuntime | On Device Runtime | Positional Embedding | PyTorch | Python | QNN | Quantization | SoC | Speech Models | TorchScript | Vision Language Models | Vision-language
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R1d ago
-
SAP Analytics & Reporting SME — Alteryx USD 101K-142KABAP CDS | Alteryx Designer | Alteryx Server | Analytics Cloud | Analytics documentationDoD clearance eligibility | Training and enablement supportMid-level Full TimeScott Air Force Base, United States3h ago
-
Cloud Security | Cloud infrastructure | IT Operations | Linux | Network Automation401k | Dental insurance | Disability coverage | Life insurance | Medical insuranceSenior-level Full TimeLaurel, United States3h ago
-
Databricks Engineer USD 97K-162KAPI | Cloud Data | Cloud Data Platforms | Data Governance | Data ModelingMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …4h ago
-
Databricks Engineer USD 126K-171KAPIs | Agile | Apache Spark | Data Governance | Data ModelingTravel 10 to 15 percentMid-level Full TimeGilbert, Arizona, United States; Lake Mary, …4h ago
-
Senior Software Machine Learning Engineer, DeepMind USD 174K-253K2D Games | 3D Games | AI Agents | C++ | Generative AISenior-level Full TimeMountain View, CA, USA5h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-301KComputer Vision | Data Preparation | Data Processing | Data Storage | DebuggingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Forward Deployed Engineer, GenAI, YouTube GTM Operations USD 128K-185KAgentic Workflows | Cloud Computing | Containerization | DevOps | EmbeddingsEquity | Health insurance | Paid time off | Retirement planMid-level Full TimeNew York, NY, USA; Mountain View, …5h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-253KAccess Control | As-a-Service | C++ | Chaos Testing | Cloud FunctionsSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA5h ago
-
AI Research Lead USD 96K-104KAPIs | AWS | Cloud infrastructure | Code review | Copyright ProtectionCompany paid life insurance | Medical, dental & vision coverage | Mental well-being resources | Paid parental leave | Paid sick daysSenior-level Full TimeNew York, NY, US, 1028110h ago
-
Supply Chain Master Data Analyst USD 129K-171KData Analysis | Data Auditing | Data Dictionary | Data Governance | Data ManagementMid-level Full TimeCosta Mesa, California, United States14h ago
-
AI Engineer USD 149K-184KAPI Integration | EHR Integration | Evaluation | Language Models | Large Language ModelsSenior-level Full TimeNew York, NY15h ago
-
Senior AI Engineer USD 182K-220KAgent workflows | Arize Phoenix | Compliance | Cost Optimization | EmbeddingsSenior-level Full TimeNew York, NY15h ago
-
AI Engineer USD 78K-82KAPI Integration | CI/CD | Containerization | Csharp | Function Calling401k match | Flexible spending account | Health savings account | Legal ID Shield | Life insuranceEntry-level Full TimeTroy, MI, US15h ago
-
AWS | Alerting | Black box monitoring | Black-box | CI/CDBackup childcare | Financial coaching | Mental health support | Mentoring | Onsite health and wellness centersSenior-level Full TimeJersey City, NJ, United States16h ago
-
Staff Research Engineer, Data Agents USD 190K-270KAgent systems | Agentic reinforcement learning | LLM Agents | Language Models | Language ProcessingSenior-level Full TimeSan Francisco, California16h ago
-
Senior Embedded Engineer USD 165K-218KADC | AXI | AXI Stream Interface | AXI-Stream | Board SupportHealth benefits | On-site benefits | Recovery Benefits | U S Secret Clearance eligibilitySenior-level Full TimeHudson, New Hampshire, United States17h ago
-
Embedded Software Engineer USD 166K-220KARM | Board Design | Bootloader | C plus plus | C#Dental insurance | Health insurance | Paid time off | Recovery Benefits | Security clearance sponsorshipMid-level Full TimeLexington, Massachusetts, United States17h ago
-
Data Engineer USD 101K-224KApache Kafka | Apache Spark | Data Governance | Data Lineage | Data ModelingConstant learning | Flexible working models | Health and well-being | Skill growthSenior-level Full TimeBellevue, WA, US, 9800417h ago
-
Machine Learning Engineer USD 101K-224KAgentic Workflows | Embeddings | Fine Tuning | Hugging Face | LLM orchestrationSenior-level Full TimeBellevue, WA, US, 9800417h ago
-
Machine Learning Operations Engineer (MLOps) USD 101K-224KAlerting | Azure | CI/CD | Docker | Inference OptimizationSenior-level Full TimeBellevue, WA, US, 9800417h ago
-
Senior AI Engineer USD 145K-181KAWS | Alerting | Azure | Docker | Embeddings401k match | Commuter benefits | Dental | Healthcare | Remote friendly workplaceSenior-level Full Time3750 Market Street, Philadelphia, PA, United … R17h ago
-
Senior-level Full TimeFort Meade, MD17h ago
-
Embedded Software Engineer USD 68K-192KC# | C++ | Ethernet | I2C | LinuxFlexible family care days | Medical, dental & vision coverage | Paid Holidays | Paid parental leave | Paid time offMid-level Full TimeSunrise, FL, United States17h ago
-
Senior Machine Learning Engineer USD 180K-250KComputer Vision | Data Pipelines | Data labeling | Deep learning | Embedding Models100 percent remote | 13 paid holidays | 401k plan | Dental insurance | Medical insuranceSenior-level Full TimeRemote USA R17h ago