Inference Optimization Engineer (local / edge runtime)

USA - CA - Santa Clara, United States

USD 170K-315K Mid-level Full Time

@ I...

Apply Save

Found 8d ago

Tasks

Benchmark performance across hardware tiers publish comparisons
Implement quantization strategy validate quality impact
Profile local inference optimize latency throughput memory
Reduce CPU overhead improve engine startup model load lifecycle
Tune KV cache continuous batching scheduling
Upstream fixes and patches to open source inference engines

Perks/Benefits

Skills/Tech-stack

Apply Save

Language: en Views:

1 Clicks:

0 Saves: 0

Related jobs

Associate Engineer, Business Analytics Industrial Engineering USD 75K-85K

Capacity Analysis | Cloud Computing | Continuous Improvement | Data Visualization | Data Warehousing

401k | Dental insurance | Discounts | Health insurance | Paid leave

Mid-level Full Time

Universal City, CALIFORNIA, United States

5h ago
Data Engineer-Secret Clearance Required USD 100K-127K

AWS | AWS Glue | AWS Redshift | Azure | Azure Data

401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount program

Senior-level Full Time

Remote - Nationwide, United States R

11h ago
Sr AI Engineer USD 84K-105K

C# | Deep learning | Digital Signal | Digital Signal Processing | Edge Computing

Accidental death and dismemberment | Commuter benefits | Dental insurance | Flexible spending account | Health savings account

Senior-level Full Time

Columbia, MARYLAND, United States

11h ago
Applied Research Scientist / Engineer USD 175K-250K

Data Curation | Deep learning | Diffusion Models | Distributed Training | Domain Adaptation

Mid-level Full Time

New York, NY, SF Bay Area, …

12h ago
AI Engineer (GenAI & Integration) USD 130K-181K

AI Agents | AI Governance | API Integration | Automation workflows | Deployment

Mid-level Full Time

Center, Center District, IL

13h ago
Data Engineer USD 105K-130K

APIs | Data Governance | Data Modeling | Data Monitoring | Data Quality

401k employer matching | Childcare reimbursement | Company events social hours | Company paid parking or MTS pass | Fertility treatment coverage

Senior-level Full Time

San Diego, CA, United States

13h ago
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 136K-140K

Artificial Intelligence | Confluence | Jira | LLM | Machine Learning

401k retirement plan | Dental insurance | Life insurance | Medical insurance | Paid time off

Mid-level Full Time

Fort George G Meade, United States

14h ago
Lead Data Engineer – Snowflake USD 170K-216K

Amazon S3 | Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake Storage

Senior-level Full Time

United States

15h ago
Software Engineer 2/3-BY-SIG-02 USD 78K-250K

Accumulo | BSON | Bigtable | Docker | HBase

401k match | Diverse inclusive workplace | Employee referral programs | Flexible work arrangements | Mental health support

Senior-level Full Time

Hanover, MD

15h ago
Data Engineer III USD 134K-161K

Access Control | Analytics Cloud | Data Governance | Data Marts | Data Quality

401k | Adoption Assistance | Dental insurance | Education reimbursement | FSA

Senior-level Full Time

Irvine, CA

15h ago
GenAI Engineer III USD 110K-218K

Artificial Intelligence | Containerization | Data Analysis | Data Pipelines | Docker

Professional development

Senior-level Full Time

Arlington/Rosslyn, Virginia, United States

16h ago
Generative AI Engineer III USD 110K-218K

Artificial Intelligence | Data Analysis | Data Pipelines | Docker | Kubernetes

Discretionary annual incentive program | Mentorship | Professional development

Senior-level Full Time

Austin, Texas, United States; Boston, Massachusetts, …

16h ago
Lead Generative AI Data Engineer III USD 159K-265K

Artificial Intelligence | Data Pipelines | Docker | Generative AI | Kubernetes

Senior-level Full Time

Austin, Texas, United States; Boston, Massachusetts, …

16h ago
Lead Generative AI Data Engineer III USD 159K-265K

Artificial Intelligence | Data Pipelines | Generative AI | Language Models | Language Processing

Senior-level Full Time

Atlanta, Georgia, United States; New York, …

16h ago
Generative AI Data Engineer III USD 131K-218K

Algorithm Development | Artificial Intelligence | Data Analysis | Data Modeling | Data Pipelines

Mentorship | Travel opportunities

Senior-level Full Time

Atlanta, Georgia, United States; New York, …

16h ago
Sr. Data Engineer - Data Engineer III USD 125K-198K

AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon Redshift

Senior-level Full Time

Philadelphia, Pennsylvania, United States

16h ago
Integration Engineer II - AI and Python Developer USD 86K-170K

AI Ops | AWS Bedrock | Azure | CI/CD | Fine Tuning

Agile team collaboration | Mentorship | Professional development

Mid-level Full Time

Atlanta, Georgia, United States; Baltimore, Maryland, …

16h ago
Sr. AI Engineer USD 150K-175K

Access Control | Agentic AI | Auditability | CI/CD | Cloud platform

401k | Dental insurance | Expense reimbursement for internet costs | Life insurance | Medical insurance

Senior-level Full Time

Remote, USA, United States R

16h ago
Networking AI Technical Lead USD 207K-301K

Algorithms | Artificial Intelligence | C++ | Compute Technologies | Data Structures

Senior-level Full Time

Sunnyvale, CA, USA; Cambridge, MA, USA

17h ago
Applied AI & ML Lead - Markets Operations USD 177K-215K

Data Analysis | Feature Engineering | Generative AI | Language Models | Large Language Models

Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centers

Senior-level Full Time

Jersey City, NJ, United States

23h ago
Senior Data Engineer, Strategic Partnerships & IMPACT360 USD 154K-209K

AWS Glue | AWS Lake Formation | AWS Lambda | Amazon Athena | Apache Airflow

Senior-level Full Time

Seattle, Washington, USA

1d ago
Edge AI Engineer USD 100K-150K

Benchmarking | Bias Evaluation | C++ | Core ML | Data Privacy

Career growth | Health benefits | Remote work

Senior-level Full Time

United States - Remote R

1d ago
AI Research Engineer (Applied AI) USD 100K-150K

Agent systems | Computer Vision | Data Quality | Data quality monitoring | Deep learning

Mid-level Full Time

United States - Remote R

1d ago
LLM Fine-Tuning Engineer USD 100K-150K

Adapter methods | Attention Optimization | Benchmarking | Dataset Quality Assurance | Dataset curation

Career growth | Mentorship | Remote work

Mid-level Full Time

United States - Remote R

1d ago
Quantitative Developer (Fintech) USD 100K-150K

Audit trails | Backtesting | C++ | Cloud Native | Cloud-native Architectures

Benefits | Career growth | Remote work

Mid-level Full Time

United States - Remote R

1d ago

Inference Optimization Engineer (local / edge runtime)

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs