Staff AI Inference and Acceleration Engineer
Tasks
- Apply operator fusion
- Apply pruning
- Apply quantization
- Collaborate with silicon vendors
- Define compute budget for inference tasks
- Define hardware friendly model constraints
- Design on board inference architecture
- Evaluate acceleration hardware
- Integrate runtime scheduling and power management
- Map models to accelerators
- Optimize data movement
- Optimize inference toolchains end to end
- Optimize kernel scheduling
- Optimize memory layout
- Partition inference workloads across heterogeneous compute
- Profile inference pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
AI Inference | Benchmarking | C++ | CUDA | Computer Architecture | Edge AI | Embedded Systems | Heterogeneous computing | INT4) | INT8 | JAX | MLIR | Memory hierarchy | Mixed Precision | ONNX | Operator fusion | Profiling | Pruning | Python | Quantization | ROCm | TFLite | TVM | TensorRT | Torch
Education
Related jobs
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-210KAI/ML | AI/ML model development | Artificial Intelligence | C++ | CI/CDSenior-level Full TimeAustin, TX, USA6h ago
-
Imaging Machine Learning Engineer USD 132K-189K3A Tuning | Algorithm Development | Benchmarking | C++ | CalibrationMid-level Full TimeMountain View, CA, USA6h ago
-
Algorithms | Android Development | C# | C++ | Data StructuresMid-level Full TimeSan Jose, CA, USA; Waterloo, ON, …6h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KC++ | Code review | Data Processing | Data Storage | DebuggingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …16h ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …16h ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …16h ago
-
Senior Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C Programming | C programming language | C#401k employer match | Cell phone reimbursement | Dinner provided twice weekly | EV charging | Flexible PTOSenior-level Full TimeEl Segundo, California, United States17h ago
-
Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | Cell phone reimbursement | EV charging | Flexible PTO | HSA employer matchEntry-level Full TimeEl Segundo, California, United States17h ago
-
Senior Embedded Software Engineer, C++ USD 169K-216KBare Metal | C++ | Computer Architecture | Computer Networking | Data Structures401k employer match | Company paid medical, dental, and vision | EV charging | Flexible PTO | Gym and fitness reimbursementSenior-level Full TimeEl Segundo, California, United States17h ago
-
Embedded Software Engineer, C++ USD 131K-184KBare Metal | C Programming | C++ | Computer Architecture | Computer Networking401k match | Company Equity Incentive Options | EV charging | Flexible PTO | Gym reimbursementEntry-level Full TimeEl Segundo, California, United States17h ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Bitbucket | Atlassian Confluence | Atlassian Jira | Bare Metal | C++401k match | Career development | Employee assistance program | Low cost dental | Low cost visionSenior-level Full TimeMarietta, GA R23h ago
-
Principal Embedded Software Engineer USD 160K-200KBare Metal | Bitbucket | C++ | Cameo | Confluence401k employer match | Career development | Employee assistance program | Low cost dental | Low cost visionSenior-level Full TimeMarietta, GA R23h ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R1d ago
-
Lead Embedded Software Engineer USD 211K-286KAerospace Standards | Agile | Bitbucket | C++ | CentOSSenior-level Full TimePhoenix, AZ1d ago
-
Airflow | Decision Trees | Deep learning | Docker | EnsemblesSenior-level Full TimeSan Francisco, California, United States1d ago
-
💎 Computational Materials Scientist 💎 USD 90K-140KAWS EC2 | Artificial Intelligence | Bash | Enterprise Linux | GPU ComputingFree food and snacks | Health care plan | Life insurance | Long-term disability | Paid time offMid-level Full TimeWalnut Creek, California, United States R1d ago
-
Sr. Data Engineer USD 61K-94KApache Flink | Apache Kafka | Apache NiFi | Apache Spark | Cassandra401k match | Accidental death and dismemberment insurance | Bonus plan | Commuter benefits | Flexible spending accountsSenior-level Full TimeCordova, TN, United States1d ago
-
Senior-level Full TimeAustin, TX1d ago
-
Full Stack Gen AI Engineer USD 128K-197KAWS Bedrock | AWS Fargate | Amazon ECS | Amazon Web Services | CI/CDSenior-level Full TimeDallas, Texas, United States1d ago
-
Senior Software Engineer, AI Developer Experience USD 200K-400KAlerting | Build systems | CI/CD | Caching | DashboardsDaily lunches & snacks | Disability benefits | Life insurance | Medical/Dental/Vision insurance | Parental leaveSenior-level Full TimeSan Francisco1d ago
-
Machine Learning Engineer USD 129K-220KC++ | Computer Vision | Data Curation | Dataset Preparation | Deep learning401k | Flexible working hours | Free Coffee, Drinks & Snacks | Health insurance | Life insuranceEntry-level Full TimeArlington, Virginia1d ago
-
Machine Learning Engineer USD 129K-190KComputer Vision | Deep learning | Language Processing | Machine Learning | Multi-object Tracking401k | Flexible working hours | Free coffee | Free drinks | Free snacksMid-level Full TimeClifton Park, New York1d ago
-
Senior Data Engineer USD 140K-216KAPI Integration | Airflow | Alerting | Amplitude | BigQuery401k match | Casual dress environment | Development dollars | Disability insurance | Life insuranceSenior-level Full TimeEdmond, OK1d ago
-
Senior Software Engineer, Robotics Platform USD 143K-241KC# | C++ | CUDA | DDS | LinuxHigh ownership team | On-site work scheduleSenior-level Full TimeSan Francisco1d ago