Senior Machine Learning Engineer - LLM Quantization & Deployment
Tasks
- Analyze numerical errors and accuracy regressions
- Analyze performance trade-offs
- Benchmark VLA performance
- Build benchmarking and validation pipelines
- Build calibration pipelines
- Build model export pipelines
- Collaborate on latency analysis for in vehicle software
- Collaborate with training infrastructure on QAT and model distillation
- Curate evaluation datasets
- Deploy LLM quantization workflows
- Develop INT8 and FP4 low bit inference methods
- Develop VLA inference models
- Develop robust Python code
- Ensure numerical consistency with training models
- Establish model metric suite
- Implement PTQ and QAT
- Implement mixed precision inference
- Orchestrate PTQ and QAT workflows
- Productionize LLM quantization methods
- Triaging field testing and simulation issues
Perks/Benefits
Skills/Tech-stack
Benchmarking | Calibration | Data Pipelines | FP4 | INT8 | LLM Inference | Language Models | Large Language Models | Latency analysis | MLIR | Machine Learning | Mixed Precision | Model Distillation | Model Optimization | Model export | Numerical analysis | ONNX Runtime | Post-training | Post-training Quantization | PyTorch | Python | Quantization | Quantization aware training | TVM | TensorRT | Transformer | Validation
Education
Master of Engineering | Master of Science | Master of Technology
Roles
AI | AI Engineer | Engineer | Learning Engineer | Machine Learning Engineer
Regions
Countries
States
Related jobs
-
Benchmarking | Calibration | Data evaluation | FP4 | INT8Dinners | Fun activities | Infrastructures and computational resources | Lunches | SnacksSenior-level Full TimeSanta Clara, CA11h ago
-
Computer Vision | Data Processing | Deep learning | DeepSpeed | Diffusion ModelsComputational resources | Dinners | Fun activities | In house infrastructure | LunchesSenior-level Full TimeSanta Clara, CA1d ago
-
Senior AI Product Engineer USD 184K-356KAgent Loops | C plus plus | Data Flywheel | Fine Tuning | Function CallingEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara2d ago
-
Senior Applied Machine Learning Engineer - VLSI Design USD 152K-230KASIC | Agentic Systems | C++ | Circuit optimization | Data AnalysisSenior-level Full TimeUS, CA, Santa Clara2d ago
-
Senior Software Engineer, AI Performance Analysis USD 184K-287KAI | C++ | Integration | Machine Learning | Performance AnalysisEmployee benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R2d ago
-
Staff/Sr. ML Compute Efficiency Engineer USD 197K-300KC plus plus | Distributed Systems | GPU Computing | High Performance | High-Performance ComputingSenior-level Full TimeSanta Clara2d ago
-
Principal IT Data Engineer- Finance USD 167K-270KApache Airflow | Apache Spark | Artificial Intelligence | BigQuery | Business IntelligenceFlexible work schedule | In-office collaborationSenior-level Full TimeSanta Clara, CA3d ago
-
Senior Deep Learning Architect, LLM Inference USD 152K-287KCPU microarchitecture | Compiler optimizations | Data parallelism | Deep learning | Disaggregated servingEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara3d ago
-
Software Engineer, CUDA Deep Learning Systems USD 152K-258KC++ | CUDA | Computer Architecture | Deep learning | Distributed ComputingBenefits | EquityMid-level Full TimeUS, CA, Santa Clara R3d ago
-
Machine Learning Systems Engineer, Networking USD 152K-287KAnomaly Detection | CPU Optimization | Data Ingestion | Feature Engineering | GoComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara3d ago
-
Machine Learning Engineer, AI Safety USD 152K-281KBias Mitigation | Content Safety | Deep learning | Keras | Language ModelsComprehensive benefits packageMid-level Full TimeUS, CA, Santa Clara R3d ago
-
Data Engineer/Senior Data Engineer USD 160K-230KAgentic Workflows | Airflow | Apache Spark | Argo Workflows | Automated Regression401k plan | Free lunch | Unlimited beverages | Unlimited snacksSenior-level Full TimeSanta Clara, CA3d ago
-
Senior Site Reliability Engineer - Storage USD 168K-270KAWS | Amazon S3 | Azure | Bash | Cloud ComputingSenior-level Full TimeUS, CA, Santa Clara4d ago
-
Senior Software Engineer, AI Developer Tools USD 184K-287KAPIs | Command Line | Command-line Interface | Continuous integration | DockerEquity | Health benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara R4d ago
-
Computer Vision | Deep learning | Language Models | Large Language Models | Machine LearningEntry-level InternshipSanta Clara, CA7d ago
-
Computer Vision | Deep learning | Language Models | Large Language Models | Machine LearningMid-level Full TimeSanta Clara, CA7d ago
-
ATE | BSP | Bootloader | C# | C++Senior-level Full TimeUS, CA, Santa Clara7d ago
-
Senior Machine Learning Engineer, Perception USD 184K-287K3D Geometry | BEV Representation | Camera | Computer Vision | Deep learning401k plan | Free lunch | Salary and benefits package | Unlimited beverages | Unlimited snacksSenior-level Full TimeSanta Clara, CA7d ago
-
C++ | CUDA | CUPTI | Continuous batching | KV cacheSenior-level Full TimeUS, CA, Santa Clara R8d ago
-
AWS | Azure | Bazel | C# | C++Equity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara R8d ago
-
Senior MLOps Engineer USD 184K-287K3D Geometry | Accelerated computing | C plus plus | CI/CD | Cloud infrastructureEquity | Health benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara8d ago
-
C++ | CUDA | Data Preprocessing | Data Processing | Data loadingSenior-level Full TimeUS, CA, Santa Clara9d ago
-
C# | C++ | Caching | Distributed Systems | GPU ArchitectureComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R9d ago
-
Senior Software Engineer, Deep Learning - MLIR TRT USD 184K-287KC# | C++ | CUDA | Compression | Deep learningSenior-level Full TimeUS, CA, Santa Clara9d ago
-
Senior Deep Learning Frameworks Sustaining Engineer USD 152K-218KBazel | C# | C++ | CI Jenkins | CI/CDBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara9d ago