Machine Learning Engineer — Inference Optimization
Tasks
- Benchmark performance across hardware and cloud setups
- Build and maintain inference serving systems
- Implement and tune quantization
- Improve reliability and observability under real workloads
- Improve speculative decoding batching and streaming
- Optimize KV cache reuse
- Optimize inference latency throughput and cost
- Profile and bottleneck GPU CPU inference pipelines
- Prune models or simplify architectures for inference
Perks/Benefits
- N/A
Skills/Tech-stack
BF16 | CUDA | Deep learning | Distributed Systems | FP16 | FP8 | INT8 | KV cache | Low Latency | Low-Latency Systems | Memory Optimization | ONNX Runtime | Performance Profiling | PyTorch | Quantization | ROCm | Speculative decoding | TensorRT | Triton | VLLM
Education
N/A
Related jobs
-
Senior Embedded Software Engineer - Future Forward USD 134K-201KAuthentication | C# | C++ | CAN | CUDASenior-level Full TimeSunnyvale, CA, United States R11h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R1d ago
-
Senior Machine Learning Engineer AUD 148K-210KAccess Control | Agent systems | CI/CD | Capabilities Based Access Control | Error RecoveryHealth and wellness benefits | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R1d ago
-
Senior Machine Learning Engineer AUD 148K-210KACID | Distributed Systems | Durable Execution | Event Sourcing | Fault ToleranceHybrid work | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R1d ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R1d ago
-
Principal Data Engineer INR 3740K-5876KAirflow | Amazon Athena | Amazon EMR | Amazon Redshift | Apache FlinkHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R1d ago
-
Sr Data Engineer USD 91K-163KAI/ML | Azure DevOps | CI/CD | Code review | Data Compliance401k contribution | Career development opportunities | Comprehensive benefits | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior-level Full TimeSingapore R1d ago
-
Senior Big Data Engineer INR 2000K-3000KAutosys | Data Modeling | Data Warehousing | Dimensional Modeling | Distributed SystemsFull-time employment | High-performing team | Hybrid work model | Operational reliabilitySenior-level Full TimeLocation(s): Pune, Maharashtra, India R1d ago
-
API | Acoustic Echo Cancellation | Automated testing | Beamforming | BehaviorTree.CPPAnnual bonus | Dental insurance | Disability insurance | Equity awards | Health insuranceSenior-level Full TimeRemote - USA, United States R1d ago
-
Applied AI Specialist AED 216K-300KAPI | Anomaly Detection | Cloud Architecture | Computer Vision | Data GovernanceContinued career development support | Employee resource groups | Flexible work-from-home policy | Generous paid time off | Paid volunteer timeSenior-level Full TimeUAE-Dubai, United Arab Emirates R1d ago
-
Lead Machine Learning Engineer CAD 156K-251KAWS | Azure | CI/CD | Cloud Computing | Cloud platformAutonomy | Career development support | Learning and development programs | Mentorship and coachingSenior-level Full TimeToronto, Canada R1d ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Mid-level Full TimeArgentina, Remote R1d ago
-
Mid-level Full TimeBogota, Colombia R1d ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R1d ago
-
MLOps Engineer - GPU Platform (Inference & Training) USD 184K-300KAmazon EKS | ArgoCD | Bottlerocket | CUDA | DCGMOn site office relocationSenior-level Full TimeAlmaty, Kazakhstan R1d ago
-
Member of Engineering (Experiment Platform) USD 180K-290KAPI Design | Backend architecture | Database Design | Distributed Systems | GoCompany-provided equipment | Flexible hours | Fully remote work | Health insurance allowance | Home-office allowanceSenior-level Full TimeRemote (EMEA/East Coast) R1d ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R1d ago
-
Associate AI-ML Engineer INR 3200K-4500KCI/CD | CrewAI | Databases | Docker | Generative AILearning and growth | Mentorship | Mentorship from technology leadersMid-level Full TimeBengaluru East, Karnataka, India R1d ago
-
AI Engineer II (Remote) USD 39K-72KAPIs | AWS | CI/CD | Data workflows | Distributed SystemsFull-time employment | Remote workMid-level Full TimeIndia, Remote R1d ago
-
AI Engineer II (Remote) USD 39K-72KAWS | Attention Mechanism | BERT | CI/CD | Distributed SystemsCode reviews | Mentorship | Remote workMid-level Full TimeBogota, Colombia R1d ago
-
Mid-level Full TimeMexico, Remote R1d ago
-
Mid-level Full TimeTürkiye, Remote R1d ago
-
AI Engineer II (Remote) USD 39K-72KAPIs | AWS | BERT | CI/CD | Distributed SystemsFull-time employment | Remote workMid-level Full TimeLatin America R1d ago