Machine Learning Engineer — Inference Optimization
Tasks
- Benchmark performance across hardware and cloud setups
- Build and maintain inference serving systems
- Implement and tune quantization
- Improve reliability and observability under real workloads
- Improve speculative decoding batching and streaming
- Optimize KV cache reuse
- Optimize inference latency throughput and cost
- Profile and bottleneck GPU CPU inference pipelines
- Prune models or simplify architectures for inference
Perks/Benefits
- N/A
Skills/Tech-stack
BF16 | CUDA | Deep learning | Distributed Systems | FP16 | FP8 | INT8 | KV cache | Low Latency | Low-Latency Systems | Memory Optimization | ONNX Runtime | Performance Profiling | PyTorch | Quantization | ROCm | Speculative decoding | TensorRT | Triton | VLLM
Education
N/A
Related jobs
-
Senior Embedded Software Engineer - Future Forward USD 134K-201KAuthentication | C# | C++ | CAN | CUDASenior-level Full TimeSunnyvale, CA, United States R12h ago
-
Senior Cloud Data Infrastructure Engineer CAD 140K-202KAWS | Amazon EC2 | Apache Kafka | Apache Spark | As-a-ServiceFlexible time off | Flexible work environment | Global gatherings | Healthcare employer contribution | Home office setupSenior-level Full TimeCanada (Remote) R14h ago
-
Senior Cloud Data Infrastructure Engineer EUR 75K-95KAWS | Apache Kafka | Apache Spark | As-a-Service | AzureEmployer healthcare contributions | Flexible time off | Flexible work environment | Global gatherings | Home office setupSenior-level Full TimeGermany (remote) R14h ago
-
Senior Software Developer – Data Analytics COP 58800K-58800KAWS | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step Functions100 percent remote work | Funeral assistance | Home office stipend | Internet allowance | Life insuranceSenior-level Full TimeBogotá, Colombia R17h ago
-
Senior AI Software Engineer III - Colombia COP 89364K-94620KAI Governance | AI Safety | AI guardrails | AWS | AWS BedrockHome office stipend | Internet allowance | Life insurance and funeral assistance | Paid time off | Prepaid medicineSenior-level Full TimeBogotá, Colombia R18h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R1d ago
-
Senior AI Developer CAD 141K-170KAWS | Agile | Azure | CI/CD | CachingFlexible hours | Paid sabbatical | Parental program | Training | Wellness and productivity spending accountSenior-level Full TimeMontreal (EN) R1d ago
-
Computational Biology MLOps Engineer USD 125K-189KAWS | Alerting | CI/CD | Checkpointing | Cloud platformOnsite work three days per weekMid-level Full TimeSan Diego, CA / Indianapolis, IN … R1d ago
-
Senior Machine Learning Engineer AUD 148K-210KAccess Control | Agent systems | CI/CD | Capabilities Based Access Control | Error RecoveryHealth and wellness benefits | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R1d ago
-
Senior Machine Learning Engineer AUD 148K-210KACID | Distributed Systems | Durable Execution | Event Sourcing | Fault ToleranceHybrid work | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R1d ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R1d ago
-
Principal Data Engineer INR 3740K-5876KAirflow | Amazon Athena | Amazon EMR | Amazon Redshift | Apache FlinkHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R1d ago
-
Sr Data Engineer USD 91K-163KAI/ML | Azure DevOps | CI/CD | Code review | Data Compliance401k contribution | Career development opportunities | Comprehensive benefits | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior-level Full TimeSingapore R1d ago
-
Senior Big Data Engineer INR 2000K-3000KAutosys | Data Modeling | Data Warehousing | Dimensional Modeling | Distributed SystemsFull-time employment | High-performing team | Hybrid work model | Operational reliabilitySenior-level Full TimeLocation(s): Pune, Maharashtra, India R1d ago
-
API | Acoustic Echo Cancellation | Automated testing | Beamforming | BehaviorTree.CPPAnnual bonus | Dental insurance | Disability insurance | Equity awards | Health insuranceSenior-level Full TimeRemote - USA, United States R1d ago
-
Applied AI Specialist AED 216K-300KAPI | Anomaly Detection | Cloud Architecture | Computer Vision | Data GovernanceContinued career development support | Employee resource groups | Flexible work-from-home policy | Generous paid time off | Paid volunteer timeSenior-level Full TimeUAE-Dubai, United Arab Emirates R1d ago
-
Lead Machine Learning Engineer CAD 156K-251KAWS | Azure | CI/CD | Cloud Computing | Cloud platformAutonomy | Career development support | Learning and development programs | Mentorship and coachingSenior-level Full TimeToronto, Canada R1d ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Mid-level Full TimeArgentina, Remote R1d ago
-
Mid-level Full TimeBogota, Colombia R1d ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R1d ago
-
MLOps Engineer - GPU Platform (Inference & Training) USD 184K-300KAmazon EKS | ArgoCD | Bottlerocket | CUDA | DCGMOn site office relocationSenior-level Full TimeAlmaty, Kazakhstan R1d ago
-
Member of Engineering (Experiment Platform) USD 180K-290KAPI Design | Backend architecture | Database Design | Distributed Systems | GoCompany-provided equipment | Flexible hours | Fully remote work | Health insurance allowance | Home-office allowanceSenior-level Full TimeRemote (EMEA/East Coast) R1d ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R1d ago