Machine Learning Engineer — Inference Optimization
Tasks
- Benchmark model performance on GPUs and CPUs
- Build and maintain inference serving infrastructure
- Implement quantization and KV cache optimization
- Implement speculative decoding and batching
- Improve monitoring and observability for ML systems
- Optimize machine learning inference systems for latency and throughput
- Productionize new model architectures
- Profile GPU and CPU inference bottlenecks
- Reduce operational cost of inference workloads
Perks/Benefits
Skills/Tech-stack
Batching | CUDA | Compute Graphs | Distributed Systems | GPU Performance | GPU Performance Optimization | Inference Optimization | KV cache | Low Latency | Low-Latency Systems | Machine Learning | ONNX Runtime | Performance optimization | PyTorch | Quantization | ROCm | Speculative decoding | Streaming | TensorRT | Triton | VLLM
Education
N/A
Related jobs
-
Axolotl | Direct Preference Optimization | Efficient Fine Tuning | Fine Tuning | Language ModelsContinuous learning and professional development | Exposure to Open Source AI | Fully remote work environment | Inclusive diverse collaborative workplace | Opportunity to work on cutting-edge AIMid-level Full TimeAustria R1d ago
-
Platform Engineer (AI / Data Platform) EUR 47K-48KCI/CD | Data Engineering | Docker | Kubernetes | LinuxOn site visits by agreement | Remote workEntry-level Contract Full TimeWien1d ago
-
MLOps Engineer EUR 35K-35KCI/CD | Cloud Computing | Data Versioning | MLOps | Machine LearningFlexible onsite visits | Remote workEntry-level Contract Full TimeWien1d ago
-
AI Engineer (m/f/d) - Healthcare IT EUR 45K-45KAPI Design | AWS | Agent Orchestration | Automated testing | BatchingCorporate discounts | Flexible meal vouchers | Group accident insurance | Group discounts | Private health insuranceSenior-level Full TimeAUT - Graz, Austria4d ago
-
AWS | Azure | Cloud infrastructure | Containerization | Deep learningAdditional days off | Flexible working hours | Health promotion | Home office | Learning & developmentMid-level Full TimeVienna, Austria, Vienna5d ago
-
Machine Learning Engineer EUR 60K-76KANN search | AWS SageMaker | Airflow | Amazon EC2 | Amazon EKSMid-level Full TimeAustria (remote) R7d ago
-
(Senior) GenAI Engineer (m/f/d) EUR 38K-51KAWS | Adversarial Networks | Azure | CI/CD | DALL-EConference funding | Flexible work environment | Gym membership subsidy | Home office | Public transport ticketMid-level Full TimeVienna, Wien, Austria10d ago
-
Senior Machine Learning Engineer - Automotive EUR 78K-108KC plus plus | Camera perception | Computer Vision | Data pipeline | Deep learningSenior-level Full TimeRemote - Austria R12d ago
-
Condition-Based Monitoring | Data Pipelines | Data Quality | Feature Engineering | IoTChildcare support | Education Catalog | Employee discounts | Fitness activities | Flexible working hoursSenior-level Full TimeWien-Favoriten, Wien, Austria; Wien-Favoriten R14d ago
-
Agentic Workflows | Anomaly Detection | Artificial Intelligence | CI/CD | ClassificationCareer growth | Inclusion and equal opportunitiesEntry-level Full TimeHaag, St. Gallen, CH15d ago
-
Agentic patterns | Auto Instrumentation | Context propagation | Distributed Systems | Evaluation FrameworksSenior-level Full TimeLinz, Vienna, Klagenfurt, Graz, Upper Austria, …18d ago
-
Adversarial Testing | Agent planning | CI/CD | Command Line | Command-line interfacesSenior-level Full TimeLinz, Vienna, Klagenfurt, Graz, Upper Austria, …18d ago
-
Data Science & AI Engineer (f/m/x) EUR 48K-48KCloud Computing | Data Science | Deep learning | Embedded Systems | GitFlexible work options | Personal development | Professional development | Training and onboardingEntry-level Full TimeGraz, Styria, Austria19d ago
-
Data Science & AI Engineer (w/m/d) EUR 48K-48KCloud Computing | Data Validation | Deep learning | Embedded Systems | GitIndividual onboarding | Long-term employment | Training and development | Work outside officeEntry-level Full TimeGraz, Styria, Austria19d ago
-
Data Science & AI Engineer (w/m/d) EUR 48K-48KCloud Computing | Data Science | Embedded Systems | Git | KerasFlexible work outside office | Individual onboarding | Long-term employment | Personal development | Professional developmentEntry-level Full TimeGraz, Styria, Austria19d ago
-
Data Science & AI Engineer (f/m/x) EUR 48K-48KCloud Computing | Data Science | Deep learning | Desktop applications | Embedded SystemsIndividual training and onboarding | Long-term employment | Personal development | Professional development | Voluntary flexibility allowanceEntry-level Full TimeGraz, Styria, Austria19d ago
-
AI Engineer (f/m/d) EUR 55K-55KCI/CD | Cloud Computing | Containerization | Docker | Infrastructure as CodeCompany pension scheme | Flexible working hours | Health and social benefits | Remote work option | Training and further education opportunitiesMid-level Full TimeAUT.Reutte, Austria R19d ago
-
Data Science Engineer (f/m/d) EUR 45KLanguage Processing | Machine Learning | Model Monitoring | Natural Language | Natural Language ProcessingBirthday off | Company training | Device choice | Flexible hours | Hybrid workingMid-level Full TimeVienna R22d ago
-
CRM | Customer Analytics | Data Analysis | Data Pipelines | Data ScienceEmployee discounts | Family-friendly culture | Flexible working hours | Homeoffice | Meal allowanceEntry-level Full TimeWiener Neudorf, Niederösterreich, Austria27d ago
-
AI Agents | Computational Search | Cyber-Physical Systems | Generative AI | Language ModelsFlextime | Food canteen | International collaboration events | Mentoring | SnacksEntry-level Full TimeGraz, AT28d ago
-
AI Agents | Cyber-Physical Systems | Language Models | Large Language Models | Machine LearningEvents | Flextime | Food provided | Training and development | Work from homeEntry-level Full TimeGraz, AT28d ago
-
Data Modeling | Data Processing | Data Visualization | Data pipeline | Distributed SystemsArbeitszeit mit Entwicklungsspielraum | Motiviertes Team | Weiterbildungsmöglichkeiten | Übernahme von VerantwortungSenior-level Full TimeHart bei Graz, Steiermark, AT, 807529d ago
-
MLOps & AI Infrastructure Engineer (f/m/d) EUR 55K-55KCI/CD | Containerization | Distributed Systems | Docker | GPU ComputingAccess to Tech Conferences | Hybrid work options | Mobility support | Onsite Team Lunch | Relocation supportSenior-level Full TimeLinz, Oberösterreich, Austria1mo ago
-
Ai/Ml Consultant/Developer EUR 54K-76KClearML | Computer Vision | Convolutional Neural Networks | Data Processing | Data Processing PipelinesMid-level Full TimeAustria1mo ago
-
AI/ML Engineer (Python) EUR 58K-81KClearML | Convolutional Neural Networks | Data Processing | Data Processing Pipelines | Deep learningSenior-level Full TimeVienna, Vienna, Austria1mo ago