Machine Learning Engineer — Inference Optimization
Tasks
- Benchmark model performance across hardware and cloud environments
- Build and maintain inference serving infrastructure
- Collaborate with research engineers to productionize new model architectures
- Implement optimization techniques like quantization KV cache optimization speculative decoding batching and streaming
- Improve system reliability monitoring and observability
- Optimize machine learning inference systems for latency throughput scalability and cost
- Profile and identify bottlenecks in GPU and CPU inference pipelines
- Scale ML infrastructure for quality scalability and maintainability
Perks/Benefits
Skills/Tech-stack
Attention Mechanisms | Batching | CUDA | Compute Graphs | Distributed Systems | GPU Performance | GPU Performance Optimization | KV cache | Low Latency | Low-Latency Systems | Machine Learning | Memory Optimization | Model Deployment | Neural Networks | ONNX Runtime | Performance optimization | PyTorch | Quantization | Speculative decoding | Streaming | TensorRT | Triton | VLLM
Education
N/A
Related jobs
-
Experienced - GenAI & Prompt Engineer EUR 33K-37KAI Security | AI compliance | AI ethics | Artificial Intelligence | GPT-4Hybrid work | Internal knowledge sharing | Training sessionsMid-level Full TimeMilano, Napoli, Roma17h ago
-
Adversarial Testing | Bias Assessment | Experiment tracking | Factual consistency | Hallucination detectionFlexible schedule | Remote workSenior-level Contract Full TimeItaly R22h ago
-
API Design | Artificial Intelligence | Channels | Concurrency | Distributed SystemsFlexible work location | Four-day work week | Fully remote work | Professional growth opportunities | Uncapped holiday allowanceSenior-level Full TimeItaly R1d ago
-
Data Engineer EUR 40K-60K.NET | Azure Cognitive | Azure Cognitive Services | Azure Data | Azure Data FactoryContinuous learning opportunities | Flexible working hours | Global team collaboration | Permanent contract | Remote work up to 3 days per weekSenior-level Full TimeReggio Emilia, Emilia - Romagna, Italy R2d ago
-
API Design | Command Line | Command-line interfaces | Data Modeling | Database systemsCompany-provided equipment | Continuous learning allowance | Flexible working hours | Fully remote work | Health insurance allowanceSenior-level Full TimeItaly R3d ago
-
Machine Learning Engineer (ELE-ST) EUR 32K-40KC++ | Continuous integration | Foundation Models | Git | JenkinsHybrid working | Meal allowance | Training and professional development | Welfare benefitsEntry-level Full TimeIT - Roma - Via Tiburtina …3d ago
-
Project Work in Clinical Data Science EUR 28K-28KData Mapping | Data Transformation | Data integration | Language Models | Language ProcessingEntry-level Full TimeITA - Milan - Trinita, Italy R3d ago
-
Data Engineer Business Intelligence EUR 35K-45KAWS | AWS Glue | Amazon Redshift | Azure | Cloud platformHealth insurance | Meal vouchersMid-level Full TimeBOLOGNA, EMILIA ROMAGNA, Italy3d ago
-
A/B | A/B Testing | AWS | Alerting | AutoscalingFully remote within Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimeItaly R4d ago
-
AI & Data Science Consultant EUR 38K-38KAI Act | AI Governance | AI guardrails | Automated Deployment | CI/CDContinuous learning programs | Employee discounts program | Employee referral program | Health insurance | Life and permanent disability by accident coverageEntry-level Full TimeIT306 - DXC Paolo Di Dono …5d ago
-
C# | Digital Signal | Digital Signal Processing | Embedded firmware | Model OptimizationNone Full TimeAgrate Brianza, Italy7d ago
-
Audio Processing | Deep learning | Digital Signal | Digital Signal Processing | PyTorchSenior-level Full TimeAgrate Brianza, Italy7d ago
-
Auto Scaling | Blue-Green Deployment | Blue/green | CI/CD | CUDAFlexible remote work | Fully remote | Growth opportunities | High ownership and influence | Meaningful technical impactSenior-level Full TimeItaly R8d ago
-
Senior Data Engineer EUR 45K-60KAWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS S3Continuous improvement culture | Cross-functional collaboration | Hybrid work environmentSenior-level Full TimeSAN DONATO MILANESE (MI), Italy9d ago
-
Data Engineer EUR 30K-40KAWS Glue | AWS S3 | Amazon Redshift | Apache Airflow | Apache SparkHybrid work scheduleMid-level Full TimeSAN DONATO MILANESE (MI), Italy9d ago
-
Junior AI Engineer – NextHub Bari EUR 22K-25KData Processing | Data Processing Pipelines | Deep learning | Feature Engineering | Fine TuningHybrid workEntry-level Full TimeBari9d ago
-
Deep AI Native Software Engineering EUR 28K-36KC++ | Computer Vision | Data Pipelines | Data Preprocessing | Data RetrievalEntry-level Full TimeAssago, Via del Mulino 11a, Italy10d ago
-
Senior Databricks Data Engineer EUR 40K-55KAccess Control | Apache Spark | Batch Processing | CI/CD | Data GovernanceNational and international travel opportunities | Smart-working optionSenior-level Full TimeRoma, Lazio, Italy10d ago
-
Junior Robotics Engineer – NextHub Bari EUR 22K-25KAutonomous Navigation | CUDA | Computer Vision | Edge Robotics | Human robotHybrid work environmentEntry-level Full TimeBari10d ago
-
Data Analysis | Data Preprocessing | Deployment Automation | Exploratory Data Analysis | Feature EngineeringTechnical mentoringEntry-level Full TimeItaly11d ago
-
Entry-level Full TimeASSAGO, Lombardia(MI), Italy11d ago
-
AI Robotics and Computer Vision specialist M/F/D EUR 38K-49KC++ | CI/CD | Computer Vision | Containerization | Deep learningDisability programs | Flexible working hours | Life insurance | Private medical care | Tailored financial programsEntry-level Full TimeIT-FI-FLORENCE-VIA FELICE MATTEUCCI 2, Italy12d ago
-
AWS | Automation | Cloudflare | DNS | DatadogGrowth Plan Tailored | Gym discounts | Learning resources | Mental health support | MentorshipSenior-level Full TimeMilan12d ago
-
Cloud Computing | Digital Twin | Edge Computing | Internet of Things | MESCareer development | Hybrid workMid-level Full TimeBari13d ago
-
Data Engineer EUR 40K-50KBig Data | Data Modeling | Data Pipelines | Data Warehousing | Machine LearningSenior-level Full TimeMilan, IT, 2014514d ago