Staff Software Engineer – ML Inference Runtime
Location Galway, Ireland
EUR 55K-84K (estimate) Senior-level Full Time
Tasks
- Analyze tokenization attention KV cache batching and quantization performance
- Develop C++ C and Python integrations for machine learning frameworks
- Implement integrations with llama.cpp
- Integrate ML runtimes with Arm hardware acceleration
- Lead work from design through delivery
- Mentor junior engineers
- Optimize performance for ML and LLM workloads
- Support technical decisions
Perks/Benefits
Skills/Tech-stack
Attention | Automated testing | Batching | C# | C++ | Compiler technology | Continuous integration | GPU Compute | Git | GitLab | Hardware acceleration | KV cache | LLM Inference | Machine Learning | Machine Learning Graph | Profiling | Python | Quantization | Tokenization | Vulkan
Education
N/A
Roles
Related jobs
-
Staff Forward Deployed Engineer, Google Cloud Consulting EUR 122K-125KAPIs | Agent systems | Cloud platform | Cost Optimization | Data PipelinesBonus | Collaboration with research teams | Equity | Travel opportunitiesSenior-level Full TimeDublin, Ireland12h ago
-
Senior Data Engineer EUR 65K-86KAPI Gateway | AWS Glue | AWS Lambda | Amazon Athena | Amazon AuroraAnnual leave | Company pension | Cycle to work | Flexible working hours | Global eventsSenior-level Full TimeDublin, Ireland23h ago
-
Senior Data Engineer - HealthCare Economics EUR 65K-98KAWS | Agile | Apache Airflow | Apache Hadoop | Apache KafkaCareer development opportunities | Flexible work arrangements | Hybrid work modelSenior-level Full TimeDublin, Leinster, IRELAND; Letterkenny, Ulster, IRELAND23h ago
-
Senior Software Engineer – ML Inference Runtime EUR 62K-75KAttention | Automated testing | Batching | C# | C++Hybrid work environment | Training programsSenior-level Full TimeLocation Galway, Ireland23h ago
-
BigQuery | CI/CD | Cloud Composer | Cloud Storage | Data ModelingConference reimbursement | Coworking or home office reimbursement | Equipment and workspace support | Fully remote | Health insurance reimbursementSenior-level Full TimeIreland R1d ago
-
Senior Data Engineer EUR 55K-72KAmazon Web Services | Apache Airflow | Apache Kafka | Azure | CI/CDSenior-level Full TimeDublin, Ireland1d ago
-
AI Services | API Integration | Angular | Azure | Azure AIRemote work flexibilityMid-level Contract Full TimeIreland R1d ago
-
AI Prompt Engineer EUR 42K-60KAI Operations | Classification | Content Moderation | Data Analysis | Evaluation metricsHybrid workMid-level Full TimeDublin, D, Ireland R1d ago
-
Senior AI Engineer EUR 55K-75KAgile | Algorithms | Azure Machine Learning | Computer Vision | Data StructuresBike to work | Career mentorship | Educational assistance | Employee assistance programme | Flexible remote workSenior-level Full TimeDublin, County Dublin, Ireland R1d ago
-
Lead AI Solutions Delivery Engineer EUR 80K-120KAI orchestration | API Integration | Autonomous Agents | C++ | Cloud SecuritySenior-level Full TimeDublin, Ireland R1d ago
-
Principal AI/ML Software Engineer EUR 83K-125KAPI Development | Agile | Batch Processing | CI/CD | Cloud infrastructureAnnual performance bonus | Continuous professional development | Family healthcare coverage | Flexible benefits package | Hybrid work modelSenior-level Full TimeIRL-G Galway Parkmore 2, Ireland R1d ago
-
Senior AI Software Engineer EUR 65K-98KAPI Development | Automated testing | CI/CD | Cloud Computing | Computer VisionAnnual performance bonus | Continuous professional development | Family healthcare coverage | Hybrid work model | Pension contributionSenior-level Full TimeIRL-G Galway Parkmore 2, Ireland R1d ago
-
Senior-level Full TimeDublin, Ireland1d ago
-
Principal AI/ML Software Engineer EUR 83K-125KAPI Development | Automation | CI/CD | Cloud Computing | Computer VisionAnnual performance bonus | Continuous professional development | Family healthcare coverage | Hybrid work model | Pension contributionSenior-level Full TimeIRL-G Galway Parkmore 2, Ireland R1d ago
-
Senior AI Software Engineer EUR 65K-98KAgile Scrum | Application Programming | Application Programming Interfaces | Automated testing | Batch ProcessingAnnual performance bonus | Continuous professional development | Family healthcare coverage | Hybrid work model | Pension contributionSenior-level Full TimeIRL-G Galway Parkmore 2, Ireland R1d ago
-
Associate Technical Services Engineer II EUR 57K-80KAWS | Benchmarking | C Sharp | C plus plus | C#Mid-level Full TimeDublin, Ireland; Ireland3d ago
-
Staff Software Engineer, AI Reliability Engineering EUR 235K-295KAvailability Engineering | Cloud infrastructure | Distributed Systems | GPU | High AvailabilityFlexible working hours | Generous vacation | Hybrid work option | Optional equity donation matching | Parental leaveSenior-level Full TimeDublin, IE R4d ago
-
Databricks Expert EUR 93K-139KAWS | AWS IAM | AWS Lambda | Amazon EC2 | Amazon ECSEducational support | Health and wellness benefits | Professional development opportunitiesSenior-level Full TimeCork, Co. Cork, Ireland4d ago
-
Bash | Block Storage | CSI | Distributed Storage | File systemsCareer growth | Cross-functional exposure | Flexible work model | Inclusive equal opportunity | International diverse working environmentSenior-level Full TimeIreland R4d ago
-
Database Site Reliability Engineer EUR 49K-67KBackup and Recovery | Cloud Platforms | Database Administration | Database monitoring | Database performanceEntry-level ContractDublin, Ireland4d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Portfolio and LinkedIn optional | Remote/distributed workMid-level Full TimeCork, Ireland4d ago
-
Senior Embedded Software Engineer EUR 65K-98KADC | Bare Metal | C# | C++ | CI/CDFlexible benefits | Short-term incentive planSenior-level Full TimeIRL-G Galway Michael Collins, Ireland4d ago
-
Senior Embedded Software Engineer EUR 65K-98KADC | Bare Metal | C# | C++ | CI/CDFlexible benefits package | Short-Term IncentiveSenior-level Full TimeIRL-G Galway Michael Collins, Ireland4d ago
-
Lead Site Reliability Engineer (AI/ML) EUR 65K-75KAutomation | CI/CD | Cause analysis | Cloud | ContainerizationSenior-level Full TimeDublin, Ireland4d ago
-
API Development | AWS | Agile | Artificial Intelligence | CI/CDAnnual bonus | Annual leave | Family health insurance | Flexible work model | Inclusion and wellbeing initiativesSenior-level Full TimeEXMFG - Dublin, Ireland R4d ago