Senior Site Reliability Engineer, AI Inference
Tasks
- Build inference engines for LLM serving
- Build performance and load testing suites
- Design auto scaling architectures for online and batch inference
- Implement inference routing and orchestration with Kubernetes
- Monitor model latency and throughput metrics
- Optimize deployments for low latency
- Optimize memory utilization and bandwidth utilization
- Profile and optimize models for hardware backends
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | C++ | CUDA | CUDA kernels | CoreML | Docker | GCP | Golang | Kubernetes | Llama.cpp | Load Testing | MLOps | NVIDIA GPUs | Ollama | PagedAttention | Python | Rust | Speculative decoding | TPUs | TensorRT | Throughput | Time To First Token | Triton | VLLM
Education
N/A
Related jobs
-
API Integration | Anomaly Detection | Containerization | Data Modeling | Data Pipelines100 percent remote work | Career growth | Flexible work environment | Global collaboration opportunitiesMid-level Full TimeIreland R16h ago
-
AWS | Alerting | Amazon SageMaker | CI/CD | Cloud ArchitectureCareer growth opportunities | Collaborative international teams | Flexible employment options | Inclusive workplace | Remote-first work environmentSenior-level Full TimeIreland R1d ago
-
.NET | CRM | Csharp | Go | JavaContinuous professional development | Employee stock purchase plan | Hybrid work | Mentor and buddy program | Product trainingSenior-level Full TimeDublin, Ireland1d ago
-
Accelerate | Data Analysis | Deep learning | Diffusers | Distributed SystemsAutonomy and ownership | Career growth opportunities | Continuous learning | Flexible work environment | Fully remoteMid-level Full TimeIreland R1d ago
-
Graduate Embedded Test Engineer (2026) EUR 44K-44KAgile | Bitbucket Pipelines | C# | C++ | CI/CDComprehensive benefits | Flexible work schedulesEntry-level Full TimeGalway, Ireland1d ago
-
Data Curation | Deep learning | Distributed machine learning | GPU Training | JAXFlexible work schedule | Fully remote | High-performance computing access | Professional growth opportunitiesSenior-level Full TimeIreland R1d ago
-
MTS 2, Software Engineer, Data Platforms EUR 70K-90KAPIs | Algorithms | CI/CD | Containers | Data GovernanceEngineering excellence culture | Knowledge sharing | Long-term growth | On call balanceSenior-level Full TimeDublin, Ireland1d ago
-
NumPy | Numerical Simulation | Pandas | Python | SciPyFlexible scheduling | Freelance project-based work | Part-time opportunityEntry-level FreelanceIreland - Remote R3d ago
-
NumPy | Numerical Simulation | Pandas | Python | SciPyPart-time engagement | Project based workEntry-level FreelanceIreland - Remote R3d ago
-
Technical Solutions Engineer, Databases, Google Cloud PLN 124K-186KCloud platform | Data Modeling | Data Processing | Database Administration | Distributed ComputingMid-level Full TimeWarsaw, Poland; Dublin, Ireland4d ago
-
AI Engineer EUR 56K-79KAI Act | AI Development | API Integration | AWS SageMaker | Agent systemsBike to work | Career progression | Diversity & inclusion initiatives | Educational assistance | Employee assistance programmeSenior-level Full TimeDublin, County Dublin, Ireland4d ago
-
AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS Lambda | AlertingCareer development | Dental plan | Financial planning resources | Flexible-hybrid work | Income protectionSenior-level Full TimeVirtual Office (Ireland) R4d ago
-
Staff Engineer, Embedded AI Software Engineer EUR 66K-90KAI | Apache TVM | Architecture Search | Autonomous Agents | Bare MetalSenior-level Full TimeIreland, Cork4d ago
-
Senior Engineer - Embedded Software EUR 57K-76KARM Cortex | ARM Cortex-M | Abstraction layer | Agile | Automated testingSenior-level Full TimeIreland, Limerick4d ago
-
Senior Engineer - Embedded software EUR 57K-76KARM Cortex | ARM Cortex-M | Abstraction layer | Agile | Automated testingSenior-level Full TimeIreland, Limerick4d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 100K-100KMATLAB | NumPy | Pandas | Python | RFlexible freelance assignments | Part-time availability | Project based workSenior-level FreelanceIreland - Remote R4d ago
-
Electromagnetism | Mechanics | NumPy | Numerical Simulation | PandasFreelance | Part-time | Project-basedSenior-level FreelanceIreland - Remote R4d ago
-
AWS | Azure | Bash | Caching | Cloud platformEquity via restricted stock units | Home office stipend | Pension plan | Private healthcare | Remote work supportSenior-level Full TimeIreland R5d ago
-
ADC | Board Bring-up | Bring-up | C# | C++Cross-functional exposure | End To End Product Lifecycle Exposure | Flexible working arrangements | Remote work | Technical ownershipSenior-level Full TimeIreland5d ago
-
AWS | AWS Bedrock | AWS SageMaker | Computer Vision | Data IngestionFlexible scheduling | Fully remote | Inclusive team culture | Paid training | Professional development supportMid-level Full TimeIreland R5d ago
-
Principal MTS– Distributed Data Platform EUR 70K-90KArtificial Intelligence | Automation | Data Consistency | Data Processing | Distributed SystemsSenior-level Full TimeDublin, Ireland5d ago
-
AI Engineer @ The Dock EUR 40K-40KAPI Development | API Gateway | AWS | AWS Lambda | AgileCharitable leave | Community events | Discounted gym membership | Emergency caring facilities | Employee share schemeEntry-level Full TimeDublin6d ago
-
AI/ML Engineer (Generative AI & LLMs) EUR 42K-57KAPIs | Agentic Workflows | Agile | Anthropic Claude | ArgoCDCareer growth | Continuous learningMid-level Full TimeIE-L-Wicklow6d ago
-
AI Architect (R-18541) EUR 72K-98KAWS | Azure | CI/CD | Cloud Computing | Data GovernanceAnnual leave | Educational assistance program | Employee Health Insurance | Family-friendly leave | Flexible working (hybrid model)Senior-level Full TimeDublin - Ireland R6d ago
-
AI Software Engineer II (R-18544) EUR 42K-67KAgentic Workflows | CI/CD | Container Orchestration | Debugging | FastAPIEducational assistance program | Employee Health Insurance | Family-friendly leave | Flexible working (hybrid model) | Life assuranceMid-level Full TimeDublin - Ireland R6d ago