Senior Site Reliability Engineer, AI Inference
Tasks
- Build inference engines for LLM serving
- Build performance and load testing suites
- Design auto scaling architectures for online and batch inference
- Implement inference routing and orchestration with Kubernetes
- Monitor model latency and throughput metrics
- Optimize deployments for low latency
- Optimize memory utilization and bandwidth utilization
- Profile and optimize models for hardware backends
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | C++ | CUDA | CUDA kernels | CoreML | Docker | GCP | Golang | Kubernetes | Llama.cpp | Load Testing | MLOps | NVIDIA GPUs | Ollama | PagedAttention | Python | Rust | Speculative decoding | TPUs | TensorRT | Throughput | Time To First Token | Triton | VLLM
Education
N/A
Related jobs
-
AWS Glue | AWS S3 | AWS Step Functions | Amazon Athena | Amazon EMRAutonomy | International collaborative environment | Remote friendly working within EuropeMid-level Full TimeIreland16h ago
-
Bash | Data Ingestion | Data Pipelines | Distributed Systems | DockerAccess to cutting edge AI and data technologies | Autonomy | Collaborative engineering culture | Distributed first work environment | Fully remoteMid-level Full TimeIreland R17h ago
-
Data Engineer EUR 56K-79KAWS Fargate | AWS Glue | AWS Lambda | Amazon Aurora | Amazon Aurora ServerlessAnnual leave | Career development | Company laptop | Company pension | E-learningSenior-level Full TimeDublin1d ago
-
Agentic AI - Senior Software Engineer EUR 54K-75KAI SDK | AI System Design | Agentic AI | Agents SDK | AutomationSenior-level Full TimeDublin, Ireland1d ago
-
Data Engineer, 3P Geo Data Operations EUR 94K-96KData Analysis | Data Infrastructure | Data Modeling | Data Pipelines | DataflowMid-level Full TimeDublin, Ireland2d ago
-
AI Observability | AWS | Azure | CI/CD | Cloud ArchitectureCareer advancement | Collaborative engineering culture | Exposure to emerging technologies | Fully remote work | Leadership opportunitiesSenior-level Full TimeIreland R3d ago
-
Senior Analytics Engineer (AI & Quality) EUR 44K-57KCloud platform | Data Governance | Data Modeling | Data Quality | GitHubInternational team collaboration | Remote work | Supportive work environmentSenior-level Full TimeDublin, Ireland R3d ago
-
API | Automation platforms | Classification | Event Driven | Event-driven architectureCompany-sponsored health insurance | Employee discounts | Flexible working hours | Home office setup allowance | Learning and development opportunitiesMid-level Full TimeIreland R4d ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunities | Laid-back atmosphere | Remote friendly distributed setupMid-level Full TimeDublin, Ireland4d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPMid-level Full TimeGalway, Ireland4d ago
-
Senior Data Engineer EUR 70K-81KAWS Glue | Apache Hadoop | Apache NiFi | Apache Spark | AzureEnhanced leave options | Health and wellbeing supports | Hybrid work model | Pension and savings options | Training and coachingSenior-level Full TimeDublin, Ireland4d ago
-
Staff AI Software Engineer EUR 86K-115KAPIs | AWS | Agentic AI | Azure | Cloud NativeContinuous learning | Mentorship | Work-life balanceSenior-level Full TimeIreland, Limerick4d ago
-
MATLAB | NumPy | Pandas | Python | RPart time freelance projectsSenior-level FreelanceIreland - Remote R4d ago
-
Machine Learning Engineer EUR 60K-76KAWS | Azure | Cloud infrastructure | Experiment tracking | GCPDonation support | Generous time off | Healthcare | Occasional travel | Parental leaveMid-level Full TimeRemote - Ireland R4d ago
-
AI Agent | AI agent architectures | API Integration | Agent architectures | AnthropicCareer growth | Events and team activities | Flexible work arrangements | Learning programs | MentorshipMid-level Full TimeIreland4d ago
-
Agentic Workflows | Context learning | Data Engineering | Deep learning | Diffusion ModelsContribution to open source community | On-site hybrid work | Open publication policyMid-level Full TimeDublin, 1 Grand Canal Square, Ireland5d ago
-
Agentic AI - Senior Software Engineer EUR 54K-75KAI SDK | AI orchestration | Agents SDK | Automation | CI/CDSenior-level Full TimeDublin, Ireland5d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFlexible schedule | Part-time hours | Project based work | Remote workMid-level FreelanceIreland - Remote R5d ago
-
Lead AI/ML Engineer EUR 85K-100KAPIs | Agent workflow | Artificial Intelligence | Azure | Continuous ImprovementSenior-level Full TimeDublin, Ireland5d ago
-
APIs | Agent systems | Cloud platform | Data Pipelines | EvaluationEquity | Health insurance | Paid time off | Professional development | Retirement planMid-level Full TimeDublin, Ireland5d ago
-
API Integration | Agent systems | Cloud platform | CrewAI | Evaluation PipelinesMid-level Full TimeDublin, Ireland5d ago
-
Causal Inference | Data Analysis | Decision Trees | Embeddings | Ensemble ModelsCaregiver reimbursement | Employee stock purchase plan | Flexible working hours | Hackathons | Learning groupsSenior-level Full TimeLeinster-Dublin, Ireland R6d ago
-
Senior-level Full TimeParkmore East Business Park, Galway Ireland6d ago
-
Senior-level Full TimeParkmore East Business Park, Galway Ireland6d ago
-
AI Coding Assistants | AI coding | Alerting | BigQuery | CI/CDContinuous improvement culture | Flexible working hours | High autonomy | Learning community access | Long-term ownershipSenior-level Full TimeIreland R6d ago