AI Inference Engineer
Tasks
- Build inference engines
- Conduct performance and load testing
- Deploy real-time and batch inference pipelines
- Design auto-scaling architectures
- Ensure scalability during traffic spikes
- Implement performance monitoring and observability
- Maximize tokens per second
- Optimize large language model inference
- Optimize models for CoreML
- Optimize models for GPU acceleration
- Optimize models for TensorRT
- Orchestrate inference routing with Kubernetes
- Profile model performance
- Reduce inference latency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | C++ | CUDA | CoreML | Docker | GCP | Go | Kubernetes | Language Models | Large Language Models | Llama.cpp | MLOps | NVIDIA Triton | Ollama | PagedAttention | Python | Rust | SRE | Speculative decoding | TPU | TensorRT | Triton | VLLM
Education
N/A
Related jobs
-
API Design | Checkpointing | Cloud Computing | Containerization | Data ProcessingAdditional paid time off | Annual hackathons | Equipment budget | Equity options | Flexible working conditionsSenior-level Full TimeIreland20h ago
-
Automation | Containerization | Database Reliability | Distributed Systems | Infrastructure as CodeHybrid work modelSenior-level Full TimeDublin1d ago
-
Senior Embedded Linux Software Engineer II EUR 57K-76KBuildroot | C# | C++ | Continuous integration | Device DriversSenior-level Full TimeIreland - Dublin2d ago
-
Forward Deployed AI Engineer EUR 68K-85KAPIs | Agent Orchestration | Autogen | Claude | Edge ComputingHybrid work | Learning and development | Open source contributionsSenior-level Full TimeIreland2d ago
-
Alerting | Cloud infrastructure | Containerization | Docker | Fault ToleranceFlexible schedule | Remote workMid-level FreelanceIreland - Remote R3d ago
-
Senior-level Full TimeIreland, Limerick3d ago
-
Senior Analytics Engineer EUR 60K-86KApache Airflow | Automation | DBT | Dashboards | Data GovernanceCycle to work scheme | Dental insurance | Flexible paid time off | Health insurance | Hybrid workSenior-level Full TimeDublin, Ireland3d ago
-
Data Quality Developer EUR 55K-76KAgile | Azure | Azure Logic | Azure Logic Apps | BitbucketHybrid work modelSenior-level Full TimeTralee, IE4d ago
-
Bash | Black box testing | Black-box | Box testing | Code CoverageFlexible hours | Flexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeIreland - Remote R4d ago
-
Senior-level Full TimeDublin, Ireland4d ago
-
Executive-level Full TimeDublin4d ago
-
A/B | A/B Testing | Applied Mathematics | B testing | Cloud backendSenior-level Full TimeIreland, Dublin6d ago
-
Senior Software Engineer ll EUR 112K-145KAmazon Web Services | Datadog | Django | Functional testing | GRPCHome office stipend | Pension plan with employer match | Private healthcare plan | Unlimited vacation | Wellness stipendSenior-level Full TimeIreland - Remote R6d ago
-
Senior Software Engineer EUR 68K-96KC# | Database tuning | Go | Indexing | JavaFertility assistance | Parental leave | Remote work optionSenior-level Full TimeDublin6d ago
-
Mid-level Full TimeDublin, Ireland6d ago
-
ARIMA | Anomaly Detection | Apache Airflow | Azure Monitor | Boosted TreesSenior-level Full TimeCork, Ireland7d ago
-
AWS | Agent systems | Apache Airflow | Automated retraining | CI/CDSenior-level Full TimeCork, Ireland7d ago
-
Software Engineer (Python) EUR 38K-54KAgile | C# | Containers | Continuous Delivery | DebuggingCareer development opportunities | Employee resource groups | Flexible work arrangements | TrainingMid-level Full TimeCork, Ireland7d ago
-
Senior Software Engineer EUR 56K-76KAgile | C++ | Cluster management | Continuous integration | Distributed SystemsSenior-level Full TimeCork, Ireland7d ago
-
Software Engineer EUR 39K-54KAgent Orchestration | Amazon S3 | Anomaly Detection | Caching | DiagnosticsMid-level Full TimeCork, Ireland7d ago
-
Senior-level Full TimeCork, Ireland7d ago
-
AWS | Azure | CI/CD | Docker | KubernetesCycle to work scheme | Employee stock purchase plan | Gym subsidy | Income protection | Life insuranceSenior-level Full TimeCORK 01, Ireland7d ago
-
GenAI Software Engineer (Full Stack) EUR 45K-62KAPI Gateway | AWS | AWS Lambda | Agile Scrum | AngularHealth & wellbeing benefits | Inclusion culture | Professional developmentMid-level Full Time30 North Wall Quay - IFSC, …7d ago
-
Principal Data Engineer EUR 46K-72KAWS | Airflow | DBT | Data Architecture | Data ModelingFlexible working | Generous time off | Health insurance | Paid leave | Pension matchingSenior-level Full TimeDublin7d ago
-
Data Engineer I EUR 42K-49KAlerting | DBT | Data Modeling | Data Pipelines | Data QualityLearning and developmentEntry-level Full TimeCork, Ireland8d ago