Staff Software Engineer, Inference
Tasks
- Benchmark inference performance
- Build low latency high throughput inference systems
- Conduct post-incident analysis
- Define inference platform architecture
- Design request routing and scheduling
- Develop speculative decoding
- Drive traffic management and failure mitigation
- Enable KV cache reuse and memory optimization
- Implement micro batching and dynamic scheduling
- Improve P95 P99 latency and throughput
- Improve testing and observability
- Lead capacity planning and autoscaling
- Lead cross-team design reviews
- Lead multi-service cross team design
- Manage GPU resources
- Mentor engineers and elevate engineering standards
- Optimize cost per token
- Own SLIs SLOs reliability
Perks/Benefits
- Critical illness cover
- Employee assistance programme
- Family dental insurance
- Family medical insurance
- Generous pension contribution
- Life assurance
- Living wage accredited employer
- Tuition reimbursement
Skills/Tech-stack
Autoscaling | BF16 | Benchmarking | C++ | CUDA | Capacity Planning | Cloud platform | Distributed Systems | Dynamic Scheduling | FP8 | Failure mitigation | Go | KV cache | Kubernetes | Latency optimization | Memory Optimization | Micro Batching | Mixed Precision | NCCL | NUMA | Observability | Performance optimization | Python | RDMA | SLI | SLO | Speculative decoding | Streaming token delivery | System design | Throughput Optimization | Traffic Management
Education
Roles
Related jobs
-
Forward Deployed Engineer II, GCC PLN 206K-211KAPIs | Agent systems | Cost Per | Cost Per Request | CrewAISenior-level Full TimeWarsaw, Poland1d ago
-
Senior Software Engineer, Vertex 1P GenAI SRE PLN 364K-373KAPI Design | C++ | Capacity Planning | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeWarsaw, Poland1d ago
-
Senior Artificial Intelligence/Machine Learning Engineer PLN 242K-340KAgent systems | Artificial Intelligence | Benchmarking | Evaluation | Human-in-the-loopCorporate events | Flexible working hours | Home office option | Hybrid remote work | Internal trainingsSenior-level Full TimePoland2d ago
-
Agile | Containerization | Data Glossary | Data Modeling | Enterprise DataConference access | Family benefits | Flexible working hours | Hybrid work | Language coursesMid-level Full TimeWarszawa, Województwo mazowieckie, Poland2d ago
-
Data Engineer - HR support project (m/f/n) PLN 276K-280KAI tools | Apache Spark | Data Governance | Data Monitoring | Data PrivacyB2B contract | Flexible working model | Remote optionsMid-level Full TimeWarszawa, Województwo mazowieckie, Poland2d ago
-
A/B | A/B Testing | ARIMA | AWS Lambda | Amazon ECSConference co financing | Course co financing | English classes co financing | Flexible working hours | Individual development plansSenior-level Full TimeWrocław, Poland2d ago
-
Security Management - Data Engineer PLN 182K-258KAI Foundry | API Integration | Access Management | Ansible | App ServicesSenior-level Full TimeWrocław, DS, PL, 50-0862d ago
-
Embedded Software Engineer PLN 237K-276KARM Cortex | ARM Cortex-M | C# | C++ | CANAgile team collaboration | Background check providedMid-level Full TimeKrakow, PL, 08-8842d ago
-
Senior Big Data Engineer PLN 188K-350KApache Spark | Azure | Big Data | CI/CD | Data QualityAgile culture | Collaborative team environment | Conference participation | Quarterly planning | Technical trainingSenior-level Full TimeWarsaw, Poland2d ago
-
Senior-level Full TimeWarsaw, Poland2d ago
-
Software Enabling and Optimization Engineer PLN 157K-284KDPDK | Data Center Storage | Data center | Docker | EthernetEmployee pension plan | Flexible working hours | Hybrid work model | Life and community programs | Life insuranceMid-level Full TimePOL - Gdansk, Poland2d ago
-
Senior Data Engineer PLN 236K-242KAgile | Artificial Intelligence | BigQuery | CDC | Cloud ComputingSenior-level Full TimeWarszawa, Masovian, PL, 02-1462d ago
-
Algorithms | CI/CD | Data Structures | Geometric algorithms | Multi SensorHybrid working model | Life insurance | Private healthcare | Professional developmentMid-level Full TimeCzęstochowa, Śląskie, PL, 42-2002d ago
-
Data Engineer - Superior Retail Execution PLN 276K-276KApache Spark | Azure | CI/CD | Cloud platform | Data ArchitectureHybrid work model | Private health care | Remote work options | Savings plans | Sport cardsMid-level Full TimeWARSAW PLANT & GO, Poland2d ago
-
Data Engineer (UA/RU Language speaking) EUR 49K-67KAPI Integration | AWS | Airflow | Airflow Orchestration | CRMAccess scoped retrieval and audit focus | Distributed team | Part time 20 hours per weekMid-level Full TimePoland3d ago
-
Senior Staff Engineer, AI Developer, Platform PLN 640K-655KAPI Design | Cloud Computing | Cloud platform | Containerization | GoBonus target | Equity | Health insurance | Paid time off | Retirement benefitsSenior-level Full TimeWarsaw, Poland3d ago
-
Software Engineer - FDE PLN 225K-312KAWS | Azure | Data Modeling | Data Validation | Data WarehousingSenior-level Full TimePL-Warsaw-Lixa C3d ago
-
Senior-level Full TimeKraków, Województwo małopolskie, PL3d ago
-
MLOps Team Lead PLN 288K-384KAmazon Web Services | Apache Airflow | Apache Spark | CI/CD | Cloud platformSenior-level Full TimeWarsaw, Poland, PL3d ago
-
Senior-level Full TimeWrocław, Województwo dolnośląskie, PL3d ago
-
Senior AI Engineer PLN 241K-390KAPI Integration | CI/CD | Chatbots | Chroma | Cloud PlatformsBirthday day off | Flexible start of day | Hybrid working model | Individual benefits package | Medical and wellbeing programSenior-level Full TimeWarszawa Ctech - Polna 11, Poland3d ago
-
IT Semantic Engineer - RDT Data Platforms PLN 14K-26KArgoCD | Distributed Workflow Orchestration | Fair Principles | GitOps | Graph DatabaseCharity paid leave | Company laptop allowance | Flex location | Group life insurance | MultisportMid-level Full TimeWarsaw Grafit, Poland3d ago
-
1104 | Senior Data Engineer (Databricks) PLN 270K-384KACID | AWS | Access Control | Apache Spark | AzureSenior-level Full TimePoland - Remote R3d ago
-
AWS Bedrock | Agentic Workflows | Anthropic | Developer platforms | EvaluationEnd-to-end delivery | Global collaboration | Refresments provided | Technical leadership | Workspace access at Warsaw WeWork Mennica TowersSenior-level Full TimeWarszawa, Masovian Voivodeship, Poland4d ago
-
Senior Machine Learning Engineer (E3) PLN 283K-358KAB Testing | AWS | BigQuery | Cloud Dataflow | Data DriftSenior-level Full TimeKrakow, Poland R4d ago