Senior Software Engineer, AI Inference Systems
Tasks
- Architect scheduling and orchestration for inference deployments
- Benchmark GPU kernels and inference
- Build kernel DSLs and compiler infrastructure
- Conduct and publish ML systems research
- Contribute features to vLLM
- Define MLPerf inference benchmarking tools
- Deploy containerized inference on GPU clusters
- Develop and optimize GPU kernels
- Profile and optimize inference framework
Perks/Benefits
Skills/Tech-stack
Algorithms | C++ | CI/CD | CUDA | CUDA Graphs | Cgroups | Computer Architecture | Cutlass | Data Structures | Deep learning | Distributed Systems | Docker | Infrastructure as Code | Kubernetes | LLVM | Linux | Linux Namespaces | MLIR | NCCL | Nsight Compute | Nsight Systems | Operating Systems | Parallel Programming | Production observability | Profiling | PyTorch | PyTorch Inductor | Python | SGLang | Slurm | Tensor cores | TorchDynamo | Triton | VLLM | XLA | “as-code”
Education
Related jobs
-
Data Engineer (w/m/d), remote in DE EUR 68K-78KAWS | Apache Hudi | Azure | BigQuery | CI/CDBike leasing | Childcare subsidy | Flexible Hardware | Paid time off | Remote workSenior-level Full TimeGermany R1d ago
-
Data & AI Engineer (w/m/d), remote in DE EUR 47K-47KAI Foundry | AI Search | API Development | AWS Bedrock | Azure AIBike leasing | Equipment allowance | Kita allowance | Paid time off | Remote workMid-level Full TimeGermany R1d ago
-
Statistics & Python Expert - Freelance AI Trainer USD 100K-100KCAP | CMME | MATLAB | NumPy | PandasProject based work | Remote workSenior-level FreelanceGermany - Remote R1d ago
-
Electromagnetism | Mechanics | NumPy | Numerical Simulation | PandasFlexible schedule | Freelance project opportunities | Part-time project-based workEntry-level FreelanceGermany - Remote R1d ago
-
C# | Electromagnetism | MATLAB | Mechanics | NumPyFreelance project-based work | Part-time workEntry-level FreelanceGermany - Remote R1d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible part time scheduling | Freelance project-based work | Paid per project tasksSenior-level FreelanceGermany - Remote R1d ago
-
Chatbot LLM Engineer (all genders) EUR 42K-66KAgile | Dialog design | LLM Operations | Language Models | Large Language Models30 days vacation | E-learning reimbursement | Flexible work hours | International clients | Part-time optionMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R2d ago
-
(Senior) AI Engineer (all genders) EUR 65K-85KCI/CD | Cloud Platforms | Containerization | Docker | LLM EvaluationCompany participation | E-learning support | Family-friendly support | Fitness benefits | Flexible working hoursMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R2d ago
-
Senior Data Engineer (f/m/d) EUR 75K-90KAmazon S3 | Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka30 vacation days | Company hackathons and events | Employee assistance program | Flexible working hours | Hybrid work setupSenior-level Full TimeHamburg R2d ago
-
APIs | Airbyte | Apache Airflow | DBT | Data ModelingFully remote work | Home office setup budget | Language learning sessions | Paid sick days | Paid time offSenior-level Full TimeGermany R2d ago
-
Amazon Redshift | Data Modeling | Data Pipelines | Data Warehousing | DjangoSenior-level Full TimeGermany R2d ago
-
Senior Data Engineer (d/f/m) EUR 65K-86KApache Airflow | DBT | Data Architecture | Data Pipelines | Data WarehousingEmployee assistance program | Internal training | Mental health support | Remote work | SportsSenior-level Full TimeBerlin, Germany R2d ago
-
Senior Software Engineer, Real-Time Data Platform EUR 85K-102KAWS | Apache Kafka | CI/CD | Distributed Systems | Distributed tracingSenior-level Full TimeGermany, Remote R2d ago
-
Alerting | Cloud Platforms | Containerization | Data Processing | Deployment PipelinesFlexible working schedule | Fully remote | High autonomy | Performance-based bonus | Remote self directed workMid-level FreelanceGermany R3d ago
-
AWS | Apache Flink | Apache Kafka | Apache Spark | Cloud DataAutonomy | Flexible time off | Fully remote | Global health coverage | Home office budgetSenior-level Full TimeGermany R3d ago
-
APIs | Apache Spark | Data Lakes | Data Modeling | DatabricksCareer growth opportunities within Allianz Group | Childcare support | Company pension plan | Hybrid work model | Mental health programsSenior-level Full TimeFrankfurt, DE, 60323 R3d ago
-
API Design | Agile | Apache Spark | Cloud Computing | Data LakesBike leasing | Childcare facilities | Company share purchasing plan | Flexible working arrangements | JobticketSenior-level Full TimeFrankfurt, DE, 60323 R3d ago
-
AI Agents | CI/CD | Chatbots | ChromaDB | Fine TuningCompany car | Company fitness | Family service | Flexible vacation | Hybrid workSenior-level Full Timebundesweit, Germany R4d ago
-
Mid-level Full TimeDarmstadt, Remote R4d ago
-
Freelance Machine Learning Engineer USD 116K-116KLangchain | Language Models | Large Language Models | MLOps | Machine LearningFlexible project hours | Part-time availability | Project based workMid-level FreelanceGermany - Remote R4d ago
-
Applied AI Engineer - Remote EUR 66K-95KData Validation | Inference Optimization | LLM Evaluation | Language Models | Large Language ModelsAI native development workflow | Career growth | Modern tooling workflow | Ownership of backend systems | Remote workMid-level Full TimeGermany - Remote R4d ago
-
AI Engineer (LLM Products) - Remote EUR 52K-75KCost Optimization | Inference Optimization | Input validation | LLM Evaluation | Language ModelsCareer growth | Healthcare domain experience | Modern AI development workflow | Ownership | Remote workMid-level Full TimeGermany - Remote R4d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible hours | Part-time project-based workSenior-level Full TimeGermany - Remote R6d ago
-
Freelance Data Science Engineer (Python & SQL) USD 116K-116KBig Data | Data Analysis | Data cleaning | Exploratory Data Analysis | Feature EngineeringPart-time availability | Project based workMid-level FreelanceGermany - Remote R6d ago
-
Senior Data Engineer - Data Platform (m/f/d) EUR 60K-72KBigQuery | Cloud Run | Cloud platform | Data Catalog | Data GovernanceEGYM Wellpass | Job bike leasing | Remote workSenior-level Full TimeBerlin, Remote, Hamburg, München R7d ago