Senior Software Engineer, AI Inference Systems
Tasks
- Architect scheduling and orchestration for GPU inference deployments
- Build kernel DSL and compiler infrastructure
- Contribute features to vLLM
- Contribute to MLPerf Inference
- Define inference benchmarking methodologies
- Develop optimize and benchmark GPU kernels
- Integrate research ideas into production software
- Profile and optimize inference framework
Perks/Benefits
Skills/Tech-stack
C# | C++ | CI/CD | CUDA | CUDA graph | Cgroups | Cutlass | Docker | Go | Inductor | Infrastructure as Code | Kubernetes | LLVM | Linux | Linux Namespaces | MLIR | NCCL | Nsight Compute | Nsight Systems | PyTorch | Python | Rust | SGLang | Slurm | Tensor cores | TorchDynamo | Triton | VLLM | XLA | “as-code”
Education
Related jobs
-
Senior AI Engineer EUR 48K-51K.NET | AI Foundry | AI Search | Azure AI | Azure AI FoundryFlexible scheduling | Hybrid work | Long-term career growthSenior-level Full TimeHanau, Germany; Hanau, HE, Germany; Germany-Hanau R23h ago
-
C plus plus | C# | C++ | Embedded Systems | FirmwareFamily-friendly culture | Flexible working hours | Training and development | Work-life balanceEntry-level Full TimeDE-Berlin, DE-Hybrid-Berlin R1d ago
-
C# | C++ | Data Analysis | Embedded Systems | Firmware TestingCompany onboarding | Family-friendly culture | Flexible working hours | Training and development | Yearly work time accountEntry-level Full TimeDE-Berlin, DE-Hybrid-Berlin R1d ago
-
Software Engineer Analytics (m/w/d) | DSIDMG EUR 60K-71KBitbucket | CI/CD | Cloud Computing | Confluence | GitAdditional paid day off | Bike leasing | Company pension scheme | Family budget | Guided onboardingSenior-level Full TimeKarlsruhe, Deutschland R1d ago
-
Agentic AI Software Engineer EUR 38K-51KAWS | Azure | CI/CD | Docker | FastAPICareer development | Downtown office location | Flexible work model | Hackathons and conferences | Knowledge sharing eventsEntry-level Full TimeMunich, Bayern, Germany R1d ago
-
Applied AI Architect, Industries EUR 190K-215KClaude API | Claude for Work | Cloud Architecture | Data Science | Enterprise IntegrationFlexible working hours | Generous vacation | Hybrid work policy | Office collaboration space | Optional equity donation matchingSenior-level Full TimeMunich, Germany R1d ago
-
Airflow | Computer Vision | DBT | Dagster | Data PipelinesDistributed team collaboration | Fully remote work | High-impact technical challenges | Meaningful ownership of machine learning productsSenior-level Full TimeGermany R1d ago
-
Embedded Software Engineer (M/F/D) Car Access EUR 53K-58KASPICE | Automotive Cybersecurity | Bluetooth | C# | CANBicycle leasing | Career development opportunities | Company pension plan | Corporate fitness network discount | Discounted public transport ticketSenior-level Full TimeSchortens, NIEDERSACHSEN, Germany; HKG Schortens R1d ago
-
AWS | AWS Glue | BigQuery | Data Pipelines | Database Management100 percent remote | Flexible capacity (full-time or part-time) | Long-term contractMid-level ContractBerlin R2d ago
-
(Senior) AI Engineer (all genders) EUR 65K-80KCloud Computing | Containerization | Docker | Inference Optimization | Language ModelsE-learning reimbursement | Family-friendly support | Fitness benefits | Flexible work options | Internal eventsMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R2d ago
-
Senior Data Engineer EUR 70K-90KApache Kafka | CI/CD | ClickHouse | Data Processing | Distributed SystemsCoaching | Flexible working hours | Learning and development training | Remote-first | Six learning days per yearSenior-level Full TimeGermany /Spain / Romania (Remote) R2d ago
-
C# | C++ | Git | Linux | PythonFlexible working hours | Hybrid work setup | Internal growth opportunities | Learning platform | Paid time offEntry-level Part TimeMunich Hybrid (NavVis GmbH) R4d ago
-
Algorithms | C++ | Consensus | Data Structures | DebuggingCareer growth | Collaborative culture | Innovation-focused culture | International environment | Learning opportunitiesSenior-level Full TimeGermany R4d ago
-
Benchmarking | Conversational AI | Data Analysis | Embeddings | Evaluation FrameworksAnnual company retreats | Autonomy | Flexible local time zone | Paid annual leave | Referral bonusesSenior-level Full TimeGermany R4d ago
-
AI Agents | Agent architectures | Autonomous Systems | Computer Vision | ExperimentationFlexible working hours | Part-time work | Remote work | Student research opportunities | Vacation daysEntry-level Part TimeUlm, Germany R4d ago
-
Data Engineer (all genders welcome) EUR 55K-70KAgile | Alerting | Azure | Azure DevOps | CI/CDCommunities of Practice | Company restaurant | Day care center support | Discounted insurance offers | EV charging discountsEntry-level Full TimeDE Wietmarschen-Lohne, Germany R4d ago
-
Autonomous Systems | Computer Vision | Foundation Models | Human robot | Human-Robot InteractionBarrier free access | Cafeteria | Coaching | Company pension plan | Employee discountsEntry-level Part TimeUlm, DE R4d ago
-
Agentic Workflows | Azure | Cloud Computing | Data Augmentation | Data PipelinesFlexible working hours | Individual onboarding | Part-time work option | Remote work opportunity | Vacation daysEntry-level Part TimeKarlsruhe, Germany R4d ago
-
API Design | API Gateway | AWS Lambda | Airflow | Alerting30 vacation days | Dog-friendly office | Fitness club membership subsidy | Flexible working hours | Home-office allowanceSenior-level Full TimeBerlin, Germany; Hamburg, Germany R5d ago
-
API Design | API Gateway | AWS Lambda | Airflow | Alerting30 vacation days | Dog-friendly offices | Fitness club membership subsidy | Flexible working hours | Home-office allowanceSenior-level Full TimeHamburg, Germany R5d ago
-
AWS IoT | AWS Lambda | Amazon DynamoDB | Amazon S3 | DevOps30 vacation days | Dog-friendly offices | Fitness club membership subsidy | Flexible working hours | Home office expense allowanceSenior-level Full TimeBerlin, Germany; Hamburg, Germany; Hannover, Germany; … R5d ago
-
AWS | Azure | Bash | C plus plus | C#30 days vacation | Health insurance package | Home office flexibility | Remote work from GermanySenior-level Full TimeMunich, Germany R5d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Collaboration with multidisciplinary teams | Fully remote | Remote work autonomy and flexibilitySenior-level Contract Full TimeGermany R5d ago
-
Senior Data Engineer (Databricks) (m/w/d) EUR 62K-72KApache Spark | Azure Data | Azure Data Factory | CI/CD | ComplianceBicycle leasing | Corporate benefits platform | Deutschlandticket | Employee Assistance Program (EAP) | Employee wellbeing supportSenior-level Full TimeHamburg, Germany R5d ago
-
Senior Data Engineer (Databricks) (m/w/d) EUR 62K-72KAgile | Apache Spark | Azure Data | Azure Data Factory | CI/CD30 days paid vacation | Allowance for mobile workspace | Bahncard | Bike leasing | Corporate benefits platformSenior-level Full TimeStuttgart, Germany R5d ago