Senior Deep Learning Software Engineer, Inference
Tasks
- Build and optimize inference pipelines
- Contribute code to inference libraries
- Design GPU accelerated inference software
- Implement latest inference algorithms in frameworks
- Improve deployment and serving for large language models
- Improve multi GPU communication performance
- Optimize model serving with CUDA kernels
- Performance optimization analysis and tuning
- Profile and debug CPU and GPU code
- Scale inference performance across GPU architectures
Perks/Benefits
Skills/Tech-stack
Agile | C# | C++ | CUDA | CUDA kernels | Cutlass | Debugging | FlashInfer | GPU Programming | Generative AI | LLM | NVIDIA NCCL | NVSHMEM | Performance Tuning | Profiling | PyTorch | Python | SGLang | Software Design | Triton | VLLM
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R15d ago
-
Senior DataOps Engineer USD 150K-180K800-171 | AWS CloudFormation | AWS Glue | AWS GovCloud | AWS IAMRemote position | US government clearance requiredSenior-level Full TimeRemote - United States R9h ago
-
Senior DataOps Engineer ( Remote US) USD 113K-163KAWS | AWS CloudFormation | Amazon EMR | Ansible | Apache Airflow401K employee contribution | Employee assistance program | Flexible Time Away From Work | Health & medical benefits | Learning platformSenior-level Full TimeRemote US R10h ago
-
Senior Software Engineer II - Ingestion AI Engineer USD 105K-155KAWS | Agile | Alerting | Azure | Causal InferenceMid-level Full TimeRemote, United States R11h ago
-
Senior Embedded Software Engineer USD 140K-165KAFDX | ARINC 429 | ARINC 653 | Atlassian Suite | C++401k match | Certification assistance | Flexible workplace | Medical dental life and disability coverage | Professional development supportSenior-level Full TimeRemote R11h ago
-
Embedded Software Engineer USD 130K-145KAFDX | ARINC 429 | ARINC 653 | ARINC-661 | Atlassian Suite401k employer match | Certification assistance | Flexible work environment | Medical dental life disability coverage | Professional development supportMid-level Full TimeRemote R11h ago
-
Lead Data Engineer GBP 70K-75KAWS DMS | Amazon Web Services | BigQuery | CDC | CI/CDHybrid work environmentSenior-level Full TimeLondon, UK R12h ago
-
None Full Time深圳 R13h ago
-
None Full Time深圳 R13h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-250KAir-gapped | Alerting | Argo CD | ArgoCD | Bare MetalAttend conferences and working groups | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R13h ago
-
Machine Learning Engineer - IT COP 18396K-18396KBigQuery | CI/CD | Clean architecture | Computer Vision | Context engineeringHybrid workMid-level Full TimeBogotá,Colombia R14h ago
-
AWS Glue | AWS Lambda | AWS S3 | Amazon EC2 | Amazon EMRFully remote opportunitySenior-level Full TimeGuatemala, Guatemala (Remote) R14h ago
-
Data Engineer GCP USD 142K-213KApache Airflow | BigQuery | CI/CD | Cloud Functions | Cloud RunFull-time schedule | Remote workExecutive-level Full TimeRemote job R14h ago
-
Senior Data Engineer - Automation & AI AUD 118K-127KAccess Control | Agentic Systems | Auditability | Batch Processing | ChunkingEmployee assistance program | Employee wellbeing platform | Extra days leave | Flexibility support | Hybrid work modelSenior-level Full TimeAustralia R15h ago
-
Senior Data Engineer USD 109K-243KAzure | CI/CD | Data Governance | Data Lake | Data LineageFlexible hybrid work schedule | Onsite or remote optionsSenior-level Full TimeFlexible Hybrid R17h ago
-
Senior Cloud Data Engineer USD 89K-114KAWS Lambda | Access Control | Access Management | Airflow | Azure Blob401(a) retirement plan | Dental insurance | Disability insurance | ECO pass reduced transit fare | Holiday paySenior-level Full TimeRemote R18h ago
-
Senior Cloud Data Engineer USD 89K-114KAWS Lambda | Access Management | Agile | Airflow | Azure Blob401(a) retirement plan | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRemote R18h ago
-
API Design | Anthropic | Automation | CRM Integrations | CrewAIDistributed work flexibility | Fully remote | High ownership roleMid-level Full TimeIndia R19h ago
-
Senior AI Engineer CHF 129K-192KBehavior analytics | Detection and Response | Fine Tuning | Langchain | Language ModelsAnnual training budget | Company events and workshops | Enhanced maternity leave | Enhanced paternity leave | Hybrid optionsSenior-level Full Timeremote or office, Zürich, Switzerland R20h ago
-
Senior AI Engineer PLN 242K-242KAPI Gateway | API Management | AWS Bedrock | AWS ECS | AWS ECS FargateEmployer supported pension plan | Extra paid holidays | Flexible benefits | Home-office allowance | Hybrid work modelSenior-level Full TimeWarszawa, Mazowieckie, PL R22h ago
-
Bias Assessment | Experiment tracking | Hallucination detection | LLM Evaluation | Language ModelsContract opportunity | Flexible work schedule | Fully remote | Remote collaborationSenior-level Contract Full TimeSaudi Arabia R22h ago
-
Adversarial Testing | Bias Assessment | Experiment tracking | Hallucination detection | LLM EvaluationContract opportunity | Flexible schedule | Remote workSenior-level Contract Full TimeBelgium R22h ago
-
Adversarial Testing | Bias Assessment | Experiment tracking | Factual consistency | Hallucination detectionFlexible contract opportunity | Fully remote work | Health insurance not included | Paid time off not includedSenior-level Contract Full TimeTurkey R22h ago
-
Adversarial Testing | Bias Assessment | Evaluation Frameworks | Experiment tracking | Factual consistencyContract position | Flexible hours | Health insurance not included | Paid time off not included | Remote workSenior-level Contract Full TimeMexico R22h ago
-
Adversarial Testing | Artificial Intelligence | Bias Assessment | Data Analysis | Hallucination detectionRemote workSenior-level Contract Full TimeRomania R22h ago