Senior Engineer 2: Inference Data Plane
Tasks
- Collaborate with cross-functional teams
- Design data plane components
- Develop scalable inference services
- Maintain high-scale services
- Mentor junior engineers
- Optimize distributed inference performance
Perks/Benefits
- Employee assistance program
- Equity compensation
- Flexible time off
- Learning & development resources
- Local Employee Meetups
- Reimbursement for conferences
Skills/Tech-stack
AI | Continuous batching | Data parallelism | Databases | Distributed Systems | GPU Optimization | GRPC | Go | Inference Engines | Infrastructure as Code | KV cache | LLM architectures | ML | Messaging Systems | Microservices | Modular | NVLink | Open Source | Python | Quantization | RoCE | SGLang | Smart routing | Tensor Data | Tensor/data parallelism | VLLM | XGMI | “as-code”
Education
Roles
Related jobs
-
Senior AI/ML Engineer USD 125K-157KAI platforms | AWS | Agentic AI | Agentic AI Platforms | Data GovernanceDental insurance | Disability plans | Employee referral program | Fertility benefits | Life insuranceSenior-level Full TimeUS Remote R4h ago
-
Senior Generative AI Engineer USD 125K-156KAI Governance | AWS | Bedrock | Data Processing | ECS401k plan | Dental insurance | Disability insurance | Employee referral program | Fertility benefitsSenior-level Full TimeUS Remote R4h ago
-
Staff Applied AI Engineer - Pre-Sales USD 190K-330KAgent architectures | Data Processing | Fine Tuning | GenAI | LLMCareer growth opportunities | Equity | Remote work optionsSenior-level Full TimeNew York City, NY (Hybrid); Redwood … R6h ago
-
Principal Data Scientist - Foundational Models USD 142K-237KContainer Orchestration | Data Manipulation | Observability tools | PyTorch | PythonEquity | Growth opportunities | Inclusive health benefitsSenior-level Full TimeRemote, USA R11h ago
-
Director of Data Engineering USD 145K-250KAWS | Agile | Bash Scripting | Data Processing | Data Processing Frameworks401k | Disability insurance | Employee assistance program | Flexible paid time off | Flexible spending accountsExecutive-level Full TimeCharlotte, NC R14h ago
-
Data Engineer USD 157K-190KAPIs | Cloud Platforms | Collaboration | Communication | Data ModelingCoworking subscription | Dental insurance | Flexible holiday schedule | Health insurance | Home office stipendMid-level Full TimeUnited States R16h ago
-
AWS | Columnar Databases | Data Storage | Distributed Systems | Document-orientedCareer advancement | Growth opportunitiesSenior-level Full TimeRemote - USA R16h ago
-
Senior Data Engineer (AWS, Azure, GCP) USD 115K-180KAWS | Azure | Big Data | C# | CI/CD401k matching | Employee resource groups | Fertility and family benefits | Flexible work environment | Health coverageSenior-level Full TimeCharlotte, NC, United States R16h ago
-
Senior Full-Stack Engineer II - AI/ML USD 184K-231KAI | API Standards | Cloud Architecture | Computer Vision | GoCareer development | Employee assistance program | Equity compensation | Flexible time off | Local meetupsMid-level Full TimeSeattle R16h ago
-
Senior Full-Stack Engineer II - AI/ML USD 184K-231KAI | API Design | Computer Vision | Go | Inference EnginesCareer development | Employee assistance | Employee stock purchase | Equity | Flexible time offMid-level Full TimeDenver R16h ago
-
Senior Full-Stack Engineer II - AI/ML USD 184K-231KAI | API Standards | APIs | Cloud Architecture | Computer VisionConference reimbursement | Employee assistance program | Equity grants | Flexible time off | Remote workMid-level Full TimeBoston R16h ago
-
Senior Full-Stack Engineer II - AI/ML USD 184K-231KAI | AI platforms | APIs | Cloud Architecture | Computer VisionEmployee assistance program | Equity compensation | Flexible time off | Local Employee Meetups | Professional development reimbursementMid-level Full TimeAustin R16h ago
-
Senior Full-Stack Engineer II - AI/ML USD 184K-231KAI Techniques | API Standards | APIs | Cloud Architecture | Computer VisionBonus opportunities | Career development | Employee assistance program | Equity compensation | Flexible time offMid-level Full TimeSan Francisco R16h ago
-
AWS DevOps Data Engineer USD 118K-185KAWS | Airflow | CloudFormation | GitHub Actions | GitLab401k | MedicalDentalVisionPet Insurance | Paid time offMid-level Full TimeU.S. Remote R17h ago
-
Senior Data Engineer USD 147K-198KAirflow | Cloud infrastructure | Dagster | Data Contracts | Data Lakehouse401k | Flexible stipends | Health coverage | Parental leave | Unlimited vacationSenior-level Full TimeUS - Remote R17h ago
-
Senior Engineer 2: Inference Optimizations USD 167K-209KAI Model Optimization | AI model | C# | CUDA | GPU ArchitectureCareer development resources | Competitive benefits | Equity compensation | Flexible remote work | Reimbursement for trainingSenior-level Full TimeSan Francisco R18h ago
-
AI Solutions Engineer USD 123K-254KAI | Automation | Business acumen | CI/CD | CommunicationFlexible work schedule | Inclusive environmentMid-level Full TimeSan Francisco, CA, Seattle, WA, US; … R18h ago
-
Software Engineer USD 138K-174KCloud Platforms | Data Architecture | Data Governance | Data Lakes | Data ModelingRemote workSenior-level Full TimeRemote, United States R18h ago
-
Senior Engineer 2: Inference Data Plane USD 167K-209KAI hardware | Cloud Operations | Distributed Systems | GPU Optimization | GRPCEmployee assistance program | Equity compensation | Flexible time off | Health benefits | Learning resourcesSenior-level Full TimeBoston R19h ago
-
Senior Engineer 2: Inference Data Plane USD 167K-209KCloud Operations | Distributed Systems | GRPC | Golang | Hardware optimizationEmployee assistance program | Equity compensation | Flexible time off | Reimbursement for training | Remote workSenior-level Full TimeSeattle R19h ago
-
Senior Engineer 2: Inference Data Plane USD 167K-209KAI | Databases | Distributed Systems | GPU Optimization | GRPCBenefits support | Educational courses | Equity compensation | Flexible time off | Reimbursement for trainingSenior-level Full TimeSan Francisco R19h ago
-
Senior Engineer 2: Inference Data Plane USD 167K-209KAI/ML | Cloud infrastructure | Distributed Systems | GPU Optimization | GRPCEmployee assistance program | Equity compensation | Flexible time off | Health benefits | Reimbursement for trainingSenior-level Full TimeDenver R19h ago
-
Azure Data Architect (remote US) USD 110K-135KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksComprehensive benefits | Flexible work hoursSenior-level Full TimeUnited States R1d ago
-
Sr. AI Engineer (24 months fixed-term) USD 137K-232KBias Mitigation | Communication | Data Analysis | Education Technology | Generative AIFlexible schedule | Health insurance | Inclusive culture | Learning and development opportunities | Paid time offSenior-level TemporaryMountain View, CA / Remote (Continental … R1d ago
-
Lead Copilot Studio AI Engineer USD 102K-190KAI | Copilot Studio | M365 | Power Platform401k | Flexible work schedule | Health insurance | Paid time off | Stock purchase plansSenior-level Full TimeRemote-FL, United States R1d ago