Senior Engineer, Inference Data Plane
Tasks
- Architect distributed control plane services for AI workloads
- Collaborate with product and engineering leadership on roadmaps
- Define SLOs and observability for platform health
- Design system proposals for availability and resiliency
- Develop multi tenant LLM inference orchestration
- Lead operational strategy for critical services
- Optimize fleets for AI native networking and infrastructure
Perks/Benefits
- Conference reimbursement
- Employee assistance program
- Employee stock purchase program
- Equity compensation
- Flexible time off
- LinkedIn Learning access
- Local Employee Meetups
- Remote work
- Training reimbursement
Skills/Tech-stack
Block Storage | Cloud Networking | Cloud Storage | Databases | Distributed Systems | Ethernet | GRPC | Go | Infrastructure as Code | Kubernetes | Load balancers | Messaging Systems | NFS | Network Protocols | Object storage | Observability | Python | RDMA | Security | VLAN | VPC | “as-code”
Education
N/A
Regions
Countries
States
Related jobs
-
Anomaly Detection | Automated testing | Benchmarking | Computer Vision | Data Preparation401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R8h ago
-
Senior Machine Learning Engineer, Sentry Tower USD 220K-330KC plus plus | Computer Vision | Continuous integration | Data collection | Dataset curationEquity grants | Health benefits | Recovery BenefitsSenior-level Full TimeIrvine, California, United States; Remote R12h ago
-
Senior Sales Engineer - Majors (East) USD 149K-198K.NET | C# | CRM | Go | JavaCommunity guilds | Employee stock purchase plan | Hybrid work | Inclusive culture | Mentor and buddy programSenior-level Full TimeNew York, USA, Remote R16h ago
-
Senior Platform/MLOps Engineer USD 168K-215KAnsible | Artificial Intelligence | C# | CI/CD | Configuration ManagementTravelSenior-level Full TimeRemote (USA) R17h ago
-
AI Engineer USD 180K-240KAnalytics | Data Analysis | Fine Tuning | Language Models | Large Language ModelsFlexible collaboration tools | Remote work | Supportive team environmentMid-level Full TimeSF Hybrid R1d ago
-
Staff Machine Learning Engineer, Multimodal Modeling USD 200K-240KBash | Computer Vision | Contrastive Learning | Data pipeline | Distributed TrainingCaregiver support | Company holidays | Criminal Justice Information Services CJIS certification required | ERGs | Fertility benefitsSenior-level Full TimeRemote - USA R1d ago
-
Sr Machine Learning Engineer USD 156K-211KA/B | A/B Testing | AWS | Airflow | AzureBonus program | Career development | Dental insurance | Disability insurance | Flexible spending accountsSenior-level Full TimeUS - Texas - Houston - … R1d ago
-
On-Call AI Solutions Specialist - REMOTE USD 67K-114KAI/ML | AI/ML libraries | AWS | AWS CodeBuild | AWS CodePipelinePart time up to 30 hours per week | Reasonable accommodations | Remote workMid-level Part TimeNationwide Remote Office (US99), United States R1d ago
-
Senior Software Engineer - Applied AI/ML USD 135K-155KAWS | AWS Lambda | Amazon SageMaker | Apache Airflow | Audio Data401k match | Dental insurance | Employee stock purchase plan | Medical insurance | Paid HolidaysSenior-level Full TimeChicago, IL, United States R1d ago
-
API Integration | Agentic AI | Authentication | Authorization | CI/CDMid-level Full Time3401 WEST END AVE (LOC00541), United … R1d ago
-
Senior AI Engineer USD 124K-174KAgent Orchestration | Artificial Intelligence | CI/CD | Human-in-the-loop | LLM-as-a-JudgeSenior-level Full TimeVirtual - Illinois, United States R1d ago
-
Sr. AI Software Engineer (NYC Hybrid) USD 133K-258KAPI Integration | Angular | Automated testing | Cloud Native | Cloud Native ArchitectureAnnual bonus eligibility | Family care resources | Health and wellness benefits | Hybrid work schedule | Paid time offSenior-level Full TimeNew York, NY, United States R1d ago
-
Senior AI Software Engineer USD 90K-153KAsynchronous processing | CI/CD | Docker | Embedding Models | FastAPISenior-level Full TimeUSA - IL (Remote), United States R1d ago
-
Senior Machine Learning Engineer USD 174K-287KDeep learning | Gradients | Graph theory | Inference Optimization | Language ModelsEmployee assistance program | Employee stock purchase plan | Flexible spending account | Health savings account | Paid HolidaysSenior-level Full TimeBoston, United States R1d ago
-
AI Engineer I - Hybrid USD 125K-135KAPI Development | Agentic Workflows | Azure | Azure Fabric | CI/CDSenior-level Full TimeWindsor, Colorado, United States R1d ago
-
Lead AI Software Engineer USD 136K-188KAWS | Agent Orchestration | Automated testing | Cloud Native | ContainersHybrid work up to three days from homeSenior-level Full TimeNew York City, NY (hybrid) R1d ago
-
Senior Software Engineer, Perception Architecture USD 184K-240KC++ | Computer Vision | Data Pipelines | Deep learning | Image SegmentationSenior-level Full TimePittsburgh, PA or Remote R1d ago
-
Data Engineer USD 101K-130KAgile | Apache Airflow | Apache Spark | Data Warehousing | Docker401k matching | Employee assistance program | Life insurance | Long-term disability insurance | Medical/Dental/Vision insuranceMid-level Full TimeSt. Paul, MN; Remote (United States) R1d ago
-
Backend Data Engineer USD 160K-200KAgile | Apache Kafka | CI/CD | CRM | Database IndexingComprehensive benefits package | Hybrid work environmentSenior-level Full TimeRemote Worker - USA R1d ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R1d ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R1d ago
-
Principal AI Engineer USD 240K-260KAI systems | Agent evaluation | Agent systems | Agentic AI | Anthropic API401k | Company-provided equipment | Disability insurance | Flexible vacation policy | Life insuranceSenior-level Full TimeRemote (United States) R1d ago
-
Bioinformatics Engineer II (Remote/East Coast) USD 100K-135KAWS | Bash | Data Visualization | Docker | Git401k | Flexible spending account | Generous time off | Life insurance | Long-term disabilityMid-level Full TimeEastern Time Zone (USA) R1d ago
-
Staff AI Engineer USD 210K-235KAgent systems | Agentic AI | Agents SDK | Anthropic API | Automated Evaluation401k | Disability and life insurance | Equipment provided | Flexible vacation policy | Medical, dental, and vision insuranceSenior-level Full TimeRemote (United States) R1d ago
-
Senior AI Engineer USD 170K-200KAgent systems | Agentic AI | Automated evals | Backend architecture | Continuous Improvement401k | Company equipment provided | Equity compensation | Flexible vacation policy | Medical, dental & vision coverageSenior-level Full TimeRemote (United States) R1d ago