Senior Engineer, Inference Data Plane
Tasks
- Architect distributed control plane services
- Collaborate with product and engineering leadership
- Define SLOs for critical services
- Design multi tenant inference cloud systems
- Develop orchestration for LLM inference and hosting
- Improve observability and platform health
- Plan fleet optimization initiatives
- Run customer facing high availability services
Perks/Benefits
- Conference reimbursement
- Employee assistance program
- Flexible time off
- LinkedIn Learning
- Local Employee Meetups
- Remote work
- Training reimbursement
Skills/Tech-stack
Block Storage | Cloud Networking | Databases | Distributed Systems | GRPC | Go | Inference Orchestration | Infrastructure as Code | Kubernetes | LLM Hosting | Load balancers | Messaging Systems | Multi-tenancy | NFS | Object storage | Observability | Python | Security | VPC | “as-code”
Education
N/A
Related jobs
-
Sr Machine Learning Engineer USD 156K-211KA/B | A/B Testing | AWS | Airflow | AzureBonus program | Career development | Dental insurance | Disability insurance | Flexible spending accountsSenior-level Full TimeUS - Texas - Houston - … R19h ago
-
AI Engineer I - Hybrid USD 125K-135KAPI Development | Agentic Workflows | Azure | Azure Fabric | CI/CDSenior-level Full TimeWindsor, Colorado, United States R20h ago
-
Lead AI Software Engineer USD 136K-188KAWS | Agent Orchestration | Automated testing | Cloud Native | ContainersHybrid work up to three days from homeSenior-level Full TimeNew York City, NY (hybrid) R22h ago
-
Senior Software Engineer, Perception Architecture USD 184K-240KC++ | Computer Vision | Data Pipelines | Deep learning | Image SegmentationSenior-level Full TimePittsburgh, PA or Remote R1d ago
-
Data Engineer USD 101K-130KAgile | Apache Airflow | Apache Spark | Data Warehousing | Docker401k matching | Employee assistance program | Life insurance | Long-term disability insurance | Medical/Dental/Vision insuranceMid-level Full TimeSt. Paul, MN; Remote (United States) R1d ago
-
Backend Data Engineer USD 160K-200KAgile | Apache Kafka | CI/CD | CRM | Database IndexingComprehensive benefits package | Hybrid work environmentSenior-level Full TimeRemote Worker - USA R1d ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R1d ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R1d ago
-
Principal AI Engineer USD 240K-260KAI systems | Agent evaluation | Agent systems | Agentic AI | Anthropic API401k | Company-provided equipment | Disability insurance | Flexible vacation policy | Life insuranceSenior-level Full TimeRemote (United States) R1d ago
-
Bioinformatics Engineer II (Remote/East Coast) USD 100K-135KAWS | Bash | Data Visualization | Docker | Git401k | Flexible spending account | Generous time off | Life insurance | Long-term disabilityMid-level Full TimeEastern Time Zone (USA) R1d ago
-
Staff AI Engineer USD 210K-235KAgent systems | Agentic AI | Agents SDK | Anthropic API | Automated Evaluation401k | Disability and life insurance | Equipment provided | Flexible vacation policy | Medical, dental, and vision insuranceSenior-level Full TimeRemote (United States) R1d ago
-
Senior AI Engineer USD 170K-200KAgent systems | Agentic AI | Automated evals | Backend architecture | Continuous Improvement401k | Company equipment provided | Equity compensation | Flexible vacation policy | Medical, dental & vision coverageSenior-level Full TimeRemote (United States) R1d ago
-
Software Engineer II, Computational Platform USD 124K-154KAWS | Agentic AI | Data Modeling | Docker | ETL401k plan | Annual performance bonus | Commuter support | Company-provided laptop | Flexible paid time offMid-level Full TimeRemote; Watertown, Massachusetts, United States R1d ago
-
Senior AI Engineer | Sage Home Loans USD 150K-220KAgent Orchestration | Automated Regression | Automated regression testing | Cost Optimization | DPO401k match | Disability insurance | Employee assistance program | Flexible paid time off | Flexible spending accountsSenior-level Full TimeCharlotte, NC R1d ago
-
Data Engineer USD 139K-198KAWS Glue | AWS GovCloud | AWS Lambda | Access Control | AgileDoD Top Secret clearance supported | Fully remote | US citizenship eligibility supportedMid-level Full TimeArlington, VA R1d ago
-
Senior Data Engineer USD 129K-165KAWS | Airflow | CI/CD | Data Modeling | Django401k | Half-day Fridays | Medical/Dental/Vision insurance | Paid Holidays | Remote workSenior-level Full TimeChicago, IL, US R1d ago
-
Solutions Engineer USD 150K-180KAI | Apache Flink | Apache NiFi | Apache Spark | Applied ScienceContinued Career Development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeMid-level Full TimeUS-California-Remote, United States R1d ago
-
Mid-level Full TimeReston, VA (VA30), United States R1d ago
-
API | AWS | Agile | Automation | AzureRemote work | Security Clearance Initiated Upon HireSenior-level Full TimeNationwide Remote Office (US99), United States R1d ago
-
Agile | Cloud infrastructure | DBT | Data Lakes | Data Modeling401k match | Dental insurance | Flexible work schedules | Holidays | Life insuranceSenior-level Full TimeUS-IN-REMOTE, United States R1d ago
-
ML Engineer USD 180K-250KAWS | Agile | Deep learning | Docker | Feature EngineeringEnglish classes | Learning opportunities | Medical benefits | Professional development | Regular meetupsSenior-level Full TimeBelarus - Remote R1d ago
-
API ingestion | Apache Airflow | BigQuery | Cloud Composer | Cloud RunOccasional onsite requirement in Atlanta or Austin | Remote work | W2 employmentSenior-level Contract Full TimeAtlanta, Georgia, United States - Remote R1d ago
-
ABAC | Apache Iceberg | Audit Logging | Cloud Data | Cloud Data PipelinesSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
ABAC | Audit Logging | Cloud Data | Cloud Data Pipelines | Data ContractsSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago