Senior Engineer 2: Inference Data Plane
Tasks
- Collaborate with cross-functional teams
- Design data plane components
- Develop scalable inference services
- Maintain high-scale services
- Mentor junior engineers
- Optimize distributed inference performance
Perks/Benefits
- Employee assistance program
- Equity compensation
- Flexible time off
- Learning & development resources
- Local Employee Meetups
- Reimbursement for conferences
Skills/Tech-stack
AI | Continuous batching | Data parallelism | Databases | Distributed Systems | GPU Optimization | GRPC | Go | Inference Engines | Infrastructure as Code | KV cache | LLM architectures | ML | Messaging Systems | Microservices | Modular | NVLink | Open Source | Python | Quantization | RoCE | SGLang | Smart routing | Tensor Data | Tensor/data parallelism | VLLM | XGMI | “as-code”
Education
Roles
Related jobs
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R9h ago
-
DNS | FC | Fibre Channel | Isilon | LinuxRemote work | Unlimited growthSenior-level Full TimeUnited States, United States R11h ago
-
Mid-level Full TimeRemote, United States R21h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R1d ago
-
Agent Frameworks | Deterministic systems | Distributed Systems | GraphQL | LLMDirect collaboration with executive leadership | High-ownership environment | Hybrid schedule | Relocation assistance | Remote flexibilitySenior-level Full TimeRemote; San Francisco, CA; United States R1d ago
-
Apache Airflow | AtScale | BigQuery | CI/CD | Cloud DataSenior-level Full TimeGEORGIA - VIRTUAL - GA01, United … R1d ago
-
Airflow | BigQuery | CI/CD | Data Modeling | Data WarehousingRemoteMid-level Full TimeGEORGIA - VIRTUAL - GA01, United … R1d ago
-
Principal Machine Learning Revenue Architect USD 163K-382KBig Data | Business Process | Data Mining | Data Science | Data VisualizationSenior-level Full TimeVirtual, United States R1d ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data Modeling | Data mesh | Data pipeline | Databricks401k | Health insurance | Hybrid work options | Paid Holidays | Paid time offSenior-level Full TimeRemote-MO, United States R1d ago
-
Software Engineer, Data Platform USD 105K-132KAPI | AWS | CI/CD | Code review | DBT401k | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R1d ago
-
AI Value Partner, Customer Analytics USD 120K-160KA/B | A/B Testing | B testing | Causal Inference | Experimental DesignFlexible vacation time | Gym allowance | Lunch and dinners stipend | Medical, dental, vision plans | Paid parental leaveMid-level Full TimeUnited States (Remote) R1d ago
-
Principal Software Engineer - Storage Cache USD 295K-345KActive/Active | Alertmanager | C++ | Chaos Engineering | Container OrchestrationEquity compensationSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Senior Software Engineer, Data Platform USD 125K-156KAPI Development | AWS | Automation | CI/CD | Data Engineering401k benefits | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R1d ago
-
Embedded & Automation Engineer USD 140K-230KAbstraction layer | C# | C++ | Edge Computing | Embedded Systems401k retirement savings plan | Accident insurance | Basic Life/AD&D | Critical illness insurance | DCFSAMid-level Full TimeSan Diego, CA, Remote R1d ago
-
Associate Data Engineer USD 70K-95KABAC | AWS Glue | Amazon S3 | Apache Airflow | Apache IcebergAD and D insurance | Flexible spending accounts | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeRemote, United States R1d ago
-
Applied AI & Optimization Engineer USD 140K-185KAgent-based | Agent-based modeling | Air Gapped Computing | Air-gapped | Analytics401k matching | DCFSA | Employee mental health resources | FSA | HSAMid-level Full TimeSan Diego, CA, Remote R1d ago
-
Finance Analytics Engineer USD 185K-221KAnomaly Detection | Apache Airflow | Business Intelligence | Data Modeling | Data MonitoringEquity compensation | Health benefitsMid-level Full TimeSan Mateo, CA, United States R1d ago
-
Action Chunking | Behavioral cloning | Data Versioning | Diffusion Models | Domain Randomization401k retirement plan | Comprehensive medical, dental and vision coverage | Daily free lunch | Employee referral bonuses | Flexible PTOMid-level Full TimeColumbus, Ohio R1d ago
-
Action Policy Learning | C++ | Data collection | Domain Randomization | Edge inference401k retirement plan | Dental insurance | Employee referral bonuses | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R1d ago
-
Data Engineer II USD 101K-153KAmazon RDS | Amazon Redshift | Apache Spark | DBT | Data GovernanceComprehensive health plans | Parental leave | Professional development stipend | Remote workMid-level Full TimeRemote - US R1d ago
-
Senior Software Engineer - Robotics USD 134K-184KAgent coordination | Agile | Algorithms | C++ | CI/CDRemote work flexibilitySenior-level Full TimeWoburn, MA R1d ago
-
Staff Machine Learning Engineer, AI Research USD 230K-275KComputer Vision | Feature Engineering | Fine Tuning | Hyperparameter Tuning | Kubeflow401k | Dental insurance | Equity | Fertility treatment benefit | Health insuranceSenior-level Full TimeRemote - United States R1d ago
-
Full-Stack Analytics Engineer II USD 95K-118KAirflow | BigQuery | CI/CD | DBT | Dagster401k match | Dental insurance | Educational reimbursement | Flexible schedule | Health insuranceMid-level Full TimeWashington DC R1d ago
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R1d ago
-
Principal Engineer, AI Architect USD 190K-210KCloud Architecture | Conversational AI | Enterprise SaaS | GCP | Generative AI401k match | Critical illness insurance | Dedicated WeWork space | Employee assistance program | Employee stock purchase programSenior-level Full TimeRemote - Colorado R1d ago