Software Engineer, Training & Inference Infrastructure
Tasks
- Architect training infrastructure reliable scalable cost efficient
- Automate resource orchestration and fault recovery
- Build model serving infrastructure low latency high throughput
- Ensure infrastructure reliability security observability
- Optimize training and inference pipelines performance reliability cost
- Partner with researchers to productionize models and features
Perks/Benefits
- 401k match
- Daily meals
- Health insurance
- Learning and development stipend
- Relocation assistance
- Unlimited PTO
- Wellness stipend
Skills/Tech-stack
AWS EFA | CUDA | GPU Computing | HPC | Infiniband | Model Parallelism | NCCL | Observability | PyTorch | Python | Security Engineering | VLLM
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Generative AI Consultant USD 136K-136KAWS | Azure | CI/CD | Cloud platform | Deep learning401k matching | Dental insurance | Flexible spending account | Gym reimbursement | HealthcareSenior-level Full TimeSan Francisco, CA, United States4h ago
-
Sr. Staff Embedded AI Engineer USD 180K-225KBare Metal | C# | C++ | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Remote work optionSenior-level Full TimeColumbia, MARYLAND, United States8h ago
-
Senior Developer USD 145K-150KAPI | AWS ECS | AWS EKS | AWS Fargate | Amazon S3Agile team collaboration | Remote workSenior-level Full TimeFairfax, VA, United States10h ago
-
Staff Data Engineer USD 146K-233KAWS | Apache Iceberg | Apache Spark | Automated testing | Azure401k | Dental insurance | FSA/HSA | Health insurance | Life insuranceSenior-level Full TimeFoster City, CA, United States11h ago
-
Machine Learning Engineer USD 130K-190KAnomaly Detection | Bayesian Networks | CI/CD | Causal Inference | Causal ModelsSenior-level Contract Full TimePortland, OR, United States11h ago
-
Ansible | Azure | Azure Foundry | Azure Monitor | CI/CDMid-level Full TimeHuntsville, AL11h ago
-
Technical Lead Embedded Software Engineering USD 150K-175KARM | Agile | Build systems | C# | C++401k match | Health insurance | Minimal travel | Paid time offSenior-level Full TimeWaltham, MA, United States13h ago
-
Technical Architect – AI, ML & Generative AI USD 150K-202KAWS Bedrock | AWS SageMaker | Apache Spark | Artificial Intelligence | CI/CD401k | Critical Illness Accident Hospital Indemnity Identity Theft Protection | Dental plans | Life and Accidental Death and Dismemberment | Long-term disabilitySenior-level Full TimeFrisco, United States13h ago
-
Staff Machine Learning Engineer - VoIP Infrastructure USD 173K-303KAnsible | Configuration Management | DevOps | Distributed Systems | FreeSWITCH401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, California, United States13h ago
-
Senior Full-Stack Data Engineer (Remote) USD 110K-130KAI code assistance | Automated testing | Azure DevOps | CI/CD | Code assistanceFull-time | Fully remote | Long-term | No timezone shiftingSenior-level Full TimeFlorida, Aventura, United States of America R13h ago
-
Senior Data Engineer on Site USD 140K-200KAWS Lambda | Amazon Kinesis | Amazon S3 | Data Modeling | Data ProcessingDay 1 impact | Fast execution | Low corporate overhead | Own major product parts | Shape technical visionSenior-level Full TimeSan Francisco, United States13h ago
-
Bash | C# | CI/CD | JUnit | JavaFinancial benefits | Health and wellness benefitsEntry-level Full TimePennsylvania, Exton15h ago
-
Mid-level Full TimeBurlingame, CA16h ago
-
Machine Learning Engineer USD 214K-240KBigtable | Code review | Computer Vision | Data Mining | Data PipelinesMid-level Full TimeBellevue, WA16h ago
-
Data Engineer, Analytics USD 209K-235KData Warehousing | Dimensional Modeling | ETL | MPP | MapReduceEntry-level Full TimeBurlingame, CA16h ago
-
Senior Software Engineer, AI/ML GenAI USD 174K-252KBenchmarking | C++ | Cloud platform | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Staff Software Engineer, ML Infrastructure, Applied AI USD 207K-300KC++ | Code review | Data Processing | Debugging | Design reviewSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Software Engineer, GenAI, Platforms and Devices USD 147K-211KAudio generation | C++ | Data Processing | Debugging | Image GenerationMid-level Full TimeMountain View, CA, USA16h ago
-
Practice Customer Engineer IV, Cloud AI, Google Cloud USD 192K-267KAgent systems | Autogen | Convolutional Neural Networks | CrewAI | Deep learningSenior-level Full TimeSunnyvale, CA, USA; Seattle, WA, USA16h ago
-
Software Engineer, Machine Learning USD 207K-300KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeNew York, NY, USA; Mountain View, …16h ago
-
Senior Blackbelt Engineer, Gemini Cloud Assist (English) USD 234K-325KAPI | Artificial Intelligence | CNTK | Caffe | Computer VisionSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KCybersecurity | Dashboarding | Data Transformation | Data Visualization | Data collectionMid-level Full TimeWashington D.C., DC, USA; Atlanta, GA, …16h ago
-
Software Engineer III, Rankings, Lens Quality USD 147K-211KAlgorithms | C plus plus | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA16h ago
-
Staff Software Engineer, Cooling Optimization USD 207K-300KC++ | Control Theory | Cooling systems | Data Center Technology | Data StructuresSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Senior Data Engineer - Remote USD 150K-160KAPIs | Data Governance | Data Lineage | Data Management | Data Modeling401k | Dental insurance | Health and wellness programs | Health insurance | Life insuranceSenior-level Full TimeAtlanta, GA, US, 30328 R20h ago