Software Engineer, Training & Inference Infrastructure
Tasks
- Architect training infrastructure reliable scalable cost efficient
- Automate resource orchestration and fault recovery
- Build model serving infrastructure low latency high throughput
- Ensure infrastructure reliability security observability
- Optimize training and inference pipelines performance reliability cost
- Partner with researchers to productionize models and features
Perks/Benefits
- 401k match
- Daily meals
- Health insurance
- Learning and development stipend
- Relocation assistance
- Unlimited PTO
- Wellness stipend
Skills/Tech-stack
AWS EFA | CUDA | GPU Computing | HPC | Infiniband | Model Parallelism | NCCL | Observability | PyTorch | Python | Security Engineering | VLLM
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Developer USD 145K-150KAPI | AWS ECS | AWS EKS | AWS Fargate | Amazon S3Agile team collaboration | Remote workSenior-level Full TimeFairfax, VA, United States9h ago
-
Ansible | Azure | Azure Foundry | Azure Monitor | CI/CDMid-level Full TimeHuntsville, AL10h ago
-
Technical Architect – AI, ML & Generative AI USD 150K-202KAWS Bedrock | AWS SageMaker | Apache Spark | Artificial Intelligence | CI/CD401k | Critical Illness Accident Hospital Indemnity Identity Theft Protection | Dental plans | Life and Accidental Death and Dismemberment | Long-term disabilitySenior-level Full TimeFrisco, United States11h ago
-
Senior Full-Stack Data Engineer (Remote) USD 110K-130KAI code assistance | Automated testing | Azure DevOps | CI/CD | Code assistanceFull-time | Fully remote | Long-term | No timezone shiftingSenior-level Full TimeFlorida, Aventura, United States of America R12h ago
-
Senior Data Engineer on Site USD 140K-200KAWS Lambda | Amazon Kinesis | Amazon S3 | Data Modeling | Data ProcessingDay 1 impact | Fast execution | Low corporate overhead | Own major product parts | Shape technical visionSenior-level Full TimeSan Francisco, United States12h ago
-
Bash | C# | CI/CD | JUnit | JavaFinancial benefits | Health and wellness benefitsEntry-level Full TimePennsylvania, Exton13h ago
-
Mid-level Full TimeBurlingame, CA14h ago
-
Machine Learning Engineer USD 214K-240KBigtable | Code review | Computer Vision | Data Mining | Data PipelinesMid-level Full TimeBellevue, WA14h ago
-
Data Engineer, Analytics USD 209K-235KData Warehousing | Dimensional Modeling | ETL | MPP | MapReduceEntry-level Full TimeBurlingame, CA14h ago
-
Senior Software Engineer, AI/ML GenAI USD 174K-252KBenchmarking | C++ | Cloud platform | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Staff Software Engineer, ML Infrastructure, Applied AI USD 207K-300KC++ | Code review | Data Processing | Debugging | Design reviewSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Software Engineer, GenAI, Platforms and Devices USD 147K-211KAudio generation | C++ | Data Processing | Debugging | Image GenerationMid-level Full TimeMountain View, CA, USA15h ago
-
Practice Customer Engineer IV, Cloud AI, Google Cloud USD 192K-267KAgent systems | Autogen | Convolutional Neural Networks | CrewAI | Deep learningSenior-level Full TimeSunnyvale, CA, USA; Seattle, WA, USA15h ago
-
Software Engineer, Machine Learning USD 207K-300KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeNew York, NY, USA; Mountain View, …15h ago
-
Senior Blackbelt Engineer, Gemini Cloud Assist (English) USD 234K-325KAPI | Artificial Intelligence | CNTK | Caffe | Computer VisionSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KCybersecurity | Dashboarding | Data Transformation | Data Visualization | Data collectionMid-level Full TimeWashington D.C., DC, USA; Atlanta, GA, …15h ago
-
Software Engineer III, Rankings, Lens Quality USD 147K-211KAlgorithms | C plus plus | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA15h ago
-
Staff Software Engineer, Cooling Optimization USD 207K-300KC++ | Control Theory | Cooling systems | Data Center Technology | Data StructuresSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Senior Data Engineer - Remote USD 150K-160KAPIs | Data Governance | Data Lineage | Data Management | Data Modeling401k | Dental insurance | Health and wellness programs | Health insurance | Life insuranceSenior-level Full TimeAtlanta, GA, US, 30328 R19h ago
-
Data Engineer I USD 68K-100KAPI Keys | Azure | Azure Data | Azure Data Factory | Azure Synapse401k match | Employee onboarding program | Flexible PTO | Health and wellness benefits | Onsite optionsEntry-level Full TimeMorrisville, NC, US, 2756019h ago
-
Senior Analytics Engineer, Marketing USD 159K-201KAttribution | DBT | Data Modeling | Dimension tables | Dimensional ModelingAnnual equity refresh grants | New hire equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R22h ago
-
(Senior) Machine Learning Engineer USD 96K-214KCausal Inference | Counterfactual Modeling | DAG Learning | Generative Modeling | Graph DatabasesAnnual incentive program | Healthcare coverage | Other benefits | Retirement benefitsSenior-level Full TimeBoston, MA23h ago
-
(Senior) Machine Learning Engineer USD 96K-214KCausal Inference | Counterfactual Modeling | DAG Learning | Generative Modeling | Graph DatabasesAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeBoston, MA USA23h ago
-
Staff Machine Learning Engineer USD 159K-324KAmazon SageMaker | BigQuery | Cloud platform | Contrastive Learning | Deep learning401k plan | Commuter benefits | Dental insurance | Disability insurance | Electric car chargingSenior-level Full TimeMountain View, USA1d ago
-
Staff Machine Learning Engineer USD 138K-297KAWS | Amazon SageMaker | BigQuery | Cloud platform | Contrastive Learning401k plan with company match | Electric Car Charging Station | Employee assistance program | Flexible spending accounts | Health savings accountSenior-level Full TimeMountain View, USA1d ago