Staff Software Engineer, AI Runtime
Mountain View, California; San Francisco, California
USD 190K-265K Senior-level Full Time
Tasks
- Build checkpoint restore and fault tolerance for long running jobs
- Define APIs CLI and developer experience for training jobs
- Deliver resilience observability for multi node jobs
- Drive architecture and evolution of managed GPU training platform
- Implement GPU scheduling dynamic routing and high throughput data loading
- Lead end to end engineering from design to production rollout
- Mentor engineers and lead technical discussions
- Solve multi node orchestration and distributed training performance problems
Perks/Benefits
- N/A
Skills/Tech-stack
Algorithms | Automatic Recovery | Checkpointing | Collective communication | Data Structures | Data loading | Data parallelism | DeepSpeed | Distributed Systems | FSDP | Failure Detection | GPU Computing | High Performance | High Throughput | High Throughput Data Loading | High-Performance Computing | High-throughput data | Infiniband | Machine Learning | Megatron | Multi-tenant | Multi-tenant platform | NVLink | Orchestration | Performance Computing | Pipeline parallelism | PyTorch | RoCE | SLAs | SLOs | Sequence parallelism | System design | Tensor Parallelism
Education
Roles
Regions
Countries
States
Related jobs
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R7h ago
-
Staff Applied Scientist USD 244K-320KAgentic Systems | Artificial Intelligence | Benchmarking | CI/CD | Computer VisionEmployee communities | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States7h ago
-
AI Research Engineer USD 190K-280KDeep learning | Generative AI | Language Models | Language Processing | Large Language ModelsCareer development | Diversity and inclusion | Flexible work environmentMid-level Full TimeSeattle, Washington, United States; South San …8h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R11h ago
-
Data Scientist I (Prescriptive AI) USD 99K-135KCPLEX | DB2 | Data Warehousing | Discrete Event Simulation | Discrete eventCross training | Onsite Work Authorization SupportMid-level Full TimeLittle Rock, AR12h ago
-
Software Engineer - Medical Applications & Algorithms USD 130K-150KAWS CodeBuild | AWS CodePipeline | Agile | Amazon Web Services | C++Cross-functional team collaboration | Hybrid work environment | Medical device industry domainMid-level Full TimeSan Francisco, California, United States12h ago
-
Senior-level Full TimeIrving, TX12h ago
-
Associate AI Engineer USD 144K-180K.NET | APIs | ASPNet | AWS | Azure401k matching | Dental insurance | Hybrid work model | Medical insurance | Paid time offMid-level Full TimeIrving, TX R13h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R14h ago
-
Sr AI Engineer USD 84K-105KC# | Deep learning | Digital Signal | Digital Signal Processing | Edge ComputingAccidental death and dismemberment | Commuter benefits | Dental insurance | Flexible spending account | Health savings accountSenior-level Full TimeColumbia, MARYLAND, United States14h ago
-
Staff Machine Learning Engineer, Foundation - Seattle USD 208K-298KAWS | Artificial Intelligence | Azure | C++ | Code reviewCommunity groups | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States15h ago
-
Applied Research Scientist / Engineer USD 175K-250KData Curation | Deep learning | Diffusion Models | Distributed Training | Domain AdaptationMid-level Full TimeNew York, NY, SF Bay Area, …15h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Curation401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States; Remote U.S. R16h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Drift401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Remote U.S. R16h ago
-
AI Engineer (GenAI & Integration) USD 130K-181KAI Agents | AI Governance | API Integration | Automation workflows | DeploymentMid-level Full TimeCenter, Center District, IL16h ago
-
Senior Software Engineer - San Francisco (Onsite) USD 130K-220KAWS | Amazon EMR | Amazon S3 | Apache Flink | Apache SparkFast-paced startup environment | Onsite work environment | Rapid hiring process feedback | Relocation supportSenior-level Full TimeSan Francisco, CA, US17h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 136K-140KArtificial Intelligence | Confluence | Jira | LLM | Machine Learning401k retirement plan | Dental insurance | Life insurance | Medical insurance | Paid time offMid-level Full TimeFort George G Meade, United States17h ago
-
Machine Learning Engineer USD 223K-260KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | BigQuery401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeNew York City, NY17h ago
-
Machine Learning Engineer USD 187K-260KA/B | A/B Testing | AWS | Amazon RDS | Amazon S3401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careMid-level Full TimeSan Francisco, CA17h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus | Collaborative culture | Distributed-first environmentMid-level Full TimeCanada R18h ago
-
GenAI Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerProfessional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States19h ago
-
Generative AI Engineer III USD 110K-218KArtificial Intelligence | Data Analysis | Data Pipelines | Docker | KubernetesDiscretionary annual incentive program | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …19h ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Docker | Generative AI | KubernetesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …19h ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Generative AI | Language Models | Language ProcessingSenior-level Full TimeAtlanta, Georgia, United States; New York, …19h ago
-
Generative AI Data Engineer III USD 131K-218KAlgorithm Development | Artificial Intelligence | Data Analysis | Data Modeling | Data PipelinesMentorship | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; New York, …19h ago