Sr. Software Engineer, AI Infrastructure
Tasks
- Build distributed serving systems
- Collaborate with open-source community
- Design distributed training infrastructure
- Develop containerized pipeline orchestration
- Enable model parallelism and tensor parallelism
- Improve system observability and profiling
- Mentor engineers and lead technical strategy
- Optimize GPU inference latency and throughput
- Optimize deep learning training performance
- Support internal AI teams with ML infrastructure
Perks/Benefits
Skills/Tech-stack
Apache Beam | Apache Spark | C# | C++ | CUDA | Containerization | Data I/O | Deep learning | DeepSpeed | Distributed Training | Feature Engineering | Flax | Flink | GNNs | GPU Inference | Go | Horovod | HuggingFace Transformers | I/O | Incremental Learning | JAX | Java | Kubeflow | Kubernetes | LLM serving | MLflow | Machine Learning | Model Parallelism | Observability | Online Learning | Profiling | PyTorch | Python | Ray | Rust | Scala | Search Systems | Tensor Parallelism | TensorFlow | VLLM | Zero Redundancy Optimization
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R7d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R21d ago
-
Amazon S3 | Cloud Computing | Cybersecurity | Data Quality | Data integrationSenior-level ContractRaleigh, United States2h ago
-
Mid-level Full TimeJersey City, New Jersey, United States; …2h ago
-
Applied AI Engineer II - Encore Program USD 93K-170K.NET | AI Agent | AI agent orchestration | AWS | AWS BedrockMentorship | Professional growthMid-level Full TimeJersey City, New Jersey, United States; …2h ago
-
Controls Room AI/ML Developer - Senior Associate USD 170K-185KAPI Integration | Agent systems | Asynchronous programming | Context Management | EvaluationBackup childcare | Financial coaching | Mental health support | Onsite health and wellness centers | Retirement savings planSenior-level Full TimeJersey City, NJ, United States3h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Cloud Computing | Data Privacy | Data exfiltration | Distributed SystemsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA4h ago
-
Data Structures | Data Structures and Algorithms | Decision Making | Embeddings | Information RetrievalSenior-level Full TimeSan Bruno, CA, USA4h ago
-
Software Engineer III, AI/ML, Gemini Enterprise USD 147K-211KAudio generation | C++ | Data Processing | Debugging | Google CloudSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Software Engineer III, AI/ML, Platforms and Devices USD 147K-211KC++ | Data Processing | Debugging | Machine Learning | Machine Learning InfrastructureSenior-level Full TimeMountain View, CA, USA4h ago
-
Novel AI Lead Methodologist USD 171K-248KArtificial Intelligence | Automation | Data Analysis | Data Manipulation | Data ScienceSenior-level Full TimeWashington D.C., DC, USA; Atlanta, GA, …4h ago
-
Software Engineer III, AI/ML GenAI, Google Ads USD 147K-211KAudio generation | C++ | Data Preparation | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA4h ago
-
C++ | Data Processing | Debugging | Distributed Systems | GoSenior-level Full TimeSunnyvale, CA, USA4h ago
-
ASE | Apptainer | Binding Site Identification | CI/CD | CheminformaticsHealth insurance | Paid time off | Remote work flexibility | Retirement contributionsSenior-level Full TimeSan Jose, California, US, 951349h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Development | Automation | Backend Development | PythonDirect impact on company growth | Equity | Fast moving startup environment with significant ownership | Hybrid work environment | Opportunity to define internal systems and customer experienceMid-level Full TimeKing of Prussia, PA, United States R9h ago
-
Senior Software Engineer - Machine Learning USD 152K-186KApache Flink | Apache Storm | Deep learning | Generative AI | Go401k match | Dental insurance | Equity awards | Health plan | Life insuranceSenior-level Full TimeChicago, IL 60607, United States12h ago
-
Senior-level Full TimeSan Francisco, California, United States12h ago
-
Staff Software Engineer, Foundation Model API USD 190K-265KCloud Native | Cloud-native infrastructure | Deployment Pipelines | Distributed Systems | GPU OrchestrationSenior-level Full TimeSan Francisco, California12h ago
-
Software Development Staff Engineer Senior USD 184K-232KAWS | AWS CodeCommit | AWS CodeDeploy | AWS CodePipeline | AWS DocumentDBSenior-level Full TimeCosta Mesa, CA, United States13h ago
-
Development and Operations Engineer I USD 102K-125KAWS | AWS CloudFormation | AWS CodeBuild | AWS CodePipeline | Amazon EC2Comprehensive benefits | TelecommuteSenior-level Full TimeCosta Mesa, CA, United States13h ago
-
Algorithm Developer USD 120K-200KC++ | Computational imaging | Computer Vision | Electromagnetics | Estimation Theory401k match | Dental coverage | Disability insurance | Discretionary bonus eligibility | Employee stock ownership planMid-level Full TimeGoleta, CA, US13h ago
-
Algorithm Developer, Battlespace Awareness USD 111K-147KAgile | C++ | Classification | Clustering | Data AssociationMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …13h ago
-
Database Developer Expert USD 183K-202KAlteryx | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web ServicesSenior-level Full TimeCosta Mesa, CA, United States13h ago
-
AI/ML Software Engineer USD 120K-200KC++ | Computer Vision | Computer vision models | Configuration Management | Control SystemsCompany funded 401k | Dental coverage | ESOP | Employer paid medical insurance | HSA employer contributionsMid-level Full TimeGoleta, CA, US13h ago
-
Alerting | Cloud Computing | Compute Optimization | Data Quality | Distributed Training401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ14h ago