Staff Engineer, Distributed Storage and HPC & AI Infrastructure
Tasks
- Build Kubernetes storage operators and controllers
- Design disaster recovery and backup runbooks
- Design multi petabyte AI storage systems
- Design multi tier caching and smart prefetching
- Enable automated provisioning and self service storage
- Implement NVMe over Fabrics and iSCSI
- Implement monitoring alerting SLOs and automated remediation
- Implement multi tenant isolation and quota enforcement
- Integrate parallel filesystems and object stores
- Mentor teams and contribute to open source
- Optimize RDMA Infiniband and data center networks
- Optimize data paths for GPU workloads
- Perform chaos engineering
- Plan capacity and optimize storage costs
- Tune parallel filesystems for high throughput
- Write documentation and postmortems
Perks/Benefits
Skills/Tech-stack
Ansible | ArgoCD | BeeGFS | CSI | Ceph | Custom Controllers | Disaster Recovery | Distributed Systems | Ext4 | GPFS | GitOps | Go | Grafana | Helm | ISCSI | Infiniband | Kubernetes | LVM | Linux | Linux Storage Stack | Linux storage | Lustre | Minio | NVMe | NVMe-oF | Object storage | Observability | PersistentVolumes | Prometheus | Python | R2) | RAID | RAID configurations | RDMA | S3 | SLO | StatefulSets | Storage operators | Storage stack | TCPIP | Terraform | Thanos | WekaFS | XFS
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R7h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States8h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA8h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA8h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas11h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R11h ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R12h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …12h ago
-
Cheminformatics | Cloud Computing | Data Analysis | Data Visualization | Deep learningSenior-level Full TimeRedwood City, California, United States12h ago
-
AI Developer USD 99K-198KAWS | Agentic AI | Azure | CI/CD | Data LakesHybrid work schedule | Leadership development | Professional developmentMid-level Full TimeWashington, DC12h ago
-
Senior-level Full TimeOrlando, FL, United States13h ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsCompany-matched 401k | Flexible schedule | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeUnited States R14h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KBusiness Intelligence | Microstrategy | Python | R | SQL401k match | Dental insurance | Disability insurance | Firm paid holidays | Health insuranceEntry-level Full TimeWashington, DC, United States14h ago
-
Algorithms | Concurrency | Data Structures | ESQL | ElasticsearchFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeUnited States R14h ago
-
Artificial Intelligence | C plus plus | CUDA | Camera Calibration | Computer VisionVisa sponsorship not availableMid-level Full TimeKenner, LA, United States16h ago
-
Reindeer- Software Engineer (Infrastructure) USD 180K-250KAPI Integration | AWS | Authentication | Authorization | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL17h ago
-
Reindeer- AI Solutions Engineer (IL) USD 80K-170KApplication Integration | Cloud Computing | Communication | Compliance | Data AnalysisSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL18h ago
-
Agent systems | Alignment Training | C++ | CoT prompting | Computer VisionSenior-level Full TimeSeattle, Washington, United States18h ago
-
C++ | DPO | GNN | Graph Neural Networks | Heterogeneous GraphsEntry-level Full TimeSeattle, Washington, United States18h ago
-
Forward Deployed Engineer IV, Applied AI, Google Cloud USD 207K-301KAPI Integration | Agent systems | Cloud platform | Conversational AI | DebuggingTravel up to 50%Senior-level Full TimeSan Francisco, CA, USA; Austin, TX, …19h ago
-
C++ | Data Processing | Debugging | Distributed Computing | Machine LearningSenior-level Full TimeSunnyvale, CA, USA; New York, NY, …19h ago
-
Deep learning | Isaac Sim | Jetson | Language Models | Large Language ModelsSenior-level Full TimeMountain View, CA, USA19h ago
-
Data Analytics Architect USD 136K-220KArtificial Intelligence | Business Intelligence | Data Engineering | Data Governance | Data LakeHybrid work | One day per week remoteSenior-level Full TimeCenter, Center District, IL1d ago
-
Robotics Integration Engineer USD 150K-193KC++ | CAN bus | CI/CD | Calibration | Camera401k | Commuter benefits | Daily lunches | Flexible vacation policy | Health ConciergeMid-level Full TimeMountain View, CA1d ago