ML Infrastructure Engineer
Tasks
- Apply quantization and model distillation
- Build dataset storage and metadata indexing
- Build low latency inference pipeline
- Build model training infrastructure
- Collaborate with researchers to translate needs into infrastructure
- Design multimodal data ingestion and validation pipelines
- Develop research tooling for debugging visualization and experiment analysis
- Implement model sharding and activation checkpointing
- Log metrics and monitor training workloads
- Maintain research codebase for fast iteration
- Optimize GPU utilization and training throughput
- Optimize dataloaders sharding and prefetching
- Reason about performance memory I O and GPU utilization
- Scale distributed training across GPU clusters
- Schedule training jobs and manage checkpoints
- Use model compilation for inference optimization
Perks/Benefits
- N/A
Skills/Tech-stack
Activation checkpointing | CUDA | Data Pipelines | Data Validation | Dataloader optimization | Dataset Management | Distributed Training | Flatbuffers | GPU Optimization | Knowledge Distillation | Kubernetes | Low Latency | Low-Latency Systems | Metadata indexing | Model Quantization | Model compilation | Prefetching | Protobuf | PyTorch | Python | Serialization | Sharding | Slurm | Video Processing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Marketing Data Analytics Engineer USD 100K-150KAPI Integration | Amazon Web Services | Attribution Modeling | Audience Segmentation | Automated testingExclusive perks | Financial well-being | Health and wellness | Learning and development | Life and family supportSenior-level Full TimeBoston, Massachusetts, United States7h ago
-
A/AI Research Engineer Asc - E1 USD 67K-124KC++ | CIN? N/A | Computer Vision | Control Engineering | Control Systems401k match | Dental insurance | Education assistance | Flexible work arrangements | Life insuranceEntry-level Full TimeOrlando, FL, US9h ago
-
Data Engineer Senior - Level 3 USD 85K-158KAgile | Data Cleansing | Data Mining | Data Quality | Data Warehousing401k match | Education assistance | Employee assistance program | Flexible work arrangements and schedules | HolidaysSenior-level Full TimeFort Worth, TX, US9h ago
-
Associate Manager, Computer Vision & Perception USD 135K-251KAgile | Artificial Intelligence | C++ | CI/CD | Camera Hardware401k match | Dental insurance | Education assistance | Employee assistance program | Flexible schedulesMid-level Full TimeLittleton, CO, US9h ago
-
Algorithm Engineer, Tracking Systems USD 126K-167KAgile | C++ | Clustering | Data Association | Differential EquationsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …11h ago
-
Algorithm Developer, Tracking Systems USD 126K-167KAgile | C++ | Clustering | Computer Vision | Data AssociationHealth benefits | Recovery supportMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …11h ago
-
Senior Algorithm Engineer, Tracking Systems USD 190K-252KAgile Development | C++ | Clustering | Controls | Data AssociationHealth insurance | Performance bonusesSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …11h ago
-
Applied AI Architect, Government USD 234K-335KAI architecture | APIs | Access Management | Agentic AI | Application IntegrationHybrid work | Relocation assistanceSenior-level Full TimeWashington, DC R12h ago
-
Agentic AI Engineer, Automation USD 220K-292KAgent Orchestration | C++ | Data Aggregation | Data Pipelines | Data SanitizationNone Full TimeCosta Mesa, California, United States13h ago
-
ML Infra Engineer, Modeling USD 200K-270KCheckpointing | Cloud Computing | Data loading | Distributed Training | Experiment trackingSenior-level Full TimeSan Francisco13h ago
-
APIs | Agentic AI | Cloud Computing | Data Modeling | Data Pipelines401k matching | Company holidays | Dental insurance | Elder and Childcare Days | Employee stock purchase programMid-level Full TimeNeedham, MA, United States14h ago
-
Senior Engineer, Physical Design AI/ML USD 138K-206KActive Learning | Agentic AI | Bayesian optimization | C++ | Clock Tree401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environmentSenior-level Full TimeSan Jose, California, United States14h ago
-
Senior AI Engineer USD 130K-150KAI Governance | AI Services | AI/ML | API Integration | AWS AI401k match | Dental insurance | Disability insurance | Employee assistance program | Health insuranceSenior-level Full TimeCentennial, CO; Westminster, CO R14h ago
-
API Integration | Artificial Intelligence | Data Engineering | Data Pipelines | Data provenanceSenior-level Full TimeUS026 PA Spring House - 1400 …14h ago
-
Entry-level Full TimeOakland, CA, US, 94612 R14h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeUnited States R15h ago
-
Embedded Software Engineer USD 160K-200KADC | ARM Cortex | ARM Cortex-M | Analog Signal | Analog signal processingHealthcare benefits | Medical/Dental/Vision | Paid Holidays | Paid time offEntry-level Full TimeCarlsbad, CA15h ago
-
Director, Law Firm Analytics USD 160K-180KArtificial Intelligence | Automation | Data Modeling | Data Quality | Data Visualization401k match | Disability insurance | HSA | Life insurance | Medical/Dental/Vision insuranceExecutive-level Full TimeRemote (United States) R15h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R16h ago
-
Senior Embedded Engineer – Robotics & Sensor Systems USD 164K-220KAI Inference | AIS | AWS | Azure | C++Senior-level Full TimeArlington, VA16h ago
-
Senior Principle PM Data Analyst USD 100K-145KCause analysis | Clinical Data Analysis | Clinical data | Corrective and Preventive Action | DashboardsSenior-level Full TimeGainesville, FL16h ago
-
Mid-level Full TimeSan Francisco Bay Area16h ago
-
Senior Machine Learning (ML) Engineer USD 175K-200KAI Search | Artificial Intelligence | Attention Mechanisms | Autogen | Azure AI401k plan | Dental insurance | Flexible paid time off | Flexible work hours | Medical insuranceSenior-level Full TimeSeattle, WA R16h ago
-
Software Engineer, Data Runtime USD 29KAWS | Admission Policy | Arrow | Azure | Benchmarking401k | Additional company holidays | Enhanced parental leave | Generous vacation policy | Holiday breakSenior-level Full TimeSan Francisco, US (Hybrid) R16h ago
-
Analyst, Data Analytics USD 77K-131KA/B | A/B Testing | Agile | Automation | B testingHybrid work up to one day per week from homeMid-level Full TimeColorado Springs, Colorado, United States16h ago