Machine Learning Infrastructure Engineer
Tasks
- Build high performance serving systems
- Conduct performance engineering and capacity planning
- Design ML inference platforms
- Enable autoscaling and GPU utilization
- Implement caching strategies
- Implement request routing and batching
- Operate low latency high throughput services
- Perform end to end observability
- Respond to incidents and troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | Batching | C++ | Caching | Capacity Planning | Cloud Platforms | Distributed Systems | GPU Architecture | Go | Kubernetes | LLM Inference | Metrics | Observability | Performance Engineering | Python | Request Routing | Rust | Structured Logging | TensorRT-LLM | Tracing | VLLM
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R15d ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R15h ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R15h ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R15h ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Streaming Data Engineer USD 100K-150KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R15h ago
-
Senior-level Full TimeUnited States - Remote R15h ago
-
Robotics Engineer USD 100K-150KC++ | Concurrent programming | Control | Gazebo | Isaac SimCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R15h ago
-
Senior DataOps Engineer USD 150K-180K800-171 | AWS CloudFormation | AWS Glue | AWS GovCloud | AWS IAMRemote position | US government clearance requiredSenior-level Full TimeRemote - United States R17h ago
-
Senior Data Science Engineer I, Claims USD 170K-190KAWS | Apache Airflow | Automated testing | ClickHouse | Data Modeling401k matching | Disability and life insurance | Flexible working hours | Fully remote work | HSA & FSA optionsSenior-level Full TimeRemote R17h ago
-
Senior AI Engineer, Real-World Data USD 137K-175KAI orchestration | AWS | AWS Fargate | AWS Lambda | AWS S3401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R18h ago
-
Senior AI Engineer USD 188K-258KAgentic Systems | Agile | Cloud Architecture | Code review | Configuration ManagementCell phone allowance | Comprehensive health coverage | Equity for every employee | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R18h ago
-
Amazon Redshift | Amazon SageMaker | Amazon Web Services | Azure Machine Learning | Azure SynapseDental insurance | Flexible spending account | Health insurance | Paid time off | Stock optionsEntry-level Full TimeUnited States - Remote R18h ago
-
Staff Data Engineer USD 237K-270KAmazon EMR | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R18h ago
-
Senior Performance Engineer, Data Products USD 172K-195KAPI | Benchmarking | ClickHouse | ClickHouse Cloud | Concurrency401k matching | Co hanging stipend | Company sponsored disability insurance | Company-sponsored life insurance | DCFSASenior-level Full TimeRemote R18h ago
-
Senior DataOps Engineer ( Remote US) USD 113K-163KAWS | AWS CloudFormation | Amazon EMR | Ansible | Apache Airflow401K employee contribution | Employee assistance program | Flexible Time Away From Work | Health & medical benefits | Learning platformSenior-level Full TimeRemote US R19h ago
-
Senior Software Engineer II - Ingestion AI Engineer USD 105K-155KAWS | Agile | Alerting | Azure | Causal InferenceMid-level Full TimeRemote, United States R19h ago
-
Senior Software Engineer, Data Engineering Platform USD 186K-218KAPIs | Bitcoin | Blockchain Protocols | Blockchain infrastructure | Crypto infrastructureSenior-level Full TimeRemote - USA R20h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgoCD | CSI | Cluster API | Flux | GPUDirect StorageCompany outings happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R20h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-250KAir-gapped | Alerting | Argo CD | ArgoCD | Bare MetalAttend conferences and working groups | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R22h ago
-
Senior Data Engineer - Data warehousing/Python/AI USD 120K-159KAutomation | Business Intelligence | Cause analysis | Cloud Computing | Continuous ImprovementFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeTampa, FL, United States R22h ago
-
AI Engineer - AI Agents (Remote-United States) USD 112K-216KA/B | A/B Testing | Agent Orchestration | Automated testing | B testing401k retirement plan | Employee stock purchase plan | Medical/Dental/Vision insurance | Mental health support | Paid HolidaysSenior-level Full TimeUnited States R1d ago
-
Explosives Research Experiment Lead USD 146K-222KAerospace Engineering | Bench testing | C++ | Computational modeling | Computer Aided Design401k | Education reimbursement | Flexible schedule | Hybrid work schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R1d ago
-
AI Engineer - ICAM USD 146K-197KAccess Management | Agile | Artificial Intelligence | Generative AI | Hugging Face100 percent remote workMid-level Full TimeUSA MD Home Office (MDHOME), United … R1d ago