AI Infrastructure Engineer
Tasks
- Build and own end to end model serving infrastructure
- Collaborate with algorithms engineers on inference configuration
- Design AI inference platform architecture
- Establish MLOps best practices with CI CD pipelines
- Integrate power data with AI inference software
- Monitor model deployment and support rollback
- Optimize GPU utilization and inference performance
- Serve AI models with fault tolerant low latency systems
- Support infrastructure roadmap build vs buy decisions
Perks/Benefits
- 401k match
- Dental insurance
- Health insurance
- Paid time off
- Remote work
- Travel for retreats and onsite engagements
- Vision insurance
Skills/Tech-stack
C++ | CI/CD | CUDA | Container Orchestration | Datadog | Distributed Systems | Docker | Fault-tolerant | Fault-tolerant systems | GPU Acceleration | Go | Grafana | Helm | Infrastructure as Code | Kubernetes | Low Latency | MLOps | Model Serving | Monitoring | NVIDIA Triton | Observability | Prometheus | Python | Reliability | Rust | SGLang | Scalability | TensorRT | Terraform | Torchserve | VLLM | “as-code”
Education
N/A
Related jobs
-
Director - Microsoft Cloud & AI Solution Architecture (Communications, Media & Technology) USD 225K-240KAKS | Ansible | Application development | Azure DevOps | Azure Firewall401k match | Bereavement leave | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeLos Angeles, CA, United States R4h ago
-
Machine Learning Engineer USD 130K-194KAI machine learning | AWS AI | AWS AI Machine Learning | Amazon DynamoDB | Amazon EC2Professional development | Work from homeMid-level Full TimeRemote, NY, US R9h ago
-
Data Scientist, Analytics (Technical Leadership) USD 160K-190KAI Workflow Optimization | AI workflow | Agent Orchestration | Bias Mitigation | Causal InferenceCareer development | World class analytics communitySenior-level Full TimeRemote, US | Bellevue, WA | … R10h ago
-
Adaptive Control | Apache Spark | Azure DevOps | C++ | CI/CDFlexible hybrid work model | Flexible vacation policy | Paid Holidays | Paid time off | Personal and family careSenior-level Full TimeNew York, NY, US, 10001-8604 R20h ago
-
Adaptive Control | Agile | Audio Processing | Azure DevOps | C++Flexible vacation policy | Hybrid work model | Paid Holidays | Travel opportunitiesMid-level Full TimeNew York, NY, US, 10001-8604 R20h ago
-
AWS | Benchmarking | Code Quality | Code review | Data Pipelines401k matching | Dining | Flexible spending accounts | Healthcare | Onsite gymSenior-level Full TimeRemote - US R21h ago
-
Software Engineer III (AI/ML) USD 113K-169KAPI Design | AWS | CrewAI | Docker | DynamoDBCompany sponsored retirement plan | Flexible work environment | Health and wellness benefits | Hybrid work options | In person orientation processSenior-level Full TimeRemote (USA), United States R22h ago
-
AI Program Manager USD 96K-192KAWS | Agile | Azure | Cloud Platforms | Cloud platformDental insurance | Dependent care spending account | Health care benefits | Health care spending account | Health savings accountMid-level Full TimeCAFLO: Carrier-Home Florida Remote Location, Remote … R22h ago
-
A/B | A/B Testing | Airflow | Anomaly Detection | Artificial IntelligenceSenior-level Full TimeRemote - USA R22h ago
-
Staff Applied AI Engineer USD 180K-273KAWS SageMaker | Agentic AI | Amazon Bedrock | CI/CD | Caching401k match | Dental insurance | Fertility assistance | Flexible paid time off | Health insuranceSenior-level Full TimeRemote - US & Canada R23h ago
-
Applied AI Engineer II USD 100K-295KAI Agents | AWS | Azure | CI/CD | Docker401k matching | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountSenior-level Full TimeAddison, TX (Hybrid); Durham, NC (Hybrid) R23h ago
-
Senior Software Engineer, Data Platform USD 163K-247KAWS | Amazon EMR | Amazon Kinesis | Amazon MSK | Amazon Redshift401k match | Equity RSUs | Health insurance | Paid time offSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R23h ago
-
Agile | Algorithms | Analytics | C plus plus | CI/CD401k | Accident insurance | Dental insurance | FSA | HSASenior-level Full TimeAustin, Texas or Remote R1d ago
-
Data Solutions Engineer USD 119K-164KAlerting | Azure | Azure Data | Azure Data Factory | Azure Databricks401k match | Dental insurance | Employee referral program | Health insurance | Life insuranceEntry-level Full TimeRemote, United States R1d ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Contrastive Learning | Data Augmentation401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeRemote U.S. R1d ago
-
Staff AI Engineer USD 170K-215KAWS | Agent Orchestration | Agentic Workflows | ClickHouse | Distributed SystemsParental leave | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (Austin, TX) R1d ago
-
Senior AI Engineer USD 155K-185KAWS | Agent Orchestration | CI/CD | ClickHouse | ContainerizationHealth benefits | Parental leave | Tuition reimbursement | Unlimited PTOSenior-level Full TimeHybrid (Austin, TX) R1d ago
-
Data Engineer (Remote) USD 123K-178KAlerting | Batch Processing | CI/CD | Cloud platform | ClusteringFully remote | W2 Candidates OnlyMid-level Full TimeRochester, MN R1d ago
-
Software Engineer, AI Solutions USD 120K-149KAWS | Agent Orchestration | Agent systems | Azure | Containers100 Percent Healthcare Coverage | 100 percent remote | 401k plan | Coaching | Flexible spending accountMid-level Full TimeUnited States R1d ago
-
Data Engineer II-AWS USD 90K-100KAWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDB | Amazon EMRFully remote workMid-level Full TimeOrlando, FL, United States R1d ago
-
AI-Native Data Platform Engineer USD 165K-225KAWS Glue | AWS Lambda | AWS S3 | Access Control | Amazon OpenSearch401k matching | Book clubs | Health benefits | Roth IRA options | SeminarsSenior-level Full TimeHybrid - New York, NY R1d ago
-
Senior Full Stack AI Developer USD 145K-180KArtificial Intelligence | Cloud Computing | Continuous Delivery | Continuous integration | Language ModelsRemote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Senior Solution Engineer USD 165K-216KAnalytics | Artificial Intelligence | Cloud Computing | Data Science | Data WarehousingSenior-level Full TimeUS-CA-Bay Area-Remote R1d ago
-
Senior Data Engineer USD 130K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Data Solutions Engineer USD 123K-178KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon S3401k match | Flexible spending account | Growth opportunities | Health benefits | Long-term disabilityMid-level Full TimeUS-Remote R1d ago