Senior Inference Engineer - AI
United States of America, Eagan, Minnesota
R
USD 110K-204K Senior-level Full Time
Tasks
- Collaborate on quantization techniques and model architectures
- Deploy and scale GPU inference workloads
- Develop guardrails and automation for inference workloads
- Ensure AI deployment monitoring governance and drift detection
- Implement observability and health monitoring for inference pipelines
- Implement routing and failover strategies
- Integrate models into production APIs
- Optimize LLMs and ML models for inference
- Optimize containerized inference pipelines with Kubernetes
- Productionize AI and LLM workloads
- Profile inference performance and optimize compute utilization
Perks/Benefits
- Career development
- Employee assistance program
- Fitness reimbursement
- Flexibility & work-life balance
- Headspace access
- Health, dental, vision, disability, and life insurance
- Hybrid work model
- Mental health days
- Retirement savings
- Tuition reimbursement
- Volunteer days off
- Work from anywhere
Skills/Tech-stack
AWS | Azure | C++ | CI/CD | CUDA | Cloud Native | Cloud Native Architecture | GPU Programming | Google Cloud | Knowledge Distillation | Kubernetes | Latency optimization | Microservices | ONNX Runtime | OpenSearch | Pruning | PyTorch | Python | Quantization | Retrieval-Augmented Generation | TensorFlow | TensorRT | Vector Search
Education
N/A
Related jobs
-
Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 200K-400KClaude Code | Cursor | JavaScript | OpenAI Codex | PythonSenior-level Full TimeMiami R11h ago
-
AI Security Engineer USD 140K-200K800-53 | ABAC | AI RMF | AI Studio | AKS401k matching | Dental insurance | Employee development program | Employee referral program | Medical insuranceSenior-level Full TimeRemote, MD, US R12h ago
-
Senior Middleware Software Development Engineer USD 128K-245KC# | C++ | Distributed Computing | GPU Software Development | GPU softwareHealth benefits | Hybrid work model | Retirement benefits | VacationSenior-level Full TimeUSA - OR - Hillsboro, United … R13h ago
-
Junior AI Engineer USD 86K-120KAPI Integration | Authentication | Cloud deployment | Docker | Error Handling401k matching | BYOD reimbursement | Company holidays | Flexible spending accounts | Health savings accountEntry-level Full TimeHouston, Texas, United States (Hybrid) R13h ago
-
Staff Machine Learning Engineer, Traffic Intelligence USD 212K-265KBayesian Calibration | Bayesian Inference | Calibration | Causal Inference | Data PipelinesSenior-level Full TimeUnited States R14h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Privacy | EncryptionDiscretionary paid time off | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R14h ago
-
Active Learning | Auto-labeling | Computer Vision | Confidence Scores | Data BalancingBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, … R14h ago
-
Solution Engineer USD 165K-216KCloud Computing | Data Lake | Data Warehouse | Data fabric | Data meshTravelSenior-level Full TimeUS-OH-Remote R16h ago
-
Principal Data Engineer (Remote) USD 151K-189KAmazon Kinesis | Apache Spark | CI/CD | Cloud Data | Cloud Data Services12 weeks new parent leave | Coworking support | Flexible PTO | Learning & development stipend | Time allotment for learning and developmentSenior-level Full TimeUnited States R16h ago
-
Lead Data Engineer (Remote) USD 126K-157KAWS | AWS Redshift | Amazon Kinesis | Azure | Azure DataCoworking support | Flexible PTO | Learning and development stipend | New parent leave | Remote workSenior-level Full TimeUnited States R17h ago
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R17h ago
-
Senior Analytics Engineer USD 141K-176KAWS Glue | Amazon Athena | Apache Hive | Apache Spark | CI/CDGenerous time off | Healthcare | Occasional travel for in person meetings | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R17h ago
-
Autonomous Systems | Build systems | C++ | Computer Vision | Core dumpsSenior-level Full TimeSunnyvale R18h ago
-
Senior Software Engineer (Forward Deployed) USD 180K-264KAWS | Automation | Data Contracts | Data Governance | Data QualityHybrid work | On-call support | Travel opportunitiesSenior-level Full TimeLondon - Hybrid; New York - … R18h ago
-
Data Scientist USD 90K-120KAWS | Agentic AI | Azure | Cypress | Data Analysis401k employer contribution | Remote work optionMid-level Full TimeRemote, USA R19h ago
-
Senior AI Engineer USD 170K-190KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon AuroraCareer advancement | Employee assistance program | Employee recognition | LinkedIn Learning Platform | Open PTOSenior-level Full TimeRemote US R19h ago
-
Senior Machine Learning Engineer I, AI & ML Platform USD 183K-205KAWS | Azure | DevOps | K8s | Kubernetes401k match | Child care backup care and elder care | Donation matching | Fertility care support | Fitness Mindfulness Nutrition and Sleep SubscriptionSenior-level Full TimeSan Francisco, CA (Hybrid) R20h ago
-
AI Engineer (Remote) USD 169K-230KAWS | Agent systems | Application development | Automation | Azure401k plan | Accident insurance | Dental insurance | Disability insurance | Flexible spending accountExecutive-level Full TimeFort Washington, PA, United States R20h ago
-
Software Engineer, Storage USD 80K-105KAnsible | Ceph | Continuous Deployment | Continuous integration | Distributed Systems401k match | Anniversary bonus | Dental insurance premium paid by employer | Gym membership reimbursement | Health Insurance Premium Paid by EmployerMid-level Full TimeRemote - United States R20h ago
-
Senior Storage Engineer USD 130K-150KAutomation | Bash | Cause analysis | Ceph | Cloud infrastructure401k match | Company-paid health insurance | Gym membership reimbursement | Internet reimbursement | Paid sabbaticalSenior-level Full TimeRemote - United States R20h ago
-
Storage Operations Engineer USD 80K-100KAnsible | Automation | Bash | Block Storage | Ceph100 percent company paid insurance premiums | 401k match | Company paid Wellable subscription | Gym membership reimbursement | Internet reimbursementMid-level Full TimeRemote - United States R20h ago
-
Staff/Senior Agentic AI Engineers (Multiple roles) USD 180K-215KAPI Design | AWS | Agent Orchestration | Agentic AI | Cloud infrastructureSenior-level Full TimeSan Francisco, California R21h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Machine Learning | CI/CDRemote | USC OnlySenior-level Full TimeDallas, TX. R21h ago
-
ABAC | AWS CloudFormation | AWS Lambda | AWS Step Functions | AWS-APIsOnsite/hybrid workSenior-level Full TimeChantilly, Virginia R22h ago
-
Senior Site Reliability Engineer USD 168K-200KAWS | Alerting | Amazon S3 | Apache Kafka | AutoscalingSenior-level Full TimeRemote - United States R22h ago