Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation
Tasks
- Build data engines and feedback loops for training data collection management and evaluation
- Build scalable systems for deep learning model inference across large video and sensor data
- Create observability monitoring and debugging tools for production AI systems
- Deploy and operate AI systems using enterprise best practices
- Design AI inference infrastructure for real time computer vision and multimodal workloads
- Develop evaluation harnesses benchmarking systems and regression testing for model quality
- Implement continuous model evaluation experimentation and deployment pipelines
- Improve model serving architecture with batching caching routing quantization and parallelism
- Optimize inference performance for latency throughput GPU utilization reliability and cost
Perks/Benefits
- 401k plan
- Dental insurance
- Flexible time off
- Health insurance
- Life insurance
- Stock options
- Vision insurance
- Winter break
Skills/Tech-stack
Batching | Benchmarking | Caching | Cloud infrastructure | Computer Vision | Containers | Data Pipelines | Deep learning | Distributed Systems | Evaluation Frameworks | GPU Utilization | Inference Optimization | Kubernetes | Language Models | Large Language Models | Latency optimization | Machine Learning | Model Parallelism | Model Serving | Monitoring | Multimodal AI | Observability | Python | Quantization | RAG | Regression testing
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 493559h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US11h ago
-
PIIM Analytics Engineer USD 105K-160KAI/ML | APIs | Access Control | Azure Databricks | Code AutomationFull time office or project telework | Relocation assistanceMid-level Full TimeHouston, TX, US11h ago
-
Senior-level Full TimeSeattle, Washington, United States; USA - …12h ago
-
Staff Robotics Engineer, Maritime USD 254K-336KC++ | Collision Avoidance | Computer Vision | Computer Vision Algorithms | Machine LearningHealth benefits | Mentorship | Recovery BenefitsSenior-level Full TimeQuincy, Massachusetts, United States13h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KC++ | Cameras | Computer Vision | Gazebo | LidarHealth insurance | Mentorship | Travel opportunitiesSenior-level Full TimeQuincy, Massachusetts, United States13h ago
-
Machine Learning Operations Engineer USD 140K-240KAWS | Alerting | Cloud GPU | Compression | Data Quality401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ13h ago
-
Data Analytics Engineer - Techno functional USD 103K-128KAWS | Azure | Business Intelligence | Dashboarding | Data Governance401k | Employee share ownership plan | Flexible work | Healthcare | Paid parental leaveSenior-level Full TimeNew York, US14h ago
-
Machine Learning Engineer, GPU Kernel and Runtime USD 213K-263KCUDA | Deep learning | GPU Computing | Kernel optimization | Machine LearningSenior-level Full TimeMountain View, California15h ago
-
Distributed Systems | Fault Tolerance | GPU Computing | JAX | Low LatencyBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, California15h ago
-
Sr. Validation & Tools Engineer - Embedded Firmware USD 160K-190KAppium | Bug tracking | C plus plus | C# | CAN401k match | Dental insurance | FSA | Family building benefits | Fertility benefitsSenior-level Full TimePalo Alto15h ago
-
RFML Engineer, EW USD 166K-220K5G | C++ | Channel equalization | Channel estimation | Deep learningEmployee benefits package | Travel | U.S. Secret security clearance supportMid-level Full TimeCosta Mesa, California, United States16h ago
-
Staff ML Engineer, StockStory USD 140K-160KCNN | Deep learning | Embeddings | Human-in-the-loop | Information ExtractionDaily group classes | Daily specials | Dry cleaning | Free onsite fitness center | Free shuttle transportationSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States17h ago
-
Staff Engineer, Data Analysis (R5290) USD 121K-197KAnomaly Detection | Automated Validation | Cloud Storage | Communications | DashboardsSenior-level Full TimeUnited States17h ago
-
Batch scheduling | Batching | CI/CD | Caching | Capacity PlanningFlexible working hours | Generous vacation | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA17h ago
-
Staff Research Engineer, Discovery Team USD 350K-850KArtificial Intelligence | Cloud deployment | Containerization | Data Pipelines | Distributed SystemsFlexible remote work policy | Flexible working hours | Generous vacation | Parental leave | Visa sponsorship assistanceSenior-level Full TimeSan Francisco, CA17h ago
-
Software Engineer, Systems USD 150K-250KAWS S3 | Apache Iceberg | Apache Parquet | C# | C++401k match | Catered meals | Commuter benefit | Dental insurance | Flexible PTOMid-level Full TimeSan Francisco17h ago
-
Senior AI Solutions Engineer USD 164K-215KAI Observability | Agentic Systems | Airflow | Amazon S3 | Amazon Web Services401k plan | Annual Caltrain Pass | Fastrak reimbursement | Fitness reimbursement | Health, dental, vision insuranceSenior-level Full TimeUS - Remote R18h ago
-
C++ | Deep learning | Distributed Training | ETL Pipelines | GoSenior-level Full TimeMountain View, CALIFORNIA, United States18h ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States18h ago
-
Senior-level Full TimeOakland, CA, United States18h ago
-
Test Data Engineer USD 68K-131KArtificial Intelligence | Automation | Cloud | Configuration Management | Data Governance401k match | Catered lunches | Coffee tea beverages | Dental insurance | Health insuranceMid-level Full TimeBoston19h ago
-
Active Learning | Agentic Workflows | Bayesian optimization | Computational Biology | Experimental DesignSenior-level Full TimeSomerville, MA19h ago