Inference Systems Engineer
Tasks
- Design modular distributed systems with clear contracts
- Develop extensible inference system interfaces
- Diagnose and resolve performance bottlenecks
- Lead architecture decisions for concurrency and data movement
- Optimize distributed abstractions for performance and reliability
- Support software from implementation through production
Perks/Benefits
Skills/Tech-stack
API Design | Abstraction design | Actor Model | Async Scheduling | Concurrency | Data Structures | Distributed Systems | GPU Programming | Graph Dataflow | Memory Optimization | NUMA | POSIX APIs | Performance Tuning | Python | Rust | Zero copy
Education
N/A
Related jobs
-
AC DC Sizing | AC/DC | Arc Flash | Artificial Intelligence | AutomationMultiple project extensions | Paid on time | Remote work optionSenior-level Full TimeJuno Beach, FL R8h ago
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R9h ago
-
Benchmarking | C plus plus | CUDA | Computational Engineering | Distributed Computing401k match | Generous paid time off | Medical, dental & vision coverage | Stock options | WFH Hardware ReimbursementSenior-level Full TimeSunnyvale, CA R20h ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R1d ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R1d ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R1d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R1d ago
-
Sr Staff AI Engineer - Veza USD 190K-334KAgent Orchestration | Algorithms | C++ | Data Structures | Distributed Systems401k plan with match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeMinneapolis, Minnesota, United States R1d ago
-
Senior GTM AI Engineer USD 154K-213KAgent Orchestration | Agent Performance | Agent Performance Monitoring | Anthropic Claude | App Development401k match | Catered lunch | Company events | Desk setup stipend | Flexible spending accountsSenior-level Full TimeOakland, California, United States R1d ago
-
Data Science Engineer USD 121K-154KData Visualization | Documentation | Entity Resolution | Fine Tuning | Git401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R1d ago
-
Software Engineer, Database Reliability & Performance USD 100K-168KAI tools | Automated testing | C++ | CI/CD | CircleCI401k | Annual professional development budget | Financial planning and legal advice | Flexible time off | Life insuranceMid-level Full TimeRemote US R1d ago
-
AI Architect USD 120K-197KAI orchestration | Automation | Cloud Computing | Data Governance | Distributed SystemsWeekly earned wage access optionSenior-level Full TimeDurant, OK, United States R1d ago
-
Senior Software Engineer - Frontend USD 130K-300KAI coding | AI coding tools | Algorithms | Coding Tools | Data StructuresCareer development opportunities | Community guilds | Employee stock purchase plan | Free mental health benefit | Hybrid work environmentSenior-level Full TimeNew York, New York, USA R1d ago
-
Staff Diagnostics and Embedded Cyber Security Engineer USD 150K-283KAUTOSAR | Automotive Ethernet | BLE | C# | C++Employee resource groups | Flexible family care days | Paid parental leave | Paid time off | Subsidized back-up child careSenior-level Full TimePalo Alto, CA, United States R1d ago
-
Senior Analytics Engineer USD 153K-206KAWS | Data Quality | ETL | Healthcare Claims | PySpark401k plan | Commuter benefits | Dental insurance | Disability insurance | Flexible spending accountSenior-level Full TimeRemote- US R1d ago
-
Senior Data Engineer USD 190K-210KAccess Control | Alerting | CI/CD | DBT | Data Governance401k | Flex PTO | Learning and development reimbursement | Medical, dental, vision plans | Paid parental leaveSenior-level Full TimeRemote (US) R1d ago
-
Agile | C# | C++ | Change Management | Configuration Management401k match | Dental insurance | Disability insurance | Educational assistance | Employee assistance programSenior-level Full TimePhoenix, AZ, United States R1d ago
-
Senior AI Analytics Engineer USD 149K-212KAI Agents | Agent Frameworks | Automation | DBT | Python401k match | Employee assistance program | HSA contribution | Health insurance | Hybrid workSenior-level Full TimePlano,Texas,United States R1d ago
-
Senior Data Engineer (B2B) USD 105K-135KAutomated testing | BigQuery | DBT | Data Modeling | Data Quality401k matching | Annual class pass credits | Dental insurance | Extended holiday break | Flexible schedulesSenior-level Full TimeRemote, United States R1d ago
-
Senior Software Engineer, Data Platform USD 168K-297KAWS | Anomalo | Apache Airflow | Apache Iceberg | BuildkiteFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeBay Area, CA, United States of … R1d ago
-
IAA - Principal Data Engineer USD 171K-256KAzure | Azure Synapse | Azure Synapse Analytics | CI/CD | Data GovernanceHybrid work schedule | Onsite expectation 2 days per weekSenior-level Full TimeChicago, IL (Hybrid) R1d ago
-
Full-Stack AI Engineer USD 150K-200KAWS | Authentication | Azure | CI/CD | CSSD E And I Initiatives | Fertility and menopause leave | Fitness allowance | Health benefits | Hybrid workingMid-level Full TimeNew York R1d ago
-
Software Engineer I USD 97K-122KBatch inference | Cloud infrastructure | Docker | GPU Optimization | GoConference reimbursement | Education reimbursement | Employee assistance program | Flexible time off | Hybrid workEntry-level Full TimeSeattle R1d ago
-
Backend Engineer, Multi-cloud Inference Platform USD 234K-319KAmazon Web Services | Backend Engineering | Cloud platform | Distributed Systems | GenAI401k matching | Flexible paid time off | Health insurance | Local meetups | Remote workMid-level Full TimeUnited States / Canada R1d ago
-
Cloud Inference Engineer USD 166K-273KAutoscaling | Cold Start | Cold Start Optimization | Distributed KV Cache | Distributed SystemsMid-level Full TimeUnited States / Canada R1d ago