Backend Inference Framework Engineer Graduate (AML Inference) - 2027 Start
San Jose, California, United States
USD 128K-256K Entry-level Full Time
Tasks
- Design inference service architecture
- Develop inference engine scheduling
- Implement canary release
- Implement model inference services
- Implement monitoring and alerting
- Maintain distributed service architecture solutions
- Optimize distributed high concurrency service performance
- Optimize inference framework core modules
- Resolve performance bottlenecks
- Resolve resource bottlenecks
- Resolve stability issues
- Select and evaluate inference technologies
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Algorithms | C# | C++ | Canary Deployment | Concurrency | Data Structures | Distributed Systems | GPU resource management | High concurrency | High-concurrency distributed systems | Inference Systems | Latency optimization | Linux | Monitoring | Multithreading | Performance Tuning | Resource Management | Scheduling | Service Latency | Service Latency Optimization | Synchronization | Thread pool
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
C# | C++ | CPU architecture | Cache optimization | Code generation401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States5h ago
-
Access Optimization | C# | C++ | CUDA | Computational Graph Optimization401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States5h ago
-
Bash | C# | C++ | CMake | Configuration Management401k match | Dental insurance | Education assistance | Employee Assistance Program (EAP) | Flexible spending accountsEntry-level Full TimeFort Worth, TX, US13h ago
-
Developer Experience Engineer II and/or Senior Developer Experience Engineer - AI Frameworks USD 119K-234KAzure Pipelines | Bazel | Build Automation | C# | C++Mid-level Full TimeUnited States21h ago
-
Desktop UI Developer (AI Software) USD 120K-185KAnimation | Asynchronous programming | C++ | Component design | GraphicsAccess to cutting-edge AI tools | Flexible working hours | Remote workMid-level Full TimeGeorgia R1d ago
-
Software Engineer, AI/ML, Full Stack, Search Ads USD 147K-210KA/B | A/B Testing | Agentic AI | B testing | C++Mid-level Full TimeMountain View, CA, USA1d ago
-
Machine Learning Engineer USD 238K-345KAPI Development | AWS | Agent Orchestration | Azure | Cloud platformSenior-level Full TimeSan Jose, United States R1d ago
-
Rates Quantitative Analyst -VP USD 150K-225KAnalytical libraries | C++ | Computational Methods | Curve construction | Derivative pricingExecutive-level Full TimeNew York, 745 7th Avenue, United …1d ago
-
Staff Quantitative Developer USD 179K-243KAWS | Azure | C++ | CS01 | Credit401k | Dental insurance | Health insurance | Long-term disability | Medical leaveSenior-level Full TimeOffice - New York, United States1d ago
-
Entry-level Full Time TemporaryRedwood City, CA2d ago
-
Hadoop Big Data Developer USD 86K-103KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Enterprise AI Platform Engineer USD 112K-175KAgent Orchestration | Agent systems | Authentication & Authorization | CI/CD | Cloud ComputingMid-level Full Time00000, US R2d ago
-
Senior Embedded Developer USD 190K-240KC# | C++ | Embedded C | Embedded Linux | Operating SystemsComp time | Dental insurance | Flexible work hours | Long-term disability | Medical insuranceSenior-level Full TimeFort Meade, MD, United States2d ago
-
Agentic AI Developer USD 125K-200KAI Security | AI guardrails | API Integration | Access Controls | Agentic AI401k match | Associate referral bonuses | Dental insurance | Flexible spending account | Health insuranceMid-level Full TimeDallas Office, United States2d ago
-
GIS Web AI Developer, Senior Associate USD 77K-202KArcGIS | Data Conversion | Data Visualization | Data integration | Environmental Management401k | Annual discretionary bonus | Dental insurance | Holiday pay | Medical insuranceSenior-level Full TimeHouston - 1000 Louisiana Street, United …2d ago
-
Altair | C++ | CI/CD | CUDA | Continuous integrationComprehensive benefits package | Performance bonusMid-level Full TimeNew York, New York, United States …3d ago
-
Algorithms | Asynchronous programming | C++ | C++17 | C++20Comprehensive benefits package | Fast-paced environment | Performance bonusMid-level Full TimeNew York, New York, United States …3d ago
-
Senior .NET Azure AI Developer USD 119K-258K.NET | AI Foundry | Application Insights | Authentication | Azure AISenior-level Full TimeBolivia; Colombia; Costa Rica; Peru4d ago
-
SOFTWARE ENGINEER – Algorithm Development - 7+ yrs of Experience - TS/SCI w/Poly clearance is required- RC - 306/309 A USD 181K-192KAlgorithm Development | C++ | Data queries | Database interfaces | Documentation401k retirement plan | Dental insurance | Floating holidays | Holidays | Life insuranceSenior-level Full TimeColumbia, United States5d ago
-
Sr Tableau Developer USD 110K-160KData Structures | Data Warehousing | Design Patterns | Predictive Analytics | SalesforceConfidentiality per EEO guidelines | End user training sessions | Training and documentationSenior-level Contract Full TimeTrenton, NJ, United States5d ago
-
Cloud/AI Developer USD 99K-223KAudit Logging | Authentication | Authorization | CI/CD | Cloud StorageSenior-level Full TimeRemote, US R5d ago
-
Gen AI Developer Specialist USD 105K-204KAI Evaluation | AWS | Access Management | Agents | Amazon BedrockSenior-level Full TimeUnited States5d ago
-
Senior-level Full TimeUSA, DC, Washington (200 MacDill Blvd), … R5d ago
-
Sr Embedded Software Developer USD 181K-254K800-53 | C# | C++ | Continuous Verification | Cryptography401k match | Education Support Program | Paid parental leave | Paid time off | Stock optionsSenior-level Full TimeCO - Littleton, United States5d ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Spark | Azure HDInsightRemote workSenior-level Full TimeUnited States - Remote R5d ago