Software Engineer 2
Tasks
- Collaborate with internal and external partners
- Deliver platform generic features
- Design and implement core inference infrastructure
- Enable fast time to market for GenAI models
- Implement load scheduling and balancing
- Improve end to end inference performance and efficiency
- Maintain high availability
- Scale platform for inference demand
- Serve GenAI models in production
Perks/Benefits
- N/A
Skills/Tech-stack
Authentication | C# | C++ | Distributed Computing | Docker | Golang | HTTP | High Throughput | Java | Kubernetes | Layer 7 | Layer 7 Network Proxies | Low Latency | Network Proxies | Online Systems | Session management | System Architecture | TCP
Education
Roles
Related jobs
-
Senior Software Engineer - AI Inference USD 160K-240KBatching | CUDA | Caching | Distributed Systems | High Performance401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York4h ago
-
Senior Software Engineer, AI/ML, Google Public Sector USD 174K-252KAlgorithms | C++ | Cloud Object Storage | Data Structures | Distributed ComputingSenior-level Full TimeReston, VA, USA5h ago
-
Staff Software Engineer, Intelligent Database Management USD 207K-300KAI | API Design | AlloyDB | Audit Logging | BigtableSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
C++ | Data Mining | Data Processing | Deep learning | Few-Shot LearningSenior-level Full TimeMountain View, CA, USA5h ago
-
Software Engineer III, AI/ML, Google Ads USD 147K-211KC++ | Data Processing | Debugging | Information Retrieval | Language ProcessingSenior-level Full TimeMountain View, CA, USA5h ago
-
Senior Data Engineer USD 140K-165KAI/ML | Apache Airflow | CRM Integration | Cloud Data | Cloud Data PlatformsSenior-level Full TimeNY, United States7h ago
-
Senior Staff Data Engineer USD 123K-185KAPI | Automated testing | Cloud platform | Data Analysis | Data GovernanceDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US8h ago
-
Staff Machine Learning Engineer USD 159K-309KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability coverage | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA15h ago
-
Staff Machine Learning Engineer USD 152K-261KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA15h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | C plus plus | CI/CD | Cloud infrastructure | Cluster managementSenior-level Full TimeNew York City, New York; San …15h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | CI testing | Cluster scheduling | Data Pipelines | Distributed SystemsSenior-level Full TimeNew York City, New York15h ago
-
Senior AI Solutions Engineer, Software Engineering USD 260K-325KAgentic Software | Agentic Software Engineering | Agentic Workflows | Benchmarking | Code generationCollaborative culture | Five days per week | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States; …16h ago
-
Principal, AI Platform Engineer USD 125K-187KAWS | Azure | CI/CD | Data leakage | Deterministic executionSenior-level Full TimeAtlanta, Georgia, US United States, 3034016h ago
-
Mid-level Full TimeCharlotte, United States16h ago
-
Agile | Alteryx | Data Engineering | Data Modeling | Data PipelinesBenefits | Paid time offMid-level Full TimeCharlotte, United States16h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Deep learning | Docker401k matching | Health insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeSan Francisco, CA, United States17h ago
-
AUTOSAR | Board Bring-up | Bring-up | C# | C++401k | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeNewark, CA18h ago
-
Robotics Integration Engineer USD 170K-250KAutomation | Behavior Trees | C++ | Control Systems | GitMid-level Full TimeSan Jose, CA18h ago
-
Staff Embedded Software Engineer USD 181K-248KAsynchronous Replication | BPFtrace | Block layer | C# | C++Equity | Learning and development stipend | PTO | Parental leave | Sick leaveSenior-level Full TimeLong Beach, California18h ago
-
Astrodynamics | C++ | Conjunction analysis | Embedded Systems | Estimation TheorySenior-level Full TimeChantilly, VA or Aurora, CO19h ago
-
Algorithms | Boost | C++ | Clang | Data StructuresRelocation assistanceSenior-level Full TimeRedlands, CA20h ago
-
Embedded Device Firmware Engineer USD 90K-128KAutomated testing | C# | C++ | CI/CD | Computer ArchitectureMid-level Full TimeSanta Clara, CA20h ago
-
Senior Embedded Systems Engineer USD 170K-226KACAP | Ansible | Bash | Cellular networking | DNS401k match | Dental insurance | Medical insurance | PTO | Sick days without limitSenior-level Full TimeChicago / Remote R20h ago
-
Staff Software Engineer, Data Engineering USD 130K-285KAirflow | Apache Flink | Data Modeling | Data pipeline | Distributed Computing401k matching | Basic life insurance | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA; Seattle, …21h ago
-
Robotics Software Engineer - Manufacturing Automation USD 140K-153KAI | Bazel | C++ | GRPC | KubernetesBonus | Equity | Health insurance | Paid time off | Performance bonusSenior-level Full TimeMountain View, California21h ago