Software Engineer 2
Tasks
- Collaborate with internal and external partners
- Deliver platform capabilities for customer and third party models
- Design and implement core inference infrastructure for production
- Design and implement load scheduling and balancing strategies
- Identify inference performance and efficiency improvements
- Scale inference platform for high availability
- Serve latest generative ai models in production
Perks/Benefits
- N/A
Skills/Tech-stack
Artificial Intelligence | Authentication | C# | C++ | Distributed Computing | Docker | Golang | HTTP | High Throughput | Java | Kubernetes | Language Models | Large Language Models | Layer 7 | Layer 7 Proxy | Load Balancing | Low Latency | Machine Learning | Machine Learning Inference | Microsoft Azure | Scheduling | Session management | System Architecture | TCP
Education
Roles
Related jobs
-
Algorithms | C++ | Computational lithography | Data Structures | Image ProcessingFinancial benefits | Health benefits | Wellness programsSenior-level Full TimeCalifornia, Sunnyvale4h ago
-
ANSYS Mechanical | Ansys Twin Builder | C++ | Controls | GazeboFinancial benefits | Health benefits | Remote work | Wellness benefitsEntry-level InternshipCalifornia, US (California) Off-Site4h ago
-
Software Engineer, Backend and Infrastructure USD 156K-316KAlerting | CI/CD | Database Design | Distributed Systems | HDFSMid-level Full TimeSan Jose, California, United States4h ago
-
Senior Software Engineer, Backend and Infrastructure USD 156K-387KAlerting | CI/CD | Cloud IDE | Database | HDFSSenior-level Full TimeSan Jose, California, United States4h ago
-
Benchmarking | Data Pipelines | Evaluation metrics | Interpretability | LLM EvaluationSenior-level Full TimeSan Jose, California, United States4h ago
-
Computer Vision | Data Processing | Deep learning | Feature Engineering | Language ModelsSenior-level Full TimeSan Jose, California, United States4h ago
-
Robotics Engineer - Autonomous Drone System USD 167K-230KAnalytics | Anomaly Detection | Autonomous Navigation | BVLOS | C++Senior-level Full TimeFremont, CA5h ago
-
Robotics Control Engineer - Manipulation USD 162K-240KABB Rapid | C++ | Calibration | Cause analysis | CommissioningSenior-level Full TimeMenlo Park, CA | Fremont, CA5h ago
-
Robotics Firmware & Electrical Engineer USD 170K-240KC# | C++ | CAN | Electrical layout | Embedded SystemsSenior-level Full TimeFremont, CA5h ago
-
Production Engineer USD 147K-208KAI workflow | AI workflow automation | Agent Orchestration | C++ | CDNSenior-level Full TimeMenlo Park, CA5h ago
-
Agent Orchestration | Benchmarking | Data Generation | Data Pipelines | EvaluationSenior-level Full TimeBellevue, WA | Menlo Park, CA …5h ago
-
Abuse prevention | Adversarial Machine Learning | Agentic Models | Benchmarks | Code reviewMid-level Full TimeMenlo Park, CA5h ago
-
Senior Research Software Engineer, Labs, AI/ML USD 174K-252KC++ | Data Structures | Data Structures and Algorithms | Deep learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA; Zürich, Switzerland5h ago
-
Software Engineer III, AI/ML, Google Cloud AI USD 147K-211KC++ | Data Processing | Debugging | GenAI | Google CloudSenior-level Full TimeSunnyvale, CA, USA5h ago
-
AI Agents | AppScript | Artificial Intelligence | Business Intelligence | Change ManagementSenior-level Full TimeSan Bruno, CA, USA5h ago
-
Staff Software Engineer, On-Device Machine Learning USD 207K-300KAndroid | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Engineering Analyst, AI, Safety USD 159K-231KAbuse detection | C++ | Data Analysis | Fine Tuning | Fraud DetectionEquity compensation | Health insurance | Mentorship | Paid time off | Retirement benefitsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA5h ago
-
Staff Software Engineer, Biglakes, BigQuery USD 207K-300KApache Arrow | Apache Flink | Apache Spark | Big Data | Big data analyticsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
Senior Software Engineer, ML Performance Infrastructure USD 174K-252KC# | C++ | Compute technology | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Software Engineer, Next Generation AI/ML Infrastructure USD 147K-211KC++ | Data Processing | Data Storage | Distributed Processing | Feature StoresMid-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Software Engineer, Jules AI, Labs, AI/ML USD 174K-252KAI infrastructure | Agent systems | Context engineering | Distributed Computing | Generative AISenior-level Full TimeMountain View, CA, USA; New York, …5h ago
-
Senior Software Engineer, Connect Sales, CRM, GenAI, Ads USD 174K-252KComputer Vision | Data Processing | Debugging | Distributed Computing | Generative AISenior-level Full TimeMountain View, CA, USA5h ago
-
Staff Software Engineer, Performance and Optimization USD 189K-303KAutomated testing | C# | C++ | EBPF | FtraceBonus | Equity compensation | Health benefits | Hybrid work environmentSenior-level Full TimeSeattle, Washington12h ago
-
Staff Software Engineer, Performance and Optimization USD 171K-273KAutomated testing | C# | C++ | Co-design | EBPFAnnual bonus | Benefits | Equity compensation | Hybrid work environmentSenior-level Full TimePittsburgh, Pennsylvania12h ago
-
Staff Software Engineer, Performance and Optimization USD 189K-303KAutomated testing | C plus plus | C# | EBPF | FtraceAnnual bonus | Benefits | Equity compensation | Hybrid work environmentSenior-level Full TimeMountain View, California12h ago