AI Infrastructure Engineer - Recommendation & LLM
San Jose, California, United States
USD 160K-220K (estimate) Senior-level Full Time
Tasks
- Conduct performance benchmarking and production rollout
- Design AI training and online inference infrastructure
- Develop distributed training and serving systems
- Identify and resolve AI stack performance bottlenecks
- Implement LLM training and inference infrastructure
- Improve latency throughput and GPU utilization
- Mentor junior engineers
- Optimize model performance across GPU and runtime
- Productionize new model architectures and algorithms
Perks/Benefits
- N/A
Skills/Tech-stack
Algorithms | C++ | CUDA | CUDA graph | Computer Architecture | Continuous batching | Data Structures | Data parallelism | Distributed Systems | FSDP | FlashAttention | GPU Kernels | GPU Programming | High Performance | High-Performance Computing | KV cache | Machine Learning | Model Parallelism | Networking | Operating Systems | Performance Computing | Pipeline parallelism | PyTorch | Python | Speculative decoding | Tensor Parallelism | TensorFlow | Triton | Zero
Education
Related jobs
-
C++ | Computer Vision | Deep learning | Domain Adaptation | FlinkCareer growth opportunities | Onboarding supportEntry-level Full TimeSan Jose, California, United States14h ago
-
Apache Flink | Apache Hive | Apache Spark | C++ | Computer VisionComplex problem solving | Growth opportunities | Team collaborationEntry-level Full TimeSeattle, Washington, United States14h ago
-
Research Engineer, Synthetic Data Generation USD 141K-208K3D Geometry | Avatar Rendering | C++ | Computer Graphics | Computer VisionCross-functional collaboration | Mentoring opportunitiesSenior-level Full TimeBurlingame, CA14h ago
-
Software Engineer, Search Platforms, GenAI Content USD 262K-364KComputer Vision | Data Processing | Debugging | Deep learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA15h ago
-
Resource Optimization and Fleet Logic Technical Lead USD 262K-364KC++ | Capacity Planning | Cloud Computing | Distributed Systems | Language ModelsSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Software Engineer III, Generative AI, Core USD 147K-210KCode review | Debugging | Distributed Computing | Generative AI | Language ModelsSenior-level Full TimeSan Jose, CA, USA15h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-221KAnalytics Warehousing | Apache Spark | Batch Processing | Big Data | Cloud ComputingSenior-level Full TimeReston, VA, USA; Washington D.C., DC, …15h ago
-
Research Engineer, Serving Quality, DeepMind USD 174K-252KC++ | JAX | Machine Learning | Python | StatisticsSenior-level Full TimeMountain View, CA, USA15h ago
-
AI Developer USD 36K-40KAPI Integration | Chatbot | Conversational AI | Data Analysis | Flow DesignerRemote work flexibilityMid-level Full Time Part TimeAnywhere - US (Remote/Work from Home), …17h ago
-
Embedded Systems Engineer USD 90K-120KAUTOSAR | Automated testing | C++ | CAN | CANoe401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeChillicothe, IL17h ago
-
Senior Machine Learning Engineer USD 171K-270KAWS | Agentic Systems | Amazon EKS | Azure | CI/CD25 annual days of vacations | Coffee and fruit | Flexible working hours | Gym allowance | Health insuranceSenior-level Full TimeLisbon IT Campus - Swiss Post17h ago
-
Senior Full Stack AI Developer USD 125K-185KAWS | Application development | Azure | CI/CD | Cloud EngineeringEmployee benefits | Government security clearance assistance | Remote workSenior-level Full TimeWork from home, VA, United States17h ago
-
Mid-level Full TimeARLINGTON, VA, United States17h ago
-
A/AI Machine Learning Engineering Sr - E3 USD 110K-204KA Star | C++ | CUDA | Computer Vision | Database401k match | EAP | Education assistance | Flexible spending accounts | Flexible work arrangementsSenior-level Full TimeVirtual Two, CO, US21h ago
-
AI Software Engineer USD 91K-169KAgile | Bash | C++ | Cloud Computing | Containers401k match | Dental insurance | Education assistance | Employee assistance program | Flexible schedulesMid-level Full TimeManassas, VA, US21h ago
-
Software Engineer Algorithms and Analysis USD 98K-182KADA | C++ | Cameo | Java | MATLAB401k match | Education assistance | Flexible work arrangements | Holidays | Paid time offMid-level Full TimeHuntsville, AL, US21h ago
-
Software Engineer Algorithms & Analysis USD 81K-150KADA | C++ | Linux | MATLAB | Modeling and Simulation401k match | Dental insurance | Education assistance | Employee assistance program | Flexible work arrangementsMid-level Full TimeHuntsville, AL, US21h ago
-
Entry-level Full TimeCambridge, MA, Arlington, VA, Seattle, WA22h ago
-
Entry-level Full TimeCambridge, MA22h ago
-
Senior-level Full TimeCambridge, MA22h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R1d ago
-
Applied Research Scientist, AI Research USD 261K-299KAudio Compression | Audio Synthesis | Computer Vision | Deep learning | Generative Modeling401k matching | Catered lunches | Flexible vacation | Health insurance | Hybrid work optionsSenior-level Full TimeSan Francisco; Hybrid or Remote R1d ago
-
Data Scientist Graduate Co-op USD 76K-125KAgile | Artificial Intelligence | Computer Vision | Data Modeling | Data VisualizationAgile work environment | Collaborative team cultureEntry-level Full TimeCambridge, MA, Arlington, VA1d ago
-
Staff Machine Learning Engineer, Financial Connections USD 212K-318KApache Spark | Data Pipelines | Language Models | Large Language Models | Machine LearningSenior-level Full TimeNew York1d ago
-
Agentic Workflows | Airflow | Backend APIs | CI/CD | CQRSSenior-level Full TimeSunnyvale1d ago