Software Engineer, Search AI Infra Performance
Mountain View, CA, USA
USD 174K-252K Mid-level Full Time
Tasks
- Collaborate with machine learning research and software reliability teams
- Design tools and processes for large language model developer experience
- Ensure large language model and AI launch under latency capacity reliability constraints
- Optimize latency and throughput across search stack for large language models
- Optimize machine learning workloads using TPU and ML accelerators
Perks/Benefits
- N/A
Skills/Tech-stack
Data Processing | Debugging | Distributed Systems | Generative AI | Language Models | Language Processing | Large Language Models | Latency optimization | Machine Learning | Model Deployment | Model Evaluation | Model Optimization | Natural Language | Natural Language Processing | Performance Engineering | Search infrastructure | System Performance | System performance engineering | Throughput Optimization
Education
Roles
Regions
Countries
States
Language: en
Views:
1
Clicks:
0
Saves: 0
Related jobs
-
Forward Deployed Engineer, DeepMind USD 174K-253KAPI Integration | Benchmarking | Generative AI | JavaScript | Language ModelsMid-level Full TimeMountain View, CA, USA; New York, …13h ago
-
Software Engineer III, AI/ML, Retail Ads USD 147K-211KA/B | A/B Testing | B testing | C++ | Data StructuresSenior-level Full TimeMountain View, CA, USA13h ago
-
C++ | Co-design | Compilers | Data Analysis | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA13h ago
-
Software Engineer, Inference Platform USD 220K-260KC++ | CI/CD | Debugging | Distributed Systems | GoMid-level Full TimeSunnyvale, CA22h ago
-
Principal Software Engineer, Performance Tooling USD 139K-304KC++ | CUDA | Computer Architecture | DNN | Distributed SystemsSenior-level Full TimeRedmond, WA, US; Mountain View, CA, …1d ago
-
Deep Learning Quality Specialist USD 72K-90KAnnotation Guidelines | Computer Vision | Confluence | Convolutional Neural Networks | Data Annotation401k plan | Commuter benefits | Employee assistance program | Flexible PTO | Fully paid medical/dental/visionMid-level Full TimeSeattle, WA R1d ago
-
Senior-level Full TimeUnited States1d ago
-
Corporate AI Engineer USD 154K-200KAPI Integration | Access Control | Data Quality | Embeddings | Generative AIHybrid work schedule | Volunteer time offMid-level Full TimeAddison, TX (Hybrid); Bellevue, WA (Hybrid); … R1d ago
-
Staff Software Engineer, Inference Platform USD 180K-260KActive/Active | Alerting | C++ | CI/CD | DebuggingSenior-level Full TimeSunnyvale, CA1d ago
-
AI Solutions Engineer USD 110K-156KAPI Integration | AWS | Agentic AI | CI/CD | Cloud platformOccasional travel | Security clearance eligibilitySenior-level Full TimeRaleigh, NC, US1d ago
-
Cyber Security Engineer (AI Operations & Optimization) USD 129K-166KAPI Integration | Automation | Dashboards | Governance | Incident ResponseMid-level Full TimePhoenix, AZ1d ago
-
Distinguished Engineer - AI Data Engine USD 266K-396KAPI Design | AWS | Agentic AI | Azure | C++Employee stock purchase plan | Health insurance | Life insurance | Paid leave options | Paid time offSenior-level Full TimeSan Jose, CA, USA Office (SANJOSE)1d ago
-
Research Engineer, Domain Scaling USD 320K-485KBenchmarking | Data Curation | Data Quality | Data Quality Evaluation | Evaluation DesignFlexible working hours | Generous vacation | Optional equity donation matching | Parental leave | Visa sponsorshipMid-level Full TimeSan Francisco, CA | New York …1d ago
-
Mid-level Full TimeAnnapolis Junction, Maryland, United States1d ago
-
Analytics Engineer USD 120K-160KAPI Development | AWS | Azure | CI/CD | Containerization401k | Dental insurance | Medical insurance | Paid Holidays | Paid time offMid-level Full TimeBrooklyn, New York, United States1d ago
-
Senior Manager, Senior Data Engineer – Paid Marketing USD 117K-174KAWS | Analytics | Apache Airflow | Data Governance | Data Modeling401k plan | Accident insurance | Adoption expense reimbursement | Childcare discounts | Commuter benefitsSenior-level Full TimeBethesda, MD, United States1d ago
-
Senior / Staff Forward Deployed AI Engineer USD 150K-250KGenerative AI | Language Models | Large Language Models | Machine Learning | Neural NetworksDental insurance | Equity | Health insurance | Professional development | Vision insuranceSenior-level Full TimeSan Francisco, New York1d ago
-
Field Engineer, SWAT USD 180K-210KAnsible | Apache Airflow | Automation | Cloud Native | Cloud Native DataSenior-level Full TimeNew York City1d ago
-
Senior-level Full TimeUnited States1d ago
-
Agentic AI Data Engineer USD 100K-150KAPI Development | AWS | Data Governance | Data Lake | Data ModelingMid-level Full TimeUnited States1d ago
-
AI Observability | AWS | Azure | CI/CD | Cost ControlCareer advancement | Fully remote work | Professional development opportunities | Work-life balanceSenior-level Full TimeCanada R1d ago
-
Bias Testing | Explainability | Language Processing | MLOps | Machine LearningSenior-level Full TimeDallas, Texas, United States1d ago
-
Senior-level Full TimeLawrenceville, Georgia, United States1d ago
-
Machine Learning Engineer USD 90K-140KClassification | Clustering | Machine Learning | Model Evaluation | PyTorch401k | Educational assistance | Profit sharingMid-level Full TimeFranklin, Wisconsin, United States1d ago
-
Content Classification | Data-Driven Strategies | Data-driven | Deep learning | Graph Neural NetworksMid-level Full TimeSan Jose, California, United States1d ago