Machine Learning Infrastructure Engineer
San Jose, California, United States
USD 140K-165K Senior-level Full Time
Tasks
- Build dashboards tracing logging alerting
- Build internal AI infrastructure
- Create APIs SDKs and platform abstractions
- Develop AI Ops evaluation and release readiness
- Develop model gateways and routing
- Implement telemetry and controls for safe execution
- Optimize performance using caching batching failover
- Own inference deployment paths
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alerting | Batching | Caching | Cost Optimization | Evaluation | Failover | GCP | Incident Response | Inference | LLM | Latency optimization | Logging | MLOps | Machine Learning | Observability | Python | Retrieval | Routing | Telemetry | Tracing
Education
N/A
Related jobs
-
AI | Automation | Data Governance | Data Management | Data OperationsSenior-level Full TimePrinceton3h ago
-
Data Engineer USD 128K-214KAWS Glue | AWS GovCloud | Apache Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeUSA-FL-Doral3h ago
-
Software Engineer III - Java/Python - Learn AI / LLM USD 176K-195KAgile | Amazon Web Services | Application Resiliency | Artificial Intelligence | Automated testingSenior-level Full TimeNew York, NY, United States4h ago
-
Software Engineer, SystemML - AI Networking USD 170K-251KC# | C++ | CUDA | Data-parallel | Distributed Data ParallelMid-level Full TimeMenlo Park, CA4h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KC plus plus | Computer Vision | Deep learning | Distributed Computing | Few-Shot LearningMid-level Full TimeSan Jose, CA, USA5h ago
-
Forward Deployed Engineer V, Generative AI, Google Cloud USD 262K-365KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …5h ago
-
Automation | C# | C++ | CSS | Database DesignMid-level Full TimeAnn Arbor, MI, USA5h ago
-
Research Engineer, Robotics Applications, DeepMind USD 174K-253KComputer Vision | Deep learning | Isaac Sim | Language Models | Language ProcessingPublishing opportunities | Research collaboration | Travel opportunityMid-level Full TimeMountain View, CA, USA5h ago
-
Principal Consultant, AI/ML, Mandiant, Google Cloud USD 168K-244KAI Evaluation | Agent systems | Cloud APIs | Cybersecurity | Data leakageSenior-level Full TimeReston, VA, USA; United States5h ago
-
Senior Product Engineer, Machine Learning Accelerators USD 144K-209KBash | Board assembly | Cause analysis | Circuit board assembly | Continuous ProcessSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Software Engineer, Eye Tracking USD 174K-253KAlgorithms | Android | Android Application Development | Android application | Application developmentSenior-level Full TimeSan Jose, CA, USA5h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA5h ago
-
Lead Data Engineer USD 110K-170KAWS Athena | AWS Glue | AWS Lambda | AWS S3 | Amazon AuroraDistance based relocation assistance | Employee assistance program | Employee business networks | Enhanced 401k | Flexible work hoursSenior-level Full TimeHolyoke, MA, 01040, USA7h ago
-
Senior-level Full TimeSan Jose, California, United States11h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-408KData Science | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Health insurance | Life insurance | Paid time off | Parental leaveSenior-level Full TimeNew York, New York12h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Distributed Systems | Experimentation | Feature Engineering | JavaDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts12h ago
-
Principal Software Engineer, Perception Pretraining USD 349K-431KC++ | Compute Optimization | Computer Vision | End to End | End-to-end modelingCompany benefits | Discretionary annual bonus | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, …13h ago
-
Senior Software Engineer, Quantitative Evaluations USD 204K-259KA/B | A/B Testing | B testing | C++ | Data PipelinesAnnual bonus program | Company benefits | Equity incentive plan | Hybrid work scheduleSenior-level Full TimeMountain View, CA, USA; San Francisco, …13h ago
-
Technical Lead Manager (TLM), ML Simulation USD 238K-302KAnomaly Detection | C++ | Data Processing | Deep learning | Hugging FaceBonus program | Company benefits program | Equity incentive plan | Hybrid work scheduleSenior-level Full TimeNew York, NY, USA; Mountain View, …13h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | Business Intelligence | DBT | Data Architecture | Data Engineering401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R13h ago
-
API Integration | API Security | Authentication | CI/CD | Cloud NetworkingAnnual performance bonus | Career growth | Fully remote workSenior-level Full TimeCanada R15h ago
-
Software Engineer, Developer Platforms and Generative AI USD 110K-130KAPI Development | Amazon Web Services | CI/CD | Claude Code | Cloud platformMid-level Full TimeNew York, NY15h ago
-
Cloud Engineer - Data USD 100K-140KAnalysis Services | Apache Spark | Azure Blob | Azure Blob Storage | Azure Cost Management401k savings plan | Education reimbursement | Gym access | Medical, dental, life insurance | PTOMid-level Full TimeNational Harbor, Maryland15h ago
-
Mid-level Full TimeMountain View, California, United States16h ago
-
Mid-level Full TimeSan Francisco, California, United States16h ago