AI Inference Platform Engineer
Tasks
- Automate performance analysis workflows
- Build AI inference benchmarking systems
- Build tooling for real time performance insights
- Create data analysis pipelines
- Develop capacity projection models
- Forecast infrastructure capacity needs
- Implement performance monitoring and regression detection
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CI/CD | Data Pipelines | Data Visualization | Distributed Systems | GPU Profiling | Go | Grafana | Inference Server | Kubernetes | Machine Learning | Machine Learning Serving | Observability | Prometheus | Python | Splunk | Statistical Analysis | TensorRT-LLM | Triton Inference | Triton Inference Server | VLLM
Education
Related jobs
-
API Integration | Access Control | Automated Evaluation | BigQuery | CassandraEquity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Software Engineer, AI/ML, Google Cloud Platforms USD 174K-252KC++ | Data Processing | Language Processing | ML Infrastructure | Machine LearningSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …3h ago
-
Senior Data Application Engineer, Core USD 163K-236KCloud Data | Cloud data lakehouse | Data Contracts | Data Governance | Data LakehouseSenior-level Full TimeSan Jose, CA, USA3h ago
-
Software Engineer, GDC AI Applications and Agents USD 147K-210KAPIs | Cloud Computing | Data Structures | Data Structures and Algorithms | Distributed SystemsBenefits | Bonus target | EquityMid-level Full TimeSunnyvale, CA, USA3h ago
-
API Design | Autoscaling | Data analytics | Databases | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Data Structures | Data Structures and Algorithms | Embedding | Experimentation | Language ProcessingSenior-level Full TimeSan Bruno, CA, USA3h ago
-
Agile | C Test | C# | C++ | CANDental insurance | Disability coverage | Employer 401k contribution | Life insurance | Medical insuranceSenior-level Full TimeChillicothe, IL7h ago
-
Cloud infrastructure | Distributed Systems | GPU | JAX | Machine LearningMid-level Full TimeUnited States R8h ago
-
LLM Application Engineer USD 130K-175KAPIs | Agent Frameworks | Databases | Distributed Systems | EvaluationMid-level Full TimeUnited States R9h ago
-
Staff Software Engineer AI/ML USD 163K-253KA/B | A/B Testing | Autogen | B testing | Batched Inference401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environmentSenior-level Full TimeSan Jose, California, United States9h ago
-
Senior/Staff - Agent Platform (Cortex Code) USD 236K-309KApache Airflow | DBT | Data Analysis | Data Engineering | Data ModelingSenior-level Full TimeUS-CA-Menlo Park10h ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Kafka | Automated Ingestion | AzureConference presentations | Hackathons | Mentorship | Remote work | Training programsSenior-level Full TimeUnited States R11h ago
-
Machine Leaning Performance Engineer (Inference) USD 200K-300KC++ | CUBLAS | CUDA | CUDA C | CutlassFitness Events | Free meals | Hybrid work options | Paid time off | Volunteer opportunitiesMid-level Full TimeNew York R12h ago
-
Machine Learning Research Engineer USD 200K-300KAI Agents | API Design | Automation | Dask | Data pipelineHybrid work | Paid time off | Paid wellness expenses | Volunteer opportunities | Workshops and continuous learningMid-level Full TimeNew York R12h ago
-
Data Analytics Engineer USD 115K-165KAgile | DAX | Data Warehousing | Dimensional Modeling | ELT401k match | Dental insurance | Fashion discount | Flex Spending Account | Health insuranceMid-level Full TimeEdina, MN, US12h ago
-
AC power | Altium Designer | Analog Signal | Analog signal conditioning | Bare MetalIn-person position | US DoD Security Clearance SponsorshipSenior-level Full TimeAustin, TX, US13h ago
-
General Pipeline - FullStack Applied AI Engineer USD 150K-250KAWS | Access Control | Asynchronous programming | Authentication | AuthorizationSenior-level Full TimeUnited States R13h ago
-
Agent Orchestration | Agentic AI | Apache Airflow | Argo Workflows | Artifact versioning401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R13h ago
-
Staff, Advanced Analytics, Incubations USD 180K-221KA/B | A/B Testing | Attribution | Attribution Modeling | B testingSenior-level Full TimeUnited States R14h ago
-
Tech Lead Manager, Cortex AI - Snowflake Intelligence USD 200K-287KData Modeling | Experimentation | Function Calling | Go | Information RetrievalSenior-level Full TimeUS-CA-Menlo Park14h ago
-
Senior Software Engineer (Data & AI Solutions) USD 125K-156KAWS | Apache Airflow | Apache Spark | BAM | Bioinformatics401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R14h ago
-
Sr. Embedded Controls Engineer – Scanning Systems USD 140K-175KADC | BLDC | Brushed DC | C# | Domain analysisSenior-level Full TimeMountain View, CA14h ago
-
AI | Apache Cassandra | Caching | Capacity Planning | Data ModelingField testing opportunities | Hybrid work model | Offsite collaborationMid-level Full TimeSan Francisco, CA; Los Angeles, CA; …14h ago
-
C# | C++ | Embedded Systems | Go | JavaSenior-level Full TimeCupertino15h ago
-
Staff Software Engineer, Backend (Online Storage) USD 230K-290KAWS | Capacity Planning | Database Benchmarking | Disaster Recovery | Distributed SQLDental and vision coverage | Employee stock purchase plan | Flexible spending wallets | Health care coverage | Remote work flexibilitySenior-level Full TimeRemote US R15h ago