Principal Engineer, AI Inference Reliability
Remote, California, United States; Sunnyvale CA or Toronto Canada
R
USD 175K-260K (estimate) Senior-level Full Time
Tasks
- Architect reliability and observability
- Build dashboards and alerts
- Build reliability tooling
- Collaborate across teams
- Communicate reliability status
- Define and manage SLOs
- Define reliability strategy
- Design reliability mechanisms
- Implement distributed fault injection
- Implement failover
- Implement fault detection
- Implement graceful degradation
- Implement prevention loops
- Implement recovery
- Implement throttling
- Lead incident management
- Mentor engineers
- Monitor reliability metrics
- Perform chaos testing
- Perform root cause analysis
- Run load simulation
- Run postmortems
- Set reliability best practices
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | C++ | Cause analysis | Chaos Engineering | Dashboards | Distributed Databases | Distributed Fault Injection | Distributed Systems | Failover | Fault detection | Fault injection | Go | Graceful Degradation | Incident Response | Load Testing | Monitoring | Observability | Postmortem | Python | Recovery | Reliability Engineering | Root Cause Analysis | Root cause | Rust | SLA | SLI | SLO | Throttling
Education
Roles
Engineer | Lead | Principal | Principal Engineer | Reliability Tech Lead | Tech Lead
Related jobs
-
Embedded Hardware Systems Engineer USD 130K-150KAltium Designer | BLE | Bluetooth Low Energy | C# | C++401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee discountsMid-level Full TimeLos Angeles, CA, US R6h ago
-
Senior Embedded Engineer USD 150K-180KBluetooth Low Energy | C# | C++ | Cryptography | Embedded Systems401k matching | Corporate discounts | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeLos Angeles, CA, US R6h ago
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R11h ago
-
Data Platform Engineer USD 182K-240KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Kafka401k | Dental insurance | Family leave | Flexible paid time off | Free food and snacksSenior-level Full TimeOrlando, Florida, United States - Remote R13h ago
-
Senior Data Engineer IS - Remote USD 122K-208KAPI | API Integration | Access Control | Alerting | BashRemote work | Rotational on-call supportSenior-level Full TimeRenton, WA, United States R14h ago
-
Senior-level Full TimeUnited States - Remote R15h ago
-
Sr Data Engineer USD 115K-145KAWS S3 | Apache Airflow | Azure Blob | Azure Blob Storage | BigQuery401k | Dental insurance | Discounts | Fully remote | Health insuranceSenior-level Full TimeNew York, NEW YORK, United States R15h ago
-
Senior Staff Software Engineer, Data Platform USD 253K-298KAI Agents | Agent systems | Batch Processing | Change Data Capture | Compliance401k | Quarterly in person surges | Remote-firstSenior-level Full TimeRemote - USA R16h ago
-
Senior Software Engineer, Data Systems (Python) USD 170K-200KAPI Design | API Keys | Apache Airflow | Authentication | BigQuery12 Company Paid Holidays | 401k | Company-Paid Holidays | Flexible PTO | Healthcare benefitsSenior-level Full TimeRemote - USA R16h ago
-
AI/ML Security Engineer USD 102K-163KAPI Integration | AWS | Azure | Benchmarking | EvaluationCorporate holidays | Flexible time off | Group dental insurance | Group health insurance | Pet benefit optionMid-level Full TimeRemote R17h ago
-
Senior Staff Engineer - Senior Data Engineer USD 135K-165KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | DatabricksRemote workSenior-level Full TimeRemote, REMOTE, United States R17h ago
-
Staff Engineer - AI Engineer USD 110K-130KERP | Hugging Face | Langchain | MES | ModbusRemote workSenior-level Full TimeRemote, REMOTE, United States R17h ago
-
Principal AI Engineer USD 160K-220KAI Governance | API Design | AWS | AWS Bedrock | Agent OrchestrationSenior-level Full TimeUS - Remote R17h ago
-
Ads AI Analytics Lead II USD 131K-165KA/B | A/B Testing | Airflow | Anomaly Detection | B testingAnnual refresh grants | Equity grant | Flexible remote work | In-person eventsSenior-level Full TimeUnited States - Remote R17h ago
-
A/B | A/B Testing | Active Learning | Auto-labeling | B testingDental insurance | Dependent Care Account | Disability insurance | Flexible spending account | Flexible vacationMid-level Full TimeAnywhere, USA R17h ago
-
Batching | C# | C++ | CUDA | FP16Dental insurance | Disability insurance | Flexible spending account | Flexible vacation | Health insuranceMid-level Full TimeAnywhere, USA R17h ago
-
Senior AI/ML Engineer USD 160K-230KAgent systems | Agentic Systems | Data Pipelines | Docker | Driven systemsSenior-level Full TimeRemote, USA R17h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsSenior-level Full TimeFremont, California R17h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsBonus | Health insurance | Onsite work | Paid time offSenior-level Full TimeManteno, Illinois R17h ago
-
AI/ML Engineer II USD 159K-211KAPI Design | AWS | Agent Orchestration | Agent systems | AzureHealth benefits | Onsite collaboration | Paid time off | Professional developmentMid-level Full TimeRemote, USA R17h ago
-
Mid-level Full TimeHerndon, VA and/or Columbia, MD R17h ago
-
AI/ML Engineer USD 150K-211KAWS | Agent systems | Cloud platform | Data Pipelines | DockerOnsite schedule | WFH FridayEntry-level Full TimeRemote, USA R17h ago
-
Data Engineer USD 130KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CDEmployer paid medical/dental/vision | Flexible work | Health savings account | Life insurance | Remote work policyMid-level Full TimeRosslyn, VA or Remote R18h ago
-
Senior Data Engineer II, Finance USD 183K-232KAirflow | Amazon Redshift | Apache Iceberg | Apache Spark | AuditabilityFlex First work policy | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Computing | Containers | Fine TuningSenior-level Full TimeSeattle, Washington, USA R19h ago