Real-Time Inference Engineering Lead (FTE / Hybrid)
Tasks
- Build and operate scalable online inference services
- Configure autoscaling and capacity planning
- Create runbooks and incident response procedures
- Define deployment patterns for predictive models
- Design low latency model serving architecture
- Drive reliability improvements with root cause analysis
- Engineer Kubernetes serving platforms
- Implement observability and SLI SLO monitoring
- Implement secure REST APIs and gRPC APIs
- Mentor engineers and document reference implementations
- Perform performance load and failure testing
- Set up CI CD and automated validation
Perks/Benefits
- 401k match
- Dental insurance
- Employee assistance program
- Health insurance
- Life insurance
- Long-term disability
- Paid time off
- Short-term disability
- Vision insurance
Skills/Tech-stack
API Gateway | Argo CD | Authentication | Authorization | Autoscaling | CI/CD | Capacity Planning | Disaster Recovery | Disaster Recovery Planning | Distributed tracing | Error Budgets | Fault Tolerance | GKE | GRPC | Git | GitHub Actions | GitLab CI | Helm | High Availability | Infrastructure as Code | Ingress | Jenkins | Kubernetes | Latency optimization | Load Testing | Monitoring | Observability | OpenShift | Performance Engineering | Profiling | REST API | Rate Limiting | Recovery Planning | Resource Management | SLI | SLO | Service Mesh | Stress Testing | Telemetry | Terraform | Traffic Management | “as-code”
Education
N/A
Regions
Countries
States
Related jobs
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R21h ago
-
Senior Software Engineer - Frontend USD 130K-300KAI coding | AI coding tools | Algorithms | Coding Tools | Data StructuresCareer development opportunities | Community guilds | Employee stock purchase plan | Free mental health benefit | Hybrid work environmentSenior-level Full TimeNew York, New York, USA R23h ago
-
AI Integrations Staff Engineer USD 150K-230KAI Models | Agent SDKs | Back-end | Back-end development | Data ModelingAutomatic 401k contribution | Bi-annual company retreats | Employee referral program | Equity | Home office setupSenior-level Full TimeRemote R1d ago
-
.NET | AI Foundry | AI Services | Action Planning | Agent FrameworkContract-to-hire | GC sponsorship available | Hybrid work | US C sponsorship availableSenior-level ContractDallas, United States R1d ago
-
Senior-level Full TimeMiami, United States R1d ago
-
Lead Software Engineer (.Net Core + LLM's) USD 150K-225K.NET | AKS | ASP.Net Core | Airflow | Application Insights401k matching | Childcare assistance | Dental insurance | Disability insurance | Education reimbursementSenior-level Full TimeDallas, Texas, United States R1d ago
-
Senior Data Platform Engineer USD 180K-220KAKS | Airflow | Apache Spark | Azure | Azure SQL401k matching | Childcare assistance | Dental insurance | Disability insurance | Education reimbursementSenior-level Full TimeDallas, Texas, United States R1d ago
-
Argo CD | ArgoCD | CSI | CSI driver | FluxExecutive-level Full TimeRemote, USA, United States R1d ago
-
Senior Machine Learning Engineer USD 229K-360KA/B | A/B Testing | Amazon S3 | Amazon SageMaker | Apache AirflowDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California R1d ago
-
Senior Embedded Software Engineer USD 120K-160KAADL | ADA | ARINC 653 | Agile | Atlassian Bitbucket401k match | Career development | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeDenver, CO R1d ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Confluence | Atlassian Jira | Atlassian Suite | Bare Metal | Bitbucket401k match | Employee assistance program | Medical/Dental/Vision | Paid Holidays | Paid time offSenior-level Full TimeMarietta, GA R1d ago
-
Staff AI Engineer, GenAI USD 200K-230KAgentic AI | Apache Spark | Azure DevOps | Azure ML | CI/CDPaid caregiver leave | Paid sick leave | Paid vacationSenior-level Full TimeUSA - NY - Remote, United … R1d ago
-
SME Data Engineer USD 114K-252KAI integration | Automated testing | Big Data | CI/CD | Data EngineeringContinuing education | Flexible time off | Healthcare | Learning resources | Retirement benefitsSenior-level Full Time999 REMOTE, United States R1d ago
-
Engineer III - Platform Data Engineer (Remote) USD 120K-180KAWS | Access Management | Apache Airflow | Apache Superset | AzureCompetitive vacation and holidays | Employee networks and volunteering | Paid adoption leave | Paid parental leave | Professional development opportunitiesSenior-level Full TimeUSA NY Remote, United States R1d ago
-
Data Engineer, Senior USD 77K-176KAWS | Agile | Azure | Azure Data | Azure Data FactoryDependent care | Paid leave | Paid training | Professional development | Retirement benefitsSenior-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive … R1d ago
-
AI Platform Engineer USD 130K-180KAPI Gateway | AWS | Authentication | Authorization | AutoscalingCareer growth | Direct W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior AI/ML Engineer USD 145K-235KAI Services | API Integration | AWS | Agent Orchestration | Agent systems401k company match | Advancement opportunities | Collaborative work environment | Community support | Dental insuranceSenior-level Full TimePhoenix AZ, United States R1d ago
-
API Integration | Agentic AI | Artificial Intelligence | CI/CD | DevSecOpsMid-level Full TimeUnited States - Remote R1d ago
-
AI DevOps Technologist USD 99K-225KAI model | AI model governance | API Integration | Access Control | Access ManagementDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, VA, McLean (8285 Greensboro Dr, … R1d ago
-
C# | C++ | CI/CD | Cloud Storage | Compute Cloud401k match | Education assistance | Health care and wellness plans | Paid Holidays | Professional development programsNone Full TimeEl Segundo, United States R1d ago
-
Small Satellite Embedded Software Engineer USD 95K-165KBash | C# | CUDA | Containerization | Data Processing401k plan | Education assistance programs | Health care and wellness plans | Inclusive work environment | Paid HolidaysSenior-level Full TimeEl Segundo, United States R1d ago
-
AWS | AWS Batch | AWS CDK | Airflow | Amazon Bedrock401k | PTO | Paid HolidaysSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C plus plus | DDS | Data Ingestion | Debugging401k | Paid time offMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | CPU GPU | CPU/GPU Optimization | DDS401k | Healthcare benefits | Paid Company Holidays | Paid time offSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time off | Flexible work scheduleSenior-level Full TimeSan Diego, CALIFORNIA, United States R1d ago