Staff + Sr. Software Engineer, Cloud Inference Launch Engineering
Tasks
- Analyze observability data and remediate bottlenecks cost anomalies regressions
- Design build and own CI CD infrastructure
- Drive faster merge to production cycle time
- Identify and fix cross platform inference behavior gaps
- Integrate inference features into production
- Launch new model architectures on cloud platforms
- Own inference change validation pipeline
- Run shadow traffic and correctness checks
- Set performance baselines throughput and latency
Perks/Benefits
Skills/Tech-stack
Batch scheduling | Batching | CI/CD | Caching | Capacity Planning | Container Orchestration | Global traffic management | Infrastructure as Code | Kubernetes | Load Balancing | Multi-region | Multi-region deployment | Observability | Performance Tuning | Prompt Caching | Python | Region deployment | Request Routing | Rust | Structured Sampling | Traffic Management | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R5d ago
-
Staff ML Engineer, StockStory USD 140K-160KCNN | Deep learning | Embeddings | Human-in-the-loop | Information ExtractionDaily group classes | Daily specials | Dry cleaning | Free onsite fitness center | Free shuttle transportationSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States9h ago
-
Staff Engineer, Data Analysis (R5290) USD 121K-197KAnomaly Detection | Automated Validation | Cloud Storage | Communications | DashboardsSenior-level Full TimeUnited States9h ago
-
Staff Research Engineer, Discovery Team USD 350K-850KArtificial Intelligence | Cloud deployment | Containerization | Data Pipelines | Distributed SystemsFlexible remote work policy | Flexible working hours | Generous vacation | Parental leave | Visa sponsorship assistanceSenior-level Full TimeSan Francisco, CA10h ago
-
C++ | Deep learning | Distributed Training | ETL Pipelines | GoSenior-level Full TimeMountain View, CALIFORNIA, United States10h ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States10h ago
-
Data Visualization Engineer USD 90K-112KArcGIS | Cartography | D3 | Data Visualization | GDALCommuter benefits | Employee assistance program | Health savings account | Home office reimbursement | LinkedIn Learning accessMid-level Full TimeSan Francisco, CA R11h ago
-
Senior Storage Engineer USD 145K-170KCapacity Planning | Cause analysis | Cloud Platforms | Data center | Distributed file systems401k match | Dental insurance | Employee assistance program | Health insurance | Health savings accountSenior-level Full TimeRemote, Texas R13h ago
-
Cyber Data Analysis Engineer 718 USD 110K-170KAWS | ArcSight | Bash | Citrix XenServer | Configuration Management401k matching | Flexible work environment | Fully paid medical | Life and disability insurance | Paid time offMid-level Full TimeSt. Louis, MO13h ago
-
Data Operations & Analytics Associate USD 100K-130KAutomation | DBT | Data Modeling | Data Pipelines | Data WarehousingMid-level Full TimeBoston14h ago
-
Data Engineer I - Data 360 USD 87K-129KAPIs | Calculated Insights | Data Governance | Data Modeling | Data Quality401k match | Flexible PTO | Health insurance | Parental leaveMid-level Full TimeMorrisville, United States14h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-200KAPI Testing | Cloud Computing | Cypher | Data Processing | Data QualityProfessional growth | Remote work | Travel opportunitiesSenior-level Full TimeReston, VA, United States R14h ago
-
Staff Analytics Engineer USD 125K-254KBusiness Logic | DBT | Data Architecture | Data Modeling | Data WarehouseSenior-level Full TimeRemote, USA R14h ago
-
Cloud Data Engineer II USD 107K-150KAWS | AWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDBMid-level Full TimeMiami Lakes, FL, United States15h ago
-
Supply Chain Applied AI Engineer USD 200K-300KAI architecture | API Integration | Data Connectivity | Generative AI | Incident ResponseSenior-level Full TimeAuburn Hills, MI, United States16h ago
-
Senior-level Full TimeMiami17h ago
-
Senior-level Full TimeSan Francisco17h ago
-
AI Engineer (Agents) USD 160KAI SDK | Adversarial Testing | Arize Phoenix | Asynchronous programming | CI/CDSenior-level Full TimeNew York17h ago
-
Agentic AI Engineer USD 101K-151KAgentic Workflows | Debugging | Embeddings | Git | GitHubFinancial benefits | Health benefits | Wellness benefitsMid-level Full TimePennsylvania, Canonsburg18h ago
-
Full-Stack Computer Scientist (Senior-Level) USD 82K-138K.Net Core | .Net Framework | Agile | Azure PaaS | C#Certification reimbursement | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeSierra Vista, AZ, United States19h ago
-
Senior-level Full TimeSan Francisco, California, United States19h ago
-
AI | AI Inference | CPU | Containers | GPUSenior-level Full TimeSeattle, Washington, United States20h ago
-
Senior Software Engineer, Cross Platform Applications USD 212K-387KArtificial Intelligence | Automation | CI/CD | Code Analysis | Dynamic analysisSenior-level Full TimeSan Jose, California, United States20h ago
-
Software Engineer (Leadership) - Infrastructure USD 160K-210KAI workflow | AI workflow automation | Agent Orchestration | Bias Mitigation | C plus plusSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …21h ago
-
Software Engineer, Sensors & Computer Vision USD 146K-208K3D Reconstruction | C++ | Camera | Clustering | Convolutional Neural NetworksMid-level Full TimeSunnyvale, CA21h ago