Staff + Sr. Software Engineer, Cloud Inference
Tasks
- Analyze observability data to identify bottlenecks and cost anomalies
- Build CI CD validation and deployment pipelines
- Create interfaces and tooling abstractions across CSPs
- Design backend services and infrastructure for cloud inference across CSPs
- Integrate with internal teams and CSP partners to launch serving stack
- Plan capacity and autoscaling for inference workloads
- Route workloads to cost effective accelerators and regions
Perks/Benefits
Skills/Tech-stack
Autoscaling | CI/CD | Cost Optimization | Infrastructure as Code | Kubernetes | Load Balancing | Multi-region | Multi-region deployment | Observability | Python | Region deployment | Rust | Workload routing | “as-code”
Education
Regions
Countries
States
Related jobs
-
Data Engineer II USD 145K-165KAWS | Agile | Apache Airflow | Apache Spark | CI/CD401k match | Company-provided phone | Extended leave | Generous PTO | Health insuranceMid-level Full TimeNew York, New York, United States14h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | Mentorship opportunities | On-call supportSenior-level Full TimeOrlando, FL, United States R17h ago
-
Senior Data Engineer USD 140K-160KAirflow | Apache Spark | Auto Loader | CI/CD | Change Data Capture401k | Paid leave | Tuition reimbursementSenior-level Full TimeNorth Hollywood, CA, United States17h ago
-
Senior Data Engineer – Hardware & Supply Chain USD 147K-203KAWS | Apache Iceberg | DBT | Data Governance | Data ModelingFlexible wellness time off | Paid Holidays | Paid sick leave | Paid time off | Parental leaveSenior-level Full TimeHybrid - San Francisco, California R17h ago
-
Mid-level Full TimeMiami Lakes, FL, United States19h ago
-
Robotics Software Intern – Real-Time Controls USD 80K-116KActuators | C++ | Control Systems | Coordinate systems | EncodersEntry-level InternshipAustin, TX19h ago
-
Hive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States19h ago
-
Senior AI Engineer USD 193K-240KAPI | Access Control | Audit Logging | CI/CD | Cloud Native401k employer match | Dental insurance | Dependent care FSA | Employer paid commuter benefit | Flexible time offSenior-level Full TimeDallas, Texas, United States20h ago
-
Agile | Calculus | Classification | Linear Algebra | Machine LearningSenior-level Full TimeMc Lean, VA, United States22h ago
-
Agile | Amazon Web Services | As-a-Service | Calculus | ClassificationMid-level Full TimeTysons, VA, United States22h ago
-
Algorithms | Data Structures | Java | JavaScript | LLM toolsSenior-level Full TimeMc Lean, VA, United States22h ago
-
AWS | Autogen | Automated testing | Azure | CI/CDOnsite workSenior-level ContractDallas, United States23h ago
-
Databricks Engineer USD 97K-162KAPI Integration | Agile | Data Governance | Data Modeling | Data QualityMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …1d ago
-
Data Scientist, Innovation Hub USD 108K-108KAudit Logging | Azure | CI/CD | Federated identity | Integration TestingCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd1d ago
-
Databricks Engineer USD 107K-179KAPI Integration | Agile | Cloud Computing | Data Governance | Data ModelingTravel 10 to 15 percentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …1d ago
-
Senior Data Engineer USD 133K-158KAKS | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeCincinnati, Ohio, United States1d ago
-
Associate BI Analytics Engineer USD 98K-163KDAX | Data Modeling | Data Warehousing | Databricks | ELTMid-level Full TimeUSA-VA-Herndon1d ago
-
Senior Software Engineer - Data & Analytics Federation USD 160K-240KApache Arrow | Asynchronous frameworks | C++ | Distributed Systems | Linux401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimePrinceton1d ago
-
Data Engineer, Employee Technology Support USD 110K-130KCause analysis | Data Governance | Data Modeling | Data Monitoring | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York1d ago
-
AI orchestration | Alerting | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Savings plan options | Vision insuranceSenior-level Full TimeSan Francisco, CA, United States R1d ago
-
A/B | A/B Testing | APIs | Anthropic | B testingDental insurance | Medical insurance | PTO | Remote | Savings plan optionsMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Alerting | Batching | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Remote work | Savings planMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Security Engineer III - AI/ML USD 170K-215KAPI Development | AWS | Anomaly Detection | Azure | BERTSenior-level Full TimePlano, TX, United States1d ago
-
Agent Orchestration | Bias Mitigation | Data Structures | Data Structures and Algorithms | Graph theorySenior-level Full TimeSunnyvale, CA | Bellevue, WA | …1d ago
-
Staff Software Engineer, Search Local Ads Data Platform USD 207K-301KArtificial Intelligence | C++ | CSS | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago