Staff + Senior Software Engineer, Inference Deployment
San Francisco, CA | New York City, NY | Seattle, WA
R
USD 320K-485K Senior-level Full Time
Tasks
- Adapt in real-time
- Analyze observability data
- Autoscale compute fleet
- Build deployment pipelines
- Build distributed systems
- Design distributed systems
- Develop flexible systems
- Develop resilient systems
- Implement intelligent request routing
- Implement load balancing
- Implement traffic management
- Integrate AI accelerator platforms
- Maintain distributed systems
- Manage geographic routing
- Manage multi-region deployments
- Maximize compute efficiency
- Operate deployment pipelines
- Orchestrate workloads
- Release new models to users
- Support inference for model architectures
Perks/Benefits
Skills/Tech-stack
AWS | Autoscaling | Azure | Batching | Caching | Deployment Pipelines | Distributed Systems | GCP | Inference Optimization | Kubernetes | LLM Inference | LLM Inference Optimization | Load Balancing | Machine Learning | Observability | Orchestration | Python | Request Routing | Rust | Traffic Management
Education
Regions
Countries
States
Related jobs
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R16h ago
-
Senior Data Engineer (Data Architecture) USD 105K-135KAPIs | AWS Glue | Airflow | Azure Data | Azure Data Factory401k matching | Dental insurance | Extended holiday break | Flexible schedules | Life insuranceSenior-level Full TimeRemote, United States R17h ago
-
Data Engineer, Hardware Reliability (Starlink) USD 135K-185KBash | C# | C++ | Concurrency | Data InfrastructureExtended hours and weekends | Onsite work required | Travel up to 10%Mid-level Full TimeBastrop, TX R18h ago
-
Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R18h ago
-
Forward Deployed Engineer (Generative AI) USD 180K-230KAI Agent Builder | AI Pipelines | Agent Builder | Agent Developer Kit | Agentic designCareer development | Equal employment opportunities | Individual responsibilitySenior-level Full TimeAustin, Texas, United States - Remote R18h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Airflow | Anomaly DetectionSenior-level Full TimeNew York R19h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R19h ago
-
Sr. Staff Software Engineer, Big Data Platform USD 177K-364KAWS | Apache Flink | Apache Presto | Apache Spark | Data ProcessingIn office collaboration 1 to 2 times per quarterSenior-level Full TimePalo Alto; Seattle, WA; New York, … R19h ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | Apache Spark | Artificial Intelligence | B testingHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States R20h ago
-
Member of Technical Staff, Platform USD 120K-200KAI Agents | API Design | Amazon Web Services | Cloud Computing | Cloud platformDental insurance | Equity | Flexible work schedule | Health insurance | Paid time offSenior-level Full TimeMountain View, CA R20h ago
-
Software Engineer I, Perception (New Grad) USD 56K-56KATRT? NLP | Adaptive thresholding | Blender | C++ | CentroidingEntry-level Full TimeDenver, CO or Long Beach, CA R20h ago
-
Member of Technical Staff, Infra USD 140K-200KAI Development | AI development tools | AI/LLM | AI/LLM integrations | API DesignDental insurance | Equity | Flexible work schedule | Health insurance | Paid time offSenior-level Full TimeMountain View, CA R20h ago
-
Senior Software Engineer, Data Platform USD 193K-290KAccess Control | Airbyte | Amazon Redshift | Amazon Web Services | Anomaly DetectionSenior-level Full TimeNew York R20h ago
-
Senior Software Engineer, Data Platform USD 193K-290KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R20h ago
-
Senior Data Engineer USD 155K-165KAI tools | AWS | Airbyte | Airflow | Alerting401k match | Dental insurance | Employee resource groups | Holiday pay | Infertility coverageSenior-level Full TimeRemote - US R21h ago
-
DevOps Engineer, Data & AI Platform USD 144K-180KAWS | Apache Airflow | Apache Kafka | Apache Spark | Bash401k match | Backup care | Dental insurance | Disability insurance | Employee resource groupsMid-level Full TimeUnited States R21h ago
-
Senior Staff Machine Learning Engineer, Post Training USD 248K-310KData Processing | Fine Tuning | GPU Inference | Kernel development | LLM Fine-tuningSenior-level Full TimeRemote - USA R21h ago
-
Senior Engineer, Data USD 140K-161KAWS | AWS Lambda | Airflow | Amazon S3 | CI/CD401k match | Dental insurance | Employee discounts | Flexible schedule | HSA contributionSenior-level Full TimeUnited States R21h ago
-
AI Engineer USD 223K-259KAgent Orchestration | Agent systems | Async | CI/CD | Capacity Planning401k | Dental insurance | Disability insurance | Flexible spending accounts | Flexible time offMid-level Full TimeRemote (Washington D.C., Atlanta, San Francisco) R21h ago
-
Data Analyst 3- AI Solutions USD 84K-115KAI Agents | Amazon Web Services | Artificial Intelligence | Azure | Data PipelinesSenior-level Full TimeRemote, US R22h ago
-
Senior Data Engineer USD 109K-164KAccess Control | Agile | Azure | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Fully remote | Health spending account | Life insuranceSenior-level Full TimeRaleigh, North Carolina, USA R23h ago
-
Junior-Mid Level GCP Data Engineer USD 76K-80KBigQuery | Cloud Composer | Cloud Dataflow | Cloud Storage | Cloud platform401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilityEntry-level ContractChandler, Arizona, USA R23h ago
-
Jr-Mid Level GCP Data Engineer USD 76K-80KApache Flink | BigQuery | Cloud Composer | Cloud Storage | Cloud platform401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractPhoenix, Arizona, USA R23h ago
-
ML Engineer, I - MLOps Framework USD 96K-135KAWS SageMaker | CI/CD | Debugging | Infrastructure as Code | Logging100 percent paid medical dental vision premiums | 401k employer match | Bonus | Disability insurance | Flexible scheduleEntry-level Full TimeRemote - US R23h ago
-
Mid-level Full TimeBoston, MA R1d ago