Technical Support Engineer (Inference) - US Weekends
Tasks
- Debug REST APIs and HTTP issues
- Diagnose network layer problems and read traces
- Escalate issues with data backed analysis
- Execute infrastructure changes via pull requests
- Flag engine level bugs with logs and repro steps
- Identify patterns in support cases and recommend roadmap changes
- Implement model deployment capacity scaling changes
- Maintain inference endpoint stability and performance
- Maintain system documentation and troubleshooting guides
- Manage incident communications
- Monitor Kubernetes inference endpoints
- Resolve customer technical incidents
- Route and verify customer traffic
- Validate system health during migrations
Perks/Benefits
Skills/Tech-stack
AWS | Ansible | Azure | Capacity scaling | Container Infrastructure | Curl | Fine Tuning | GCP | GPU clusters | Git | Git-based workflows | Grafana | HPC | HTTP | HTTP Semantics | Infrastructure as Code | JavaScript | Kubernetes | LLM Inference | LoRA | Model Deployment | NFS | Network Troubleshooting | Observability | Postman | Prometheus | Python | REST APIs | Security Hardening | Slurm | Storage management | Tracing | TypeScript | “as-code”
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R4h ago
-
AI Risk Management Framework | Adversarial Machine Learning | Adversarial Robustness | Adversarial Robustness Toolbox | Adversarial TrainingCareer growth | Flexible work environment | Fully remoteSenior-level Full TimeCanada R4h ago
-
Alerting | Batch Processing | Big Table | Data Modeling | Data ObservabilityFully remote | Inclusion and collaboration culture | Professional growth opportunities | Well-being support | Work-life balance initiativesMid-level Full TimeIndia R5h ago
-
AI Assisted Development | AI-Assisted Development Tools | API Design | Automation | Development toolsBirthday day off | Comprehensive healthcare coverage | Continuous training opportunities | Extended paternity leave | Financial support programsMid-level Full TimeBrazil R5h ago
-
API Integration | Asynchronous processing | Authentication | Celery | DjangoFlexible, async culture | Founding team opportunity | Fully remote | High ownership | Influence on product directionSenior-level Full TimeBrazil R5h ago
-
AI/ML Customer Engineer SGD 175K-225KAgentic Workflows | Air-gapped | Air-gapped networks | C# | C++Access to emerging hardware technologies | Open Source contribution | Remote work flexibility | Technical career growthSenior-level Full TimeSingapore R8h ago
-
Mid-level Full TimeLeeds/Sheffield/Manchester, UK (Hybrid) R10h ago
-
Anomaly Detection | Data Engineering | Data Lakes | Data Pipelines | Data ProcessingRegular team sessions | Remote friendly schedule | Team collaborationSenior-level Full TimeRemote, Canada (EST); San Francisco, California R11h ago
-
C++ | Compiler design | Computer Architecture | Linux | Machine LearningHealth insurance | Hybrid work model | Life insurance | Paid time off | Retirement savings matchSenior-level Full TimeRemote, Canada R11h ago
-
Aerospike | Ansible | Capacity Planning | Ceph | Configuration ManagementSenior-level Full TimeRemote, Canada; Toronto, Ontario; San Francisco, … R11h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R11h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R11h ago
-
Agile | Cloud Storage | Google Cloud | Google Cloud Storage | GraphQLMid-level Full TimeSan Francisco, California; Remote, Canada, US, … R11h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R11h ago
-
AI | AWS | Apache Kafka | Azure | C#Collaborative culture | Fully remote | Leadership opportunitySenior-level Full TimeRemote, Toronto R11h ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R11h ago
-
Senior-level Full TimeRemote, Canada; Remote, Canada; Toronto, Ontario; … R11h ago
-
AWS | Azure | Data Analysis | Data Visualization | Deep learningMid-level Full TimeRemote, Canada; San Francisco, California; Toronto, … R11h ago
-
Data Curation | Experimentation | MLOps | Machine Learning | Machine learning modelingSenior-level Full TimeToronto, Canada; Remote, Canada; Kitchener, Ontario; … R11h ago
-
Data Warehousing | Deep learning | Experimentation | Infrastructure | LLMSenior-level Full TimeRemote, Canada or US; Remote, Canada … R11h ago
-
Senior-level Full TimeCanada or US, N/A; Toronto, Ontario; … R11h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R11h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Kitchener/Waterloo, Ontario; Remote, Canada … R11h ago
-
Anomaly Detection | Classification | Clustering | Data Modeling | Data PipelinesHealth benefits | Hybrid work arrangement | Paid time off | Professional developmentSenior-level Full TimeToronto, Ontario; Kitchener, Ontario; The Valley, … R11h ago