Staff Software Development Engineer (LLM)
Tasks
- Architect LLM request response monitoring
- Build scalable low latency LLM pipeline
- Design secure APIs
- Detect LLM usage anomalies
- Detect denial of service attacks
- Develop monitoring logging and alerting
- Develop secure backend systems
- Ensure on-time feature delivery
- Implement prompt injection defenses
- Implement secure microservices platform features
- Mentor junior engineers
- Optimize databases and caching for threat detection
- Prevent unauthorized data leakage
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Health insurance
- Leave Program
- Life insurance
- Paid Holidays
- Sick time
- Vacation time
- Vision insurance
Skills/Tech-stack
API Security | AWS | Alerting | Application Security | Azure | Bias detection | C# | C++ | Caching | Data Pipelines | Data Protection | Data poisoning | Database optimization | Docker | Fact-checking | GCP | Hugging Face | Hugging Face Transformers | Kubernetes | Langchain | Logging | Microservices | Monitoring | Network Protocols | OWASP | Policy enforcement | Privacy | Prompt injection | PyTorch | Python | RAG | Responsible AI | Retrieval-Augmented Generation | Streaming Data | Streaming data pipelines | TensorFlow | Vector Databases
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Angular | Azure Databricks | CI/CD | Cloud platformRemote workMid-level Full TimeWork from home, VA, United States R7h ago
-
Senior Full Stack AI Developer USD 125K-185KApplication development | Batch | Cloud Engineering | Continuous Delivery | Continuous integrationHealth benefits | Remote workSenior-level Full TimeFairfax, VA, United States R7h ago
-
Senior Data Engineer (Remote) USD 120K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data RefreshEqual opportunity employer | Remote workSenior-level Full TimeUnited States R8h ago
-
AI Software Engineer USD 107K-195KAWS CloudFormation | AWS Lambda | Amazon Web Services | CI/CD | Cloud Computing401k match | Dental insurance | Holiday pay | Medical insurance | Paid time offSenior-level Full TimeChantilly, VA, United States9h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Amazon Web Services | Anomaly Detection | CI/CD | Causal analysisMentorship | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States11h ago
-
Senior RT Embedded Developer USD 107K-180KC# | C++ | Design Patterns | Linux | Object-OrientedOn-site work | Travel for integration activitiesSenior-level Full TimeCenter, Center District, IL11h ago
-
Model Operations Engineer USD 107K-179KALiBi | AWS SageMaker | Amazon Lambda | Apache Airflow | AzureHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn11h ago
-
Senior-level Full TimeRTP, North Carolina, USA Office (NOCAROLINA)11h ago
-
AWS DMS | AWS Database | AWS Database Migration Service | AWS VPC | AWS database migrationSenior-level ContractAustin, United States12h ago
-
AI Search | API Design | API Integration | Azure AI | Azure AI LanguageSenior-level ContractColumbus, United States12h ago
-
AI/LLM Network Software Development Engineer Graduate (High Speed Network) - 2026 Start (PhD) USD 148K-300KAI | Data center | Data center networking | High Performance | High-performance networkingEntry-level Full TimeSeattle, Washington, United States12h ago
-
Computer Vision | Data parallelism | Deep learning | Distributed Training | Model AccelerationSenior-level Full TimeSeattle, Washington, United States12h ago
-
Software Development Engineer - AI/LLM Network - Global Frontier Tech Research Program - 2027 Start (PhD) USD 202K-368KAI infrastructure | C++ | Cause analysis | Elastic scaling | Fault LocalizationEntry-level Full TimeSeattle, Washington, United States12h ago
-
Distributed Systems | Inference | Machine Learning | Model Serving | MonitoringSenior-level Full TimeSan Jose, California, United States12h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 275K-450KAlgorithm Optimization | Code review | Data Pipelines | Deep learning | Infrastructure OptimizationSenior-level Full TimeSan Jose, California, United States12h ago
-
Machine Learning Engineer (Multiple Positions) USD 174K-316KData Pipelines | Deep learning | Linux | Machine Learning | Model ServingMid-level Full TimeSan Jose, California, United States12h ago
-
Cloud Native | Containerization | Distributed Systems | GPU Acceleration | KubernetesCareer growth | Collaborative engineering environment | Global opportunities | Open Source contributionEntry-level Full TimeSan Jose, California, United States12h ago
-
Deep learning | GPU resource management | Language Models | Large Language Models | Machine LearningEntry-level InternshipSan Jose, California, United States12h ago
-
LLM AIOps Development Engineer Graduate (Data Center Networking) - 2026 Start (BS/ MS) USD 122K-256KAPI Integration | Anomaly Detection | Cause analysis | Continuous Monitoring | Data StreamingEntry-level Full TimeSan Jose, California, United States12h ago
-
AI | Big Data | CPU | Cloud Native | Container RuntimeSenior-level Full TimeSan Jose, California, United States12h ago
-
Cloud Native | Cloud-native computing | Containerization | Distributed Systems | GPU AccelerationCareer growth | Collaborative team environment | Open source contributionsEntry-level Full TimeSeattle, Washington, United States12h ago
-
Production Engineer - Applied Machine Learning USD 156K-387KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDEntry-level Full TimeSan Jose, California, United States12h ago
-
Research Intern (AI/LLM Network) - 2026 Start (PhD) USD 137K-256KAI communication | Data Analysis | High speed | High-Speed Networking | LLMEntry-level InternshipSeattle, Washington, United States12h ago
-
CUDA | Distributed Systems | GPU | Language Models | Large Language ModelsCareer growth | Global team collaborationEntry-level Full TimeSan Jose, California, United States12h ago