Staff Software Development Engineer (LLM)
Tasks
- Architect LLM request response monitoring
- Build scalable low latency LLM pipeline
- Design secure APIs
- Detect LLM usage anomalies
- Detect denial of service attacks
- Develop monitoring logging and alerting
- Develop secure backend systems
- Ensure on-time feature delivery
- Implement prompt injection defenses
- Implement secure microservices platform features
- Mentor junior engineers
- Optimize databases and caching for threat detection
- Prevent unauthorized data leakage
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Health insurance
- Leave Program
- Life insurance
- Paid Holidays
- Sick time
- Vacation time
- Vision insurance
Skills/Tech-stack
API Security | AWS | Alerting | Application Security | Azure | Bias detection | C# | C++ | Caching | Data Pipelines | Data Protection | Data poisoning | Database optimization | Docker | Fact-checking | GCP | Hugging Face | Hugging Face Transformers | Kubernetes | Langchain | Logging | Microservices | Monitoring | Network Protocols | OWASP | Policy enforcement | Privacy | Prompt injection | PyTorch | Python | RAG | Responsible AI | Retrieval-Augmented Generation | Streaming Data | Streaming data pipelines | TensorFlow | Vector Databases
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R8d ago
-
SOFTWARE DATA ENGINEER - Enterprise Infrastructure - 5+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 168K-172KCloud Security | Cloud infrastructure | Linux | Network Automation | OpenStack401k retirement plan | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeLaurel, United States2h ago
-
AI Agents | Alerting | Automation | Capacity Planning | Change ManagementBlameless post incident review process | Mentorship | Rotational on call coverageSenior-level Full TimeSan Jose, California, United States3h ago
-
Senior Data Engineer USD 187K-321KAWS | Airflow | Apache Spark | Batch Processing | Data Modeling401k matching | Flexible work schedule | Health and wellness supportSenior-level Full TimeAustin, Texas15h ago
-
Senior Data Engineer USD 148K-361KAirflow | Apache Spark | Data Modeling | Data Quality | HDFS401k | Commuter benefits | Dental insurance | Disability benefits | Equity awardsSenior-level Full TimeSan Jose, California15h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeAustin, TX, USA15h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Flexible remote work environment | Supportive entrepreneurial teamMid-level Full TimeAtlanta, GA, USA15h ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Remote workMid-level Full TimeNew York, NY, USA15h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Bonus | Equity | Laid-back atmosphere | Remote-friendlyMid-level Full TimeBoston, MA, USA15h ago
-
Bash | Cloud platform | Docker | Google Cloud | Google Cloud PlatformAsynchronous culture | Bonus | Equity | Flexible work environment | Laid-back atmosphereMid-level Full TimePortland, OR, USA15h ago
-
Bash | Cloud infrastructure | Docker | GCP | Infrastructure as CodeAsynchronous culture | Remote-friendlyMid-level Full TimeTempe, AZ, USA15h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Competitive benefits | Laid-back atmosphere | Remote-friendlyMid-level Full TimeLas Vegas, NV, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Friendly work environmentMid-level Full TimeFrisco, TX, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonuses | Equity | Friendly work environmentMid-level Full TimeMinneapolis, MN, USA15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Flexible team environmentMid-level Full TimeRaleigh, NC, USA15h ago
-
Bash | Cloud platform | Data Pipelines | Docker | Google CloudAsynchronous culture | Flexible management approach | Friendly work environment | Opportunity to make impact | Remote/distributed teamMid-level Full TimeKansas City, MO, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial environment | Opportunity impact | Remote/distributed workMid-level Full TimeCincinnati, OH, USA15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Laid-back atmosphere | Portfolio support | Remote-friendlyMid-level Full TimeDetroit, MI, USA15h ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous culture | Friendly laid-back atmosphereMid-level Full TimeEvanston, IL, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive benefits | Equity bonus | Remote-friendlyMid-level Full TimeRichmond, VA, USA15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Entrepreneurial environment | Hands-off management | Remote-friendly, distributed teamMid-level Full TimeBakersfield, CA, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Friendly atmosphere | Handsoff managementMid-level Full TimeFort Collins, CO, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly laid-back atmosphereMid-level Full TimeCollege Station, TX, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible priorities | Remote-friendly environment | Supportive teamMid-level Full TimeBirmingham, AL, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Flexible management approach | Impactful mission | Remote-friendlyMid-level Full TimeTallahassee, FL, USA15h ago