Staff Software Development Engineer (LLM)
Tasks
- Architect LLM request response monitoring
- Build scalable low latency LLM pipeline
- Design secure APIs
- Detect LLM usage anomalies
- Detect denial of service attacks
- Develop monitoring logging and alerting
- Develop secure backend systems
- Ensure on-time feature delivery
- Implement prompt injection defenses
- Implement secure microservices platform features
- Mentor junior engineers
- Optimize databases and caching for threat detection
- Prevent unauthorized data leakage
Perks/Benefits
- 401k
- Dental insurance
- Disability insurance
- Health insurance
- Leave Program
- Life insurance
- Paid Holidays
- Sick time
- Vacation time
- Vision insurance
Skills/Tech-stack
API Security | AWS | Alerting | Application Security | Azure | Bias detection | C# | C++ | Caching | Data Pipelines | Data Protection | Data poisoning | Database optimization | Docker | Fact-checking | GCP | Hugging Face | Hugging Face Transformers | Kubernetes | Langchain | Logging | Microservices | Monitoring | Network Protocols | OWASP | Policy enforcement | Privacy | Prompt injection | PyTorch | Python | RAG | Responsible AI | Retrieval-Augmented Generation | Streaming Data | Streaming data pipelines | TensorFlow | Vector Databases
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Access Control | Always On | Always On Availability | Always On Availability Groups | Auditing401k savings plan | Dental insurance | Health insurance | Long-term disability | On the job training providedMid-level Full TimePeoria, AZ, United States3h ago
-
Lead Business Intelligence Engineer USD 92K-140KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeWestchester, IL, United States3h ago
-
Senior-level Full TimeColumbus, GA, United States5h ago
-
Intelligent Systems Engineer II USD 98K-166KAPIs | AWS | Artificial Intelligence | Automated testing | Backend Development401k match | Community service day | Dental insurance | Flexible spending accounts | Life insuranceMid-level Full TimeWest Chester, OH, United States6h ago
-
Senior Data Integration Engineer USD 130K-160KAutomation | CSV | Data Quality | Data Validation | Data integrationTS SCI with Polygraph clearanceSenior-level Full TimeAnnapolis Junction, Maryland; Hanover, MD; Hanover, …7h ago
-
Automated Speech Recognition | CI/CD | CUDA | Computer Vision | Containerization401k matching | Company events | Dental coverage | Flexible work schedules | Internet reimbursementSenior-level Full TimeAnnapolis Junction, MD R7h ago
-
Big Data | Data Pipelines | Data cleaning | MAPE | Machine LearningMid-level Full TimeNewark, NJ, United States8h ago
-
4G | 5G | Automation | Network Analysis | Network TroubleshootingEducational assistance | Paid Holidays | Paid vacation | Sick leave | Stock purchase planMid-level Full TimePlano,Texas,United States R8h ago
-
Senior AI & Automation Engineer USD 82K-120KAgile | Azure Data | Azure Data Factory | Azure Dataverse | CopilotAbility to work independently | Contract 6 months or more | Hybrid work (3 days onsite)Senior-level ContractDeerfield Beach, United States8h ago
-
Data Engineer II USD 84K-140KAgile | Amazon Redshift | Apache Airflow | CI/CD | Cloud ComputingMentorship | Professional developmentMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …10h ago
-
Databricks Engineering Consultant USD 97K-162KApache Spark | Data Governance | Data Lineage | Databricks | ELTMentorship programs | Professional development | Travel opportunitiesMid-level Full TimeRosslyn, Virginia, United States; Washington, District …10h ago
-
Sr Lead Software Engineer - Java, Python, AI/ML USD 170K-189KAWS | Algorithms | Auto-GPT | Automated testing | Cause analysisSenior-level Full TimeJersey City, NJ, United States10h ago
-
Senior LLM Engineer USD 195K-255KAI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchSenior-level Full TimeAustin, Texas | Fremont, California | …10h ago
-
Mid-level Full TimeUS-Georgia-Augusta11h ago
-
Automation | C# | C++ | CPU Utilization | Capacity PlanningDevelopment workshops | Hands-on learning opportunities | Industry exposure | Mentorship | Social eventsEntry-level InternshipSan Jose, California, United States11h ago
-
Machine Learning Engineer Graduate (E-Commerce Supply Chain & Logistics - LLM/Agent) - 2027 Start (PhD) USD 137K-246KAgents | Benchmarking | C++ | Deep learning | EvaluationEntry-level Full TimeSan Jose, California, United States11h ago
-
Machine Learning Engineer Graduate (E-Commerce Supply Chain & Logistics - LLM/Agent) - 2027 Start (PhD) USD 137K-246KAI Feedback | Agents | Benchmarking | C++ | DPOEntry-level Full TimeSeattle, Washington, United States11h ago
-
Agent evaluation | Classification | Clustering | Data Mining | Deep learningEntry-level Full TimeSeattle, Washington, United States11h ago
-
Apache Flink | Apache Hive | Apache Spark | Batch Processing | C++Entry-level Full TimeSan Jose, California, United States11h ago
-
Classification | Clustering | Data Mining | Deep learning | E-commerceEntry-level Full TimeSan Jose, California, United States11h ago
-
AI Workflow Orchestration | AI workflow | CD pipeline | CI Pipeline | CI/CDMid-level Full TimeSeattle, Washington, United States11h ago
-
Machine Learning Engineer (Technical Leadership) USD 213K-251KAB Testing | C plus plus | Data Mining | Data Pipelines | Deep learningSenior-level Full TimeMenlo Park, CA | New York, …12h ago
-
Embedded Software Engineer USD 147K-208KARM Cortex | ARM Cortex A | ARM Cortex-M | Asynchronous Interface | Boot loaderAI tools for development acceleration | Access to advanced prototyping hardware | Cross functional research environment | Flexible fast iteration | Ownership cultureSenior-level Full TimeRedmond, WA12h ago
-
Software Developer, Scaled Ops AI Acceleration Team USD 170K-209KAgent Orchestration | Artificial Intelligence | Backend Development | Bug tracking | ComplianceSenior-level Full TimeAustin, TX | Menlo Park, CA …12h ago
-
Research Engineer, Machine Perception (Project Aria) USD 141K-208K3D Computer Vision | C++ | Computer Vision | Data Pipelines | Deep learningOnsite work | Work authorization supportMid-level Full TimeRedmond, WA12h ago