Applied LLM Systems Engineer
Costa Mesa, California, United States
USD 191K-253K Senior-level Full Time
Tasks
- Build production grade LLM applications for documentation workflows
- Coordinate with technical writers and engineers to identify AI use cases
- Design evaluation frameworks and regression testing
- Design orchestration for multi step workflows
- Establish observability auditability rollback and safe failure modes
- Implement retrieval structured output and tool integrated systems
- Optimize context management and token usage
- Preserve provenance between source and generated outputs
Perks/Benefits
- N/A
Skills/Tech-stack
Access Management | Agent systems | Auditability | Caching | Cloud infrastructure | Containerization | Context Management | Continuous Deployment | Continuous Integration and Continuous Deployment | Continuous integration | Data Protection | Evaluation | Event Driven | Event-driven architecture | Identity and Access Management | Identity and access | Issue Tracking | LLM | Multi-Agent | Multi-Agent Systems | Observability | Production Monitoring | Python | Queues | Regression testing | Retrieval-Augmented Generation | Rollback | Security boundaries | Source Control | Structured Output | Token optimization | Tool-Calling | Workflow Orchestration
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Staff Machine Learning Engineer USD 176K-308KAPI Design | Distributed Systems | Generative AI | Hybrid search | Inference Optimization401k plan with company match | ESPP | Family Leave Program | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R14h ago
-
Senior Analytics Engineer, Marketing Sciences USD 100K-125KAmazon Kinesis | DBT | Docker | JSON | Kafka401k match | Dental insurance | Employee resource groups | Flexible time off | Life and disability insuranceSenior-level Full TimeUnited States R14h ago
-
Sr Engineer, Data Engineering USD 30K-46KAmazon Web Services | Apache Spark | Azure | Data Lake | Data WarehouseSenior-level Full TimeRoswell, GA, United States15h ago
-
Machine Learning Engineer USD 161K-200KA/B | A/B Testing | B testing | Collaborative Filtering | Content-Based Filtering401k matching | Disability insurance | Fertility benefits | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA R15h ago
-
AWS | Ansible | Automation | BAM | Bioinformatics401k match | Commuter benefits | Employee referral program | Fertility care benefits | Free employee genetic testingSenior-level Full TimeUS Remote R15h ago
-
Senior AI & Platforms Engineer USD 30K-84KAIOps | Asyncio | Autogen | CI/CD | CrewAIContract position | Local candidates required | Onsite work 3 days per weekSenior-level Contract Full TimeBrooklyn, NY, United States16h ago
-
Sr Analytics Engineer USD 125K-150KData Engineering | Data Modeling | Data analytics | Python | SQL401k program | Dental insurance | Disability insurance | Flexible spending accounts | Life insuranceSenior-level Full TimeChicago, IL17h ago
-
Data Engineer USD 140K-180KAKS | Apache Spark | Automated testing | Azure Cosmos | Azure Cosmos DBClient-facing consulting | Cross-functional collaboration | Design sessions with stakeholders | Leadership presentationsSenior-level Full TimeAtlanta, Georgia18h ago
-
Senior-level Full TimeDetroit Area, Michigan18h ago
-
AI | API Integrations | Acceptance Testing | Application Support | Azure DevOpsMid-level Full TimeNYC, NY; Information Technology; New York, …18h ago
-
Senior-level Full TimeHerndon, VA; Information Technology; Tysons, VA; … R18h ago
-
Mid-level Full TimeHerndon, VA; Information Technology; Chantilly, VA; …18h ago
-
Software Developer/Systems Engineer USD 130K-170KAI | API Integration | Anomaly Detection | Data Classification | Data extractionTS SCI Clearance FSPMid-level Full TimeHerndon, VA; Information Technology; Annapolis Junction, …18h ago
-
Senior AI/ML Full Stack Engineer USD 130K-176KAWS | AWS Bedrock | Airflow | Authentication | AuthorizationFully remote | W2 onlySenior-level Full TimeRemote, MN; Information Technology R18h ago
-
CDC | Change Data Capture | Data Capture | Data Ingestion | Data Ingestion PipelinesContract 12 plus months | TeleworkMid-level Full TimeRemote, Texas; Information Technology R18h ago
-
Data Engineer - Vehicle Configuration Optimization USD 115K-192KData Governance | Data Modeling | Data Pipelines | Data Quality | DatabricksCompany Vehicle Lease Program | Dental insurance | Disability insurance | Family building benefit | Health insuranceMid-level Full TimeAuburn Hills, MI, United States19h ago
-
Accelerometer | C plus plus | Classification | Estimation Theory | Feature extractionMid-level Full TimeSanta Clara, California; Santa Clara, California19h ago
-
Agile | Algorithms | C# | C++ | Data StructuresSenior-level Full TimeSan Diego, California19h ago
-
Sr. AI Developer, Engineering USD 144K-189K.NET | APIs | Adobe Experience | Adobe Experience Cloud | Agent OrchestrationSenior-level Full TimeChicago, IL, United States19h ago
-
Senior Sales Engineer - NorthCentral USD 149K-198KAWS | Application Performance Monitoring | Application performance | Cloud Computing | Cloud platformBest in class onboarding | Continuous professional development | Employee stock purchase plan | Inclusive company culture | Mentor and buddy programSenior-level Full TimeIllinois, USA, Remote; Minnesota, USA, Remote R20h ago
-
MLOps Engineer USD 90K-120KAWS | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Glue401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractJuno Beach, Florida, USA R20h ago
-
Enterprise Sales Engineer - FED USD 118K-157KAmazon Web Services | Application Performance Monitoring | Application performance | Cloud platform | Developer experienceBest in class onboarding | Career pathing | Continuous professional development | Global benefits | Hybrid workplaceMid-level Full TimeDistrict of Columbia, USA, Remote; Maryland, … R20h ago
-
Senior Sales Engineer - FED USD 149K-198KAmazon Web Services | Application Performance Monitoring | Application performance | Cloud platform | CybersecurityEmployee stock purchase plan | Hybrid work | Mentor and buddy program | Onboarding program | Professional developmentSenior-level Full TimeDistrict of Columbia, USA, Remote; Maryland, … R20h ago
-
Forward Deployed AI Engineer (USA Based) USD 110K-160KAPIs | Agent Frameworks | Data Pipelines | Full Stack | Full-Stack DevelopmentEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeNew York, NY, United States20h ago
-
Senior LLM Engineer USD 195K-255KAI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchSenior-level Full TimeAustin, Texas | Fremont, California | …21h ago