Senior AI Engineer
USD 130K-197K (estimate) Senior-level Full Time
Tasks
- Build CI/CD pipelines for AI services
- Build LLM as judge pipelines
- Build and maintain internal AI SDK and shared libraries
- Build dashboards for latency error rates token usage quality and cost
- Build production-grade AI pipelines
- Configure alerting thresholds and on call runbooks
- Configure and version LLM endpoints
- Configure circuit breakers
- Configure iteration caps and timeouts
- Configure private endpoints and vNet integration
- Connect business applications data sources and AI models
- Contribute to vendor evaluations
- Design and build core AI platform
- Enforce eval thresholds for production promotion
- Implement LLM evaluation framework
- Implement PII detection and redaction
- Implement content policy filtering
- Implement cost allocation and spend controls
- Implement infrastructure-as-code
- Implement input output security controls
- Implement model abstraction layer
- Implement output moderation
- Implement prompt injection detection
- Implement rate limiting and token budgeting
- Implement role-based access control
- Integrate eval harness into CI CD
- Maintain LLM endpoints across Azure OpenAI and AWS Bedrock
- Maintain audit logs of model inputs and outputs
- Maintain secrets management for API keys and tokens
- Manage async queues and retries
- Manage golden datasets for reproducible evals
- Own model deployment layer
- Review AI workflow proposals
- Set up tracing and monitoring
- Track and report quality metrics
- Write engineering standards integration patterns and runbooks
Perks/Benefits
- 401k retirement plan
- Employee referral bonuses
- Entertainment discounts
- Healthcare dental vision plans
- On Call Runbooks
- Paid Holidays
- Paid parental leave
- Paid sick time
- Paid vacation
- Paid volunteer time
- Service discounts
Skills/Tech-stack
API Design | AWS Bedrock | Access Control | Async Programming | Audit Logging | Azure OpenAI | Azure OpenAI Service | CI/CD | Circuit Breaker | Distributed Systems | Docker | Infrastructure as Code | Kubernetes | LLM | LLM Evaluation | Langchain | Langfuse | Langgraph | Langsmith | Litellm | Llamaindex | Microservices | Monitoring | OpenAI Service | Output moderation | PII Redaction | Private Cloud | Prompt injection | Prompt injection detection | Python | RAG | RAG evaluation | Rate Limiting | Role-Based Access | Role-Based Access Control | Secrets management | Terraform | Tracing | VNet integration | Virtual Private Cloud | “as-code”
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R23h ago
-
AI and Data Science Engineer III with TS/SCI Polygraph USD 119K-198KData Visualization | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBaltimore, Maryland, United States3h ago
-
Risk Adjustment Analytics Data Scientist USD 122K-240KActuarial analysis | Cohort Segmentation | Data Quality | Data profiling | DatabricksMentorship | Professional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States3h ago
-
AI Research Scientist - Surface Inputs AR/VR USD 147K-208K3D Reconstruction | Computer Vision | Computer vision models | Deep learning | Depth EstimationSenior-level Full TimeRedmond, WA4h ago
-
Smart NIC Senior Software Engineer, Embedded USD 174K-253KArtificial Intelligence | C# | C++ | Data Center Networks | Data centerSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA4h ago
-
Software Engineer III, AI/ML, Foundational Lanes USD 147K-211KC++ | Computer Vision | Data Processing | Debugging | Geometric algorithmsSenior-level Full TimeMountain View, CA, USA4h ago
-
Access Management | Algorithms | CI/CD | Cloud platform | ComplianceEquity | Health insurance | Paid time off | Performance bonus | Retirement benefitsSenior-level Full TimeReston, VA, USA4h ago
-
Artificial Intelligence Engineer I USD 99K-176KAWS | Azure | Bioinformatics | Deep learning | DockerMid-level Full TimeHouston, TX, US6h ago
-
Senior Embedded Software Engineer USD 140K-160KC++ | Computer Vision | Coral TPU | Deep learning | Device driverFully-paid health insurance | Paid parental leave | Unlimited PTOSenior-level Full TimeBoston, Massachusetts, United States7h ago
-
VP, Data Engineer - DataBricks USD 143K-190KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid work model | Work from home optionExecutive-level Full TimeCharlotte, NC, US, 282028h ago
-
Senior Software Engineer, Data Insights USD 196K-243KAWS VPC | Amazon EKS | Analytics infrastructure | Apache Superset | Data EngineeringSenior-level Full TimeSan Mateo, CA, United States R9h ago
-
Senior Software Engineer, Unsecured Installments USD 160K-223KA/B | A/B Testing | Accessibility | B testing | CI/CD401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeUnited States | Remote R11h ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R11h ago
-
Senior Machine Learning Engineer, Voice Assistant USD 195K-361KAmazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Artificial IntelligenceFinancial wellness support | Flexible remote work | Mental health support | Paid time offSenior-level Full TimeAustin, Texas11h ago
-
Senior Machine Learning Engineer, Voice Assistant USD 216K-273KAmazon EMR | Amazon S3 | Apache Airflow | Automated Speech Recognition | C++Disability benefits | Equity awards | Health insurance | Hybrid work flexibility | Life insuranceSenior-level Full TimeBoston, Massachusetts11h ago
-
Senior Machine Learning Engineer, Voice Assistant USD 229K-367KAmazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Artificial IntelligenceDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California11h ago
-
Software Engineer, Embedded UI USD 170K-210KAI | API Design | BrightScript | C++ | Cloud DevelopmentDisability benefits | Health insurance | Life insurance | Paid time off | Parental leaveSenior-level Full TimeSan Jose, California11h ago
-
Technical Program Lead, AI Delivery USD 162K-226KData Modeling | Data Pipelines | Data Science | Generative AI | KPI TrackingClient-facing work | Executive visibility | Hybrid work | Mentorship and team leadershipSenior-level Full TimeSan Francisco12h ago
-
Staff Software Engineer, Full Stack - Gen AI USD 252K-315KAWS | Azure | Cloud platform | Google Cloud | Google Cloud PlatformCommuter stipend | Generous paid time off | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeNew York, NY; San Francisco, CA; …12h ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R13h ago
-
Entry-level Full TimeMadison, WI, US14h ago
-
Campus AI Research Engineer (Full-Time) USD 300K-300KC++ | CUDA | GPU Programming | HPC | High ThroughputCPT/OPT eligible | Visa sponsorshipEntry-level Full TimeChicago; New York15h ago
-
Campus AI Research Engineer (Intern) USD 300K-300KC# | C++ | CUDA | Data Mining | Deep learningCPT OPT eligibility | International student support | Work visa sponsorshipEntry-level InternshipChicago; New York15h ago
-
Campus Data Engineer (Intern) USD 250K-250KAgile | Data Pipelining | Data Structures | Database Management | LinuxCPT OPT eligibility | Mentorship | Work visa sponsorshipEntry-level InternshipChicago15h ago
-
Algorithms Software Engineer USD 161K-175KComputer Vision | Deployment | Image Processing | Machine Learning | NumPyTelecommuting permittedEntry-level Full TimeSan Francisco HQ Office15h ago