Senior AI Engineer
Fort Lauderdale, Florida, United States
USD 130K-197K (estimate) Senior-level Full Time
Tasks
- Build CI/CD pipelines for AI services
- Build LLM as judge pipelines
- Build and maintain internal AI SDK and shared libraries
- Build dashboards for latency error rates token usage quality and cost
- Build production-grade AI pipelines
- Configure alerting thresholds and on call runbooks
- Configure and version LLM endpoints
- Configure circuit breakers
- Configure iteration caps and timeouts
- Configure private endpoints and vNet integration
- Connect business applications data sources and AI models
- Contribute to vendor evaluations
- Design and build core AI platform
- Enforce eval thresholds for production promotion
- Implement LLM evaluation framework
- Implement PII detection and redaction
- Implement content policy filtering
- Implement cost allocation and spend controls
- Implement infrastructure-as-code
- Implement input output security controls
- Implement model abstraction layer
- Implement output moderation
- Implement prompt injection detection
- Implement rate limiting and token budgeting
- Implement role-based access control
- Integrate eval harness into CI CD
- Maintain LLM endpoints across Azure OpenAI and AWS Bedrock
- Maintain audit logs of model inputs and outputs
- Maintain secrets management for API keys and tokens
- Manage async queues and retries
- Manage golden datasets for reproducible evals
- Own model deployment layer
- Review AI workflow proposals
- Set up tracing and monitoring
- Track and report quality metrics
- Write engineering standards integration patterns and runbooks
Perks/Benefits
- 401k retirement plan
- Employee referral bonuses
- Entertainment discounts
- Healthcare dental vision plans
- On Call Runbooks
- Paid Holidays
- Paid parental leave
- Paid sick time
- Paid vacation
- Paid volunteer time
- Service discounts
Skills/Tech-stack
API Design | AWS Bedrock | Access Control | Async Programming | Audit Logging | Azure OpenAI | Azure OpenAI Service | CI/CD | Circuit Breaker | Distributed Systems | Docker | Infrastructure as Code | Kubernetes | LLM | LLM Evaluation | Langchain | Langfuse | Langgraph | Langsmith | Litellm | Llamaindex | Microservices | Monitoring | OpenAI Service | Output moderation | PII Redaction | Private Cloud | Prompt injection | Prompt injection detection | Python | RAG | RAG evaluation | Rate Limiting | Role-Based Access | Role-Based Access Control | Secrets management | Terraform | Tracing | VNet integration | Virtual Private Cloud | “as-code”
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
12-Factor | 12-factor apps | API LED | API-led integration | AWSSenior-level Full TimeDearborn, United States2h ago
-
Infrastructure Engineer USD 180K-250KAWS | Azure | Docker | GCP | GPU ComputingOnsite in SF Bay Area | Relocation supportEntry-level Full TimeSan Francisco, CA, US2h ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R3h ago
-
Staff Data Engineer USD 190K-250KAWS | Agent systems | Airflow | Alation | Amazon KinesisDental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeDallas, TX, United States3h ago
-
Staff Software Engineer USD 190K-250KAPI Design | AWS | Autogen | Azure | C#Dental insurance | Flexible working hours | Growth and learning resources | Health insurance | Hybrid optionsSenior-level Full TimeChicago, IL, United States3h ago
-
Staff Software Engineer USD 190K-250KAWS | Autogen | Azure | C# | CI/CDDental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeChicago, IL, United States3h ago
-
Staff Software Engineer USD 190K-250KAPI Design | AWS | Autogen | Azure | C#Dental insurance | Flexible working hours | Health insurance | Hybrid options | Learning resourcesSenior-level Full TimeChicago, IL, United States3h ago
-
.NET | ArgoCD | Automation | Bash | C#Mid-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …3h ago
-
AI & Machine Learning Engineer USD 98K-140KAmazon Web Services | Apache Kafka | Azure | C++ | CI/CD401k match | Company paid life insurance | Medical, dental, and vision insurance | Paid Holidays | Paid time offMid-level Full TimeUSA-WISCONSIN-Green Bay4h ago
-
Data Engineer, Technical Leadership (Ranking, AI) USD 182K-235KAI workflows | Data Architecture | Data Governance | Data Modeling | Data QualitySenior-level Full TimeMenlo Park, CA5h ago
-
Software Engineer, SystemML - AI Networking USD 170K-287KC# | C++ | CUDA | Data-parallel | Distributed Data ParallelMid-level Full TimeMenlo Park, CA5h ago
-
Senior Performance Co-Design Engineer, LLM Serving USD 174K-252KC++ | Co-design | Computer Architecture | Deep learning | Deep learning inferenceSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Automated testing | C# | C++ | CI/CD | Continuous DeploymentMid-level Full TimeMountain View, CA, USA5h ago
-
API Design | Client Libraries | Cloud Computing | Debugging | Developer AdvocacySenior-level Full TimeNew York, NY, USA; Kirkland, WA, …5h ago
-
Staff Software Engineer, Storage Intelligence Platform USD 207K-300KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | Large-scaleSenior-level Full TimeSeattle, WA, USA5h ago
-
Data Processing | Debugging | Distributed Computing | Information Retrieval | Language ModelsSenior-level Full TimeSunnyvale, CA, USA5h ago
-
C++ | Data Processing | Debugging | Generative AI | Google CloudHealth insurance | Learning and development opportunities | Paid time off | Relocation assistance | Retirement planSenior-level Full TimeMountain View, CA, USA5h ago
-
C++ | Data Processing | Debugging | Language Models | Language ProcessingSenior-level Full TimeMountain View, CA, USA5h ago
-
Senior Software Engineer, AI/ML GenAI, Google Workspace USD 174K-252KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Principal Engineer, Data Center Sustainability USD 307K-427KC States | Carbon Accounting | Co-design | Computer Architecture | DVFSSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KAlgorithms | C# | C++ | Cloud Computing | Data IntegritySenior-level Full TimeNew York, NY, USA5h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-210KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Performance Co-design Engineer, LLM Training USD 174K-252KC++ | Co-design | Computer Architecture | Data parallelism | Distributed TrainingSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Artificial Intelligence | C++ | Cloud Security | Cybersecurity | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago