Senior AI Engineer
Fort Lauderdale, Florida, United States
USD 130K-197K (estimate) Senior-level Full Time
Tasks
- Build CI/CD pipelines for AI services
- Build LLM as judge pipelines
- Build and maintain internal AI SDK and shared libraries
- Build dashboards for latency error rates token usage quality and cost
- Build production-grade AI pipelines
- Configure alerting thresholds and on call runbooks
- Configure and version LLM endpoints
- Configure circuit breakers
- Configure iteration caps and timeouts
- Configure private endpoints and vNet integration
- Connect business applications data sources and AI models
- Contribute to vendor evaluations
- Design and build core AI platform
- Enforce eval thresholds for production promotion
- Implement LLM evaluation framework
- Implement PII detection and redaction
- Implement content policy filtering
- Implement cost allocation and spend controls
- Implement infrastructure-as-code
- Implement input output security controls
- Implement model abstraction layer
- Implement output moderation
- Implement prompt injection detection
- Implement rate limiting and token budgeting
- Implement role-based access control
- Integrate eval harness into CI CD
- Maintain LLM endpoints across Azure OpenAI and AWS Bedrock
- Maintain audit logs of model inputs and outputs
- Maintain secrets management for API keys and tokens
- Manage async queues and retries
- Manage golden datasets for reproducible evals
- Own model deployment layer
- Review AI workflow proposals
- Set up tracing and monitoring
- Track and report quality metrics
- Write engineering standards integration patterns and runbooks
Perks/Benefits
- 401k retirement plan
- Employee referral bonuses
- Entertainment discounts
- Healthcare dental vision plans
- On Call Runbooks
- Paid Holidays
- Paid parental leave
- Paid sick time
- Paid vacation
- Paid volunteer time
- Service discounts
Skills/Tech-stack
API Design | AWS Bedrock | Access Control | Async Programming | Audit Logging | Azure OpenAI | Azure OpenAI Service | CI/CD | Circuit Breaker | Distributed Systems | Docker | Infrastructure as Code | Kubernetes | LLM | LLM Evaluation | Langchain | Langfuse | Langgraph | Langsmith | Litellm | Llamaindex | Microservices | Monitoring | OpenAI Service | Output moderation | PII Redaction | Private Cloud | Prompt injection | Prompt injection detection | Python | RAG | RAG evaluation | Rate Limiting | Role-Based Access | Role-Based Access Control | Secrets management | Terraform | Tracing | VNet integration | Virtual Private Cloud | “as-code”
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
AI | Automation | Data Governance | Data Management | Data OperationsSenior-level Full TimePrinceton4h ago
-
Data Engineer USD 128K-214KAWS Glue | AWS GovCloud | Apache Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeUSA-FL-Doral5h ago
-
Software Engineer III - Java/Python - Learn AI / LLM USD 176K-195KAgile | Amazon Web Services | Application Resiliency | Artificial Intelligence | Automated testingSenior-level Full TimeNew York, NY, United States5h ago
-
Software Engineer, SystemML - AI Networking USD 170K-251KC# | C++ | CUDA | Data-parallel | Distributed Data ParallelMid-level Full TimeMenlo Park, CA6h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KC plus plus | Computer Vision | Deep learning | Distributed Computing | Few-Shot LearningMid-level Full TimeSan Jose, CA, USA6h ago
-
Forward Deployed Engineer V, Generative AI, Google Cloud USD 262K-365KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …6h ago
-
Automation | C# | C++ | CSS | Database DesignMid-level Full TimeAnn Arbor, MI, USA6h ago
-
Staff Software Engineer, AI and Infrastructure USD 207K-301KC++ | Cluster management | Compute Technologies | Distributed Systems | Hardware ArchitectureSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Principal Consultant, AI/ML, Mandiant, Google Cloud USD 168K-244KAI Evaluation | Agent systems | Cloud APIs | Cybersecurity | Data leakageSenior-level Full TimeReston, VA, USA; United States6h ago
-
Benchmarking | C++ | Continuous batching | Deep learning | Disaggregated servingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Senior Product Engineer, Machine Learning Accelerators USD 144K-209KBash | Board assembly | Cause analysis | Circuit board assembly | Continuous ProcessSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA6h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApache Beam | Apache Spark | C++ | Cassandra | ConcurrencyEquity | Health insurance | On-call rotation | Paid time offSenior-level Full TimeNew York, NY, USA6h ago
-
Lead Data Engineer USD 110K-170KAWS Athena | AWS Glue | AWS Lambda | AWS S3 | Amazon AuroraDistance based relocation assistance | Employee assistance program | Employee business networks | Enhanced 401k | Flexible work hoursSenior-level Full TimeHolyoke, MA, 01040, USA9h ago
-
Embedded Software Test Engineer USD 105K-158K5S | Agile | C# | CI/CD | Case Development401k | Disability insurance | Employee stock purchase plan | Fully remote | Health insuranceMid-level Full TimeHarrisburg, PA, US, 17111 R11h ago
-
Senior-level Full TimeSan Jose, California, United States13h ago
-
Machine Learning Infrastructure Engineer USD 140K-165KAWS | Alerting | Batching | Caching | Cost OptimizationSenior-level Full TimeSan Jose, California, United States13h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-408KData Science | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Health insurance | Life insurance | Paid time off | Parental leaveSenior-level Full TimeNew York, New York13h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Distributed Systems | Experimentation | Feature Engineering | JavaDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts13h ago
-
Principal Software Engineer, Perception Pretraining USD 349K-431KC++ | Compute Optimization | Computer Vision | End to End | End-to-end modelingCompany benefits | Discretionary annual bonus | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, …14h ago
-
Senior Software Engineer, Quantitative Evaluations USD 204K-259KA/B | A/B Testing | B testing | C++ | Data PipelinesAnnual bonus program | Company benefits | Equity incentive plan | Hybrid work scheduleSenior-level Full TimeMountain View, CA, USA; San Francisco, …14h ago
-
Technical Lead Manager (TLM), ML Simulation USD 238K-302KAnomaly Detection | C++ | Data Processing | Deep learning | Hugging FaceBonus program | Company benefits program | Equity incentive plan | Hybrid work scheduleSenior-level Full TimeNew York, NY, USA; Mountain View, …14h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | Business Intelligence | DBT | Data Architecture | Data Engineering401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R14h ago
-
API Integration | API Security | Authentication | CI/CD | Cloud NetworkingAnnual performance bonus | Career growth | Fully remote workSenior-level Full TimeCanada R16h ago
-
Software Engineer, Developer Platforms and Generative AI USD 110K-130KAPI Development | Amazon Web Services | CI/CD | Claude Code | Cloud platformMid-level Full TimeNew York, NY17h ago