Lead Software Engineer II, AI Operations
Tasks
- Add observability and tracing
- Build APIs and services
- Build AWS AI infrastructure
- Build LLM agents and automations
- Create eval dashboards and regression alerts
- Design and ship LLM applications
- Enforce guardrails and governance
- Establish unit economics per workflow
- Implement IAM and policy enforcement
- Implement PII redaction and safety filters
- Implement retrieval evaluation
- Operate services in production
- Optimize cost performance for LLM workloads
- Own RAG pipelines
- Participate in on call and author runbooks
- Provide developer templates and SDKs
- Set up CI CD for AI artifacts
- Version and deploy prompts and tools
Perks/Benefits
- Dental insurance
- Employee assistance program
- Fitness center reimbursement
- Health insurance
- Identity theft protection
- Life insurance
- Paid parental leave
- Paid time off
- Pet insurance
- Retirement savings plan company match
- Vision insurance
- Wellness programs
Skills/Tech-stack
API Development | AWS | Access Control | Amazon Bedrock | Audit Logging | Autoscaling | Batching | Blue-Green Deployment | Blue/green | CI/CD | Caching | Canary testing | ChatGPT | Cost Optimization | Datadog | Docker | Embeddings | FastAPI | Grafana | Guardrails | Hybrid search | IAM | Kubernetes | LLM evals | Metaflow | Model routing | Multi Turn Orchestration | Observability | OpenAI | Outerbounds | PII Redaction | Prompt engineering | Python | RAG | Reranking | Role-Based Access | Role-Based Access Control | Security | Streaming | Tracing | Vector Databases
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R3d ago
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R3d ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R7h ago
-
Senior-level Full TimeCanada R7h ago
-
Senior Data Engineer USD 160K-180KAPI | AWS | Airflow | Change Data Capture | DBT401k | Equipment provided | Equity compensation | Flexible PTO | Home office stipendSenior-level Full TimeRemote R9h ago
-
AI & Data Engineering Apprentice USD 44K-63KAWS | Agile | Azure | Cloud Computing | Data EngineeringCareer coaching | Continuous learning culture | Flexible work arrangements | MentorshipEntry-level ApprenticeshipRemote R11h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R11h ago
-
Associate AI Engineer USD 144K-180K.NET | APIs | ASPNet | AWS | Azure401k matching | Dental insurance | Hybrid work model | Medical insurance | Paid time offMid-level Full TimeIrving, TX R12h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R14h ago
-
Data Engineer - Costa Rica USD 100K-120KAWS | Azure | Cloud Computing | Data Lake | Data WarehouseDental insurance | Disability insurance | Employee assistance program | Employee discount program | Health insuranceMid-level Full TimeCosta Rica R14h ago
-
Lead Fraud Data Scientist USD 164K-230KA/B | A/B Testing | AWS | Azure | B testingDental insurance | Health insurance | Hybrid work option | Performance bonus | Remote workSenior-level Full TimeNew York, San Francisco, Miami R15h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Curation401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States; Remote U.S. R16h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Data Augmentation | Data Drift401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Remote U.S. R16h ago
-
A/B Testing | AI SDK | AWS | Agent Orchestration | B testingAnnual leave | Career growth opportunities | Company-provided laptop | Public holidays | Remote workSenior-level Full TimeRemote R17h ago
-
Analista MLOps / Ingenier@ MLOps EUR 35K-40KAPIs | AWS | Airflow | Azure | Azure FunctionsCareer development | Continuous training | Flexible schedule | Remote work | Social benefitsMid-level Full TimeMadrid, Spain R17h ago
-
Data Engineer USD 115K-162KAWS | Apache Spark | Azure | Cloud platform | Data VisualizationRemote workMid-level Full TimeRemote R17h ago
-
AI Developer USD 140K-170KAPI Development | Algorithms | Amazon Web Services | Azure | CI/CDAdvanced English communication support | Remote positionMid-level Full TimeRemote R17h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Distributed first work environment | Fully remoteMid-level Full TimeSaudi Arabia R17h ago
-
Bash | Cloud platform | Data Ingestion | Data Pipelines | Distributed SystemsAccess to cutting-edge AI technologies | Autonomy | Bonus opportunities | Collaborative engineering culture | Distributed first work environmentSenior-level Full TimeBelgium R17h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus opportunities | Collaborative culture | Distributed first work environmentSenior-level Full TimeUnited Arab Emirates R17h ago
-
Bash | Cloud platform | Data Pipelines | Distributed Systems | DockerAutonomy | Bonus opportunities | Collaborative culture | Distributed first work environment | Equity opportunitiesSenior-level Full TimeTurkey R17h ago
-
Bash | Cloud platform | Data Pipelines | Distributed Systems | DockerAutonomy | Bonus opportunities | Collaborative culture | Distributed first work environment | Equity opportunitiesSenior-level Full TimeAustralia R17h ago
-
Bash | Cloud platform | Cost Optimization | Data Pipelines | Distributed SystemsAccess to cutting-edge technology | Autonomy | Collaborative culture | Distributed first | Fully remoteSenior-level Full TimeSouth Africa R17h ago
-
Bash | Data pipeline | Distributed Systems | Docker | GCPAutonomy | Collaborative culture | Distributed first work environment | Equity opportunities | Fully remoteMid-level Full TimeMexico R17h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting edge AI and data engineering technologies | Collaborative engineering culture | Distributed first work environment | Fully remote | High ownership autonomyMid-level Full TimeRomania R17h ago