Generative AI Platform Engineer
Tasks
- Apply FinOps for token spend optimization
- Apply policy based filtering
- Build reusable platform components with SDKs templates and IaC
- Configure prompt and version management
- Define SLIs and SLOs for AI systems
- Enforce role based access and audit trails
- Implement AI guardrails and governance
- Instrument metrics for latency safety and cost
- Lead incident response and postmortems
- Operationalize LLM and RAG services
- Optimize p95 latency with caching batching and autoscaling
- Run offline and online evaluations for retrieval quality helpfulness and factuality
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Audit Logging | Autoscaling | Batching | CI/CD | Caching | FinOps | Incident Response | Infrastructure as Code | Language Models | Large Language Models | MTTR | Milvus | Observability | OpenSearch | PGVector | Postmortems | Prompt engineering | Python | Retrieval-Augmented Generation | Role-Based Access | Role-Based Access Control | SLI | SLO | Terraform | Vector Search | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Regions
Countries
States
Related jobs
-
Cloudflare | Docker | Event Processing | Go | JavaScriptHigh ownership culture | Remote work flexibility | Startup environmentSenior-level Full TimeRemote, US R4h ago
-
Staff Machine Learning Engineer USD 154K-231KData Pipelines | Feature Engineering | Machine Learning | Model Evaluation | NumPyOccasional travelSenior-level Full Time#, CA, US, #4h ago
-
Sr. Solutions Engineer USD 152K-209KAccount Management | Amazon Web Services | Artificial Intelligence | Azure | Big DataSenior-level Full TimeBoston, Massachusetts6h ago
-
Senior Data Warehouse Engineer USD 121K-170KData Ingestion | Data Modeling | Data Quality | Data Warehousing | Data orchestration401k | Dental insurance | Disability insurance | Employee assistance program | Employee recognitionSenior-level Full TimeDraper, Utah, United States; San Jose, …6h ago
-
Senior Data/ML Engineer USD 151K-205KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R7h ago
-
Senior Machine Learning Engineer, Perception USD 213K-263KC++ | Computer Vision | Computer Vision Model Training | Deep learning | Edge ComputingBonus plan | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, CA, USA8h ago
-
Senior Software Engineer, Machine Learning USD 175K-250KA/B | A/B Testing | AWS | AWS Lambda | Airflow401k match | Employee affinity groups | Family leave | Fully-paid health care | Mental wellness programsSenior-level Full TimeNew York, NY8h ago
-
Senior Developer Experience Advocate USD 141K-190KAI Agents | Benchmarking | DBT | Documentation | GitHub401k with guaranteed contribution | Healthcare | Home office stipend | Paid parental leave | Unlimited vacationSenior-level Full TimeUS - Remote R9h ago
-
CI/CD | DBT | Dimensional Modeling | Git | Performance TuningSenior-level Full TimeHerndon, United States10h ago
-
Batching | CUDA | Decoding Optimization | Deep learning | GPU PerformanceIn-office collaborationEntry-level InternshipMilpitas, CA10h ago
-
Staff SW Engineer - Fullstack/GenAI USD 131K-210KAPI Design | Angular | C# | C++ | CI/CD401k | Dental insurance | FSA/HSA | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA, United States10h ago
-
Sr. Enterprise Security Engineer USD 176K-260KAPI Security | Access Control | Application Security | Audit Logging | AuthenticationSenior-level Full TimeRemote - California R10h ago
-
AI Agents | API Development | Agentic Workflows | Backend Development | CI/CD401 K | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States11h ago
-
Staff Analytics Engineer - US (Remote) USD 158K-232KAirflow | DBT | Data Modeling | Data Monitoring | Data QualityRemote work | Unlimited learning budgetSenior-level Full TimeUnited States R11h ago
-
AWS | Agent Orchestration | Amazon SQS | Distributed Systems | Event DrivenRemote work | Unlimited learning and development budgetSenior-level Full TimeUnited States R11h ago
-
Senior-level Full TimeBellevue, WA, United States11h ago
-
Staff Software Engineer, Combinatorial Optimization USD 155K-213KC# | C++ | CI/CD | Cloud Native | Cloud Native ArchitectureCompany holidays | Health insurance | Learning and development reimbursement | Life insurance | Long-term disabilitySenior-level Full TimeTorrance, California, United States; US - … R12h ago
-
Software Engineer, Product Security Data Platforms USD 190K-285KAWS | Apache Flink | Apache Spark | C++ | Data Engineering401-k plan | Company bonus | Equity | Medical, dental, and vision benefits | Sales commissions or bonusesSenior-level Full TimeSeattle12h ago
-
Robotics Software Engineer - Manufacturing Automation USD 140K-153KBazel | C++ | GRPC | Kubernetes | MicroservicesBonus | Equity | Health benefitsSenior-level Full TimeMountain View, California12h ago
-
Staff Data Architect USD 155K-221KAWS | Airflow | Apache Spark | Azure | BigQuery401-K matching | Classpass credits | Dental insurance | Dinner meals included | Free snacksSenior-level Full TimeLong Beach, California, United States13h ago
-
C# | C++ | DHCP | DNS | Embedded Systems401k matching | Dental insurance | Fitness programs | Hybrid work schedule | Learning and development programsSenior-level Full TimeBoston, Massachusetts, United States13h ago
-
Data Platform Software Engineer USD 140K-165KApache Airflow | Apache Kafka | Apache Spark | CI/CD | Code reviewMid-level Full TimePalo Alto, California, United States13h ago
-
Staff AI Engineer - Applied AI (Remote) USD 206K-243KAIOps | Agents | Amazon Bedrock | Anthropic | Distributed Systems401k plan | Community and employee resource groups | Dental insurance | Department stipend | Disability insuranceSenior-level Full TimeRemote - United States R13h ago
-
Analytics Engineer USD 92K-147KAirflow | Business Intelligence | DBT | Data Modeling | Data WarehousingHybrid work model | Remote work optionSenior-level Full TimeRemote, USA R13h ago
-
Software Engineer, Data USD 145K-200KAWS | Agile | Azure | Docker | ETLCareer growth | Employee wellbeing support | Hybrid work | Learning opportunities | Office-first cultureMid-level Full TimeNew York, New York, United States13h ago