GenAI Platform Engineer
Tasks
- Apply policy based filtering and safety checks
- Conduct postmortems and reduce MTTR
- Define and monitor SLIs/SLOs
- Enforce role based access and audit trails
- Implement prompt and version management
- Improve retrieval quality with information retrieval metrics
- Instrument metrics and quality dashboards
- Meter usage and apply FinOps for token spend
- Operationalize LLM and RAG services
- Optimize latency with caching batching and autoscaling
- Perform offline and online evaluations
- Provide Terraform infrastructure as code modules
- Run on call incident response
- Ship SDKs and CI CD templates
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Audit Logging | Autoscaling | Batching | CI/CD | Caching | Evaluation and testing | FinOps | Information Retrieval | Infrastructure as Code | Language Models | Large Language Models | Latency optimization | Milvus | NDCG | Observability | OpenSearch | PGVector | Prompt engineering | Python | Queueing and Control | Queuing Theory | RAG | Reliability Engineering | Retrieval-Augmented Generation | Role-Based Access | Role-Based Access Control | SLI | SLO | Safety Guardrails | Site Reliability | Site Reliability Engineering | Terraform | Vector Search | “as-code”
Education
N/A
Roles
AI | AI Platform Engineer | Engineer | GenAI Platform Engineer | Platform Engineer
Related jobs
-
Data Engineer (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Pipelines401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Health insuranceMid-level Full TimeWork From Home, United States R3h ago
-
Senior-level Full TimeAnnapolis Junction, MD5h ago
-
AWS | Agentic AI | Angular | CI/CD | DatabricksHybrid work | Technical mentorshipSenior-level Full TimeNormal, United States8h ago
-
Sr. Data Engineer USD 108K-158KAWS | Apache Spark | Automated testing | Azure Event | Azure Event Hubs401k matching | Dental insurance | Disability insurance | Educational growth | Employee discount programSenior-level Full TimeNew York-TONAWANDA8h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 212K-450KCUDA | Deep learning | Distributed Systems | GPU Performance | GPU Performance OptimizationEntry-level Full TimeSan Jose, California, United States8h ago
-
Artificial Intelligence | Data Modeling | Data Pipelines | Data Quality | Data Visualization401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York8h ago
-
Backup and Restore | Blob Storage | Cluster communication | Cluster management | Crash diagnosticsSenior-level Full TimeSan Jose, California, United States9h ago
-
AWS | AWS SDK | Amazon MSK | Apache Kafka | Generative AISenior-level Full TimeNew York, New York, United States9h ago
-
Artificial Intelligence | Audio generation | Computer Vision | Cross-functional | Cross-functional leadershipSenior-level Full TimeMenlo Park, CA | New York, …9h ago
-
Production Engineer USD 178K-200KApache | Apache Spark | Application Programming | Application Programming Interfaces | C++Entry-level Full TimeMenlo Park, CA9h ago
-
Research Engineer - MSL FAIR Foundations USD 117K-173KBenchmarking | Code review | Data Pipelines | Distributed Systems | Language ModelEntry-level Full TimeMenlo Park, CA9h ago
-
Staff Software Engineer, AI Data Generation Platform USD 207K-300KComputer Vision | Data Engineering | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Senior Software Engineer, AI/ML, Search Growth USD 174K-252KA/B | A/B Testing | B testing | Deep learning | Information RetrievalSenior-level Full TimeMountain View, CA, USA10h ago
-
Staff Software Engineer, Agentic Data and Evals USD 207K-300KC++ | CSS | Cloud | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Senior Data Engineer USD 155K-180KAWS | Agile | Alerting | Azure | Bash401k savings plan | Dental insurance | Employee assistance plan | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States11h ago
-
Data Engineer USD 118K-125KAWS | Agile | Apache Spark | Azure | Bash401k savings plan with profit sharing | Commuter parking tax savings | Employee assistance program | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States11h ago
-
Entry-level InternshipIrvine, CA, US12h ago
-
Senior GenAI Engineer USD 119K-258KAI Foundry | AI Search | API Management | AWS Bedrock | Active DirectorySenior-level Full TimeMiami, FL, US, 3313114h ago
-
Software Engineer, Applied AI USD 130K-500KData Pipelines | Data Quality | Evaluation Frameworks | Experimental Design | GoDental insurance | Equity grant | Free Equinox Membership | Health insurance | Housing bonusMid-level Full TimeSan Francisco14h ago
-
Staff Machine Learning Engineer USD 188K-221KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R17h ago
-
Staff Software Engineer, Data & AI USD 183K-214KAWS | Airflow | Analytics | Artificial Intelligence | BI AnalyticsSenior-level Full TimeCA - San Francisco; WA - …18h ago
-
ASR | Automatic Speech Recognition | CTC | Data Augmentation | Knowledge Distillation401k matching | Annual offsites | Dental insurance | Free snacks and drinks | Health insuranceSenior-level Full TimeSan Francisco, CA19h ago
-
Activity Detection | Automatic Speech Recognition | Barge In | Deep learning | Denoising401k match | Dental insurance | Free snacks and drinks | Healthcare | Hybrid workMid-level Full TimeSan Francisco, CA19h ago
-
Machine Learning Researcher, Multimodal LLMs USD 140K-250KAudio codecs | Data Analysis | Experiment design | Fine Tuning | Language ModelsDental insurance | Equity | Health insurance | High autonomy | High impactSenior-level Full TimeSan Francisco20h ago
-
Application Software Engineer, Data USD 150K-225KAngular | C# | CI/CD | Continuous integration | DeploymentSenior-level Full TimeStarbase, TX20h ago