Platform Engineer (m/w/d) LLMOps/AI Infrastructure
Tasks
- Advise product teams on integration patterns
- Advise product teams on model selection
- Advise product teams on prompt strategies
- Create developer documentation
- Define SLOs
- Develop LLM proxy and gateway
- Ensure gateway data privacy
- Ensure reliable access to LLM providers
- Implement provider failover
- Implement rate limiting
- Implement tracing logging monitoring
- Lead incident response
- Operate LLM proxy in production
- Provide observability for LLM and agent applications
- Provide platform best practices
- Support team onboarding
Perks/Benefits
- Agile work culture
- Bike leasing
- Company sport events
- Discounts on books
- Flexible working hours
- Health and wellbeing benefits
- Meal in company canteen
- Mobile work
- Networking opportunities
- Public transit discount
- Retirement benefits
- Subsidized childcare
- Training and development
- Work-life balance
- Workation
Skills/Tech-stack
AI Act | AWS | AWS Bedrock | Azure | Azure OpenAI | DSGVO compliance | EU AI | EU AI Act | GCP | Incident Management | Kubernetes | Logging | Monitoring | Observability | Rate Limiting | SLO | Tracing
Education
N/A
Roles
Related jobs
-
Senior Data Engineer (w/m/d) EUR 60K-82KAWS | AWS Glue | Airbyte | Amazon Athena | Amazon EC2Hybrid work | Jobrad | Public transport subsidy | Team events | Training and conferencesSenior-level Full TimeKarlsruhe, BW, Germany23h ago
-
AI Software Builder (m/w/d) EUR 50K-67KAWS | Artificial Intelligence | CRM | Communication | Data Migration13 salaries | Bike leasing | Childcare support | Company pension | EV chargingMid-level Full TimeNeubesetzung1d ago
-
Data Engineer (m/w/d) EUR 55K-65KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaBenefits | Paid vacation | Unrestricted contractMid-level Full TimeFrankfurt am Main, DE1d ago
-
Senior Data Engineer, Constellation Services EUR 56K-86KAWS | Cloud platform | DBT | Datadog | DockerEmployee wellness program | Equity | Home office reimbursement | LinkedIn Learning access | Paid time offSenior-level Full TimeBerlin, Germany R1d ago
-
APIs | AWS | Agentic AI | Azure | Azure DevOpsBicycle leasing | Company phone | Corporate benefits | EU remote working | Employee eventsEntry-level Full Timemehrere Standorte, DE1d ago
-
AI Engineer (m/w/d) EUR 54K-54KAI Services | Azure AI | Azure AI Services | Azure OpenAI | CI/CDAdditional vacation | Casback program | Employee discounts | Flexible working hours | Health managementEntry-level Full TimeDortmund, Germany1d ago
-
Computer Scientist Cloud Services EUR 44K-55KAWS | Amazon DynamoDB | C++ | Cassandra | Code ReviewsOn site team days | Work from home flexibilityMid-level Full TimeHamburg, Germany R1d ago
-
AI Engineer (m/w/d) EUR 54K-54KAzure | Azure OpenAI | CI/CD | Cloud | Data integrationCash back for green commute | Employee discounts | Flexible work schedule | Health management | Massage serviceEntry-level Full TimeGermany, 443691d ago
-
API Gateway | Automated testing | CI/CD | Clean architecture | DockerCareer development | Continuous learning | Flexible work arrangements | Hybrid work | Professional growthSenior-level Full TimeGermany2d ago
-
Machine Learning Engineer (all genders) EUR 31K-45KDeep learning | Fine Tuning | Machine Learning | Model Deployment | Model EvaluationBusinessbike | Company fitness | E-learning support | Extra vacation | Family Friendly ProgramEntry-level Full TimeBremen, Mainz, Berlin, München, Mannheim2d ago
-
API Integration | Access Control | Amazon Redshift | Apache Airflow | Automated testingCollaborative culture | Flexible working hours | Fully remote | Ownership and influence | Paid vacation daysSenior-level Full TimeGermany R2d ago
-
GenAI Engineer (m/w/d) EUR 53K-53KAWS | Agent systems | Azure | CI/CD | Cloud infrastructureEnterprise access to leading LLMs | Flexible work arrangement | Hackathons | Mentorship | Remote work optionSenior-level Full TimeMunich, Bayern, Germany2d ago
-
AI Engineer Microsoft (m/w/d) EUR 47K-48KAI Foundry | AI Search | API Management | Access Control | Agentic AISenior-level Full TimeBundesweit, Sulzbach/Saar R2d ago
-
AI Engineer SAP (m/w/d) EUR 47K-47KAI Core | AI Launchpad | AI-Hub | API Engineering | Agent FrameworksCareer growth | Employee sports activities | Flexible work style | International team | Team collaborationSenior-level Full TimeBundesweit, Sulzbach/Saar R2d ago
-
API Integration | Benchmarks | Cloud platform | Diffusion Models | DockerCareer development | Company bike | Employee discount | Flexible work | Public transit discountSenior-level Full TimeMünster, NRW, Germany2d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible, hands-off management | Friendly laid-back atmosphere | Impact on consumer and enterprise productsMid-level Full TimeStuttgart, Germany2d ago
-
ASPICE | AWS | Atlassian Bitbucket | Atlassian Confluence | Atlassian JiraSenior-level Full TimeMunich, Germany2d ago
-
(Senior) AI Engineer (m/f/d) EUR 47K-47KAWS | Agentic Workflows | Automated testing | CI/CD | Cloud platform30 days annual leave | Bicycle leasing | Company sports activities | Corporate fitness programmes | Discounted mealsSenior-level Full TimeFreising, BY, DE, 853542d ago
-
Apache Airflow | Apache Spark | CI/CD | Cloud Storage | DatabricksAdditional pension scheme | Development resources | ESPP | Equipment reimbursement | Flexible paid time offSenior-level Full TimeBerlin, Germany R2d ago
-
Apache Airflow | Apache Hadoop | Apache Impala | Apache Spark | CI/CDAdditional pension scheme | ESPP | Equipment reimbursement | Flexible paid time off | Internet reimbursementSenior-level Full TimeBerlin, Germany R2d ago
-
AWS | Data Classification | Data Enrichment | Data Visualization | Event DrivenCareer and training opportunities | Fitness and wellness options | Flex Time | Free access to Langdock | Hybrid workSenior-level Full TimeHamburg or Berlin3d ago
-
Data Scientist Customer Analytics (w/m/d) EUR 51K-60KAWS | Apache Spark | CI/CD | Feature Engineering | GitBicycle leasing | Company car | Company pension plan | Mobile work | Modern work environmentSenior-level Full TimeHamburg3d ago
-
AI Engineer Financial Services (m/w/d) EUR 47K-47KAPI Integration | AWS Bedrock | Azure OpenAI | Chatbots | Cloud ArchitectureCompany car | Company fitness | Family service | Flexible vacation | Hybrid workSenior-level Full Timebundesweit, Germany R3d ago
-
AWS | Apache Spark | Asynchronous programming | Azure | ChromaDBAccidental death and dismemberment coverage | Company covered travel expenses | Dental insurance | Flexible paid time off | Health insuranceMid-level Full TimeGermany R3d ago
-
Werkstudent AI Engineering (m/w/d) EUR 44K-50KAI Agents | API Integration | Automation | Azure | ChatbotsCorporate discounts | Deutschlandticket subsidy | Employee referral program | Flexible working hours | Health checksEntry-level Full Time Part TimeKöln, NRW, Germany3d ago