Platform Engineer (m/w/d) LLMOps/AI Infrastructure
Tasks
- Advise product teams on integration patterns
- Advise product teams on model selection
- Advise product teams on prompt strategies
- Create developer documentation
- Define SLOs
- Develop LLM proxy and gateway
- Ensure gateway data privacy
- Ensure reliable access to LLM providers
- Implement provider failover
- Implement rate limiting
- Implement tracing logging monitoring
- Lead incident response
- Operate LLM proxy in production
- Provide observability for LLM and agent applications
- Provide platform best practices
- Support team onboarding
Perks/Benefits
- Agile work culture
- Bike leasing
- Company sport events
- Discounts on books
- Flexible working hours
- Health and wellbeing benefits
- Meal in company canteen
- Mobile work
- Networking opportunities
- Public transit discount
- Retirement benefits
- Subsidized childcare
- Training and development
- Work-life balance
- Workation
Skills/Tech-stack
AI Act | AWS | AWS Bedrock | Azure | Azure OpenAI | DSGVO compliance | EU AI | EU AI Act | GCP | Incident Management | Kubernetes | Logging | Monitoring | Observability | Rate Limiting | SLO | Tracing
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeKaiserslautern, DE1d ago
-
AI Agents | AI Foundry | Azure | Azure AI | Azure AI FoundryDevelopment opportunities | Flexible work hours | Homeoffice | Mitarbeiterrabatte | Sport Mitgliedschaft ZuschussEntry-level Part TimeHamburg, HH, Germany1d ago
-
AI Agents | AI Foundry | Azure | Azure AI | Azure AI FoundryCareer development | Employee discounts | Homeoffice | Modern equipment | Sports membership subsidyEntry-level Part TimeGermering, BY, Germany1d ago
-
Senior-level Full TimeBerlin, Germany; Frankfurt, Germany; Munich, Germany1d ago
-
AI / ML Lead Consultant (m/w/d) EUR 75K-85KAPIs | Advanced Analytics | CI/CD | Cloud platform | Computer VisionCareer development opportunities | Continuous learning | International team collaboration | Mentoring and coaching | Support for certificationsSenior-level Full TimeFrankfurt am Main, HE, Germany1d ago
-
Software Engineer (f/m/d) – Data Platforms EUR 32K-38KAWS | Apache Hadoop | Apache Spark | Big Data | CI/CDConference attendance | Corporate benefits | Germany ticket | Hackathons | JobradEntry-level Full TimeBerlin, State of Berlin, Germany2d ago
-
AI Infrastructure Engineer EUR 100K-102KApache Beam | Apache Hadoop | Apache Hive | Apache Spark | C plus plusMid-level Full TimeLondon, UK; Berlin, Germany2d ago
-
AWS | Azure | Backend Development | C++ | Cloud ComputingConference and training access | Flexible working hours | Fully remote work | Health, dental, vision benefits | Home office supportSenior-level Full TimeGermany R2d ago
-
Senior Analytics Engineer EUR 75K-89KAWS | BigQuery | CI/CD | DBT | FinOpsAnnual team gatherings | Company stock options program | Comprehensive healthcare coverage | Flexible PTO | Inclusive parental leaveSenior-level Full TimeRemote • France, Germany, Spain or … R2d ago
-
Senior Analytics Engineer EUR 75K-89KAWS S3 | BigQuery | CI/CD | DBT | Data ArchitectureAnnual team gatherings | Company stock options | Comprehensive healthcare | Flexible PTO | Inclusive parental leaveSenior-level Full TimeRemote • France, Germany, Spain or … R2d ago
-
AWS | Access Management | Airflow | CI/CD | DagsterCareer growth opportunities | Equity participation | Flexible work arrangements | Fully remote work | International collaborationMid-level Full TimeGermany R2d ago
-
Software Engineer (f/m/d) – Data Platforms EUR 32K-38KAWS | Apache Hadoop | Apache Spark | CI/CD | Delta LakeCorporate benefits | Hackathons and conferences support | Mental health support | Mobility support | RTL+ accessEntry-level Full TimeBerlin, Germany, 104352d ago
-
AI Platform Engineer (m/f/d) EUR 49K-67KAccess Management | Azure Monitor | CI/CD | Cloud Security | DockerBike leasing | Celebration rewards | Health and wellbeing support | Jubilee recognition | Meal programsMid-level Full TimeGermany - Remote R2d ago
-
AI Developer (m/f/d) EUR 50K-70KAutomation | Bash | CI/CD | Code review | DockerFlexible working arrangements | Professional development and training | Training and certificationsSenior-level Full TimeHerzogenrath,North Rhine Westphalia,Germany2d ago
-
Apache Kafka | Apache Spark | Batch Processing | BigQuery | Cloud DataFully remote work | Training and professional developmentSenior-level Full TimeGermany R2d ago
-
Agentic AI Software Engineer EUR 38K-51KAWS | Azure | CI/CD | Docker | FastAPICommunity knowledge sharing | Downtown office location | Flexible working model | Hackathons and conferences | Public transport ticketEntry-level Full TimeMunich, Bayern, Germany3d ago
-
Expert Robotics & Automation (m/w/d) EUR 55K-55KAPI Integration | Automation | Azure | Data Architecture | Data Lake30 days vacation | Bike leasing | Company pension | Employee discounts | Flexible working hoursSenior-level Full TimeKirchdorf/Oberopfingen, DE3d ago
-
Database Platform Engineer (m/f/d) EUR 35K-48KAI | AWS RDS | Access Management | Amazon Aurora | AuditingEntry-level Full TimeHerzogenaurach, BY, DE3d ago
-
AWS | Azure | Data Lakes | Databricks | DockerFlexible working models | Learning opportunities | Professional developmentEntry-level Part TimeWalldorf, DE, 691903d ago
-
AI Engineer (f/m/d) EUR 40K-60KAI Search | Autogen | Azure AI | Azure AI Search | Azure CosmosCareer development | Company pension | Hybrid work | Learning and development programs | Mental health and wellbeing programsMid-level Full TimeMünchen, DE, 80335 R3d ago
-
AI Engineer (m/w/d) EUR 54K-54KAzure | CI/CD | Code review | Computer Vision | Data GovernanceCareer development | Collaborative work environment | Healthy Meals | International team experience | Training opportunitiesEntry-level Full TimeDitzingen, Germany3d ago
-
Senior AI Software Engineer (f/m/d) EUR 55K-90KAWS | AWS CDK | Angular | Data Pipelines | DockerConference opportunities | Health benefits | Hybrid work | Mobility benefits | Team eventsSenior-level Full TimeKarlsruhe, BW, Germany3d ago
-
Data Platform Engineer Working Student (m/w/d) EUR 34K-35KAWS | Auto Loader | Azure | CI/CD | Data GovernanceCareer development | Flexible schedule during studies | Flexible work hours | Modern hardware | Remote workEntry-level Part TimeMünchen3d ago
-
AWS ECS | Amazon Web Services | CI/CD | Cloud platform | CloudFormationAfter work drinks | Company events | Flexible time off | Team lunchSenior-level Full TimeHamburg, HH, Germany4d ago
-
AWS | Amazon ECS | CI/CD | CloudFormation | DBTSenior-level Full TimeHamburg, HH, Germany4d ago