AI Architect (LLM Focus)

Your mission

You are a highly skilled AI Architect with deep expertise in Large Language Models (LLMs) eager to join our core development team for a federal-level project in Germany. 

The goal is to build a scalable, secure, and robust AI solution to support the digitization of administrative planning and approval processes.

As the AI Architect, you will lead the design and technical direction of the AI system, ensuring alignment with functional requirements, compliance standards, and performance needs.

Our mission

We are an AI startup that empowers developers to build applications that use natural language as the interface to data. Our open-source framework Haystack is used by thousands of developers to build LLM applications. deepset AI Platform (formerly known as deepset Cloud) enables enterprises worldwide to unlock the potential of large language models for their business cases. Come join our team and work with tech experts on real-world cases, in a fast-paced and high-impact environment, and shape the AI space together with us.

Life at deepset

At deepset you will find an environment with equal opportunities to grow, share ideas, build relationships, and succeed. We believe every employee is important and generates a direct impact on our team’s success.
We are certified by Flexa® Careers as a flexible employer, and our remote first culture is designed to provide work-life balance, autonomy, and flexibility. Our daily meetings, the in person "re:base", and the social events allow us to work with great synergy. We would like to invite you to visit our life page to learn more about our culture.

Your impact

• Design and architect AI components, with a strong emphasis on LLM-based modules

• Define the system architecture, data pipelines, and integration strategies with administrative platforms

• Work closely with MLOps engineers and backend developers to ensure seamless deployment and scaling

• Ensure compliance with data protection (DSGVO/GDPR) and IT security requirements

• Collaborate with public administration stakeholders, business analysts, and legal experts to align AI capabilities with domain needs

• Provide technical leadership in model selection, fine-tuning, and optimization processes

Your profile

• Degree in Computer Science, AI, Machine Learning, or a related field

• At least 2 years of professional experience in a similar AI architecture or senior developer role

• Proven experience with Large Language Models (e.g., GPT, BERT, LLaMA) and modern ML frameworks (e.g., PyTorch, TensorFlow)

• Hands-on experience with designing and deploying AI systems in production environments

• Familiarity with MLOps/DevOps concepts for scalable deployment

• Strong understanding of data governance, model explainability, and ethical AI

• Experience in government or legal tech applications

• Previous involvement in AI projects related to approval processes, legal decision-making, or administrative digitization

• Knowledge of German public administration standards and regulations

Perks

• Remote First: You can choose to work from home or any other workspace that suits you. We offer home office setup (equipment and furniture).‍
• Grow: Personal and professional growth are important to us. We have an annual learning and development budget, and also the opportunity to speak at conferences, internal knowledge sharing, and workshops.‍
• Connect: We have a virtual office, a monthly social budget to reconnect virtually or in person, online walks and talks with colleagues from other teams, and a flexible travel policy that enables you to meet colleagues in person for special occasions.‍
• You are an owner: All employees are enrolled in the employee stock option plan and own a part of the company.‍
• Personal time off: If you want to recharge and travel the world - there are 30 days of paid vacation.‍
• Choose your tech: The choice is yours among our pre-selected options, and we will provide what you need.‍
• Pension fund and Health Insurance fitting with your main working location: All full-time employees are eligible for the pension plan. We also offer health, dental, and vision for employees in the US, in compliance with the local market.‍
• Travel Insurance: We want you to be secure during your travels. Therefore, we offer every employee additional travel insurance.‍
• Sports budget: To boost your health and well-being, we offer a monthly allowance for your sports activity.‍
• Oliva - employee mental wellbeing benefit: To boost your well-being, we offer a benefit that helps you to respond to pivotal moments at work and beyond.‍
• Dog-friendly: Our headquarters in Berlin welcomes dogs, so you can also bring your best friend to the office.‍
• Enhanced days off for Family Sick Leave: We offer additional days in case your child gets sick.‍
• Additional days off: We don't work on the 24th & the 31st of December.‍
• Flexible working hours: You can adapt your work to your private life.