AI Solution Architect

At Roche you can show up as yourself, embraced for the unique qualities you bring. Our culture encourages personal expression, open dialogue, and genuine connections,  where you are valued, accepted and respected for who you are, allowing you to thrive both personally and professionally. This is how we aim to prevent, stop and cure diseases and ensure everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters.

The Position

Always innovating, we bring together dedicated people and diverse perspectives from across our global network, empowering each other keep breaking new ground.

The Galileo team is looking for an Artificial Intelligence Solutions Architect.

Galileo is a strategic Roche Informatics program aiming to enable high-value AI (initial focus: Generative AI - GenAI) use cases at Roche through fit-for-purpose platforms and services, establishing a foundation for a Center of Excellence in AI.

We are looking for a highly skilled AI Software Architect to design and help implement end-to-end GenAI and non-GenAI applications. This role will involve working with Large Language Models (LLMs), multimodal models, Retrieval-Augmented Generation (RAG) pipelines, agentic workflows, vector and traditional databases, APIs, and other solution components also including those not related to AI, utilizing cloud services (AWS, Azure) to develop scalable and robust AI solutions.

The Opportunity:

• End-to-End System Architecture:

  • Define and design AI and non-AI components of software applications, ensuring modularity, scalability, and security

  • Architect solutions that integrate GenAI capabilities into enterprise systems while ensuring seamless interoperability with backend services, APIs, databases, and user interfaces

  • Ensure adherence to cloud-native best practices across AWS and Azure deployments, including containerization, orchestration, and infrastructure as code

• AI Model Integration & Optimization:

  • Define robust patterns for utilizing LLMs, multimodal models, and RAG and agentic systems

  • Design efficient model-serving pipelines, integrating AI capabilities into existing business workflows

• Enterprise-Grade Software Engineering:

  • Ensure that AI applications follow software engineering best practices, including version control, CI/CD, automated testing, and code quality assurance

  • Architect secure and scalable APIs to facilitate seamless communication between AI models, databases, and user interfaces

  • Design data pipelines that efficiently handle structured and unstructured data, ensuring AI models receive high-quality input data

• Observability, Performance & Security:

  • Define monitoring and logging strategies for AI-driven applications to ensure model performance, API health, and data integrity

  • Implement AI observability practices, ensuring visibility into model behavior, drift detection, and anomaly identification

  • Design architectures that adhere to data governance, security, compliance, and ethical AI guidelines

• Collaboration & Governance:

  • Work closely with ML Engineers, Data Scientists, Software Engineers, Business Analysts, Product Owners and other members of Agile development teams to translate business requirements into AI-driven architectures

  • Provide technical leadership in AI architecture reviews, design discussions, and solution validation

Who you are:

• 7+ years of experience in software architecture and engineering, including at least 3 years in AI/ML-related projects.

• Minimum Bachelors Degree or related experience.

• Expertise in AWS and Azure cloud services, including compute, storage, networking, security, and AI/ML services.

• Proven ability to design and implement cloud-native architectures using containerization (Docker, Kubernetes), orchestration, and IaC tools (Terraform, CloudFormation).

• Demonstrated track record of designing and deploying large-scale, cloud-based AI and non-AI applications in enterprise environments.

• Deep understanding of AI/ML concepts, including LLMs, multimodal models, RAG, agentic systems, model training, and evaluation metrics.

• Experience in designing and implementing AI model integration, optimization strategies, and model-serving pipelines.

• Strong software engineering background with proficiency in Python, backend development, APIs, data pipelines, and integration patterns.

• Knowledge of databases, including vector databases, SQL, NoSQL, and data storage solutions, along with experience in data governance and security.

• Experience with MLOps principles, CI/CD pipelines, DevOps, Infrastructure as Code, microservices, and software engineering best practices.

• Ability to define end-to-end system architectures, integrating AI and non-AI components, and designing monitoring, logging, and observability strategies.

Relocation benefits are not available for this job posting.

A healthier future drives us to innovate. Together, more than 100’000 employees across the globe are dedicated to advance science, ensuring everyone has access to healthcare today and for generations to come. Our efforts result in more than 26 million people treated with our medicines and over 30 billion tests conducted using our Diagnostics products. We empower each other to explore new possibilities, foster creativity, and keep our ambitions high, so we can deliver life-changing healthcare solutions that make a global impact.

Let’s build a healthier future, together.

Roche is an Equal Opportunity Employer.