Sr. Platform Engineer
Rochester, MN, United States
Mayo Clinic
The Mayo Clinic Platform AI team is seeking an experienced Senior Platform Engineer to join our innovative efforts in developing and implementing cutting-edge generative AI solutions. In this role, you will lead the design and development of state-of-the-art generative AI models, establish comprehensive safety guardrails for responsible AI deployment, and drive the creation of autonomous AI agents. You’ll collaborate closely with a diverse team of data scientists, product managers, and engineers as we shape the future of AI applications while ensuring our systems remain safe, ethical, and scalable.
Key Responsibilities
- Generative AI Model Development: Architect, design, and implement advanced generative AI models and architectures that support varied departmental applications and cutting-edge research initiatives.
- GenAI Safety & Ethics: Develop comprehensive safety guardrails and ethical guidelines to ensure responsible AI development and deployment, incorporating best practices in AI alignment and security.
- Cross-Functional Collaboration: Partner with cross-functional teams to integrate AI solutions seamlessly within the Mayo Clinic Platform, translating business needs into robust technical implementations.
- Autonomous AI Agents: Lead the creation and optimization of intelligent AI agents designed for autonomous decision-making, leveraging techniques in prompt engineering and model fine-tuning.
System Enhancement: Evaluate and enhance existing generative AI deployments across departmental applications, continually iterating to improve performance, safety, and scalability. - Performance Optimization: Identify bottlenecks in AI/ML pipelines and propose solutions to improve system performance, efficiency, and scalability.
- Monitoring & Troubleshooting: Develop and maintain observability tools, including logging, monitoring, and alerting, to diagnose and resolve production issues.
- Documentation: Create and maintain technical documentation, including architectural diagrams, API specifications, and onboarding guides for internal and external stakeholders.
- Thought Leadership: Stay updated with the latest trends and advancements in federated learning, distributed computing, and machine learning frameworks to continually enhance the platform.
- Bachelors degree in a relevant information technology field or a minimum 7 years of direct full-stack engineering with increasing complexity.
- 3-5 years working in diverse environments utilizing Agile principles of software development.
- Proven experience as a Full Stack Engineer with a strong emphasis on healthcare interoperability.
- Proficiency in Java and/or .NET for backend development, including API / service design and implementation.
- Expertise in Javascript with a focus on React and react frameworks (e.g. NextJS) for building responsive and intuitive front-end applications.
- Hands-on experience with Google Cloud Platform (GCP) (or equivalent) services and cloud-native application development.
- Familiarity with healthcare interoperability standards such as HL7, FHIR and OMOP.
- Strong problem-solving skills and the ability to work in a collaborative, cross-functional team environment.
- Experience with DevOps practices, CI/CD pipelines, and containerization technologies (e.g., Docker, Kubernetes) is a plus.
- Knowledge of healthcare data security and compliance requirements, including HIPAA, is highly desirable.
- Excellent communication skills and the ability to convey complex technical concepts to non-technical stakeholders.
- A proactive and self-driven mindset with a passion for staying up-to-date with emerging technologies and industry best practices.
- Experience with Interoperability standards such as HL7, FHIR and OMOP.
- Experience with solutions integration/delivery in a healthcare setting.
Preferred Experience
2 years in a senior or lead capacity, ideally in a distributed systems, AI/ML, or large-scale data environment. Programming Skills: Strong proficiency in languages such as Python, Java, C++, or Go, with demonstrated experience building production-grade services. Machine Learning Frameworks: Familiarity with common ML libraries and frameworks (e.g., TensorFlow, PyTorch), especially those supporting federated learning (e.g., TensorFlow Federated). Distributed Systems: Solid understanding of distributed computing principles, including concurrency, data partitioning, and scaling strategies. Cloud & DevOps: Hands-on experience with cloud platforms (AWS, Azure, or GCP) and container orchestration (Docker, Kubernetes). Familiarity with CI/CD pipelines and infrastructure-as-code tools. Security & Compliance: Working knowledge of data privacy and protection standards (GDPR, HIPAA, or similar), encryption, and secure data handling practices. LLM Fine-Tuning: Experience in fine-tuning large language models and advanced prompt engineering techniques. AI Alignment & Safety: Hands-on background in AI alignment strategies and the development of robust safety mechanisms. RAG Expertise: Familiarity with Retrieval-Augmented Generation (RAG) techniques to improve model responsiveness and efficiency. Production Deployment: Proven experience with AI model deployment and scaling in production environments, including container orchestration and cloud-based solutions. Multi-Modal AI: Understanding and experience working with multi-modal AI systems that integrate text, image, and other data types.
Why Mayo ClinicMayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic. You’ll thrive in an environment that supports innovation, is committed to ending racism and supporting diversity, equity and inclusion, and provides the resources you need to succeed.
Benefits Highlights
- Medical: Multiple plan options.
- Dental: Delta Dental or reimbursement account for flexible coverage.
- Vision: Affordable plan with national network.
- Pre-Tax Savings: HSA and FSAs for eligible expenses.
- Retirement: Competitive retirement package to secure your future.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture AWS Azure CI/CD DevOps Distributed Systems Docker Engineering GCP Generative AI Google Cloud HL7 Java JavaScript Kubernetes LLMs Machine Learning ML models Model deployment OMOP Pipelines Privacy Prompt engineering Python PyTorch RAG React Research Responsible AI Security TensorFlow
Perks/benefits: Career development Competitive pay Equity / stock options Flex hours Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.