Senior Data Pipelines Engineer

Description

VAST Data is looking for a Senior Software Engineer to join our growing Innovative DataEngine team!

This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history. This organization is in the center of the hurricane created by the artificial intelligence revolution.

As a Data Pipelines Engineer,

You will be building pipelines on top of the Vast Insight Engine, a one-stop shop to build fully integrated AI pipelines. You will build new and innovative AI pipelines and applications as blueprints for customers and AI practitioners to use.

VAST Data is the data platform company for the AI era. We are building the enterprise software infrastructure to capture, catalog, refine, enrich, and protect massive datasets and make them available for real-time data analysis and AI training and inference. Designed from the ground up to make AI simple to deploy and manage, VAST takes the cost and complexity out of deploying enterprise and AI infrastructure across data centers, edge, and cloud.

Our success has been built through intense innovation, a customer-first mentality, and a team of fearless VASTronauts who leverage their skills & experiences to make a real market impact.

Requirements

• Is proficient in python - at least 5 years of production-grade code development
• Has strong familiarity with LLM tooling frameworks (LangChain, LlamaIndex, Haystack, etc)
• Is involved in AI communities and surveys the landscape for new AI tools, technologies papers, and projects
• Familiar with state-of-the-art RAG technologies
• Has a deep understanding of the state-of-the-art AI pipelines and technologies
• Has built and deployed AI driven pipelines or applications into production - Must
• Experience with popular models HuggingFace and/or NVIDIA NIMs
• Understand modular pipelines and CI/CD integrations