Staff Machine Learning Engineer

WHO WE ARE 

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI. Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

About the Role

We are seeking a Staff Machine Learning Engineer to lead the development of cutting-edge AI applications using LangSmith, Amazon Bedrock, and OpenAI’s foundation models. As a senior technical leader, you will architect, deploy, and scale generative AI workflows that power intelligent applications across our products.

You’ll collaborate cross-functionally with research, product, and engineering teams to build robust, production-grade systems that push the boundaries of what large language models (LLMs) can do in real-world environments.

What You’ll Do

• Design and implement end-to-end generative AI systems using LangSmith and OpenAI-compatible tools.
• Integrate and evaluate foundation models (e.g., GPT-4, Claude) via OpenAI APIs and Amazon Bedrock.
• Develop reusable components and LLM pipelines, including function calling, RAG, agents, and tool augmentation.
• Lead efforts in prompt engineering, evaluation, and performance tuning using tools like LangSmith tracing and model analytics.
• Define architecture and best practices for scalable, maintainable LLM-based applications.
• Mentor junior engineers and guide the team on ML design patterns, evaluations, and deployment strategies.
• Drive technical decision-making for LLM inference, vector search integration, latency optimization, and privacy safeguards.

What We’re Looking For

• 10+ years of experience in machine learning, with 2+ years focused on LLMs, NLP, or generative AI.
• Deep understanding of modern LLM stacks and orchestration tools such as LangChain, LangSmith, LlamaIndex, or similar.
• Hands-on experience deploying models through Amazon Bedrock, OpenAI API, or comparable inference platforms.
• Strong software engineering skills in Python, and familiarity with distributed systems and cloud services (AWS preferred).
• Experience with vector databases (e.g., Pinecone, Redis, PostgreSQL) and RAG pipelines.
• Strong grasp of prompt design, evaluation metrics, and fine-tuning techniques.
• Ability to collaborate across cross-functional teams and lead architecture-level decisions.

Nice to Have

• Experience contributing to or building internal LangSmith environments for evals and observability.
• Knowledge of CI/CD for ML pipelines, model monitoring, and observability tools like Weights & Biases or MLflow.
• Exposure to multi-agent systems or MCP-compatible tools.
• Prior experience with privacy-aware AI development and model security.

BENEFITS & PERKS

• Unlimited PTO
• Excellent medical, dental, and vision coverage
• Employee Equity
• Employee Discounts, Virtual Wellness Classes, and Pet Insurance And more!!

SALARY RANGE

The salary range for this role is $200,000 - $220,000, depending on location and experience. 

PEOPLE & CULTURE AT ZETA

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.  

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here:  https://zetaglobal.com/blog/a-look-into-zetas-ergs/ 

ZETA IN THE NEWS!

https://zetaglobal.com/press/?cat=press-releases 

#LI-DD1