Corporate Vice President - Streaming Architect
New York, NY, US
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Full Time Senior-level / Expert USD 157K - 250K
New York Life Insurance Co
Protect and build your future with comprehensive one-on-one guidance from New York Life. Learn about our life insurance and financial product offerings.
Location Designation: Hybrid - 3 days per week
Our New York Life culture has laid the foundation for over 180 years of commitment to our employees, agents, policy owners, and the communities where we live and work. Here you become a valued part of a welcoming, inclusive, and caring organization with a long-standing legacy in stability and growth. The strength revolves around our diversified, multi-dimensional business portfolio that goes beyond life insurance.
As a Fortune 100 company and industry leader, we provide an environment where you can explore your career ambitions, offering opportunities to tackle meaningful challenges and stretch your skills while balancing work and life priorities. You will be part of an inclusive team guided by our belief to always be there for each other–providing the support and flexibility to grow and reach new heights while making an impact in the lives of others.
You are our future, and we commit to investing in you accordingly.
As part of AI & Data, you'll have the opportunity to contribute to groundbreaking initiatives that shape New York Life's digital landscape. Leverage cutting-edge technologies like Generative AI to increase productivity, streamline processes, and create seamless experiences for clients, agents, and employees. Your expertise fuels innovation, agility, and growth — driving the company's success.
As a Streaming Architect, you will design and implement enterprise-scale real-time data streaming architectures that enable low-latency data processing, event-driven systems, and real-time analytics across New York Life's digital ecosystem. You'll be responsible for architecting robust, scalable streaming platforms that support operational, analytical and AI workloads while ensuring high availability, fault tolerance, and data consistency. This role requires deep expertise in distributed systems, event streaming technologies, and real-time data processing frameworks. You will collaborate with data engineers, application developers, and business stakeholders to translate real-time business requirements into production-ready streaming solutions that drive competitive advantage through timely insights and responsive systems.
What You’ll Do:
As a Streaming Architect, your primary focus will be designing and implementing enterprise streaming data architectures that enable real-time processing and event-driven capabilities at scale. You will architect end-to-end streaming data platforms including event ingestion, stream processing, instream enrichment, real-time analytics, and downstream consumption patterns for both operational and analytical use cases
Managing the design of fault-tolerant, high-throughput streaming systems that ensure exactly-once processing semantics, proper backpressure handling, and comprehensive monitoring across distributed environments
You will establish streaming data standards, event modeling, and best practices including event schema evolution, stream partitioning strategies, and real-time data quality frameworks
Leading the evaluation and implementation of streaming technologies including Apache Kafka, Apache Pulsar, cloud-native streaming services, and real-time processing frameworks like Apache Flink, Spark Streaming, and Kafka Streams
Your expertise in event-driven architecture patterns will drive the implementation of CQRS, event sourcing, and saga patterns that enable microservices architectures and real-time business processes
You will create comprehensive streaming data governance frameworks including event catalog management, schema registry implementation, and real-time data lineage tracking
What You’ll Bring:
You will bring deep expertise in distributed systems architecture and real-time data processing technologies. You understand the complexities of building resilient streaming platforms including handling late-arriving data, managing state in distributed systems, and ensuring consistent processing across failure scenarios. Beyond your technical skillset, you can effectively communicate complex streaming architecture concepts to diverse stakeholders and translate business requirements for real-time capabilities into scalable technical solutions. You can influence Application owners to adopt best practices. Your communication and influence skills are equally important to your technical skills.
Required Skills:
-
BS in Computer Science, Distributed Systems, or related technical discipline with 8+ years of experience in distributed systems architecture and 5+ years specifically in streaming data platforms
-
Expert-level proficiency with Apache Kafka ecosystem including Kafka Connect, Kafka Streams, Schema Registry, and cluster management at enterprise scale
-
Strong programming skills in Java, Scala, or Python with extensive experience in distributed systems concepts including consensus algorithms, eventual consistency, and fault tolerance patterns
-
Comprehensive understanding of event-driven architecture patterns, microservices design, and real-time data governance frameworks
-
Experience with spark streaming and the Databricks ecosystem
Preferred Skills:
-
Experience with advanced streaming analytics including Complex Event Processing (CEP), time-series analysis, and real-time machine learning inference
-
Knowledge of event sourcing, CQRS patterns, and distributed transaction management in streaming environments
-
Familiarity with emerging streaming technologies including Apache Pulsar, RedPanda, or cloud-native serverless streaming solutions
-
Experience with streaming data integration patterns including Change Data Capture (CDC), event mesh architectures, and hybrid cloud streaming topologies
-
Background in highly regulated industries such as banking, insurance and health care.
Pay Transparency
Salary Range: $157,500-$250,000
Overtime eligible: Exempt
Discretionary bonus eligible: Yes
Sales bonus eligible: No
Actual base salary will be determined based on several factors but not limited to individual’s experience, skills, qualifications, and job location. Additionally, employees are eligible for an annual discretionary bonus. In addition to base salary, employees may also be eligible to participate in an incentive program.
Our Benefits
We provide a full package of benefits for employees – and have unique offerings for a modern workforce, including leave programs, adoption assistance, and student loan repayment programs. Based on feedback from our employees, we continue to refine and add benefits to our offering, so that you can flourish both inside and outside of work. Click here to discover more about our comprehensive benefit options or visit our NYL Benefits Site.
Our Commitment to Inclusion
At New York Life, fostering an inclusive workplace is fundamental to who we are and how we serve our communities. We have a longstanding commitment to creating an environment where individuals can contribute their best and succeed together. This foundation is rooted in our core values of humanity and integrity, ensuring that every employee feels valued and supported. By embracing a broad range of perspectives and experiences, we achieve greater success and fulfill our promise of providing financial security and peace of mind to families across all communities. Click here to learn more about New York Life’s leadership in this space.
Recognized as one of Fortune’s World’s Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by the Foundation. We're proud that due to our mutuality, we operate in the best interests of our policy owners. To learn more about career opportunities at New York Life, please visit the Careers page of www.NewYorkLife.com.
Visit our LinkedIn to see how our employees and agents are leading the industry and impacting communities.
Visit our Newsroom to learn more about how our company is constantly evolving to meet our clients' and employees’ needs.
Job Requisition ID: 92214
Tags: Architecture Banking Computer Science Databricks Data governance Data quality Distributed Systems Flink Generative AI Java Kafka Machine Learning Microservices Pulsar Python Scala Security Spark Streaming
Perks/benefits: Career development Competitive pay Health care Salary bonus Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.