Senior Manager, Data Platform Software

We are seeking a Senior Manager, Data Platform Software to lead our data platform team in designing, building, and maintaining a scalable and high-performance data infrastructure. This role involves managing teams working on data bus technologies like Kafka, real-time streaming services, data lakes, and analytics platforms to support business intelligence, machine learning, and AI-driven insights. The ideal candidate will have deep expertise in big data architecture, distributed systems, and cloud-native technologies, with strong leadership and strategic vision.

Key Responsibilities

• Define and drive the technical vision, architecture, and roadmap for the data platform, ensuring alignment with business goals.
• Lead cross-functional teams in the development and operation of a high-scale, low-latency data infrastructure.
• Drive best practices for data engineering, streaming, and analytics to ensure reliability, performance, and scalability.
• Collaborate with product, engineering, analytics, and business teams to define data requirements and solutions.
• Oversee the design and implementation of Kafka-based messaging systems for real-time data streaming.
• Manage the development and optimization of data lakes (e.g., AWS S3, Delta Lake, Apache Iceberg) to support large-scale analytics.
• Lead the adoption of real-time and batch processing technologies (e.g., Apache Flink, Spark, Snowflake, Databricks, BigQuery).
• Ensure efficient data governance, cataloging, lineage tracking, and access control across the data platform.
• Establish CI/CD pipelines, monitoring, and observability frameworks for data pipelines and streaming services.
• Optimize data ingestion, transformation, and storage for cost efficiency and performance.
• Lead incident management and troubleshooting for production data systems, ensuring high availability and reliability.
• Build and mentor a high-performing data engineering team, fostering a culture of ownership, learning, and innovation.
• Manage vendor relationships and oversee the integration of third-party data platform tools.
• Advocate for data-driven decision-making and align leadership on key data initiatives.

Required Qualifications

• 10+ years of experience in data engineering, platform architecture, or software development, with at least 6+ years in a leadership role.
• Hands-on experience with Kafka, Apache Flink, Apache Spark, and stream processing frameworks.
• Deep knowledge of cloud data architectures (Azure, AWS, or GCP), including serverless computing, Kubernetes, and containerized data services.
• Strong experience with data lake technologies (Delta Lake, Iceberg, Parquet, ORC) and warehouse solutions(Snowflake, BigQuery, Redshift).
• Proficiency in big data frameworks, distributed computing, and real-time analytics solutions.
• Expertise in SQL, Python, Scala, or Java for data processing and automation.
• Understanding of data security, compliance (GDPR, CCPA), and governance best practices.
• Proven experience in managing and scaling data platform teams in a fast-paced environment.
• Strong ability to influence and drive technical decisions across different levels of the organization.
• Excellent stakeholder management and ability to translate complex technical topics into business value.

Preferred Qualifications

• Experience with ML model deployment and AI-driven analytics on data platforms.
• Familiarity with real-time analytics tools (Druid, ClickHouse, Rockset, Pinot).
• Certifications in Azure/AWS/GCP data engineering.

Why Join Us?

• Experience with ML model deployment and AI-driven analytics on data platforms.
• Familiarity with real-time analytics tools (Druid, ClickHouse, Rockset, Pinot).
• Certifications in Azure/AWS/GCP data engineering.

This role offers an opportunity to define and lead the evolution of a data platform that powers mission-critical business insights. If you are passionate about scalable data architectures, real-time analytics, and leading high-performing teams, we would love to hear from you!