Senior Data Platform Engineer

Job Description

Sr. Data Platform Engineer

Our Enterprise Data & Analytics (EDA) is looking for an experienced Senior Data Platform Engineer to join our growing Platform engineering team. You’ll work in a collaborative Agile environment using the latest engineering best practices with involvement in all aspects of the software development lifecycle. 

As a Senior Data Platform Engineer, you will be responsible for building and maintaining  many key parts of the Zendesk Data Platform including next generation reporting and analytics. Working closely with your team members to craft, develop and deliver reporting products for our customers and high quality software projects on time.

Data is at the heart of Zendesk’s business! This is an autonomous role that can have a huge impact across all of the Zendesk product family!

What you get to do every single day:

• Design, develop and maintain scalable and efficient data infrastructure components, including data pipelines, storage solutions and data processing frameworks

• Build and manage integrations with various internal and external data sources via ETL solutions.

• Design, implement, and maintain CI/CD pipelines using DevOps tools like Terraform & Github Actions for automated build, test, and deployment processes

• Build high-quality, clean, scalable and reusable code by enforcing best practices around software engineering architecture and processes (Code Reviews, Unit testing, etc.)

• Collaborate with team members on researching and brainstorming different solutions for technical challenges we face

• Continually improve data pipelines for high efficiency, throughput and quality of data

• Investigate production issues and fine-tune our data pipelines

• Build and Promote best engineering practices in areas of version control system, CI/CD, code review, pair programming

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery

• Stay up-to-date with the latest technologies and industry trends, and proactively recommend improvements to our data platform.

What you bring to the role:

Basic Qualifications

• 4+ years of data engineering experience building, working & maintaining scalable data infrastructure (data pipelines & ETL processes on big data environments)

• 2+ years of experience with Cloud columnar databases (Snowflake

• Proven experience as a CI/CD Engineer or DevOps Engineer, with a focus on data platforms and analytics (Terraform, Docker, Github Actions)

• Experience with Cloud Platform (AWS, Google Cloud)

• Proficiency in query authoring (SQL) and data processing (batch and streaming)

• Intermediate experience with any of the programming language: Python, Go, Java, Scala, we use primarily Python

• Experience with ETL schedulers such as Apache Airflow, AWS Glue or similar frameworks

• Developer skills; demonstrating a strong passion to design scalable and fault-tolerant software systems

• Integration with 3rd party API SaaS applications like Salesforce, Zuora, etc

• Ensure data integrity and accuracy by conducting regular data audits, identifying and resolving data quality issues, and implementing data governance best practices.

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

• Ability to work closely with data scientists, analysts, and other stakeholders to translate business requirements into technical solutions. Strong documentation skills for pipeline design and data flow diagrams.

Preferred Qualifications

• Extensive experience with Snowflake or similar cloud warehouses (Bigquery, Redshift)

• Familiarity with infrastructure as code principles and tools (e.g., Terraform, CloudFormation, Github Actions)

• Experience with version control systems (e.g., Git) and CI/CD best practices for software development to bring automation

• Expert knowledge in python

• Familiarity with Airflow, Fivetran, Hightouch 

What does our data stack looks like:

• ELT (Fivetran, Bigquery, Snowflake, Fivetran, dbt, Airflow)

• BI (Tableau, Looker)

• Infrastructure (GCP, AWS, Kubernetes, Terraform, Github Actions)

Please note that Zendesk can only hire candidates who are physically located and plan to work from Karnataka or Maharashtra. Please refer to the location posted on the requisition for where this role is based.

Hybrid: In this role, our hybrid experience is designed at the team level to give you a rich onsite experience packed with connection, collaboration, learning, and celebration - while also giving you flexibility to work remotely for part of the week. This role must attend our local office for part of the week. The specific in-office schedule is to be determined by the hiring manager.

The intelligent heart of customer experience

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.

Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.

Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer. If you are based in the United States and would like more information about your EEO rights under the law, please click here.

Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law. If you are an individual with a disability and require a reasonable accommodation to submit this application, complete any pre-employment testing, or otherwise participate in the employee selection process, please send an e-mail to peopleandplaces@zendesk.com with your specific accommodation request.