Software Engineer - Data Engineering
Bengaluru, Karnataka
Zeotap
Zeotap is a customer intelligence platform (CIP) that helps brands understand their customers and predict behaviors so that they can improve customer engagementFounded in Berlin in 2014, Zeotap started with a mission to provide high-quality data to marketers. As we evolved, we recognized a greater challenge: helping brands create personalized, multi-channel experiences in a world that demands strict data privacy and compliance. This drive led to the launch of Zeotap’s Customer Data Platform (CDP) in 2020—a powerful, AI-native SaaS suite built on Google Cloud that empowers brands to unlock and activate customer data securely.
Today, Zeotap is trusted by some of the world’s most innovative brands, including Virgin Media O2, Amazon, and Audi, to create engaging, data-driven customer experiences that drive better business outcomes across marketing, sales, and service. With an unique background in high-quality data solutions, Zeotap is a leader in the European CDP market, empowering enterprises with a secure, privacy-first solution to harness the full potential of their customer data.
Responsibilities:
- You will design and implement robust, scalable, and high-performance data pipelines using Spark, Scala, and Airflow with familiarity on Google Cloud.
- You develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
- You will assemble large, complex data sets that meet functional and non-functional business requirements.
- You build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from various data sources.
- You will collaborate with data scientists and other stakeholders to improve data models that drive business processes.
- You implement data flow and tracking using Apache Airflow.
- You ensure data quality and integrity across various data processing stages.
- You monitor and optimize the performance of the data processing pipeline.
- You will tune and optimize Spark jobs for performance and efficiency, ensuring they run effectively on large-scale data sets.
- You troubleshoot and resolve issues related to data pipelines and infrastructure.
- You stay up-to-date with the latest technologies and best practices in Big Data and data engineering.
- You adhere to Zeotap’s company, privacy and information security policies and procedures
- You complete all the awareness trainings assigned on time
Requirements:
- 2+ years of experience in building and deploying high scale solutions
- Must have very good problem-solving skills and clear fundamentals of DS and algorithms
- Expert coding skills in Java or Scala
- Expert coding skills in Go or Python is a huge plus
- Apache Spark or other Bigdata stack experience is a mandatory
- High level and low-level design skills.
- Deep understanding of any OLTP, OLAP, NoSQL or Graph databases is a huge plus.
- Deep knowledge of distributed systems and design is a huge plus
- Hands-on with Streaming technologies like Kafka, Flink, Samza etc is a huge plus
- Good knowledge of scalable technologies involving Bigdata technologies
- Bachelor or Master’s degree in information systems, computer science or other related fields is preferred
What we offer:
- Competitive compensation and attractive perks
- Health Insurance coverage
- Flexible working support, guidance and training provided by a highly experienced team
- Fast paced work environment
- Work with very driven entrepreneurs and a network of global senior investors across telco, data, advertising, and technology
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture Big Data Computer Science Data pipelines Data quality Distributed Systems Engineering ETL Flink GCP Google Cloud Java Kafka NoSQL OLAP Pipelines Privacy Python Scala Security Spark Streaming
Perks/benefits: Competitive pay Flex hours Insurance
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.