Senior Data Engineer

Israel

Apply now Apply later

Who We Are?
Our Data team is made up of skilled senior software and data professionals who collaborate to tackle some of the most complex data challenges. With billions of data records processed daily, we build and maintain robust data infrastructure to power insights and decisions across the organization and for customers using our product line. Our pipelines handle processing of Big Data, leveraging Iceberg open-table format with Spark processing and state of the art engine capabilities.

What You’ll Do?

  • Data End-to-End: Take co-ownership of all aspects of our data, including cloud platform infrastructure selection, development, and maintenance. As well as data modeling, implementing DBA best practices to optimize performance, scalability, and reliability.

  • Ensure Data Quality & Integrity: Implement governance practices to maintain high standards of data quality across multiple environments and use cases.

  • Develop & Optimize Streamed Data Pipelines: Build, refine, and maintain ETLs, ELTs that process vast amounts of data live, in streaming, as well as schedule.  Technologies include Spark, Scala, Airflow, Snowflake, Iceberg, Trino, SQL, and AWS tools such as Firehose, Glue, Athena, EMR, Lambda, SQS, Eventbridge.

  • Collaborate with Cross-Functional Teams: Partner with Developers, Data Science, BI Developers, Data Analysis, Product teams, and external stakeholders to design and implement data-driven solutions addressing real business and product needs.  The data is consumed internally in the organization, as well as by customers using Cloudinary’s product line.  You will understand the needs, the ingress data, coming from many data sources, and the schemas, to yield valuable solutions.

  • Drive Innovation: Stay up to date of current data best practices.  Identify opportunities to streamline data processes, adopt new technologies, and advocate for engineering best practices.

  • Support Infrastructure: Contribute to the design and maintenance of scalable AWS cloud-based systems, ensuring reliable and secure data access.

Who You Are?

  • Experienced Senior Data Engineer: 3+ years in a data engineering role and with 6+ years in backend software development, with a track record of delivering high-quality, robust data solutions. 
  • We stress that we are looking for a Data Engineer who is also a strong backend developer who can build the data platform, including AWS infrastructure and Spark pipelines.

  • Hands-On Development: Routinely develops in multiple programming languages, preferably Python/Scala/Go, to build and maintain data pipelines.

  • ETL/ELT Expert: Proven experience with data processing strategies, frameworks, and tools—alongside a deep understanding of SQL, of transformations and integration patterns.

  • Business-Focused: Able to understand and align data initiatives with business objectives, ensuring data solutions effectively support company goals.

  • Cloud Savvy: Profound hands-on experience with AWS or equivalent, building the following infrastructure: Spark, EMR, Glue, Airflow,  Containers, Kubernetes, and AWS Lambda.

  • MPP/DWH Know-How: Substantial experience working with MPP databases or modern DWH technologies (e.g., Snowflake, Iceberg) to power large-scale analytics.
If you’re ready to drive data excellence at scale, collaborate on meaningful projects, and shape the future of data-driven decision-making, we’d love to talk. Join our team and help us transform how we think about data.
#LI-SL1

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0
Category: Engineering Jobs

Tags: Airflow Athena AWS Big Data Data analysis Data pipelines Data quality ELT Engineering ETL Firehose Kubernetes Lambda MPP Pipelines Python Scala Snowflake Spark SQL Streaming

Region: Middle East
Country: Israel

More jobs like this