Senior Data Engineer
Israel
Cloudinary
Who We Are?
Our Data team is made up of skilled senior software and data professionals who collaborate to tackle some of the most complex data challenges. With billions of data records processed daily, we build and maintain robust data infrastructure to power insights and decisions across the organization and for customers using our product line. Our pipelines handle processing of Big Data, leveraging Iceberg open-table format with Spark processing and state of the art engine capabilities.
#LI-SL1
Our Data team is made up of skilled senior software and data professionals who collaborate to tackle some of the most complex data challenges. With billions of data records processed daily, we build and maintain robust data infrastructure to power insights and decisions across the organization and for customers using our product line. Our pipelines handle processing of Big Data, leveraging Iceberg open-table format with Spark processing and state of the art engine capabilities.
What You’ll Do?
- Data End-to-End: Take co-ownership of all aspects of our data, including cloud platform infrastructure selection, development, and maintenance. As well as data modeling, implementing DBA best practices to optimize performance, scalability, and reliability.
- Ensure Data Quality & Integrity: Implement governance practices to maintain high standards of data quality across multiple environments and use cases.
- Develop & Optimize Streamed Data Pipelines: Build, refine, and maintain ETLs, ELTs that process vast amounts of data live, in streaming, as well as schedule. Technologies include Spark, Scala, Airflow, Snowflake, Iceberg, Trino, SQL, and AWS tools such as Firehose, Glue, Athena, EMR, Lambda, SQS, Eventbridge.
- Collaborate with Cross-Functional Teams: Partner with Developers, Data Science, BI Developers, Data Analysis, Product teams, and external stakeholders to design and implement data-driven solutions addressing real business and product needs. The data is consumed internally in the organization, as well as by customers using Cloudinary’s product line. You will understand the needs, the ingress data, coming from many data sources, and the schemas, to yield valuable solutions.
- Drive Innovation: Stay up to date of current data best practices. Identify opportunities to streamline data processes, adopt new technologies, and advocate for engineering best practices.
- Support Infrastructure: Contribute to the design and maintenance of scalable AWS cloud-based systems, ensuring reliable and secure data access.
Who You Are?
- Experienced Senior Data Engineer: 3+ years in a data engineering role and with 6+ years in backend software development, with a track record of delivering high-quality, robust data solutions.
- We stress that we are looking for a Data Engineer who is also a strong backend developer who can build the data platform, including AWS infrastructure and Spark pipelines.
- Hands-On Development: Routinely develops in multiple programming languages, preferably Python/Scala/Go, to build and maintain data pipelines.
- ETL/ELT Expert: Proven experience with data processing strategies, frameworks, and tools—alongside a deep understanding of SQL, of transformations and integration patterns.
- Business-Focused: Able to understand and align data initiatives with business objectives, ensuring data solutions effectively support company goals.
- Cloud Savvy: Profound hands-on experience with AWS or equivalent, building the following infrastructure: Spark, EMR, Glue, Airflow, Containers, Kubernetes, and AWS Lambda.
- MPP/DWH Know-How: Substantial experience working with MPP databases or modern DWH technologies (e.g., Snowflake, Iceberg) to power large-scale analytics.
#LI-SL1
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: Airflow Athena AWS Big Data Data analysis Data pipelines Data quality ELT Engineering ETL Firehose Kubernetes Lambda MPP Pipelines Python Scala Snowflake Spark SQL Streaming
Region:
Middle East
Country:
Israel
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Scientist II jobsSr. Data Engineer jobsStaff Data Scientist jobsPrincipal Data Engineer jobsBI Developer jobsStaff Machine Learning Engineer jobsData Manager jobsSenior AI Engineer jobsData Science Intern jobsJunior Data Analyst jobsPrincipal Software Engineer jobsBusiness Data Analyst jobsData Science Manager jobsResearch Scientist jobsData Specialist jobsSoftware Engineer II jobsLead Data Analyst jobsData Analyst Intern jobsSr. Data Scientist jobsDevOps Engineer jobsData Engineer III jobsJunior Data Engineer jobsAI/ML Engineer jobsBI Analyst jobsData Engineering Manager jobs
Snowflake jobsEconomics jobsLinux jobsKafka jobsOpen Source jobsNoSQL jobsData Warehousing jobsHadoop jobsAirflow jobsRDBMS jobsBanking jobsPhysics jobsJavaScript jobsComputer Vision jobsMLOps jobsScala jobsKPIs jobsGoogle Cloud jobsClassification jobsData warehouse jobsPostgreSQL jobsScikit-learn jobsTerraform jobsGitHub jobsOracle jobs
Streaming jobsLooker jobsSAS jobsScrum jobsR&D jobsPySpark jobsPandas jobsCX jobsData Mining jobsBigQuery jobsDistributed Systems jobsJira jobsdbt jobsReact jobsIndustrial jobsRobotics jobsMicroservices jobsRedshift jobsJenkins jobsUnstructured data jobsData strategy jobsNumPy jobsRAG jobsMySQL jobsELT jobs