Senior Data Engineer
Colombia
Mediabrands
The world has changed, so we have too. We’ve reengineered the very core of our business to guarantee we keep pace with a consumer that moves faster than ever before.Senior Data Engineer
We're looking for a highly skilled Senior Data Engineer to join our team and play a leading role in designing, developing, and maintaining our scalable data infrastructure. You'll leverage your expertise in Python, Snowflake, dbt (Data Build Tools), Dagster, Docker, and Kubernetes to create, containerize, deploy, and orchestrate efficient data pipelines that transform raw data into actionable insights.
Responsibilities:
- Design, develop, and maintain data pipelines using Python, Snowflake, dbt (Data Build Tools), and Dagster
- Collaborate with cross-functional teams (data analysts, product managers) to understand data requirements and architect optimal solutions
- Write clean, maintainable Python code using dbt for data transformation in Snowflake, utilizing strong SQL skills for complex data manipulation and retrieval
- Utilize Dagster to orchestrate and schedule data pipeline execution
- Optimize and tune data pipelines for performance and scalability
- Implement robust data governance, security best practices, and data quality checks
- Monitor data pipelines, implement SLA checks, and troubleshoot data-related issues efficiently
- Utilize Docker to containerize data pipelines for consistent and portable deployments
- Leverage Kubernetes to manage and orchestrate containerized data pipelines at scale
- Stay up-to-date on the latest trends and technologies in data engineering
- Document your work clearly and concisely for maintainability
- Participate in code reviews and knowledge sharing
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field (Master's degree a plus)
- 5+ years of experience as a Data Engineer or similar role
- Demonstrated expertise in SQL, with a strong understanding of core functionalities (data retrieval, manipulation), advanced capabilities (subqueries, window functions), and performance optimization techniques
- In-depth understanding of Snowflake, including SnowSQL, virtual warehouses, security, and performance optimization
- Strong proficiency in Python programming with experience in object-oriented programming (OOP) and functional programming concepts
- Experience with dbt (Data Build Tools) for data transformation and modeling in Snowflake
- Experience with Dagster or similar orchestration tools for scheduling data pipelines
- Familiarity with Docker containerization concepts and best practices
- Familiarity with Kubernetes for container orchestration (a plus)
- Experience with cloud platforms (AWS, Azure, GCP) is a plus
- Experience with data warehousing concepts (ETL, data modeling)
- Experience with Git or equivalent version control systems and CI/CD pipelines
- Experience in Agile methodologies and leading agile teams utilizing Scrum.
- An understanding of common digital marketing metrics (impressions, clicks, conversions), marketing attribution models, and familiarity with marketing data sources would be beneficial.
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
- Ability to work independently and as part of a team
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile AWS Azure CI/CD Computer Science Dagster Data governance Data pipelines Data quality Data Warehousing dbt Docker Engineering ETL GCP Git Kubernetes OOP Pipelines Python Scrum Security Snowflake SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.