Middle/Senior Data Engineer (Advertising management application)
São Paulo, Brazil
Sigma Software
Sigma Software is multinational IT company that provides the custom software development solutions. Become one of us!Company Description
We have a great opportunity for a talented and experienced Middle/Senior Data Engineer who will become part of our dynamic team in the Advertising and Media domain.
If you are ready to show a high level of engagement in making technical decisions and solving challenging problems - this opportunity is for you.
Sounds like you? We are waiting for you in our team!
PROJECT
Our client operates in the AdTech domain, specializing in developing cutting-edge applications that drive innovation in digital advertising.
As a Data Engineer, you will be involved in developing an advertising management application in the AdTech domain. Our approach empowers teams with the autonomy to solve business problems using the most effective tools and methods. We value simplicity, beauty, and cost-effectiveness in our solutions.
Job Description
- Design, implement, and maintain scalable data pipelines to ingest and transform large volumes of data from various sources
- Optimize streaming and batch data processing and storage solutions for performance and scalability
- Monitor system performance, troubleshoot issues, and implement solutions to ensure high availability and reliability
- Collaborate with product managers and other stakeholders to understand data requirements and deliver data solutions that meet business needs
- Communicate technical concepts and solutions effectively to non-technical stakeholders
- Stay abreast of emerging technologies and best practices in data engineering. Identify opportunities to improve data processes, tools, and infrastructure to enhance efficiency and effectiveness
- Document data pipelines, processes, and systems to ensure clarity and maintainability
- Share knowledge and best practices with team members to foster a culture of learning and collaboration
Qualifications
- 4+ years of hands-on experience in the Software Development field and/or Big Data
- Solid programming skills, fluency with Java
- Familiar with big data processing Framework/tools Spark, Spark Streaming, Databricks, Flink
- Experience with Data Lakehouse technics
- Solid SQL skills with experience in writing complex queries, stored procedures, and optimizing querying performance
- Experience with data warehouse, data modeling techniques, ETL processes, and relational databases (MySQL, PostgreSQL)
- Familiarity with AWS (EC2, S3, etc.), and proficiency in managing cloud-based data solutions
- At least an Upper-Intermediate level of English
Additional Information
PERSONAL PROFILE
- Excellent problem-solving skills and attention to detail
- Strong communication skills, with the ability to collaborate effectively in a team environment
- Proven ability to deliver results in a fast-paced environment
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Big Data Databricks Data pipelines Data warehouse EC2 Engineering ETL Flink Java MySQL Pipelines PostgreSQL RDBMS Spark SQL Streaming
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.