[Job - 23658] Data Engineering Specialist, Brazil
Brazil
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
At CI&T, we're growing fast and seeking a talented and motivated Senior Talend Data Engineer to join our team. In this role, you will primarily focus on developing large-volume information ingestion and transformation. This position is responsible for orchestrating data interfaces into (and out of) our Enterprise Data Warehouse using Talend, SQL, Python, Databricks, and other data engineering solutions.
Key Responsibilities
- Design and develop ETL (Talend) / SQL / Python-based processes to perform complex data transformation processes.- Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms (RDBMS and No-SQL platforms)- Build Data Integration solutions to handle batch / streaming / IoT data on ETL, Big-Data platforms.- Develop and deliver changes in the Enterprise Data Warehouse according to Data Warehousing best practices.- Utilize Databricks for data processing, including Delta Live Tables, PySpark, and Databricks Workflows, to build reliable and maintainable pipelines.- Gather requirements and construct documentation to aid in maintenance and code reuse in accordance with team processes and standards.- Design, code, and test major data processing features, as well as collaborate with other team members to provide complex software enhancements for enterprise data storage platforms.- Monitor scheduled jobs and improve the reliability of ongoing processing.- Monitor, measure, and enhance ways to improve system performance.- Ability to multitask deliverables and efficiently manage them.- Perform other duties as assigned.
Qualifications
- Understanding and Hands-on experience with key technologies (SQL, ETL, Data modeling, data processing).- Development experience in a Big Data environment is a Plus; Spark, Kafka, and Message Queues.- 3-4 yrs Hands-on experience with ETL tools (Talend preferred).- Strong SQL skills with Relational DBMS technology - SQL Server is a plus.- Experience with shell scripting / Python / PySpark.- Good understanding and expertise in relational databases and data processing concepts.- Experience in handling multiple data formats (Delimited file, JSON, XML, etc).- Hands-on experience designing and implementing data ingestion techniques for real-time processes (IoT, eCommerce) is a plus.- Strong communication skills (oral and written).- Good analytical and problem-solving skills.- Knowledge of HR systems is a plus.- Candidate must be thorough and detail-oriented.- Able to work on multiple priorities in a deadline-driven environment.
Our benefits:
-Health and dental insurance-Meal and food allowance-Childcare assistance-Extended paternity leave-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;-Profit Sharing and Results Participation (PLR);-Life insurance-Continuous learning platform (CI&T University);-Discount club-Free online platform dedicated to physical, mental, and overall well-being-Pregnancy and responsible parenting course-Partnerships with online learning platforms-Language learning platformAnd many more!
More details about our benefits here: https://ciandt.com/br/pt-br/carreiras
At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.
We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Big Data Databricks Data warehouse Data Warehousing E-commerce Engineering ETL JSON Kafka Pipelines PySpark Python RDBMS Shell scripting Spark SQL Streaming Talend XML
Perks/benefits: Career development Fitness / gym Health care Insurance Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.