[Job - 23658] Data Engineering Specialist, Colombia

Brazil

⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️

Apply now Apply later

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.With over 7,400 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. 
At CI&T, we're growing fast and seeking a talented and motivated Senior Talend Data Engineer to join our team. In this role, you will primarily focus on developing large-volume information ingestion and transformation. This position is responsible for orchestrating data interfaces into (and out of) our Enterprise Data Warehouse using Talend, SQL, Python, Databricks, and other data engineering solutions.
Key Responsibilities
- Design and develop ETL (Talend) / SQL / Python-based processes to perform complex data transformation processes.- Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms (RDBMS and No-SQL platforms)- Build Data Integration solutions to handle batch / streaming / IoT data on ETL, Big-Data platforms.- Develop and deliver changes in the Enterprise Data Warehouse according to Data Warehousing best practices.- Utilize Databricks for data processing, including Delta Live Tables, PySpark, and Databricks Workflows, to build reliable and maintainable pipelines.- Gather requirements and construct documentation to aid in maintenance and code reuse in accordance with team processes and standards.- Design, code, and test major data processing features, as well as collaborate with other team members to provide complex software enhancements for enterprise data storage platforms.- Monitor scheduled jobs and improve the reliability of ongoing processing.- Monitor, measure, and enhance ways to improve system performance.- Ability to multitask deliverables and efficiently manage them.- Perform other duties as assigned.
Qualifications
- Understanding and Hands-on experience with key technologies (SQL, ETL, Data modeling, data processing).- Development experience in a Big Data environment is a Plus; Spark, Kafka, and Message Queues.- 3-4 yrs Hands-on experience with ETL tools (Talend preferred).- Strong SQL skills with Relational DBMS technology - SQL Server is a plus.- Experience with shell scripting / Python / PySpark.- Good understanding and expertise in relational databases and data processing concepts.- Experience in handling multiple data formats (Delimited file, JSON, XML, etc).- Hands-on experience designing and implementing data ingestion techniques for real-time processes (IoT, eCommerce) is a plus.- Strong communication skills (oral and written).- Good analytical and problem-solving skills.- Knowledge of HR systems is a plus.- Candidate must be thorough and detail-oriented.- Able to work on multiple priorities in a deadline-driven environment.
Our benefits include:
- Premium Healthcare- Meal voucher- Maternity and Parental leaves- Mobile services subsidy- Sick pay-Life insurance- CI&T University   - Colombian Holidays- Paid VacationsAnd many others. 

Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Big Data Databricks Data warehouse Data Warehousing E-commerce Engineering ETL JSON Kafka Pipelines PySpark Python RDBMS Shell scripting Spark SQL Streaming Talend XML

Region: South America
Country: Brazil

More jobs like this