[Job - 23658] Data Engineering Specialist, Colombia
Brazil
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.With over 7,400 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
At CI&T, we're growing fast and seeking a talented and motivated Senior Talend Data Engineer to join our team. In this role, you will primarily focus on developing large-volume information ingestion and transformation. This position is responsible for orchestrating data interfaces into (and out of) our Enterprise Data Warehouse using Talend, SQL, Python, Databricks, and other data engineering solutions.
Key Responsibilities
- Design and develop ETL (Talend) / SQL / Python-based processes to perform complex data transformation processes.- Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms (RDBMS and No-SQL platforms)- Build Data Integration solutions to handle batch / streaming / IoT data on ETL, Big-Data platforms.- Develop and deliver changes in the Enterprise Data Warehouse according to Data Warehousing best practices.- Utilize Databricks for data processing, including Delta Live Tables, PySpark, and Databricks Workflows, to build reliable and maintainable pipelines.- Gather requirements and construct documentation to aid in maintenance and code reuse in accordance with team processes and standards.- Design, code, and test major data processing features, as well as collaborate with other team members to provide complex software enhancements for enterprise data storage platforms.- Monitor scheduled jobs and improve the reliability of ongoing processing.- Monitor, measure, and enhance ways to improve system performance.- Ability to multitask deliverables and efficiently manage them.- Perform other duties as assigned.
Qualifications
- Understanding and Hands-on experience with key technologies (SQL, ETL, Data modeling, data processing).- Development experience in a Big Data environment is a Plus; Spark, Kafka, and Message Queues.- 3-4 yrs Hands-on experience with ETL tools (Talend preferred).- Strong SQL skills with Relational DBMS technology - SQL Server is a plus.- Experience with shell scripting / Python / PySpark.- Good understanding and expertise in relational databases and data processing concepts.- Experience in handling multiple data formats (Delimited file, JSON, XML, etc).- Hands-on experience designing and implementing data ingestion techniques for real-time processes (IoT, eCommerce) is a plus.- Strong communication skills (oral and written).- Good analytical and problem-solving skills.- Knowledge of HR systems is a plus.- Candidate must be thorough and detail-oriented.- Able to work on multiple priorities in a deadline-driven environment.
Our benefits include:
- Premium Healthcare- Meal voucher- Maternity and Parental leaves- Mobile services subsidy- Sick pay-Life insurance- CI&T University - Colombian Holidays- Paid VacationsAnd many others.
Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.
At CI&T, we're growing fast and seeking a talented and motivated Senior Talend Data Engineer to join our team. In this role, you will primarily focus on developing large-volume information ingestion and transformation. This position is responsible for orchestrating data interfaces into (and out of) our Enterprise Data Warehouse using Talend, SQL, Python, Databricks, and other data engineering solutions.
Key Responsibilities
- Design and develop ETL (Talend) / SQL / Python-based processes to perform complex data transformation processes.- Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms (RDBMS and No-SQL platforms)- Build Data Integration solutions to handle batch / streaming / IoT data on ETL, Big-Data platforms.- Develop and deliver changes in the Enterprise Data Warehouse according to Data Warehousing best practices.- Utilize Databricks for data processing, including Delta Live Tables, PySpark, and Databricks Workflows, to build reliable and maintainable pipelines.- Gather requirements and construct documentation to aid in maintenance and code reuse in accordance with team processes and standards.- Design, code, and test major data processing features, as well as collaborate with other team members to provide complex software enhancements for enterprise data storage platforms.- Monitor scheduled jobs and improve the reliability of ongoing processing.- Monitor, measure, and enhance ways to improve system performance.- Ability to multitask deliverables and efficiently manage them.- Perform other duties as assigned.
Qualifications
- Understanding and Hands-on experience with key technologies (SQL, ETL, Data modeling, data processing).- Development experience in a Big Data environment is a Plus; Spark, Kafka, and Message Queues.- 3-4 yrs Hands-on experience with ETL tools (Talend preferred).- Strong SQL skills with Relational DBMS technology - SQL Server is a plus.- Experience with shell scripting / Python / PySpark.- Good understanding and expertise in relational databases and data processing concepts.- Experience in handling multiple data formats (Delimited file, JSON, XML, etc).- Hands-on experience designing and implementing data ingestion techniques for real-time processes (IoT, eCommerce) is a plus.- Strong communication skills (oral and written).- Good analytical and problem-solving skills.- Knowledge of HR systems is a plus.- Candidate must be thorough and detail-oriented.- Able to work on multiple priorities in a deadline-driven environment.
Our benefits include:
- Premium Healthcare- Meal voucher- Maternity and Parental leaves- Mobile services subsidy- Sick pay-Life insurance- CI&T University - Colombian Holidays- Paid VacationsAnd many others.
Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Big Data Jobs
Engineering Jobs
Tags: Big Data Databricks Data warehouse Data Warehousing E-commerce Engineering ETL JSON Kafka Pipelines PySpark Python RDBMS Shell scripting Spark SQL Streaming Talend XML
Region:
South America
Country:
Brazil
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Sr. Data Engineer jobsPower BI Developer jobsPrincipal Data Engineer jobsData Scientist II jobsBI Developer jobsStaff Data Scientist jobsPrincipal Software Engineer jobsStaff Machine Learning Engineer jobsDevOps Engineer jobsData Science Intern jobsJunior Data Analyst jobsSoftware Engineer II jobsAI/ML Engineer jobsStaff Software Engineer jobsData Science Manager jobsData Manager jobsLead Data Analyst jobsData Analyst Intern jobsData Specialist jobsSr. Data Scientist jobsBusiness Data Analyst jobsBusiness Intelligence Analyst jobsData Governance Analyst jobsData Engineer III jobsSenior Backend Engineer jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsKafka jobsEconomics jobsKPIs jobsGitHub jobsLinux jobsJavaScript jobsTerraform jobsPostgreSQL jobsRAG jobsPrompt engineering jobsBanking jobsStreaming jobsData Warehousing jobsScikit-learn jobsNoSQL jobsClassification jobsRDBMS jobsComputer Vision jobsPhysics jobsdbt jobsHadoop jobs
Pandas jobsScala jobsGoogle Cloud jobsGPT jobsData warehouse jobsR&D jobsLangChain jobsMicroservices jobsBigQuery jobsCX jobsELT jobsOracle jobsDistributed Systems jobsScrum jobsLooker jobsReact jobsIndustrial jobsPySpark jobsRedshift jobsJira jobsOpenAI jobsRobotics jobsSAS jobsUnstructured data jobsSalesforce jobs