[Job - 20616] Databricks Senior Data Architect, Brazil
Brazil
When applying for one of our positions, you’re agreeing to the use of AI in the early phases of the selection process, where your profile will be evaluated by our virtual assistant. For more information, access our opportunities’ page.
Since 2017, CI&T and Databricks have collaborated to help enterprise customers gather valuable insights from their data. Together, we significantly influence our clients' Data, AI, and ML journeys. With over 200 seasoned Databricks practitioners and a track record of successful enterprise projects, the partnership between CI&T and Databricks is exceptionally robust.
We're growing fast and seeking a talented, motivated Databricks Senior Data Architect to join our team. You'll play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to drive data analytics and machine learning solutions for our clients.
Responsibilities:- Architecture Design: Design and implement scalable and efficient data architecture solutions using Databricks, ensuring alignment with best practices and client needs.- Data Pipeline Development: Create, test, and maintain robust data pipelines to ingest and process large volumes of data from various sources.- Collaboration: Work closely with data engineers, data scientists, and stakeholders to understand data requirements and translate them into technical specifications.- Performance Optimization: Monitor and optimize the performance of data pipelines and infrastructure, ensuring high availability and reliability.- Technology Evaluation: Track emerging technologies and data processing frameworks to enhance the existing architecture and recommend improvements.- Documentation: Develop and maintain comprehensive documentation for data architecture, processes, and workflows.- Mentorship: Provide technical guidance and mentorship to junior data architects and engineers within the team.- Client Engagement: Collaborate with clients to understand their business objectives and data challenges, providing insights and recommendations to drive their data strategy.
Requirements for this Challenge:- Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.- Sólid experience in data architecture, data developing, or a similar role, with hands-on experience in Databricks.- Soft Skills: Excellent communication in English and Portuguese, with the ability to work effectively in a team-oriented environment and engage with clients.- Technical Skills: Proficiency in Apache Spark, SQL, and data modeling; strong understanding of ETL processes and tools.- Cloud Platforms: Experience with cloud platforms such as Azure, AWS, or Google Cloud, especially concerning Databricks services. Networking and IAM setup experience are a plus.- Programming Languages: Proficient in the Python programming language.- Data Warehousing: Familiarity with data warehousing concepts and technologies.- Problem-Solving Skills: Strong analytical and problem-solving skills with a focus on optimizing data solutions.
Nice to Have:- Certifications: Relevant certifications in Databricks, AWS, Azure, or Google Cloud.- Machine Learning Knowledge: Understanding of machine learning concepts and frameworks to support data science initiatives.- Agile Experience: Experience working in Agile environments and familiarity with DevOps + IaC practices.- Additional Programming Languages: Scala, Java, or R.
#LI-JP3#MidSeniorOur benefits:
-Health and dental insurance-Meal and food allowance-Childcare assistance-Extended paternity leave-Wellhub (Gympass)-TotalPass-Profit-sharing (PLR)-Life insurance-CI&T University-Discount club-Free online platform dedicated to physical, mental, and overall well-being-Pregnancy and responsible parenting course-Partnerships with online learning platforms-Language learning platformAnd many more!More details about our benefits here: https://ciandt.com/br/pt-br/carreiras
Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture AWS Azure Computer Science Data Analytics Databricks Data pipelines Data strategy Data Warehousing DevOps ETL GCP Google Cloud Java Machine Learning Pipelines Python R Scala Spark SQL
Perks/benefits: Career development Fitness / gym Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.