[Job - 20610] Mid Level Databricks Data Developer, Colombia
Colombia
When applying for one of our positions, you’re agreeing to the use of AI in the early phases of the selection process, where your profile will be evaluated by our virtual assistant. For more information, access our opportunities’ page.
Since 2017, CI&T and Databricks have collaborated to help enterprise customers gather valuable insights from their data. Together, we significantly influence our clients' Data, AI, and ML journeys. With over 200 seasoned Databricks practitioners and a track record of successful enterprise projects, the partnership between CI&T and Databricks is exceptionally robust.
We're growing fast and seeking a talented, motivated Databricks Data Developer to join our team. You'll play a crucial role in developing and maintaining scalable data pipelines and infrastructure to drive data analytics and machine learning solutions for our clients.
Responsibilities- Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and SQL.- Implement data ingestion processes from various sources, ensuring data quality and accessibility.- Optimize data workflows and pipelines for performance and cost-effectiveness.- Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and reliability.- Contribute to architecture discussions and provide input on best practices for data engineering.- Document data models, workflows, and technical processes for team knowledge sharing.- Collaborate with data scientists and analysts to understand data requirements and translate them into technical specifications.- Stay updated with industry trends and emerging technologies in data engineering, AI, and ML.
Requirements for this challenge:- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.- Experience in data engineering, with a strong focus on Databricks, Spark, and SQL.- Proficiency in programming languages such as Python, Scala, or Java.- Experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB).- Hands-on experience with ETL (Extract, Transform, Load) processes and data pipeline orchestration tools (e.g., Apache Airflow, Azure Data Factory).- Understanding of cloud platforms (e.g., Azure, AWS, Google Cloud) and their data services.- Analytical and problem-solving skills with an attention to detail.- Excellent communication skills and ability to work collaboratively in a team environment.
Nice to Have:- Certification in Databricks, Azure, AWS, or GCP Data Engineering.- Knowledge of data governance and data quality best practices.- Familiarity with data visualization tools (e.g., Tableau, Power BI) and techniques.- Experience with machine learning frameworks (e.g., TensorFlow, PyTorch) and deployment practices.- Experience in Agile methodologies and working in cross-functional teams.- Previous experience in a consulting environment, particularly with enterprise clients.- Ability to communicate in English and Portuguese and engage with clients.
#LI-JP3#MidSeniorOur benefits include:
- Premium Healthcare- Meal voucher- Maternity and Parental leaves- Mobile services subsidy- Sick pay-Life insurance- CI&T University - Colombian Holidays- Paid VacationsAnd many others.
Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Architecture AWS Azure Computer Science Consulting Data Analytics Databricks Data governance Data pipelines Data quality Data visualization Engineering ETL GCP Google Cloud Java Machine Learning MongoDB NoSQL Pipelines PostgreSQL Power BI Python PyTorch Scala Spark SQL Tableau TensorFlow
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.