Senior Data Engineer

Important Information 

Location: Brazil
Job Mode: Full-time 
Work Mode: Work from home

Job Summary

We are looking for a Data Engineer who has experience with data pipelines, real-time APIs, and scalable cloud infrastructure. In this role, you will work with technologies like Kotlin, Kafka/Pulsar, Azure, and Kubernetes to build reliable, high-throughput systems for data movement and access. 

Responsibilities and Duties

• Design, build, and maintain ELT pipelines in Kotlin and Python that ingest and transform data from real-time sources like Kafka and Pulsar;
• Develop and maintain high-performance APIs to serve real-time data from databases, services, and caches;
• Collaborate with internal users and microservice consumers to ensure reliable access to up-to-date data;
• Architect and implement scalable solutions to handle growing traffic and data volume across services;
• Work with Azure cloud services, including Databricks, for data processing and analytics;
• Manage containerized workloads using Kubernetes, with a focus on high availability and auto-scaling;
• Participate in CI/CD, observability, and performance tuning across the platform. 

Essential Skills

• Experience building ELT or streaming data pipelines;
• Strong Kotlin, Python development skills (or experience with JVM languages and willingness to learn Kotlin);
• Deep understanding of distributed systems and real-time data processing;
• Proven experience with microservices architecture and API development;
• Solid understanding of Kubernetes concepts: pods, services, autoscaling, Helm charts, etc;
• Cloud deployment experience, ideally on Azure with exposure to Databricks or similar platforms;
• Experience with Typescript is a plus.

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.