Data Engineer SR - Apache Flink

Important Information 

Location: Brazil
Job Mode: Full-time 
Work Mode: Work from home

Job Summary

As a Data Engineer, you will work with stream processing technologies, particularly Apache Flink and Kafka Connect. In this role, you'll design, implement, and maintain scalable data pipelines that process real-time and batch data, enabling critical business insights and data-driven decision making.

Responsibilities and Duties

• Design, develop, and optimize data pipelines using Apache Flink for stream and batch processing;
  
• Implement and maintain Kafka Connect connectors for seamless data integration;
  
• Build and maintain data infrastructure on Google Cloud Platform (GCP);
  
• Design and optimize BigQuery tables, views, and stored procedures;
  
• Collaborate with product managers and analysts to understand data requirements;
  
• Ensure data quality, reliability, and proper governance;
  
• Troubleshoot and resolve data pipeline issues;
  
• Document data flows, transformations, and architecture.
  
  

Essential Skills

• Experience as a Data Engineer;
  
• Strong experience with Apache Flink, including knowledge of the DataStream and Table APIs;
  
• Experience with Kafka and Kafka Connect for data integration · Experience with containerization (Docker) and orchestration (Kubernetes);
  
• Experience in Cloud Infrastructure platforms such as AWS, GCP;
  
• Solid SQL skills with specific experience in BigQuery SQL dialect;
  
• Experience with data modeling and schema design;
  
• Proficient in at least one programming language (Java or Python);
  
• Experience with version control systems (Git) and CI/CD pipelines.
  
  

Additional Skills

• Knowledge and hands-on experience with Kafka Infrastructure (i.e. managing and configuring Kafka components);
  
• Experience with other stream processing frameworks (Spark Streaming, Kafka Streams);
  
• Knowledge of data governance and security best practices · Proficiency with Google Cloud Platform services, particularly:
  - Google Cloud Storage;
  - Dataflow;
  - Pub/Sub;
  - BigQuery;
• Experience with Apache Airflow;
  
• Experience with BI tools such as Tableau or PowerBI · Familiarity with monitoring tools like Prometheus, Grafana;
  
• Certifications such as Google Cloud Professional Data Engineer.

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.