Data Engineer

Here is a complete and polished Job Description (JD) for the Data Engineer role based on your requirements:

Job Title: Data Engineer
Job Location: Poland (Remote)
Employment Type: B2B Contract

About the Role

We are looking for a skilled Data Engineer to join our team on a B2B contract basis for an exciting opportunity with our client, Coforge. This role is fully remote with potential occasional travel on a need basis. The ideal candidate will be based in Poland and have a strong background in data engineering, cloud technologies, and infrastructure automation.

As a Data Engineer, you will work closely with cross-functional teams to design, build, and maintain scalable data pipelines and platforms. You’ll play a critical role in enabling data-driven decision-making across the organization by ensuring data is accurate, accessible, and well-structured.

Key Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines on AWS.
• Build and automate data workflows and ETL processes using Python and AWS services.
• Collaborate with data scientists, analysts, and other engineers to understand data requirements and implement effective data solutions.
• Use AWS CDK to provision and manage cloud infrastructure following best practices.
• Implement CI/CD pipelines to streamline development and deployment workflows.
• Ensure data quality, integrity, and governance across all systems.
• Monitor data pipeline performance and troubleshoot issues proactively.
• Participate in code reviews and contribute to continuous improvement efforts.

Must-Have Skills

• Strong experience as a Data Engineer working on cloud-based data solutions.
• Proficiency in AWS services (e.g., S3, Glue, Lambda, Redshift, etc.).
• Advanced Python programming skills for data processing and automation.
• Hands-on experience with CI/CD tools and practices (e.g., GitLab CI, Jenkins).
• Experience with AWS CDK (Cloud Development Kit) for infrastructure as code.
• Solid understanding of software engineering best practices, including version control, testing, and documentation.

Preferred Qualifications

• Familiarity with data modeling and data warehousing concepts.
• Experience with containerization (Docker, ECS/EKS) is a plus.
• Knowledge of data security and compliance requirements.
• Prior experience working in an Agile environment.