Senior Data Engineer

ProArch is seeking a highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration projects and ensure seamless data transformations.

Key Responsibilities:

• Lead and execute data migration initiatives, specifically from Oracle to PostgreSQL.
• Design, develop, and implement AWS DMS solutions to migrate databases.
• Collaborate with cross-functional teams to understand data requirements and ensure smooth migration processes.
• Develop and optimize data pipelines using Python and PySpark.
• Troubleshoot migration issues and implement corrective actions to ensure minimal disruptions during data transfer.
• Ensure data integrity, accuracy, and quality throughout the migration process.
• Create and maintain detailed documentation for migration processes, workflows, and data transformations.
• Stay up to date with the latest technologies, best practices, and tools in data engineering and migration.

Requirements

Requirements

• 5+ years of experience in the IT Industry, with a focus on Data Engineering.
• Strong hands-on experience with Oracle to PostgreSQL migrations.
• Expertise in using AWS DMS (Database Migration Service) for seamless data migration.
• Proficient in Python and PySpark, with a strong understanding of data engineering concepts and data pipeline development.
• Solid understanding of database architecture, SQL, and data modeling.
• Experience in troubleshooting, optimizing, and scaling data migration workflows.
• Ability to work independently and in a team environment with strong problem-solving skills.
• Excellent written and verbal communication skills.

Preferred Qualifications:

• Experience with other AWS services such as AWS Lambda, S3, and Redshift is a plus.
• Familiarity with other database migration tools and technologies.
• Certifications in AWS or other relevant data engineering domains.