Principal Data Engineer - AWS

We're seeking a seasoned Principal Data Engineer with a track record of 8 to 10 years in the field, with a specialization in AWS, to join our dynamic team of analytics experts. This role presents an exciting opportunity for an individual who thrives on solving complex challenges spanning a diverse array of technologies. If you're someone who revels in experimentation and is eager to push the boundaries of your skills, we want to hear from you.

As a Principal Data Engineer, you'll be at the forefront of shaping and maintaining data analytic roadmaps and infrastructures that closely align with our business and technology objectives. Your innate curiosity and enthusiasm for uncovering insights buried within datasets will be invaluable as you collaborate across functional areas to drive actionable outcomes.

Required Skills and Qualifications:

• Strong SQL writing skills
• Proficiency in Python, PySpark, and Delta Lake is a must
• Experience with streaming ingestion using AWS Kinesis
• Familiarity with specialized data architecture concepts (e.g., data lake, lake house, data fabric, data mesh, etc.)
• Expertise in data engineering on the Amazon Cloud platform
• Demonstrated proficiency with AWS services such as S3, Lambda, EC2, Redshift/Redshift Spectrum, Glue, EMR, Athena, MSK, DMS, SSM, EventBus, Lake Formation, SageMaker, etc.
• In-depth understanding of data warehousing, data modeling techniques, and ETL processes
• Ability to work with large-scale datasets, structured and unstructured alike
• Experience in delivering CI/CD and DevOps capabilities in a data environment
• Proficient in Jira and Agile development methodologies
• Knowledge of industry-wide visualization and analytics tools (e.g., AWS QuickSight, Tableau, etc.)
• Strong interpersonal skills and a positive attitude
• Openness to learning new technologies and a passion for technology

Responsibilities:

• Develop and maintain data pipelines using ETL processes
• Ensure adherence to data security, privacy best practices, access control, data versioning, and regulatory compliance within AWS environments
• Collaborate with the data science team to implement data analytics pipelines
• Work closely with DevOps professionals to deploy AWS-based solutions ensuring reliability, scalability, and performance optimization
• Analyze various data stores to derive valuable insights
• Explore alternatives for data storing and processing to implement streamlined solutions
• Translate business requirements into technical specifications and supervise the implementation of AWS-based solutions
• Create and deploy scalable, secure, and efficient AWS architectures to support machine learning initiatives
• Effectively communicate with stakeholders, prioritize tasks, solve problems, and build interpersonal relationships

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred
• 8-10 years of experience in data engineering with a focus on AWS technologies
• Proven ability to work in a team environment and take initiative in problem-solving
• Strong analytical and problem-solving skills
• Excellent written and verbal communication skills

If you're driven by the challenge of working with intricate data problems and are eager to push the boundaries of your skills in a collaborative environment, we encourage you to apply for this role. Join us in our mission to leverage data analytics for actionable insights and innovation.