Pyspark, AWS Lead Data Engineer

Mississauga, Ontario, Ontario, Canada

Full Time Senior-level / Expert CAD 168K - 312K * ^est.

Saama

Saama automates key clinical development and commercialization processes, with artificial intelligence (AI), machine learning (ML) and advanced-analytics, accelerating your time to market.

View all jobs at Saama

Apply now Apply later

Posted 2 days ago

Requirement

Good understanding of big data concepts
Expertise with Amazon Web Services (AWS) - ECS, S3, Lambda, RDS, Athena, Glue, EMR, Redshift, Airflow
Good knowledge on ETL and Data warehousing concepts with hands -on experience
10+ years of total experience in data engineering development along with 2+ years in Pyspark, Python and Pandas
Knowledge of database concepts, modelling, SQL, MySQL
AWS Certification is a plus
Bachelor degree in Computer Science, Engineering or relevant field
Provide leadership and guidance to the developer community
Manage expectations of business partners
Participate in business process analysis, use case creation and requirements definition
Responsible for designing, prototyping, developing and unit testing solutions for projects and maintenance/enhancement releases
Create and maintain technical specifications, system interface diagrams, unit testing scenarios and system support documentation
Provide root cause analysis to resolve complex issues
Work on multiple priorities at the same time and manage time/work effectively