PySpark Developer (PySpark, Hadoop, Hive, exp working with large data sets, Experience in Liquidity Risk is a plus)
Mississauga, ON, Canada
Full Time Mid-level / Intermediate USD 100K - 115K
Synechron
Synechron is an innovative global consulting firm delivering industry-leading digital solutions to transform and empower businesses.We are
At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets.
Our challenge
As a PySpark Developer, candidate will play a critical role in developing and maintaining data processing applications using PySpark, Hadoop, and Hive. Candidate will work with large datasets to ensure efficient data management and analytics. Experience in liquidity risk is a plus, as candidate will collaborate with risk management teams to enhance data quality and reporting.
Additional Information
The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Mississauga, ON is CAD $100k - CAD $115k/year & benefits (see below).
The Role
Responsibilities:
- Develop, test, and deploy scalable data processing applications using PySpark.
- Design and implement data workflows in a Hadoop ecosystem.
- Write efficient Hive queries to manage and analyze large datasets.
- Collaborate with data architects and analysts to understand data requirements and provide solutions.
- Optimize data processes for performance, reliability, and cost-effectiveness.
- Perform data cleansing and transformation tasks to ensure data integrity.
- Monitor and troubleshoot data processing jobs to maintain operational efficiency.
- Document data architectures, processes, and coding standards for reference and training purposes.
- (Optional) Support liquidity risk analysis by providing data insights and reporting.
Requirements:
You are:
- Experience needed 10+ Years
- Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field.
- Proven experience as a PySpark Developer or similar role in a big data environment.
- Strong proficiency in Hadoop ecosystem components (e.g., HDFS, MapReduce).
- Experience with Hive for data querying and management.
- Hands-on experience with large datasets and data processing frameworks.
- Familiarity with SQL and experience with relational databases.
- Knowledge of data quality and governance practices.
- Experience in liquidity risk management is a plus.
- Excellent analytical and problem-solving skills.
- Strong communication and teamwork abilities.
It would be great if you also had:
- Knowledge of additional big data technologies (e.g., Apache Kafka, Spark Streaming).
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) for big data solutions.
- Proficiency in programming languages such as Python or Scala.
- Understanding of machine learning concepts and data science methodologies.
We can offer you:
- A multinational organization with 58 offices in 21 countries and the possibility to work abroad
- 15 days (3 weeks) of paid annual leave plus an additional 10 days of personal leave (floating days and sick days)
- A comprehensive insurance plan including medical, dental, vision, life insurance, and long-term disability
- Flexible hybrid policy to fit your schedule
- RRSP with employer’s contribution up to 4%
- A higher education certification policy
- On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses
- Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups
- Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms
- A truly diverse, fun-loving and global work culture
SYNECHRON’S DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.
All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.
Tags: Architecture AWS Azure Big Data Blockchain CAD Computer Science Consulting Consulting firm Data management Data quality DevOps Engineering GCP Google Cloud Hadoop HDFS Kafka Machine Learning PySpark Python RDBMS Research Scala Spark SQL Streaming
Perks/benefits: Career development Equity / stock options Flex hours Health care Insurance Medical leave
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.