Bigdata Java Developer with PySpark skills
Mississauga, ON, Canada
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Full Time Senior-level / Expert USD 110K - 120K
Synechron
Synechron is an innovative global consulting firm delivering industry-leading digital solutions to transform and empower businesses.We are
At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets.
Our challenge
We are seeking a talented Big Data Java Developer with expertise in PySpark to join our innovative data engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing applications utilizing Java and PySpark. This role involves building scalable data pipelines, performing data transformations, and optimizing performance for big data solutions.
Additional Information*
The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Mississauga, ON is CAD $110k – CAD $120k/year & benefits (see below).
The Role
Responsibilities:
- Develop and maintain big data processing pipelines using Java, Spark, and PySpark.
- Design and implement data transformation, aggregation, and processing tasks to support analytics and reporting.
- Optimize Spark jobs for performance, scalability, and resource utilization.
- Collaborate with data science and analytics teams to implement data models and solutions.
- Write efficient, reliable, and maintainable code adhering to best practices.
- Troubleshoot and resolve issues related to data pipelines and Spark applications.
- Participate in the full software development lifecycle, including requirement analysis, design, testing, deployment, and maintenance.
- Ensure data quality, integrity, and security across processing workflows.
- Stay updated with emerging big data technologies and recommend improvements to existing systems.
Requirements:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
- 7+ years of hands-on experience in big data development and data engineering.
- Strong proficiency in Java programming, with experience developing big data applications.
- Solid experience with PySpark for scalable data processing.
- Familiarity with Hadoop ecosystem components like HDFS, Hive, and Spark.
- Strong understanding of distributed computing principles and performance tuning.
- Experience with data modeling, ETL processes, and working with large datasets.
- Knowledge of SQL and experience working with relational and NoSQL databases.
- Good scripting skills in Python, Bash, or similar.
- Excellent problem-solving skills and ability to work in a dynamic environment.
Preferred, but not required:
- Experience with cloud-based big data services (AWS EMR, Azure HDInsight, GCP Dataproc).
- Knowledge of containerization and orchestration tools like Docker, Kubernetes.
- Familiarity with Apache Kafka, Oozie, and other related tools.
- Certifications related to Big Data, Spark, or Cloud platforms are a plus.
We offer:
- A multinational organization with 58 offices in 21 countries and the possibility to work abroad.
- 15 days (3 weeks) of paid annual leave plus an additional 10 days of personal leave (floating days and sick days).
- A comprehensive insurance plan including medical, dental, vision, life insurance, and long-term disability.
- Flexible hybrid policy.
- RRSP with employer’s contribution up to 4%.
- A higher education certification policy.
- On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
- Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
- Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
- A truly diverse, fun-loving and global work culture.
SYNECHRON’S DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.
All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.
Tags: AWS Azure Big Data Blockchain CAD Computer Science Consulting Consulting firm Data pipelines Dataproc Data quality DevOps Docker Engineering ETL GCP Hadoop HDFS Java Kafka Kubernetes NoSQL Oozie Pipelines PySpark Python Research Security Spark SQL Testing
Perks/benefits: Career development Equity / stock options Flex hours Health care Insurance Medical leave
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.