Big Data Developer (Spark/Scala)
São Paulo, Spain
Talan
Nous croyons que seule une pratique humaniste de la technologie fera du nouvel âge numérique une ère de progrès pour tous. Engageons-nous ensembleCompany Description
Talan is an international advisory group on innovation and transformation through technology, with 5000 employees, and a turnover of 600M€.
We offer our customers a continuum of services to support you at each key stage of your organization's transformation, with 4 main activities:
- CONSULTING in management and innovation : supporting business, managerial, cultural, and technological transformations.
- DATA & TECHNOLOGY to implement major transformation projects.
- CLOUD & APPLICATION SERVICES to build or integrate software solutions.
- SERVICE CENTERS of EXCELLENCE to support the latter through technology, innovation, agility, sustainability of skills and cost optimization.
Talan accelerates it's clients' transformation through innovation and technology. By understanding their challenges, with our support, innovation, technology and data, we enable them to be more efficient and resilient.
We believe that only a human oriented-practice of technology will make the new digital age an era of progress for all. Together let's commit!
Job Description
What you will be doing?
As a Backend Spark Developer, you'll play a key role in bringing technical and functional visions to life. You'll work closely with Solution Designers, Business Architects, and Business Analysts to develop, test, and deploy high-quality solutions that meet and exceed internal standards. Your work will be essential in ensuring optimal performance, reliability, and alignment with our quality benchmarks, driving impactful results for the organization.
We need somebody like you to help our client in different fronts:
- develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.
- certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery.
Qualifications
What are we looking for?
Required qualifications
- At least 3 years of experience working with Spark with Scala, software design patterns, and TDD.
- Experience working with big data – Spark, Hadoop, Hive is a must – Azure Databricks be a plus.
- Experience and expertise across data integration and data management with high data volumes.
- Experience working in agile continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
- Experience with different database structures, including (Postgres, SQL, Hive)
- English (at least B2+)
Preferred qualifications
- Jenkins
- Bash script
- Control-M
- Software development life cycle (HP ALM...)
- Basics of cybersecurity & Quality (Sonar, Fortify…)
- Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)
- SOA Architecture
Additional Information
What do we offer you?
- Full-time contract
- Smart Office Pack so that you can work comfortably from home.
- Training and career development
- Benefits and perks such as private medical insurance, life insurance, lunch and travel cards as part of the flexible remuneration package
- Possibility to be part of a multicultural team and work on international projects
- Hibrid position based in Málaga, Spain. Realocation is mandatory
- Possibility to manage work-permits.
If you are passionate about development & tech, we want to meet you!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture AWS Azure Big Data Consulting Databricks Data management DevOps Docker ETL Git GitHub Hadoop Jenkins Jira Kubernetes PostgreSQL Scala SDLC Spark SQL TDD
Perks/benefits: Career development Flex hours Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.