Senior Data Engineer

Digital Hub Kuala Lumpur attracts, inspire and develop diverse talents who will elevate BASF’s digital journey.

As one of the world’s largest chemical companies, BASF is on a mission to create chemistry with a sustainable future. The Digital Hub Kuala Lumpur, alongside four other Digital Hubs across the globe are part of the technology powerhouse driving our vision. Join our organization and make an impact in an inclusive and diverse work environment. We value individual differences and provide opportunities for you to contribute your unique perspective towards our collective goals.
 

Objective of the position

The Analytics & AI Implementation Services product team assists its internal business partners with their digital projects so that they become operational and can realize business value out of them.

About the Job: Data engineer in a project-based team that is responsible for designing, building, and maintaining data pipelines and systems that enable the organization to extract business value from its data.

Main tasks

• Design scalable data pipelines for optimal data extraction, transformation, and loading from a wide variety of data sources  using big data computation frameworks and Azure PaaS components.
• Architect and implement data layers to the development of compound AI systems with patterns like RAG
• Data modelling and architecture
• Ensure data quality and consistency in the resulting data products. 
• Develop and optimize existing processes and queries to extract, manipulate, and analyse data from various sources.
• Provide technical support and guidance to business partners on data engineering.
• Stay updated with the latest trends and best practices in data engineering.

Job Requirements 

Education

• Bachelor’s degree or Master’s in computer science, Information Systems, or a related field.

Work Experience

• 2-4 years of experience in data engineering tasks such as data modelling, creating, and implementing data pipelines and ETL processes. Experience with cloud computing platforms such as AWS and Azure (preferably) and Big Data architectures.

Technical & Professional Knowledge (mandatory)

• Relational, Object-Oriented, NoSQL Database Management Systems Delta Lake storage framework
• Python
• Apache Spark and Kafka, Databricks platform
• Big Data/Big compute architecture and technologies
• MicroservicesKnowledge of software development practices: Agile (Scrum, Kanban), Medallion Architecture, CI/CD, DevOps, DataOps, IaC.
   

Technical & Professional Knowledge (additional plus/nice to have skills)

• Graph and vector databases
• Kubernetes
• Azure Cloud
• Apache Airflow
• AI services
• Prompt engineering
• Strong problem-solving skills and the ability to work independently as well as part of a team.
• Excellent communication skills, with the ability to work with cross-functional teams and stakeholders.

At BASF, we create chemistry for a sustainable future. We combine economic success with environmental protection and social responsibility. Around 112,000 employees in the BASF Group contribute to the success of our customers in nearly all sectors and almost every country in the world. Our portfolio comprises six segments: Chemicals, Materials, Industrial Solutions, Surface Technologies, Nutrition & Care and Agricultural Solutions. BASF generated sales of €68.9 billion in 2023.

BASF is committed to empowering its employees to pursue their interests and explore emerging technologies. By investing in top-quality tools and promoting cross-functional collaboration, we encourage our team members to drive positive change within our organization. Come join us and be a part of our digitalization journey. 

Further Information at https://go.basf.net/careers_digitalhubkl