Data Engineer
Kuala Lumpur, MY
BASF
Our aspiration is to grow profitably and create value for society ► This is how we create chemistry for a sustainable futureDigital Hub Kuala Lumpur attracts, inspire and develop diverse talents who will elevate BASF’s digital journey.
As one of the world’s largest chemical companies, BASF is on a mission to create chemistry with a sustainable future. The Digital Hub Kuala Lumpur, alongside four other Digital Hubs across the globe are part of the technology powerhouse driving our vision. Join our organization and make an impact in an inclusive and diverse work environment. We value individual differences and provide opportunities for you to contribute your unique perspective towards our collective goals.
We are currently seeking a talented Data Engineer to join our team at BASF's Agricultural Solutions department Digital Factory.
In this role, you will be responsible for ensuring we can leverage data effectively for analytics, reporting, and decision-making. Your main objective will be to build and maintain a robust data infrastructure for enterprise-grade IT solutions of BASF Agricultural. This role requires both technical expertise and strong leadership skills to drive efficient product delivery.
Responsibilities
- You will leverage your expertise to design and maintain efficient data models, schemas, and structures that facilitate data storage and retrieval. Working closely with cross-functional teams, you will ensure that objectives are met and collaborate on data-related initiatives.
- Your responsibilities will include designing, building, and maintaining infrastructure and pipelines for extracting, transforming, and loading (ETL) data from various sources into data storage systems such as data warehouses or data lakes. You will implement quality checks, validation processes, and error handling to maintain high data quality standards.
- You will continuously monitor the pipelines and infrastructure, promptly troubleshooting and resolving any performance issues, errors, or anomalies to ensure seamless operations.
- Throughout the product lifecycle, you will provide technical support and expertise to the product team and stakeholders. This will involve performing rigorous testing and evaluation to ensure that the final product meets design specifications and quality standards.
- You will also play a crucial role in transforming and cleaning raw data, including handling missing values, data normalization, and aggregation. Administering and optimizing databases, such as performance tuning, indexing, and ensuring data security, may be required as well.
- You will have the opportunity to prepare, present, and maintain technical reports, documentation, and presentations. This may include creating and updating schematics, blueprints, and manuals to facilitate effective communication and knowledge sharing.
- To excel in this position, it is important to stay updated with new technologies, industry advancements, and best practices. This will enable you to bring innovative solutions and ideas to the table.
- You will be instrumental in improving efficiency and reducing manual intervention by automating processes and routine tasks. Ensuring compliance with regulatory standards and requirements is also crucial to meet industry guidelines.
Qualifications
- Bachelor Degree in Computer Science / Computer Engineering / Information Technology or business-technology related discipline
- Min. 3-5 years of professional experience in IT and / or IT Consulting
- Experienced in Java, Scala, Python, SQL
- Experience in Tools like Databricks, Azure Data Factory, Synapse, SQL Server
- Design & Implementation of ETL / ELT data pipelines
- Familiar with Data Warehouse and Data Lake architecture concept
At BASF, we create chemistry for a sustainable future. We combine economic success with environmental protection and social responsibility. Around 112,000 employees in the BASF Group contribute to the success of our customers in nearly all sectors and almost every country in the world. Our portfolio comprises six segments: Chemicals, Materials, Industrial Solutions, Surface Technologies, Nutrition & Care and Agricultural Solutions. BASF generated sales of €68.9 billion in 2023.
BASF is committed to empowering its employees to pursue their interests and explore emerging technologies. By investing in top-quality tools and promoting cross-functional collaboration, we encourage our team members to drive positive change within our organization. Come join us and be a part of our digitalization journey.
Further Information at https://go.basf.net/careers_digitalhubkl
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Azure Chemistry Computer Science Consulting Databricks Data pipelines Data quality Data warehouse ELT Engineering ETL Excel Industrial Java .NET Pipelines Python Scala Security SQL Testing
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.