Data Engineer
Kuala Lumpur, MY
BASF
Our aspiration is to grow profitably and create value for society ► This is how we create chemistry for a sustainable futureDigital Hub Kuala Lumpur attracts, inspire and develop diverse talents who will elevate BASF’s digital journey.
As one of the world’s largest chemical companies, BASF is on a mission to create chemistry with a sustainable future. The Digital Hub Kuala Lumpur, alongside four other Digital Hubs across the globe are part of the technology powerhouse driving our vision. Join our organization and make an impact in an inclusive and diverse work environment. We value individual differences and provide opportunities for you to contribute your unique perspective towards our collective goals.
We are looking for a Data Engineer to ensure we can leverage data effectively for analytics, reporting, and decision-making by building and maintaining a robust data infrastructure for enterprise-grade IT solutions of BASF Agricultural. The role involves both technical and leadership skills to drive efficient product delivery.
High-level objectives are as follows:
- Designing, building, and maintaining data pipelines and infrastructure
- Integrate data from various sources, ensuring data quality, manage data storage, and optimize performance.
- Communication and collaboration
- Ensure compliance.
- Stakeholder Alignment
- Innovation
Responsibilities
- Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems such as data warehouses or data lakes.
- Integrate data from different databases, applications, and external sources, ensuring data consistency and accuracy.
- Create and maintain data models, schemas, and structures that facilitate efficient data storage and retrieval.
- Transform and clean raw data to prepare it for analysis, including handling missing values, data normalization, and aggregation.
- Implement data quality checks, validation processes, and error handling to maintain high data quality standards.
- Administer and optimize databases, including performance tuning, indexing, and ensuring data security.
- Automate ETL processes and routine tasks to improve efficiency and reduce manual intervention.
- Continuously monitor data pipelines and infrastructure for performance issues, errors, and data anomalies. Troubleshoot and resolve issues promptly.
- Stay updated with the latest data engineering tools and technologies and evaluate their suitability for the organization's needs.
Qualifications
- Bachelor Degree in Computer Science / Computer Engineering / Information Technology or business-technology related discipline
- Min. 3-5 years of professional experience in IT and / or IT Consulting
- Experience in Tools like Databricks, Azure Data Factory, Synapse, SQL Server
- Experienced in Python, SQL
- Business Consulting and Technical Consulting skills
- Familiar with Data Warehouse and Data Lake architecture concept
- Design & Implementation of ETL / ELT data pipelines
At BASF, we create chemistry for a sustainable future. We combine economic success with environmental protection and social responsibility. Around 112,000 employees in the BASF Group contribute to the success of our customers in nearly all sectors and almost every country in the world. Our portfolio comprises six segments: Chemicals, Materials, Industrial Solutions, Surface Technologies, Nutrition & Care and Agricultural Solutions. BASF generated sales of €68.9 billion in 2023.
BASF is committed to empowering its employees to pursue their interests and explore emerging technologies. By investing in top-quality tools and promoting cross-functional collaboration, we encourage our team members to drive positive change within our organization. Come join us and be a part of our digitalization journey.
Further Information at https://go.basf.net/careers_digitalhubkl
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Azure Chemistry Computer Science Consulting Databricks Data pipelines Data quality Data warehouse ELT Engineering ETL Industrial .NET Pipelines Python Security SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.