Data Engineer - Databricks
Ground Floor Unit G01 and G02, 3rd, 4th, 5th and 6th Floors, Block C4, Brigade Tech Gardens, ITPL Main Road, Brookefield, Kundalahalli, India
Magna International
Magna. Forward. For all. Explore how Magna´s advancements in mobility help build a better world for everyone and everything.What we offer:
At Magna, you can expect an engaging and dynamic environment where you can help to develop industry-leading automotive technologies. We invest in our employees, providing them with the support and resources they need to succeed. As a member of our global team, you can expect exciting, varied responsibilities as well as a wide range of development prospects. Because we believe that your career path should be as unique as you are.Group Summary:
Transforming mobility. Making automotive technology that is smarter, cleaner, safer and lighter. That’s what we’re passionate about at Magna Powertrain, and we do it by creating world-class powertrain systems. We are a premier supplier for the global automotive industry with full capabilities in design, development, testing and manufacturing of complex powertrain systems. Our name stands for quality, environmental consciousness, and safety. Innovation is what drives us and we drive innovation. Dream big and create the future of mobility at Magna Powertrain.Job Responsibilities:
Highly skilled and experienced Data Engineer to be part of our data engineering & analytics team. The successful candidate will be responsible for designing, implementing, and managing our data infrastructure
and analytical systems. This role requires technical expertise in data modeling, ETL processes, and database management. As the team member of Data Engineering group, you will provide guidance andmentorship to other junior data engineers, ensuring high-quality deliverables and driving the team's success.
Major Responsibilities
Design, develop, and implement data models, ETL processes, and data pipelines to ensure
efficient and accurate data flow using Databricks. Mentor a team of junior data engineers, providing technical guidance, mentoring, and support.
Implementing the solutions basis architectural standards and frameworks to ensure a flexible and scalable data environment.
Collaborating with cross-functional teams to gather requirements, analyze data, and design effective solutions.
Hands-on development of Python/ Spark-based scripts and applications to support data
processing and transformation.
• Utilizing tools such as Databricks Notebooks, Azure Data Factory, and Change Data Capture (CDC) for orchestrating and managing data workflows.
Optimize and enhance existing data infrastructure and systems for performance, scalability, and reliability.
Playing a key role in DevOps activities, including deployment of jobs and required infrastructure setup.
Staying updated with the latest industry trends and technologies in data engineering and analytics.
Knowledge and Education
Degree in computer science or a similar field. Work Experience
5+ Years of experience in the field of Data Engineering & Analytics.
Strong understanding of Data warehousing, engineering & ETL concepts.
Experience in Databricks development using Python, PySpark & DLT Pipelines.
Experience working with databases and various types of data storage.
Excellent communication and interpersonal skills
Time and project management skills, with the ability to prioritize and multitask as needed.
Goal orientation and holistic thinking and action.
Experience working with Azure / AWS.
Certifications in relevant data technologies will be an added advantage
Skills and Competencies
Troubleshooting and analytical skills.
Good communication and collaboration skills.
Client management skills.
Awareness, Unity, Empowerment:
At Magna, we believe that a diverse workforce is critical to our success. That’s why we are proud to be an equal opportunity employer. We hire on the basis of experience and qualifications, and in consideration of job requirements, regardless of, in particular, color, ancestry, religion, gender, origin, sexual orientation, age, citizenship, marital status, disability or gender identity. Magna takes the privacy of your personal information seriously. We discourage you from sending applications via email or traditional mail to comply with GDPR requirements and your local Data Privacy Law.
Worker Type:
Regular / PermanentGroup:
Magna Powertrain* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Computer Science Databricks Data pipelines Data Warehousing DevOps Engineering ETL Pipelines Privacy PySpark Python Spark Testing
Perks/benefits: Career development Flex hours
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.