Senior Data Engineer (f/m)
Zagreb, HR
AVL
AVL is one of the world’s leading mobility technology companies for development, simulation and testing in the automotive industry, and in other sectors.AVL is the world's largest independent company for development, simulation and testing technology of powertrains (hybrid, combustion engines, transmission, electric drive, batteries and software) for passenger cars, trucks and large engines.
AVL – AST d.o.o. Croatia is a member of the AVL Group.
The Data Engineering team is responsible for implementation of data engineering processes of the AVL Data Analytics Platform. You will be participating in development of ETL pipelines for batch processing of files, data quality check libraries and processing libraries for automotive files. You will be working on innovative and strategic projects in the automotive industry for various domains (fleet validation, HIL/SIL testing, ADAS, …) related to data engineering and applied data science in large scaled team with broad areas of expertise.
YOUR RESPONSIBILITIES:
• Involvement in all SW development stages, from design to production
• Development of ETL Workflow tasks
• Development of Python Processing library which is used for Time Series analysis and offers user defined extensions and scripting
• Development of simple Python microservices
• Following the best code practices while executing the previous tasks with adherence to clean coding and security standards, covering important cases with unit tests and making components reliable and monitorable
• Work with latest architectures and technologies in fast-paced project or product development
• Collaboration with other key stakeholders from other teams – Solution architects, content and product managers, backend and frontend developers, UI/UX designers
• Mentoring less experienced colleagues
YOUR PROFILE:
• Engineering education (BSc, MSc, MEng or PhD) in Computer Science, Mathematics/Statistics or Engineering Degree
• Strong knowledge of writing object oriented Python code, Python testing practices, and good knowledge of at least one Dataframe library (Pandas, Polars)
• Experience in working with ETL tools and writing custom flows in them (Prefect would be great, Airflow, Dagster…)
• Good knowledge of Docker and Kubernetes
• Strong focus on software quality and smooth software delivery process including the skills to review, verify, and validate the software code developed
• Fluent speaking and excellent writing skills in English
• Kafka knowledge
• Educated in database technologies (SQL and Non-SQL)
Preferable:
- Basic .NET knowledge
- Basic cloud (Azure, AWS) knowledge
- Previous product development experience (SaaS)
- Experience in DevOps topics like Continuous integration and Deployment, Security and compliance, Monitoring performance and optimizations
- Experience with ELK stack
WE OFFER:
• Mentor/lead
• Contribution to projects of high technical complexity
• Considerable extra financial benefits
• Professional development
• International teams and dynamic environment
• Very casual and friendly atmosphere
If you are eager to work in an international environment, you appreciate a relaxed atmosphere and great compensation packages, and you want to broaden your knowledge while thriving on challenges, apply now!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture AWS Azure Computer Science Dagster Data Analytics Data quality DevOps Docker ELK Engineering ETL Kafka Kubernetes Mathematics Microservices Pandas PhD Pipelines Python Security SQL Statistics Testing UX
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.