(Senior) Data Engineer (m/f/x)
Neckarsulm, DE
Schwarz Gruppe
Erfahren Sie, wie die Unternehmen der Schwarz Gruppe innovative Lösungen für Produktion, Handel, Recycling und Digitalisierung entwickeln.What you´ll do
- Work in a cross-functional product team to design and implement data centered features for Europe’s largest Ad Network
- Help to scale our data stores, data pipelines and ETLs handling terabytes of one of the largest retail companies
- Design and implement efficient data processing workflows
- Extend our reporting platform for external customers and internal stakeholders to measure advertising performance
- Continue to develop our custom data processing pipeline and continuously search for ways to improve our technology stack along our increasing scale
- Work with machine learning engineers and software engineers, to build and integrate fully automated and scalable reporting, targeting and ML solutions
- You will work in a fully remote setup but you will meet your colleagues in person in the company and engineering specific onsite events
What you’ll bring along
- 5+ years of professional experience working on data-intensive applications
- Fluency with Python and good knowledge of SQL
- Experience with developing scalable data pipelines with Apache Spark
- Good understanding of efficient algorithms and know-how to analyze them
- Curiosity about how databases and other data processing tools work internally
- Familiarity with git
- Ability to write testable and maintainable code that scales
- Excellent communication skills and a team-player attitude
Great if you also have
- Experience with Kubernetes
- Experience with Google Cloud Platform
- Experience with Snowflake, Big Query, Databricks and DataProc
- Knowledge of columnar databases and file formats like Apache Parquet
- Knowledge of "Big Data" technologies like Delta Lake
- Experience with workflow management solutions like Apache Airflow
- Affinity for Data Science tasks to prototype Reporting and ML solutions
- Knowledge of Dataflow / Apache Beam
We look forward to receiving your application.
Schwarz Dienstleistung KG · Heiko Kiefer · Reference no. 43709
Stiftsbergstraße 1 · 74172 Neckarsulm, Germany
www.careers.it.schwarz
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Big Data BigQuery Databricks Dataflow Data pipelines Dataproc Engineering ETL GCP Git Google Cloud Kubernetes Machine Learning Parquet Pipelines Python Snowflake Spark SQL
Perks/benefits: Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.