Senior Data Engineer - Search
Berlin, London
SoundCloud
Discover and play over 320 million music tracks. Join the world’s largest online community of artists, bands, DJs, and audio creators.SoundCloud empowers artists and fans to connect and share through music. Founded in 2007, SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources. With over 400+ million tracks from 40+ million artists, the future of music is SoundCloud.
We are looking for a Senior Data Engineer to join the Soundcloud Search team (part of the Music Discovery group), with a mission to help users find and play what they’re looking for and enable them to explore further to discover music that exists nowhere else and connect directly with the artists that make it. You will be crucial in shaping the data infrastructure that powers our search systems, ensuring high-quality, scalable, and real-time data flows. Collaborating with a multidisciplinary team, you will contribute to building robust data pipelines that power all our feedback cycles, from feeding our Machine Learning algorithms to enhancing the search performance and user experience.
About the role:
As a Data Engineer, you will work on building and optimizing high-end data pipelines that drive key performance indicators (KPIs) and train our ML models. You will also be working on the real-time processing of the data pipelines that power search features for millions of users. You’ll work with a range of technologies, including Python and Scala, BigQuery and BigTable, Spark and Dataflow, and collaborate with other teams to ensure data is structured and prepared for both search systems and machine learning models.
About you:
You have a strong background in data engineering (at least 5 years), with strong foundations on algorithms and data structures. You have experience designing and optimizing data pipelines, data architecture and modeling, and ETL processes for large-scale (distributed) systems. You are comfortable working with millions of data points regularly and are passionate about ensuring data quality and consistency, which are key to improving the overall search experience. You are proficient in SQL and Python, ideally also experienced in Scala or Java. You also have experience training, prototyping, and deploying machine learning models. Experience in Search or Recommender Systems is a plus.
You are proactive, detail-oriented, and committed to learning. You thrive in a collaborative, Agile environment, working closely with cross-functional teams to tackle complex data challenges. You are a problem-solver at heart, driven by a passion for data and how it can enhance user experiences. While independent in your work, you excel in a team setting, contributing to a culture of excellence and shared success.
About us:
- We are a multinational company with offices in the US (New York and Los Angeles), Germany (Berlin), and the UK (London)
- We provide a flexible work culture that offers the opportunity to collaborate and connect in person at our offices as well as accommodating work from home
- We are deeply committed to ensuring diversity, equity and inclusion at all levels of our organization and fostering a community where everyone’s voice, perspective and experience is respected and heard
- We believe a strong team is made by investing in employees through mentorship, workshops, and enrichment opportunities
- You can contribute to our Engineering Blog
Benefits:
- Not located in Berlin? No worries, we offer extensive relocation support including allowances, one-way flights, temporary accommodation, and by partnering with Expath, on the ground support on arrival
- Interested in a gym membership, photography course or book? We have a Creativity and Wellness benefit!
- Employee Stock Ownership Plan
- Professional development allowance
- Flexible vacation and public holiday policy where you can take up to 35 days of PTO annually
- We offer free German courses at beginning, intermediate and advanced
- Various snacks, goodies and 2 free lunches weekly at the office!
Diversity, Equity and Inclusion at SoundCloud
SoundCloud is for everyone. Diversity and open expression are fundamental to our organization; they help us lead what’s next in music by understanding and empowering our creators and fans, no matter their identity. We acknowledge the challenges in the music industry, and strive to influence an inclusive culture where everyone can contribute respectfully and thrive, especially the historically marginalized communities that many of our creators, fans and SoundClouders identify with. We are dedicated to creating an inclusive environment at SoundCloud for everyone, regardless of gender identity, sexual orientation, race, ethnicity, migration background, national origin, age, disability status, or care-giver status.
At SoundCloud you can find your community or elevate your allyship by joining a Diversity Resource Group. Diversity Resource Groups are employee-organized groups focused on supporting and promoting the interests of a particular underrepresented community in order to build a more inclusive culture at SoundCloud. Anyone can join, whether you share the identity or strive to be an ally.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture BigQuery Bigtable Dataflow Data pipelines Data quality Engineering ETL Excel Java KPIs Machine Learning ML models Pipelines Prototyping Python Recommender systems Scala Spark SQL
Perks/benefits: Career development Fitness / gym Flex hours Flex vacation Lunch / meals Relocation support Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.