Senior Data Engineer
The Personalization team makes deciding what to play next on Spotify easier and more enjoyable for every listener. We seek to understand the world of music and podcasts better than anyone else so that we can make great recommendations to every individual person and keep the world listening.
Everyday, hundreds of millions of people all over the world use the products we build which include destinations like Home and Search as well as original playlists such as "Discover Weekly" and Daily Mix. We're a team of technologists, product insight experts, designers, and product managers in Boston, New York, Stockholm, and London.
Spotify is looking for a Data Engineer to join us. You will build data driven solutions to bring music and digital media experiences to hundreds of millions of active users and millions of creators by matching fans with creators in a personal and relevant way. You will take on complex data-related problems using some of the most diverse datasets available user behaviors, acoustical analysis, revenue streams, cultural and contextual data, and other signals across our broad range of mobile and connected platforms. Above all, your work will impact the way the world experiences art.
What youll do
- Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Storm or Spark and the Google Cloud Platform.
- Leverage best practices in continuous integration and delivery.
- Help drive optimization, testing and tooling to improve data quality.
- Collaborate with other engineers, ML experts and stakeholders, taking learning and leadership opportunities that will arise every single day.
- Work in cross functional agile teams to continuously experiment, iterate and deliver on new product objectives.
Who you are
- You know how to work with high volume heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, and Cassandra.
- You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, or something we didnt list- but not just Pig/Hive/BigQuery/other SQL-like abstractions
- You are knowledgeable about data modeling, data access, and data storage techniques.
- You care about agile software processes, data-driven development, reliability, and responsible experimentation.
- You understand the value of collaboration within teams.
We are proud to foster a workplace free from discrimination. We strongly believe that diversity of experience, perspectives, and background will lead to a better environment for our employees and a better product for our users and our creators. This is something we value deeply and we encourage everyone to come be a part of changing the way the world listens to music.