Everything Is a Plugin: How the Backstage Architecture Helps Platform Teams at Spotify and Beyond Spread Ownership and Deliver Value

QCon London 2024

Session

Everything Is a Plugin: How the Backstage Architecture Helps Platform Teams at Spotify and Beyond Spread Ownership and Deliver Value

Monday Apr 8 / 03:55PM BST, Fleming (3rd Fl.)

Abstract

Back in 2014, platform engineers at Spotify identified a problem: the number of internal tools was growing rapidly, and as a result engineers around the company were struggling to find the tools and information they needed to work efficiently. Reducing the number of tools is the obvious way to address this problem, but how do you consolidate all the tools in one place without disempowering and slowing down the teams working on them?

Fast-forward 10 years, and Backstage has had a massive impact on developer productivity at Spotify, making teams that use it heavily about 2.3x more active on GitHub, and 30% more productive overall. And it doesn’t stop there: in 2020, we open-sourced the Backstage framework to help other companies build their own internal developer portal – and thousands of companies are using it today.

Backstage is now a central pillar of our software development workflow: it catalogs our software ecosystem, helps our engineers follow best-practices and measure the tech health of the components they own, and centralizes and streamlines repeatable tasks. But how can we bring all this together in Backstage? And how does the value we get from it internally translate to adopters of the open-source framework? The answer is plugins.

In this talk we explain how the Backstage plugin system brings disparate pieces of functionality together in one place, helping platform teams to build independently while still shipping a cohesive product for our engineering teams to use. We’ll explain the architecture of the plugin system, and walk through some specific examples of how Backstage (and individual plugins themselves) can be extended and interconnected, and how we make use of this to distribute ownership at Spotify.

Finally, we’ll talk about how the extensibility model of Backstage helps companies offering commercial products in the IDP space add value to the open-source Backstage offering, from specific plugins to entirely new IDP products like Spotify Portal for Backstage. 

Interview

Pia: I lead the Platform Developer Experience Studio at Spotify, which means I'm supporting teams to build a greater developer experience internally, and bring some of these great products to the market as open-source or in our commercial Backstage product suite.

Mike: I'm the tech lead for Backstage at Spotify, which means I spend my days thinking about how to make Backstage a better product for adopters, internal users, contributors, and customers.

We're excited to share the benefits we've seen from building a powerful extensibility model into Backstage, in terms of both encouraging contributions in the open-source framework, and enabling distributed ownership of capabilities in our internal instance. 

This talk is aimed at senior engineers and architects with an interest in building extensible software solutions. No prior experience with Backstage is required!

We're hoping to share the things we've learned building an extensible framework, and inspire others to incorporate more extensibility along with open- and inner-source contribution models into their software.

76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon London 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Monday 8 April

10:35 Fleming (3rd Fl.) Session architecture Beyond Platform Thinking at RB Global – Build Things No One Expects, in a Place No One Expects It Ranbir Chawla SVP of Engineering @RB Global, Previously SME @Thoughtworks Digital Platform Strategy Team, 30+ Years in Software Engineering and Entrepreneurship 11:45 Fleming (3rd Fl.) Session 0 → 1, shipping Threads in 5 months Zahan Malkani Software Engineer @Meta 13:35 Whittle (3rd Fl.) Session Data Architecture Architecting for Data Products Danilo Sato Global Head of Technology - Data & AI @Thoughtworks, Author of DevOps in Practice, CD4ML, and DataIQ UK’s 100 Most Influential People in Data in 2022–2023 14:45 Fleming (3rd Fl.) Session platforms How We Created a High-Scale Notification System at Duolingo That Delivered Millions of Messages Within Seconds During a Super Bowl Commercial Break Vitor Pellegrino, Zhen Zhou 15:55 Fleming (3rd Fl.) Session Everything Is a Plugin: How the Backstage Architecture Helps Platform Teams at Spotify and Beyond Spread Ownership and Deliver Value Pia Nilsson, Mike Lewis 17:05 Rutherford (4th Fl.) Unconference Unconference: Architectures You've Always Wondered About