Speaker
Abstract
Back in 2014, platform engineers at Spotify identified a problem: the number of internal tools was growing rapidly, and as a result engineers around the company were struggling to find the tools and information they needed to work efficiently. Reducing the number of tools is the obvious way to address this problem, but how do you consolidate all the tools in one place without disempowering and slowing down the teams working on them?
Fast-forward 10 years, and Backstage has had a massive impact on developer productivity at Spotify, making teams that use it heavily about 2.3x more active on GitHub, and 30% more productive overall. And it doesn’t stop there: in 2020, we open-sourced the Backstage framework to help other companies build their own internal developer portal – and thousands of companies are using it today.
Backstage is now a central pillar of our software development workflow: it catalogs our software ecosystem, helps our engineers follow best-practices and measure the tech health of the components they own, and centralizes and streamlines repeatable tasks. But how can we bring all this together in Backstage? And how does the value we get from it internally translate to adopters of the open-source framework? The answer is plugins.
In this talk we explain how the Backstage plugin system brings disparate pieces of functionality together in one place, helping platform teams to build independently while still shipping a cohesive product for our engineering teams to use. We’ll explain the architecture of the plugin system, and walk through some specific examples of how Backstage (and individual plugins themselves) can be extended and interconnected, and how we make use of this to distribute ownership at Spotify.
Finally, we’ll talk about how the extensibility model of Backstage helps companies offering commercial products in the IDP space add value to the open-source Backstage offering, from specific plugins to entirely new IDP products like Spotify Portal for Backstage.
Interview
Pia: I lead the Platform Developer Experience Studio at Spotify, which means I'm supporting teams to build a greater developer experience internally, and bring some of these great products to the market as open-source or in our commercial Backstage product suite.
Mike: I'm the tech lead for Backstage at Spotify, which means I spend my days thinking about how to make Backstage a better product for adopters, internal users, contributors, and customers.
We're excited to share the benefits we've seen from building a powerful extensibility model into Backstage, in terms of both encouraging contributions in the open-source framework, and enabling distributed ownership of capabilities in our internal instance.
This talk is aimed at senior engineers and architects with an interest in building extensible software solutions. No prior experience with Backstage is required!
We're hoping to share the things we've learned building an extensible framework, and inspire others to incorporate more extensibility along with open- and inner-source contribution models into their software.
QCon London 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Architectures You've Always Wondered About Hosted by Cassandra Shum Vice President of Field Engineering @RelationalAI, Previously @ThoughtworksFrom the same track
Monday 8 April
10:35 Fleming (3rd Fl.) Session architecture Beyond Platform Thinking at RB Global – Build Things No One Expects, in a Place No One Expects It Ranbir Chawla SVP of Engineering @RB Global, Previously SME @Thoughtworks Digital Platform Strategy Team, 30+ Years in Software Engineering and Entrepreneurship Ever wondered what is it really like to move from a poorly integrated COTS legacy architecture to a well factored API driven cloud native platform and event driven architecture, globally deployed in AWS EKS with modern observability and daily software releases? 11:45 Fleming (3rd Fl.) Session 0 → 1, shipping Threads in 5 months Zahan Malkani Software Engineer @Meta In Jan 2023, we received word that we’d need to build a microblogging service to compete with Twitter in a couple of months. This is the (technical) story of the small team that was assembled to take on that challenge, and that shipped a new social network in July. 13:35 Whittle (3rd Fl.) Session Data Architecture Architecting for Data Products Danilo Sato Global Head of Technology - Data & AI @Thoughtworks, Author of DevOps in Practice, CD4ML, and DataIQ UK’s 100 Most Influential People in Data in 2022–2023 Data Mesh principles have brought data products to the forefront of data architecture discussions. However, due to the variety of applications and the vast technology landscape, it is hard to bring those principles into practice. 14:45 Fleming (3rd Fl.) Session platforms How We Created a High-Scale Notification System at Duolingo That Delivered Millions of Messages Within Seconds During a Super Bowl Commercial Break Vitor Pellegrino, Zhen Zhou Building a notification system may seem trivial, but what about building one that could reach million of users within a few seconds? What about doing that right after your advertisement airs? 15:55 Fleming (3rd Fl.) Session Everything Is a Plugin: How the Backstage Architecture Helps Platform Teams at Spotify and Beyond Spread Ownership and Deliver Value Pia Nilsson, Mike Lewis Back in 2014, platform engineers at Spotify identified a problem: the number of internal tools was growing rapidly, and as a result engineers around the company were struggling to find the tools and information they needed to work efficiently. 17:05 Rutherford (4th Fl.) Unconference Unconference: Architectures You've Always Wondered About An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions.