You are viewing content from a past/completed QCon

Presentation: LinuxKit

Track: Modern Operating Systems

Location: Westminster, 4th flr.

Duration: 10:35am - 11:25am

Day of week: Monday

Share this on:

This presentation is now available to view on InfoQ.com

Watch video with transcript

What You’ll Learn

  1. Learn about LinuxKit, what it is and what it is helpful for.

  2. Hear about running systems with the simplicity of containers and the isolation provided by VMs

Abstract

Why aren't operating systems more like applications?
We live in an era of application microservices, even nanoservices. Each application serves precisely its purpose, living for exactly how long it needs. When we need it to do something else, we either create a distinct service, or rebuild and replace the existing one. Applications last seconds to minutes, at best hours.

What's good for the application goose, is great for the operating system gander.

Welcome to LinuxKit, a modern operating system composer. You compose precisely the components you need into a super-lightweight distribution, deploy it, and then throw it away when no longer needed.

In this talk, we will:

  1. Introduce LinuxKit, its history and purpose, and how it differs radically from the operating system distributions with which you likely are familiar.
  2. Delve into LinuxKit's design and architecture.
  3. Explore how LinuxKit offers new ways of operating, plugging operating systems as first-class citizens directly into our deployment pipelines.

And, of course, we will build and deploy immutable, bootable, purpose-built images in minutes live on-stage.

Question: 

What's the focus of your work today?

Answer: 

I'm playing in a few different areas all related around technology and operations. My focus tends to be where do changes in technology or engineering lead to fundamental changes in how individuals and companies operate. Sometimes it's a little bit more about the tech, sometimes it's a little more about operations and organization, but always somewhere at the nexus of those: operations, finance, technology. f I look at my last year, I've got everything from: LinuxKit, which for the most part is voluntary, where I'm writing stuff; a client company where we officially deployed once per month, practically  once every quarter, when I started working with them, and now are cloud-native deploying multiple times per day... and that's on a slow day. Some of the work I've done is cloud-native for ARM. At the same time I'm doing some product strategy work for a startup that is selling into that space. I love interesting tech that changes how we operate, that has a practical impact.

Question: 

What’s the focus of the talk, an introduction to LinuxKit or use cases of applying it in production?

Answer: 

It's more of the former, which is an introduction to LinuxKit, how to use it and perhaps more importantly how you could actually fit it in your supply chain. I will, to some degree, delve into what it is technically and how it's built, but probably I won't get too far into that part because I think it leaves fewer practical lessons for people.

Question: 

What is a use case that LinuxKit excels in?

Answer: 

Supply chains. Knowing that your distribution is actually what you needed to be. The practical example of that might be a secure environment, which, frankly, I think everything out there should be treated as a secure environment. As part of your supply chain, you want it to be immutable so that you could reproduce it reliably at every stage. You mentioned the financials where they really care exactly what's running, down to highly more secure environments, through to edge and IoT. Additionally, there are optimized environments where I already run 20 VMs on the server. How I get to 200 or 2,000 of them running without interference becomes a real financial question. The sheer size of what you’re running, then, has a very practical impact on how much density you can squeeze out of each server. Overall, I think LinuxKit has a pretty broad use. I have seen it used for CI/CD, Kubernetes,, companies running their SaaS on top of it, to building stuff that runs on tiny edge machines.

Question: 

Who's the focus of the talk?

Answer: 

Definitely architect, systems engineer, anyone with an interest in reliability, performance, reproducibility and security. I think a kernel developer might find it interesting but I'm not trying to target that group, though, of course, they’re more than welcome. We're not getting into how the kernel is built, what patches has the team done on it. That in itself could be its own talk but the reality is that I will be lost in the face of the crowd that will be well above my head.

Question: 

In a world of containers do we need LinuxKit?

Answer: 

Definitively, without question, for several reasons. First of all, containers have to run on something. And that's is true especially now when they have become larger and larger even for non-hyperscale companies, i.e. other than AWS, Azure, or Google. Moderately sized companies are dealing with densities that are pretty decent scale. So what you do then? The second piece, and this is really interesting. I think we can thank AWS to some degree for this. There is a growth of interest in 'Here are things that I want to run like their containers but I want the isolation of VMs', and I mentioned VMs because of the whole stir they created with the release of Firecracker. And once you decide to run on VMs, the question is how small can I get that VM to run something with the container experience but with VM isolation?

Question: 

What do you want people to leave your talk with?

Answer: 

That there are chunks of how they operate, that they've assumed as mutable and could not be improved, yet it was just the way it's been for a long time. They can build on an improvement to take advantage of it.

Speaker: Avi Deitcher

Managing Consultant @Atomic Inc.

Avi Deitcher has been an engineer and businessman for over 20 years, designing and implementing technology, strategy and operations. He loves technology, but most importantly he loves what it enables us to do as individuals and businesses. He uses his time helping clients implement technology solutions that fundamentally change how they operate, and invests time in building and contributing to open-source that has the potential to affect how enterprises operate.

"Tech is cool; useful tech that matters is much cooler." 

Find Avi Deitcher at

Tracks

  • Architectures You've Always Wondered About

    Hard-earned lessons from the names you know on scalability, reliability, security, and performance.

  • Machine Learning: The Latest Innovations

    AI and machine learning is more approachable than ever. Discover how ML, deep learning, and other modern approaches are being used in practice.

  • Kubernetes and Cloud Architectures

    Learn about cloud native architectural approaches from the leading industry experts who have operated Kubernetes and FaaS at scale, and explore the associated modern DevOps practices.

  • Evolving Java

    JVM futures, JIT directions and improvements to the runtimes stack is the theme of this year’s JVM track.

  • Next Generation Microservices: Building Distributed Systems the Right Way

    Microservice-based applications are everywhere, but well-built distributed systems are not so common. Early adopters of microservices share their insights on how to design systems the right way.

  • Chaos and Resilience: Architecting for Success

    Making systems resilient involves people and tech. Learn about strategies being used, from cognitive systems engineering to chaos engineering.

  • The Future of the API: REST, gRPC, GraphQL and More

    The humble web-based API is evolving. This track provides the what, how, and why of future APIs.

  • Streaming Data Architectures

    Today's systems move huge volumes of data. Hear how the innovators in this space are designing systems and leveraging modern data stream processing platforms.

  • Modern Compilation Targets

    Learn about the innovation happening in the compilation target space. WebAssembly is only the tip of the iceberg.

  • Leaving the Ivory Tower: Modern CS Research in the Real World

    Thoughts pushing software forward, including consensus, CRDT's, formal methods & probabilistic programming.

  • Bare Knuckle Performance

    Crushing latency and getting the most out of your hardware.

  • Leading Distributed Teams

    Remote and distributed working are increasing in popularity, but many organisations underestimate the leadership challenges. Learn from those who are doing this effectively.

  • Full Cycle Developers: Lead the People, Manage the Process & Systems

    "Full cycle developers" is not just another catch phrase; it's about engineers taking ownership and delivering value, and doing so with the support of their entire organisation. Learn more from the pioneers.

  • JavaScript: Pushing the Client Beyond the Browser

    JavaScript is not just the language of the web. Join this track to learn how the innovators are pushing the boundaries of this classic language and ecosystem.

  • When Things Go Wrong: GDPR, Ethics, & Politics

    Privacy, confidentiality, safety and security: learning from the frontlines, from both good and bad experiences

  • Growing Unicorns in the EU: Building, Leading and Scaling Financial Tech Start Ups

    Learn how EU FinTech innovators have designed, built, and led both their technologies and organisations.

  • Building High Performing Teams

    To have a high-performing team, everybody on it has to feel and act like an owner. Learn about cultivating culture, creating psychological safety, sharing the vision effectively, and more

  • Scaling Security, from Device to Cloud

    Implementing effective security is vitally important, regardless of where you are deploying software applications.