Conference:March 6-8, 2017
Workshops:March 9-10, 2017
Presentation: Monitoring Serverless Architectures
Location:
- Whittle, 3rd flr.
Duration
Day of week:
- Wednesday
Level:
- Intermediate
Persona:
- Architect
Key Takeaways
- Learn how you can monitor the performance of systems using serverless architectures
- Discuss tools and AWS services that can be used to monitor and audit cloud based systems
- Gain knowledge, ideas, and practical advice to make your systems meet (and exceed) performance goals
Abstract
Serverless architectures are attracting more and more interest from the IT professionals and companies hoping to lower the costs of creating and operating distributed systems without constant worrying about availability, scalability and capacity management. Despite all the attractive properties that serverless architectures offer, such systems still need to be comprehensively monitored to be effectively operated and maintain the expected quality of service and SLAs.
In this talk, I will provide the overview of monitoring capabilities required by system built on the Serverless stack, discuss various AWS services that can be used to deliver such capabilities. I will cover everything from metering and logging to tracing, auditing and alerting.
Additionally, I will share some top tips on how to monitor and optimise the spend on the cloud infrastructure as well as control and adjust provisioned capacity for the resources that use provisioned capacity model, like DynamoDB and Kinesis.
Lastly, I will also offer some suggestions on how to supplement provider’s own solutions with bespoke extensions, built using the Serverless stack, to provide even more comprehensive monitoring.
Interview
Today, I’m working on replatforming an existing system to leverage serverless architectures on AWS. This talk is that experience working with serverless architectures. A couple of the big components of this project is obviously monitoring and observability. My talk is theory to practice. I will be looking at serverless architectures from a very practical angle. Monitoring and observability for serverless architectures is not that different than what you might be used to if you’re using AWS for more standard architures. As one of the major goals with serverless architectures is to get away from managing servers, a major difference with monitoring in serverless is to limit your tools to those that are offered by the provider first and foremost. For instance, I will be talking about how you can use CloudWatch for application monitoring, CloudWatch Logs, and CloudTail for auditing. Additionally, I will use AWS Lambda to build additional functionality to supplement the services that are available from the provider.
Intermediate level, I expect attendees to have some basic understanding and working knowledge of cloud computing and AWS. I think that minimum level of understanding will be essential to keep people engaged. I will be trying to get from there to more advanced use cases.
I hope to give people ideas on how to monitor and instrument their systems better using tooling provided by AWS. While it’s a serverless focused talk, I think a good part of what I’ll be discussing can also be used for more traditional platforms. So I hope people will leave with ideas and practical recommendations for specific solutions for a variety of systems..
While observability is a big part of serverless, it’s not the only part. For example, one common question I often get is the feasibility of using serverless in the confines of a larger system. So, I expect to get a lot of questions from the audience about the full range of serverless implementation options. I hope to be able to answer those questions for people too.
Similar Talks




Tracks
-
Architecting for Failure
Building fault tolerate systems that are truly resilient
-
Architectures You've Always Wondered about
QCon classic track. You know the names. Hear their lessons and challenges.
-
Modern Distributed Architectures
Migrating, deploying, and realizing modern cloud architecture.
-
Fast & Furious: Ad Serving, Finance, & Performance
Learn some of the tips and technicals of high speed, low latency systems in Ad Serving and Finance
-
Java - Performance, Patterns and Predictions
Skills embracing the evolution of Java (multi-core, cloud, modularity) and reenforcing core platform fundamentals (performance, concurrency, ubiquity).
-
Performance Mythbusting
Performance myths that need busting and the tools & techniques to get there
-
Dark Code: The Legacy/Tech Debt Dilemma
How do you evolve your code and modernize your architecture when you're stuck with part legacy code and technical debt? Lessons from the trenches.
-
Modern Learning Systems
Real world use of the latest machine learning technologies in production environments
-
Practical Cryptography & Blockchains: Beyond the Hype
Looking past the hype of blockchain technologies, alternate title: Weaselfree Cryptography & Blockchain
-
Applied JavaScript - Atomic Applications and APIs
Angular, React, Electron, Node: The hottest trends and techniques in the JavaScript space
-
Containers - State Of The Art
What is the state of the art, what's next, & other interesting questions on containers.
-
Observability Done Right: Automating Insight & Software Telemetry
Tools, practices, and methods to know what your system is doing
-
Data Engineering : Where the Rubber meets the Road in Data Science
Science does not imply engineering. Engineering tools and techniques for Data Scientists
-
Modern CS in the Real World
Applied, practical, & real-world dive into industry adoption of modern CS ideas
-
Workhorse Languages, Not Called Java
Workhorse languages not called Java.
-
Security: Lessons Learned From Being Pwned
How Attackers Think. Penetration testing techniques, exploits, toolsets, and skills of software hackers
-
Engineering Culture @{{cool_company}}
Culture, Organization Structure, Modern Agile War Stories
-
Softskills: Essential Skills for Developers
Skills for the developer in the workplace