Speaker
Abstract
LinkedIn is in the process of migrating from Rest.li, an internally developed open source framework for building RESTful APIs to gRPC for better framework capabilities, runtime efficiency, and developer productivity.
For this migration across ~8k services and ~100M LoC to be ROI positive, we built an in-house automation framework that drastically reduces human toil and calendar time (from millions to hundreds of dev hours), and provides an incremental migration path without hurting feature development velocity.
This presentation will delve into:
- Schema translation from pegasus (used by rest.li) to proto3 (used by gRPC)
- Runtime translation between rest.li and grpc on client and server
- Automated migration of routing configurations and operational dashboards/alerts
- Incremental ramp and validation framework
- AST and Generative AI based techniques for code migration
- Results and learnings from our journey so far
- Leverage in other software migration projects at LinkedIn
Topics
QCon London 2024 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Connecting Systems: APIs, Protocols, Observability Hosted by Thomas Betts Laureate Application Architect @Blackbaud, Lead Editor for Architecture & Design @InfoQFrom the same track
Tuesday 9 April
10:35 Fleming (3rd Fl.) Session Long running Are You Done Yet? Mastering Long-Running Processes in Modern Architectures Bernd Ruecker Co-Founder and Chief Technologist @Camunda Navigating the challenges of long-running processes is an important skill to survive modern architecture. The complexities arise from the growing distribution of systems and the need to address issues related to remote communication and the unavailability of peers. 11:45 Churchill (Ground Fl.) Session GRPC gRPC Migration Automation at LinkedIn Karthik Ramgopal, Min Chen LinkedIn is in the process of migrating from Rest.li, an internally developed open source framework for building RESTful APIs to gRPC for better framework capabilities, runtime efficiency, and developer productivity. 13:35 Whittle (3rd Fl.) Session architecture Sidecar-Less or Sidecars for Your Applications in Istio Service Mesh? Lin Sun Open Source @solo.io, Istio TOC Member, CNCF TAG Network Cochair & Ambassador Sidecar-less functionality has emerged as an alternative approach in service mesh architectures, addressing concerns related to costs and complexity associated with sidecars. 14:45 Churchill (Ground Fl.) Session architecture Modernizing in Healthcare – From On-Prem to the Cloud Leander Vanderbijl Senior Engineer @Livi, Previously Principal Engineer @Informa, 13 Years Developing, Managing, and Integrating Diverse Online Systems and Applications Change is hard. Changing an industry as complex as Healthcare is doubly hard. With conflicting interests, complicated synchronization practices, diverse api integration requirements and an aging, overly complex application, our path from on-prem to cloud-native was not simple. 15:55 Rutherford (4th Fl.) Unconference Unconference: Connecting Systems An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions. 17:05 Fleming (3rd Fl.) Session testing Production Comes First - An Outside-In Approach to Building Microservices Martin Thwaites Developer & Developer Advocate @Honeycomb.io, Observability Activist The software world is moving towards multiple interconnected applications that service our customer needs, but this makes development so much harder. Now we need to think about how were interact we other systems that we don't necessarily own.