Building a Streaming Agentic AI Pipeline with Redpanda and Snowflake

In this technical talk for developers, architects and the technically curious, Paul will cover recent developments within Redpanda Connect.

Firstly, we will highlight new capabilities that enable agentic AI processes to be applied to streaming data. By using tools for external integration, we will show how to build highly specialized and capable AI agents that interact with external systems, providing essential additional context to LLMs.

In the second part of the talk, we will show how recent developments in Redpanda Connect that can also enable high throughput data ingestion into Snowflake (via Snowpipe Streaming).

Finally, we will combine all of these techniques together into a single, end-to-end demo.


Speaker

Paul Wilkinson

Principal Solutions Architect @Redpanda

Paul Wilkinson is an innovative technologist with a multi-faceted background in research, development, training and consulting. As a hands-on practitioner with two decades of experience in the technology industry, Paul has developed a passion for solving the most difficult challenges. His current focus at Redpanda is on reducing the time-to-value for Redpanda customers through automation and tooling. As a Principal Solutions Architect, Paul works closely with Redpanda's customers in EMEA to accelerate the development of production data streaming applications.
 

Read more

Session Sponsored By

 Redpanda is a simple, powerful, and cost-efficient streaming data platform that is compatible with Kafka® APIs while eliminating Kafka complexity.

Date

Monday Apr 7 / 02:45PM BST ( 50 minutes )

Location

Westminster (4th Fl.)

Video

Video is not available

Share

From the same track

Session

AI Developer Tools Are Focused on the Wrong Problem

Monday Apr 7 / 05:05PM BST

For all the claims about AI increasing developer productivity, why aren't developers seeing more of an impact?What we've heard from thousands of developers is that writing code is not their main challenge.

Speaker image - Dennis Pilarinos

Dennis Pilarinos

Founder & CEO @Unblocked

Session

A Blueprint for Agentic AI Services

Monday Apr 7 / 01:35PM BST

We’re all excited to build and deliver agentic AI services. But what about running at the exponentially greater scale that agents create? LLMs suffer from poor latency and availability issues. More frequent model training drives more frequent updates to agentic services.

Speaker image - Duncan DeVore

Duncan DeVore

Sr. Director & Architect Advocate @Akka

Session

Zero Trust or Bust. Bring Your Own Cloud To Real-Time Data

Monday Apr 7 / 11:45AM BST

As organizations increasingly look to adopt Bring Your Own Cloud (BYOC) models to deploy scalable, real-time data streaming solutions, security concerns around data governance, access control, and compliance become critical business considerations.

Speaker image - Karin  Landers

Karin Landers

Senior Product Marketing Manager @Ververica