Tushar Thole's guest appearances

Tushar Thole

Streaming Audio: Apache Kafka® & Real-Time Data

Jason Bell

Sam Ritchie

Kent Beck

Cornelia Davis

Anna McDonald

Kelsey Hightower

Lena Hall

Jay Smith

Matt Simpson

Colin McCabe

Sam Newman

Josh Long

Gwen Shapira

Paul Rayner

Dylan Scott

OwlTail

Data availability, usability, integrity, and security are words that we sometimes hear a lot. But what do they actually look like when put into practice? That’s where data governance comes in. This becomes especially tricky when working with real-time data architectures.Tushar Thole (Senior Manager, Engineering, Trust &amp; Security, Confluent) focuses on delivering features for software-defined storage, software-defined networking (SD-WAN), security, and cloud-native domains. In this episode, he shares the importance of real-time data governance and the product portfolio—Stream Governance, which his team has been building to fostering the collaboration and knowledge sharing necessary to become an event-centric business while remaining compliant within an ever-evolving landscape of data regulations. With the increase of data volume, variety, and velocity, data governance is mandatory for trustworthy, usable, accurate, and accessible data across organizations, especially with distributed data in motion. When it comes to choosing a tool to govern real-time distributed data, there is often a paradox of choice. Some tools are built for handling data at rest, while open source alternatives lack features and are not managed services that can be integrated with the Apache Kafka® ecosystem natively. To solve governance use cases by delivering high-quality data assets, Tushar and his team have been taking Confluent Schema Registry, considered the de facto metadata management standard for the ecosystem, to the next level. This approach to governance allows organizations to scale Kafka operations for real-time observability with security and quality. The fully managed, cloud-native Stream Governance framework is based on three key workflows: Stream catalog: Search and discover data in a self-service fashionStream lineage: Understand the complex data relationships with interactive, end-to-end maps of event streams Stream quality: Deliver trusted, high-quality event streams to the organization Tushar also shares use cases around data governance and sheds light on the Stream Governance roadmap. EPISODE LINKSStream Governance – How it WorksData Mess to Data Mesh | Jay KrepsDemo: Stream GovernanceData Governance for Real Time DataWatch the video version of this podcastKris Jenkins TwitterStreaming Audio Playlist Join the Confluent CommunityLearn more with Kafka tutorials, resources, and guides at Confluent DeveloperLive demo: Intro to Event-Driven Microservices with ConfluentUse PODCAST100 to get an additional $100 of free Confluent Cloud usage (details)  

Data availability, usability, integrity, and security are words that we sometimes hear a lot. But what do they actually look like when put into practice? That’s where data governance comes in. This becomes especially tricky when working with real-time data architectures.Tushar Thole (Senior Manager, Engineering, Trust &amp; Security, Confluent) focuses on delivering features for software-defined storage, software-defined networking (SD-WAN), security, and cloud-native domains. In this episode, he shares the importance of real-time data governance and the product portfolio—Stream Governance, which his team has been building to fostering the collaboration and knowledge sharing necessary to become an event-centric business while remaining compliant within an ever-evolving landscape of data regulations. With the increase of data volume, variety, and velocity, data governance is mandatory for trustworthy, usable, accurate, and accessible data across organizations, especially with distributed data in motion. When it comes to choosing a tool to govern real-time distributed data, there is often a paradox of choice. Some tools are built for handling data at rest, while open source alternatives lack features and are not managed services that can be integrated with the Apache Kafka® ecosystem natively. To solve governance use cases by delivering high-quality data assets, Tushar and his team have been taking Confluent Schema Registry, considered the de facto metadata management standard for the ecosystem, to the next level. This approach to governance allows organizations to scale Kafka operations for real-time observability with security and quality. The fully managed, cloud-native Stream Governance framework is based on three key workflows: <ul><li>Stream catalog: Search and discover data in a self-service fashion</li><li>Stream lineage: Understand the complex data relationships with interactive, end-to-end maps of event streams </li><li>Stream quality: Deliver trusted, high-quality event streams to the organization </li></ul>Tushar also shares use cases around data governance and sheds light on the Stream Governance roadmap. EPISODE LINKS<ul><li><a href="https://www.confluent.io/blog/stream-governance-how-it-works/" rel="nofollow" target="_blank">Stream Governance – How it Works</a></li><li><a href="https://www.youtube.com/watch?v=G_qRkDZfX00" rel="nofollow" target="_blank">Data Mess to Data Mesh | Jay Kreps</a></li><li><a href="https://www.youtube.com/watch?v=2KNP1P9Wk-E" rel="nofollow" target="_blank">Demo: Stream Governance</a></li><li><a href="https://www.confluent.io/product/stream-governance/" rel="nofollow" target="_blank">Data Governance for Real Time Data</a></li><li><a href="https://www.youtube.com/watch?v=RoF3MPTU7Qo&amp;list=PLa7VYi0yPIH1B0i7mhzVi78TIkKSd-0vE" rel="nofollow" target="_blank">Watch the video version of this podcast</a></li><li><a href="https://twitter.com/krisajenkins" rel="nofollow" target="_blank">Kris Jenkins Twitter</a></li><li><a href="https://www.youtube.com/playlist?list=PLa7VYi0yPIH1B0i7mhzVi78TIkKSd-0vE" rel="nofollow" target="_blank">Streaming Audio Playlist </a></li><li><a href="https://www.confluent.io/community/ask-the-community/" rel="nofollow" target="_blank">Join the Confluent Community</a></li><li><a href="https://developer.confluent.io/" rel="nofollow" target="_blank">Learn more with Kafka tutorials, resources, and guides at Confluent Developer</a></li><li><a href="https://www.confluent.io/resources/online-talk/demo-intro-to-event-driven-microservices-with-confluent/" rel="nofollow" target="_blank">Live demo: Intro to Event-Driven Microservices with Confluent</a></li><li><a href="https://www.confluent.io/confluent-cloud/tryfree" rel="nofollow" target="_blank">Use PODCAST100 to get an additional $100 of free Confluent Cloud usage</a> (<a href="https://www.confluent.io/confluent-cloud-promo-disclaimer/" rel="nofollow" target="_blank">details</a>)  </li></ul>

Building Real-Time Data Governance at Scale with Apache Kafka ft. Tushar Thole

DAVID ARAUJO

Confluent Platform 5.5 introduces long-awaited JSON Schema and Protobuf support in Confluent Schema Registry and across other platform components. Support for Protobuf and JSON Schema in Schema Registry provides the same assurances of data compatibility and consistency we already had with Avro, while opening up Kafka to more businesses, applications, and use cases that are built upon those data serialization formats. Tushar Thole (Engineering Leader, Confluent) and David Araujo (Product Manager, Confluent) share about these new improvements to Confluent Schema Registry, the differences between Apache Avro™, Protobuf, and JSON Schemas, how to treat optional fields, some of the arguments between Avro and Protobuf, and why it took some time for Schema Registry to support JSON Schemas and Protobuf.Later, they talk about custom plugins, adding another layer of safety in Confluent Platform 5.5, and their vision for data governance.EPISODE LINKSIntroducing Confluent Platform 5.5Confluent Platform Now Supports Protobuf, JSON Schema, and Custom FormatsDownload Confluent PlatformGetting Started with Protobuf in Confluent CloudRead articles by Robert Yokota Schema Validation with Confluent Platform 5.4 Playing Chess with Confluent Schema RegistryJSON Schema specsSend feedback to datagovernance@confluent.ioFully managed Apache Kafka as a service! Try free.Join the Confluent Community SlackLearn more with Kafka tutorials, resources, and guides at Confluent Developer

Confluent Platform 5.5 introduces long-awaited JSON Schema and Protobuf support in Confluent Schema Registry and across other platform components. Support for Protobuf and JSON Schema in Schema Registry provides the same assurances of data compatibility and consistency we already had with Avro, while opening up Kafka to more businesses, applications, and use cases that are built upon those data serialization formats. Tushar Thole (Engineering Leader, Confluent) and David Araujo (Product Manager, Confluent) share about these new improvements to Confluent Schema Registry, the differences between Apache Avro™, Protobuf, and JSON Schemas, how to treat optional fields, some of the arguments between Avro and Protobuf, and why it took some time for Schema Registry to support JSON Schemas and Protobuf.Later, they talk about custom plugins, adding another layer of safety in Confluent Platform 5.5, and their vision for data governance.EPISODE LINKS<ul><li><a href="https://www.confluent.io/blog/introducing-confluent-platform-5-5?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.introducing-protobuf-json-support.community_content.confluent-platform" rel="nofollow" target="_blank">Introducing Confluent Platform 5.5</a></li><li><a href="https://www.confluent.io/blog/confluent-platform-now-supports-protobuf-json-schema-custom-formats/?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.introducing-protobuf-json-support.community_content.confluent-platform" rel="nofollow" target="_blank">Confluent Platform Now Supports Protobuf, JSON Schema, and Custom Formats</a></li><li><a href="https://www.confluent.io/download/?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.introducing-protobuf-json-support.community_content.confluent-platform" rel="nofollow" target="_blank">Download Confluent Platform</a></li><li><a href="https://www.confluent.io/blog/using-protobuf-in-confluent-cloud?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.introducing-protobuf-json-support.community_content.confluent-platform" rel="nofollow" target="_blank">Getting Started with Protobuf in Confluent Cloud</a></li><li><a href="https://www.confluent.io/blog/author/robert-yokota/?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.introducing-protobuf-json-support.community_content.confluent-platform" rel="nofollow" target="_blank">Read articles by Robert Yokota</a> </li><li><a href="https://www.confluent.io/blog/data-governance-with-schema-validation?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.introducing-protobuf-json-support.community_content.confluent-platform" rel="nofollow" target="_blank">Schema Validation with Confluent Platform 5.4</a> </li><li><a href="https://yokota.blog/2020/02/26/playing-chess-with-confluent-schema-registry/" rel="nofollow" target="_blank">Playing Chess with Confluent Schema Registry</a></li><li><a href="https://json-schema.org/specification.html" rel="nofollow" target="_blank">JSON Schema specs</a></li><li><a href="mailto:datagovernance@confluent.io">Send feedback to datagovernance@confluent.io</a></li><li><a href="http://confluent.io/confluent-cloud/?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.introducing-protobuf-json-support.community_content.confluent-platform" rel="nofollow" target="_blank">Fully managed Apache Kafka as a service! Try free.</a></li><li><a href="https://cnfl.io/confluent-community-slack" rel="nofollow" target="_blank">Join the Confluent Community Slack</a></li><li><a href="https://developer.confluent.io/?utm_source=buzzsprout&amp;utm_medium=podcast&amp;utm_campaign=ch.episode-links_type.community_content.developer" rel="nofollow" target="_blank">Learn more with Kafka tutorials, resources, and guides at Confluent Developer</a></li></ul>

Introducing JSON and Protobuf Support ft. David Araujo and Tushar Thole