Kamil Bajda-Pawlikowski's guest appearances

Kamil Bajda-Pawlikowski

Data Engineering Podcast

Nikita Shamgunov

Christopher Ryan

Emily Miller

Peter Bull

Patrick Hunt

Jonathan Katz

Kevin Moore

Dan Robinson

Matthew Rocklin

Maxime Beauchemin

Jean Georges Perrin

Todd Walter

Mark Marinelli

Andy LoPresto

Joe Crobak

OwlTail

Starburst

Summary Most businesses end up with data in a myriad of places with varying levels of structure. This makes it difficult to gain insights from across departments, projects, or people. Presto is a distributed SQL engine that allows you to tie all of your information together without having to first aggregate it all into a data warehouse. Kamil Bajda-Pawlikowski co-founded Starburst Data to provide support and tooling for Presto, as well as contributing advanced features back to the project. In this episode he describes how Presto is architected, how you can use it for your analytics, and the work that he is doing at Starburst Data. Preamble  Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline you’ll need somewhere to deploy it, so check out Linode. With private networking, shared block storage, node balancers, and a 40Gbit network, all controlled by a brand new API you’ve got everything you need to run a bullet-proof data platform. Go to dataengineeringpodcast.com/linode to get a $20 credit and launch a new server in under a minute. Go to dataengineeringpodcast.com to subscribe to the show, sign up for the newsletter, read the show notes, and get in touch. Your host is Tobias Macey and today I’m interviewing Kamil Bajda-Pawlikowski about Presto and his experiences with supporting it at Starburst Data  Interview  Introduction How did you get involved in the area of data management? Can you start by explaining what Presto is?  What are some of the common use cases and deployment patterns for Presto?   How does Presto compare to Drill or Impala? What is it about Presto that led you to building a business around it? What are some of the most challenging aspects of running and scaling Presto? For someone who is using the Presto SQL interface, what are some of the considerations that they should keep in mind to avoid writing poorly performing queries?  How does Presto represent data for translating between its SQL dialect and the API of the data stores that it interfaces with?   What are some cases in which Presto is not the right solution? What types of support have you found to be the most commonly requested? What are some of the types of tooling or improvements that you have made to Presto in your distribution?  What are some of the notable changes that your team has contributed upstream to Presto?    Contact Info  Website E-mail Twitter – @starburstdata Twitter – @prestodb  Parting Question  From your perspective, what is the biggest gap in the tooling or technology for data management today?  Links  Starburst Data Presto Hadapt Hadoop Hive Teradata PrestoCare Cost Based Optimizer ANSI SQL Spill To Disk Tempto Benchto Geospatial Functions Cassandra Accumulo Kafka Redis PostGreSQL  The intro and outro music is from The Hug by The Freak Fandango Orchestra / {CC BY-SA](http://creativecommons.org/licenses/by-sa/3.0/)?utm_source=rss&amp;utm_medium=rssSupport Data Engineering Podcast

<h2>Summary</h2> <p>Most businesses end up with data in a myriad of places with varying levels of structure. This makes it difficult to gain insights from across departments, projects, or people. Presto is a distributed SQL engine that allows you to tie all of your information together without having to first aggregate it all into a data warehouse. Kamil Bajda-Pawlikowski co-founded Starburst Data to provide support and tooling for Presto, as well as contributing advanced features back to the project. In this episode he describes how Presto is architected, how you can use it for your analytics, and the work that he is doing at Starburst Data.</p> <h2>Preamble</h2> <ul> <li>Hello and welcome to the Data Engineering Podcast, the show about modern data management</li> <li>When you’re ready to build your next pipeline you’ll need somewhere to deploy it, so check out Linode. With private networking, shared block storage, node balancers, and a 40Gbit network, all controlled by a brand new API you’ve got everything you need to run a bullet-proof data platform. Go to <a href="https://www.dataengineeringpodcast.com/linode?utm_source=rss&amp;utm_medium=rss" rel="nofollow" target="_blank">dataengineeringpodcast.com/linode</a> to get a $20 credit and launch a new server in under a minute.</li> <li>Go to <a href="https://www.dataengineeringpodcast.com?utm_source=rss&amp;utm_medium=rss" rel="nofollow" target="_blank">dataengineeringpodcast.com</a> to subscribe to the show, sign up for the newsletter, read the show notes, and get in touch.</li> <li>Your host is Tobias Macey and today I’m interviewing Kamil Bajda-Pawlikowski about Presto and his experiences with supporting it at Starburst Data</li> </ul> <h2>Interview</h2> <ul> <li>Introduction</li> <li>How did you get involved in the area of data management?</li> <li>Can you start by explaining what Presto is? <ul> <li>What are some of the common use cases and deployment patterns for Presto?</li> </ul> <p></p></li> <li>How does Presto compare to Drill or Impala?</li> <li>What is it about Presto that led you to building a business around it?</li> <li>What are some of the most challenging aspects of running and scaling Presto?</li> <li>For someone who is using the Presto SQL interface, what are some of the considerations that they should keep in mind to avoid writing poorly performing queries?<p></p> <ul> <li>How does Presto represent data for translating between its SQL dialect and the API of the data stores that it interfaces with?</li> </ul> <p></p></li> <li>What are some cases in which Presto is not the right solution?</li> <li>What types of support have you found to be the most commonly requested?</li> <li>What are some of the types of tooling or improvements that you have made to Presto in your distribution?<p></p> <ul> <li>What are some of the notable changes that your team has contributed upstream to Presto?</li> </ul> <p></p></li> </ul><p></p> <h2>Contact Info</h2> <ul> <li><a href="http://www.starburstdata.com?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Website</a></li> <li><a href="mailto:info@starburstdata.com">E-mail</a></li> <li><a href="https://twitter.com/starburstdata?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Twitter – @starburstdata</a></li> <li><a href="https://twitter.com/prestodb?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Twitter – @prestodb</a></li> </ul> <h2>Parting Question</h2> <ul> <li>From your perspective, what is the biggest gap in the tooling or technology for data management today?</li> </ul> <p>Links</p> <ul> <li><a href="https://www.starburstdata.com?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Starburst Data</a></li> <li><a href="https://www.prestodb.io?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Presto</a></li> <li><a href="https://www.crunchbase.com/organization/hadapt?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Hadapt</a></li> <li><a href="https://hadoop.apache.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Hadoop</a></li> <li><a href="https://hive.apache.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Hive</a></li> <li><a href="http://www.teradata.com?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Teradata</a></li> <li><a href="https://www.starburstdata.com/presto-managed-services?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">PrestoCare</a></li> <li><a href="https://www.starburstdata.com/technical-blog/2018/4/9/introduction-to-presto-cost-based-optimizer?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Cost Based Optimizer</a></li> <li><a href="https://en.wikipedia.org/wiki/SQL?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">ANSI SQL</a></li> <li><a href="https://docs.starburstdata.com/latest/admin/spill.html?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Spill To Disk</a></li> <li><a href="https://github.com/prestodb/tempto?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Tempto</a></li> <li><a href="https://github.com/prestodb/benchto?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Benchto</a></li> <li><a href="https://docs.starburstdata.com/latest/functions/geospatial.html?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Geospatial Functions</a></li> <li><a href="http://cassandra.apache.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Cassandra</a></li> <li><a href="https://accumulo.apache.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Accumulo</a></li> <li><a href="http://kafka.apache.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Kafka</a></li> <li><a href="https://redis.io/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Redis</a></li> <li><a href="https://www.postgresql.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">PostGreSQL</a></li> </ul> <p>The intro and outro music is from <a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/Love_death_and_a_drunken_monkey/04_-_The_Hug?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">The Hug</a> by <a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">The Freak Fandango Orchestra</a> / {CC BY-SA](<a href="http://creativecommons.org/licenses/by-sa/3.0/)?utm_source=rss&amp;utm_medium=rss" rel="nofollow" target="_blank">http://creativecommons.org/licenses/by-sa/3.0/)?utm_source=rss&amp;utm_medium=rss</a></p><p><a href="https://dataengineering.supercast.com/" rel="payment nofollow" target="_blank">Support Data Engineering Podcast</a></p>

PrestoDB and Starburst Data with Kamil Bajda-Pawlikowski - Episode 32