Haoyuan Li's guest appearances

Haoyuan Li

Software Engineering Daily

Software Engineering Radio - the podcast for professional software developers

Data Archives - Software Engineering Daily

Contributor

Software Daily

Frank McSherry

Tanmai Gopal

Maxim Fateev

Ketan Umare

Abe Gong

Alexander Gallego

Nick Schrock

Alexandr Wang

Rick Houlihan

Johannes Schickling

Justin Borgman

Alan Murphy

Joey Parsons

Zhenxiao Luo

Allison King

OwlTail

 Full show notes and transcript.  Eric Anderson (@ericmander) hosts Haoyuan Li (@haoyuan), also known as H.Y., creator of Spark Streaming as well as the open source data orchestration system, Alluxio. H.Y. founded Alluxio, Inc. to further develop the research project that he first created as a doctoral student at UC Berkeley’s AMPLab. Listen to today’s episode to learn more about how H.Y. identified an opportunity to disrupt cloud storage with an open source project as his Ph.D. thesis. In this episode we discuss:  H.Y.’s analysis of the data storage industry’s cyclical history How H.Y. balanced academics with the Alluxio community The 3 types of Alluxio contributors Use cases for Alluxio  Links:  Alluxio Spark Streaming Kubernetes Presto TensorFlow AMPLab

<ul> <li><a href="https://contributor.fireside.fm/alluxio" rel="nofollow" target="_blank">Full show notes and transcript.</a></li> </ul> Eric Anderson (<a href="https://twitter.com/ericmander" rel="nofollow" target="_blank">@ericmander</a>) hosts Haoyuan Li (<a href="https://twitter.com/haoyuan" rel="nofollow" target="_blank">@haoyuan</a>), also known as H.Y., creator of Spark Streaming as well as the open source data orchestration system, Alluxio. H.Y. founded Alluxio, Inc. to further develop the research project that he first created as a doctoral student at UC Berkeley’s AMPLab. Listen to today’s episode to learn more about how H.Y. identified an opportunity to disrupt cloud storage with an open source project as his Ph.D. thesis. In this episode we discuss: <ul> <li>H.Y.’s analysis of the data storage industry’s cyclical history</li> <li>How H.Y. balanced academics with the Alluxio community</li> <li>The 3 types of Alluxio contributors</li> <li>Use cases for Alluxio</li> </ul> Links: <ul> <li><a href="http://alluxio.io/" rel="nofollow" target="_blank">Alluxio</a></li> <li><a href="https://spark.apache.org/streaming/" rel="nofollow" target="_blank">Spark Streaming</a></li> <li><a href="https://kubernetes.io/" rel="nofollow" target="_blank">Kubernetes</a></li> <li><a href="https://prestodb.io/" rel="nofollow" target="_blank">Presto</a></li> <li><a href="https://www.tensorflow.org/" rel="nofollow" target="_blank">TensorFlow</a></li> <li><a href="https://amplab.cs.berkeley.edu/" rel="nofollow" target="_blank">AMPLab </a></li></ul>

Alluxio with Haoyuan Li

In 2009, the Berkeley AMPLab was a center of innovation. Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has customers including Alibaba, Baidu, Wells Fargo, and Samsung.Alluxio is a distributed, fault-tolerant, tiered storage system. Alluxio allows application developers to think in terms of the latency that they require from their infrastructure rather than the details of different storage systems. Haoyuan discusses the process of integrating with gigantic companies like cloud providers, telecoms, and huge ecommerce companies.Alluxio is also hosting an upcoming conference, the Data Orchestration Summit November 7th at the Computer History Museum in Mountain View California.November 7, 2019 is the first open source Data Orchestration Summit in the Computer History Museum in Mountain View, CA. The summit brings together data engineers, data platform engineers, and data scientists to share their challenges and learnings from building and using modern analytics, AI, and cloud technologies. Featuring tech talks covering use cases, demos, best practices, and tutorials by industry experts from EA, Walmart, DBS Bank, Netflix, AWS, Rakuten, Tencent, Google, Baidu, Alibaba and more, with a focus on how to build cloud native analytics &amp; AI platforms. Use code “SDE” to get a 50% discount.

In 2009, the Berkeley AMPLab was a center of innovation. Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has customers including Alibaba, Baidu, Wells Fargo, and Samsung.Alluxio is a distributed, fault-tolerant, tiered storage system. Alluxio allows application developers to think in terms of the latency that they require from their infrastructure rather than the details of different storage systems. Haoyuan discusses the process of integrating with gigantic companies like cloud providers, telecoms, and huge ecommerce companies.Alluxio is also hosting an upcoming conference, the <a href="https://www.alluxio.io/data-orchestration-summit-2019/" rel="nofollow" target="_blank">Data Orchestration Summit</a> November 7th at the Computer History Museum in Mountain View California.November 7, 2019 is the first open source <a href="https://www.alluxio.io/data-orchestration-summit-2019/" rel="noopener noreferrer nofollow" target="_blank">Data Orchestration Summit</a> in the Computer History Museum in Mountain View, CA. The summit brings together data engineers, data platform engineers, and data scientists to share their challenges and learnings from building and using modern analytics, AI, and cloud technologies. Featuring tech talks covering use cases, demos, best practices, and tutorials by industry experts from EA, Walmart, DBS Bank, Netflix, AWS, Rakuten, Tencent, Google, Baidu, Alibaba and more, with a focus on how to build cloud native analytics &amp; AI platforms. Use code “SDE” to get a 50% discount.

Alluxio: Data Orchestration with Haoyuan Li

In 2013, the Berkeley AMPLab was a center of innovation.  Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has customers including Alibaba, Baidu, Wells Fargo, and Samsung. Alluxio is an open source data orchestration system. Alluxio allows application developers to think in terms of the latency that they require from their infrastructure rather than the details of different storage systems. Haoyuan discusses the process of integrating with gigantic companies like cloud providers, telecoms, and huge ecommerce companies. Alluxio is also hosting an upcoming conference, the Data Orchestration Summit November 7th at the Computer History Museum in Mountain View California. Sponsorship inquiries: sponsor@softwareengineeringdaily.com Show Notes November 7, 2019 is the first open source Data Orchestration Summit in the Computer History Museum in Mountain View, CA. The summit brings together data engineers, data platform engineers, and data scientists to share their challenges and learnings from building and using modern analytics, AI, and cloud technologies. Featuring tech talks covering use cases, demos, best practices, and tutorials by industry experts from EA, Walmart, DBS Bank, Netflix, AWS, Rakuten, Tencent, Google, Baidu, Alibaba and more, with a focus on how to build cloud native analytics &amp; AI platforms. Use code “SDE” to get a 50% discount. Check out our active projects:  We are hiring a head of growth. If you like Software Engineering Daily and consider yourself competent in sales, marketing, and strategy, send me an email: jeff@softwareengineeringdaily.com FindCollabs is a place to build open source software. The SEDaily app for iOS and Android includes all 1000 of our old episodes, as well as related links, greatest hits, and topics. Subscribe for ad-free episodes.  The post Alluxio: Data Orchestration with Haoyuan Li appeared first on Software Engineering Daily.

In 2013, the Berkeley AMPLab was a center of innovation.  Three projects from AMPLab have turned into successful open source projects and companies: Spark, Mesos, and Alluxio. Haoyuan Li was the creator of Alluxio, and he returns to the show to discuss his journey taking Alluxio from a research project to a company that has customers including Alibaba, Baidu, Wells Fargo, and Samsung. Alluxio is an open source data orchestration system. Alluxio allows application developers to think in terms of the latency that they require from their infrastructure rather than the details of different storage systems. Haoyuan discusses the process of integrating with gigantic companies like cloud providers, telecoms, and huge ecommerce companies. Alluxio is also hosting an upcoming conference, the <a href="https://www.alluxio.io/data-orchestration-summit-2019/" rel="nofollow" target="_blank">Data Orchestration Summit</a> November 7th at the Computer History Museum in Mountain View California. Sponsorship inquiries: <a href="mailto:sponsor@softwareengineeringdaily.com">sponsor@softwareengineeringdaily.com</a> <h2>Show Notes</h2> November 7, 2019 is the first open source <a href="https://www.alluxio.io/data-orchestration-summit-2019/" rel="noopener noreferrer nofollow" target="_blank">Data Orchestration Summit</a> in the Computer History Museum in Mountain View, CA. The summit brings together data engineers, data platform engineers, and data scientists to share their challenges and learnings from building and using modern analytics, AI, and cloud technologies. Featuring tech talks covering use cases, demos, best practices, and tutorials by industry experts from EA, Walmart, DBS Bank, Netflix, AWS, Rakuten, Tencent, Google, Baidu, Alibaba and more, with a focus on how to build cloud native analytics &amp; AI platforms. Use code “SDE” to get a 50% discount. <h2>Check out our active projects:</h2> <ul> <li>We are hiring a <a href="https://www.softwaredaily.com/jobs/5c3a6cf0f7fb250029d873a9" rel="nofollow" target="_blank">head of growth</a>. If you like Software Engineering Daily and consider yourself competent in sales, marketing, and strategy, send me an email: jeff@softwareengineeringdaily.com</li> <li><a href="https://findcollabs.com/" rel="nofollow" target="_blank">FindCollabs</a> is a place to build open source software.</li> <li><a href="https://itunes.apple.com/us/app/software-engineering-daily/id1253734426?mt=8" rel="nofollow" target="_blank">The SEDaily app for iOS</a> and <a href="https://play.google.com/store/apps/details?id=com.koalatea.sedaily" rel="nofollow" target="_blank">Android</a> includes all 1000 of our old episodes, as well as related links, greatest hits, and topics. <a href="https://softwareengineeringdaily.com/subscribe" rel="nofollow" target="_blank">Subscribe</a> for ad-free episodes.</li> </ul> The post <a href="https://softwareengineeringdaily.com/2019/10/25/alluxio-data-orchestration-with-haoyuan-li/" rel="nofollow" target="_blank">Alluxio: Data Orchestration with Haoyuan Li</a> appeared first on <a href="https://softwareengineeringdaily.com" rel="nofollow" target="_blank">Software Engineering Daily</a>.