In this episode of the Data Show, I speak with Peter Bailis, founder and CEO of Sisu, a startup that is using machine learning to improve operational analytics. Bailis is also an assistant professor of computer science at Stanford University, where he conducts research into data-intensive systems and where he is co-founder of the DAWN Lab. We had a great conversation spanning many topics, including:  His personal blog, which contains some of the best explainers on emerging topics in data management and distributed systems. The role of machine learning in operational analytics and business intelligence. Machine learning benchmarks—specifically two recent ML initiatives that he’s been involved with: DAWNBench and MLPerf. Trends in data management and in tools for machine learning development, governance, and operations.  Related resources:  “Setting benchmarks in machine learning”: Dave Patterson, Peter Bailis, and other industry leaders discuss how MLPerf will define an entire suite of benchmarks to measure performance of software, hardware, and cloud systems. “The quest for high-quality data” “RISELab’s AutoPandas hints at automation tech that will change the nature of software development” Jeff Jonas on “Real-time entity resolution made accessible” “What are model governance and model operations?” “We need to build machine learning tools to augment machine learning engineers”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I speak with <a href="http://www.bailis.org/" rel="nofollow" target="_blank">Peter Bailis</a>, founder and CEO of <a href="http://sisu.ai/" rel="nofollow" target="_blank">Sisu</a>, a startup that is using machine learning to improve operational analytics. Bailis is also an assistant professor of computer science at Stanford University, where he conducts research into data-intensive systems and where he is co-founder of the <a href="https://dawn.cs.stanford.edu/" rel="nofollow" target="_blank">DAWN Lab</a>. We had a great conversation spanning many topics, including: <ul> <li>His <a href="http://www.bailis.org/blog/" rel="nofollow" target="_blank">personal blog</a>, which contains some of the best explainers on emerging topics in data management and distributed systems.</li> <li>The role of machine learning in operational analytics and business intelligence.</li> <li>Machine learning benchmarks—specifically two recent ML initiatives that he’s been involved with: <a href="https://dawn.cs.stanford.edu/benchmark/" rel="nofollow" target="_blank">DAWNBench</a> and <a href="https://mlperf.org/" rel="nofollow" target="_blank">MLPerf</a>.</li> <li>Trends in data management and in tools for machine learning development, governance, and operations.</li> </ul> Related resources: <ul> <li><a href="https://www.oreilly.com/ideas/setting-benchmarks-in-machine-learning" rel="nofollow" target="_blank">“Setting benchmarks in machine learning”</a>: Dave Patterson, Peter Bailis, and other industry leaders discuss how MLPerf will define an entire suite of benchmarks to measure performance of software, hardware, and cloud systems.</li> <li><a href="https://www.oreilly.com/radar/the-quest-for-high-quality-data/" rel="nofollow" target="_blank">“The quest for high-quality data”</a></li> <li><a href="https://www.oreilly.com/ideas/riselabs-autopandas-hints-at-automation-tech-that-will-change-the-nature-of-software-development" rel="nofollow" target="_blank">“RISELab’s AutoPandas hints at automation tech that will change the nature of software development”</a></li> <li>Jeff Jonas on <a href="https://www.oreilly.com/radar/real-time-entity-resolution-made-accessible" rel="nofollow" target="_blank">“Real-time entity resolution made accessible”</a></li> <li><a href="https://www.oreilly.com/ideas/what-are-model-governance-and-model-operations" rel="nofollow" target="_blank">“What are model governance and model operations?”</a></li> <li><a href="https://www.oreilly.com/radar/we-need-to-build-machine-learning-tools-to-augment-machine-learning-engineers/" rel="nofollow" target="_blank">“We need to build machine learning tools to augment machine learning engineers”</a></li></ul>

Machine learning for operational analytics and business intelligence

In this episode of the Data Show, I speak with Arun Kejariwal of Facebook and Ira Cohen of Anodot (full disclosure: I’m an advisor to Anodot). This conversation stemmed from a recent online panel discussion we did, where we discussed time series data, and, specifically, anomaly detection and forecasting. Both Kejariwal (at Machine Zone, Twitter, and Facebook) and Cohen (at HP and Anodot) have extensive experience building analytic and machine learning solutions at large scale, and both have worked extensively with time-series data. The growing interest in AI and machine learning has not been confined to computer vision, speech technologies, or text. In the enterprise, there is strong interest in using similar automation tools for temporal data and time series. We had a great conversation spanning many topics, including:  Why businesses should care about anomaly detection and forecasting; specifically, we delve into examples outside of IT Operations &amp; Monitoring. (Specialized) techniques and tools for automating some of the relevant tasks, including signal processing, statistical methods, and machine learning. What are some of the key features of an anomaly detection or forecasting system. What lies ahead for large-scale systems for time series analysis.  Related resources:  “Product management in the machine learning era” – a new tutorial at the Artificial Intelligence Conference in London “One simple chart: Who is interested in Apache Pulsar?” Ira Cohen: “Semi-supervised, unsupervised, and adaptive algorithms for large-scale time series” “Got speech? These guidelines will help you get started building voice applications” “RISELab’s AutoPandas hints at automation tech that will change the nature of software development” Ameet Talwalker: “How to train and deploy deep learning at scale”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I speak with <a href="https://www.linkedin.com/in/arunkejariwal/" rel="nofollow" target="_blank">Arun Kejariwal</a> of Facebook and <a href="https://www.linkedin.com/in/ira-cohen-1615491/" rel="nofollow" target="_blank">Ira Cohen</a> of <a href="https://www.anodot.com/" rel="nofollow" target="_blank">Anodot</a> (full disclosure: I’m an advisor to Anodot). This conversation stemmed from a recent online panel discussion we did, where we discussed time series data, and, specifically, anomaly detection and forecasting. Both Kejariwal (at Machine Zone, Twitter, and Facebook) and Cohen (at HP and Anodot) have extensive experience building analytic and machine learning solutions at large scale, and both have worked extensively with time-series data. The growing interest in AI and machine learning has not been confined to computer vision, speech technologies, or text. In the enterprise, there is strong interest in using similar automation tools for temporal data and time series. We had a great conversation spanning many topics, including: <ul> <li>Why businesses should care about anomaly detection and forecasting; specifically, we delve into examples outside of IT Operations &amp; Monitoring.</li> <li>(Specialized) techniques and tools for automating some of the relevant tasks, including signal processing, statistical methods, and machine learning.</li> <li>What are some of the key features of an anomaly detection or forecasting system.</li> <li>What lies ahead for large-scale systems for time series analysis.</li> </ul> Related resources: <ul> <li><a href="https://conferences.oreilly.com/artificial-intelligence/ai-eu/public/schedule/detail/77906" rel="nofollow" target="_blank">“Product management in the machine learning era”</a> – a new tutorial at the Artificial Intelligence Conference in London</li> <li><a href="https://www.oreilly.com/ideas/one-simple-chart-who-is-interested-in-apache-pulsar" rel="nofollow" target="_blank">“One simple chart: Who is interested in Apache Pulsar?”</a></li> <li>Ira Cohen: <a href="https://www.oreilly.com/ideas/semi-supervised-unsupervised-and-adaptive-algorithms-for-large-scale-time-series" rel="nofollow" target="_blank">“Semi-supervised, unsupervised, and adaptive algorithms for large-scale time series”</a></li> <li><a href="https://www.oreilly.com/ideas/got-speech-these-guidelines-will-help-you-get-started-building-voice-applications" rel="nofollow" target="_blank">“Got speech? These guidelines will help you get started building voice applications”</a></li> <li><a href="https://www.oreilly.com/ideas/riselabs-autopandas-hints-at-automation-tech-that-will-change-the-nature-of-software-development" rel="nofollow" target="_blank">“RISELab’s AutoPandas hints at automation tech that will change the nature of software development”</a></li> <li>Ameet Talwalker: <a href="https://www.oreilly.com/ideas/how-to-train-and-deploy-deep-learning-at-scale" rel="nofollow" target="_blank">“How to train and deploy deep learning at scale”</a></li></ul>

Machine learning and analytics for time series data

In this episode of the Data Show, I speak with Michael Mahoney, a member of RISELab, the International Computer Science Institute, and the Department of Statistics at UC Berkeley. A physicist by training, Mahoney has been at the forefront of many important problems in large-scale data analysis. On the theoretical side, his works spans algorithmic and statistical methods for matrices, graphs, regression, optimization, and related problems. On the applications side, he has contributed to systems used for internet and social media analysis, social network analysis, as well as for a host of applications in the physical and life sciences. Most recently, he has been working on deep neural networks, specifically developing theoretical methods and practical diagnostic tools that should be helpful to practitioners who use deep learning.Analyzing deep neural networks with WeightWatcher. Image by Michael Mahoney and Charles Martin, used with permission.We had a great conversation spanning many topics, including:  The class of problems in big data, machine learning, and data analysis that he has worked on at Yahoo, Stanford, and Berkeley. The new UC Berkeley FODA (Foundations of Data Analysis) Institute. HAWQ (Hessian AWare Quantization of Neural Networks with Mixed-Precision), a new framework for addressing problems pertaining to model size and inference speed/power in deep learning. WeightWatcher: a new open source project for predicting the accuracy of deep neural networks. WeightWatcher stems from a recent series of papers with Charles Martin, of Calculation Consulting.  Related resources:  “Deep learning at scale: Tools and solutions” – a new tutorial at the Artificial Intelligence Conference in San Jose Ameet Talwalker on “How to train and deploy deep learning at scale” Greg Diamos on “How big compute is powering the deep learning rocket ship” “RISELab’s AutoPandas hints at automation tech that will change the nature of software development” Reza Zadeh on “Scaling machine learning” “Becoming a machine learning company means investing in foundational technologies” “Managing risk in machine learning” “What are model governance and model operations?” “Product management in the machine learning era”: a tutorial at the Artificial Intelligence Conference in San Jose

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I speak with <a href="https://www.stat.berkeley.edu/~mmahoney/index.html" rel="nofollow" target="_blank">Michael Mahoney</a>, a member of <a href="https://rise.cs.berkeley.edu/" rel="nofollow" target="_blank">RISELab</a>, the <a href="https://www.icsi.berkeley.edu/icsi/" rel="nofollow" target="_blank">International Computer Science Institute</a>, and the <a href="https://statistics.berkeley.edu/" rel="nofollow" target="_blank">Department of Statistics</a> at UC Berkeley. A physicist by training, Mahoney has been at the forefront of many important problems in large-scale data analysis. On the theoretical side, his works spans algorithmic and statistical methods for matrices, graphs, regression, optimization, and related problems. On the applications side, he has contributed to systems used for internet and social media analysis, social network analysis, as well as for a host of applications in the physical and life sciences. Most recently, he has been working on deep neural networks, specifically developing <a href="https://arxiv.org/search/advanced?advanced=&amp;terms-0-operator=AND&amp;terms-0-term=Charles+H.+Martin&amp;terms-0-field=author&amp;terms-1-operator=AND&amp;terms-1-term=Michael+W.+Mahoney&amp;terms-1-field=author&amp;classification-physics_archives=all&amp;classification-include_cross_list=include&amp;date-filter_by=all_dates&amp;date-year=&amp;date-from_date=&amp;date-to_date=&amp;date-date_type=submitted_date&amp;abstracts=show&amp;size=50&amp;order=-announced_date_first" rel="nofollow" target="_blank">theoretical methods</a> and <a href="https://github.com/CalculatedContent/WeightWatcher" rel="nofollow" target="_blank">practical diagnostic tools</a> that should be helpful to practitioners who use deep learning.Analyzing deep neural networks with <a href="https://github.com/CalculatedContent/WeightWatcher" rel="nofollow" target="_blank">WeightWatcher</a>. Image by Michael Mahoney and Charles Martin, used with permission. We had a great conversation spanning many topics, including: <ul> <li>The class of problems in big data, machine learning, and data analysis that he has worked on at Yahoo, Stanford, and Berkeley.</li> <li>The new <a href="https://foda.berkeley.edu/" rel="nofollow" target="_blank">UC Berkeley FODA (Foundations of Data Analysis) Institute</a>.</li> <li><a href="https://arxiv.org/abs/1905.03696" rel="nofollow" target="_blank">HAWQ</a> (Hessian AWare Quantization of Neural Networks with Mixed-Precision), a <a href="https://github.com/amirgholami/HessianFlow" rel="nofollow" target="_blank">new framework</a> for addressing problems pertaining to model size and inference speed/power in deep learning.</li> <li><a href="https://github.com/CalculatedContent/WeightWatcher" rel="nofollow" target="_blank">WeightWatcher</a>: a new open source project for predicting the accuracy of deep neural networks. WeightWatcher stems from <a href="https://arxiv.org/search/advanced?advanced=&amp;terms-0-operator=AND&amp;terms-0-term=Charles+H.+Martin&amp;terms-0-field=author&amp;terms-1-operator=AND&amp;terms-1-term=Michael+W.+Mahoney&amp;terms-1-field=author&amp;classification-physics_archives=all&amp;classification-include_cross_list=include&amp;date-filter_by=all_dates&amp;date-year=&amp;date-from_date=&amp;date-to_date=&amp;date-date_type=submitted_date&amp;abstracts=show&amp;size=50&amp;order=-announced_date_first" rel="nofollow" target="_blank">a recent series of papers</a> with <a href="https://www.linkedin.com/in/charlesmartin14/" rel="nofollow" target="_blank">Charles Martin</a>, of <a href="https://calculationconsulting.com/" rel="nofollow" target="_blank">Calculation Consulting</a>.</li> </ul> Related resources: <ul> <li><a href="https://conferences.oreilly.com/artificial-intelligence/ai-ca/public/schedule/detail/77041" rel="nofollow" target="_blank">“Deep learning at scale: Tools and solutions”</a> – a new tutorial at the Artificial Intelligence Conference in San Jose</li> <li>Ameet Talwalker on <a href="https://www.oreilly.com/ideas/how-to-train-and-deploy-deep-learning-at-scale" rel="nofollow" target="_blank">“How to train and deploy deep learning at scale”</a></li> <li>Greg Diamos on <a href="https://www.oreilly.com/ideas/how-big-compute-is-powering-the-deep-learning-rocket-ship" rel="nofollow" target="_blank">“How big compute is powering the deep learning rocket ship”</a></li> <li><a href="https://www.oreilly.com/ideas/riselabs-autopandas-hints-at-automation-tech-that-will-change-the-nature-of-software-development" rel="nofollow" target="_blank">“RISELab’s AutoPandas hints at automation tech that will change the nature of software development”</a></li> <li>Reza Zadeh on <a href="https://www.oreilly.com/ideas/scaling-machine-learning" rel="nofollow" target="_blank">“Scaling machine learning”</a></li> <li><a href="https://www.oreilly.com/ideas/becoming-a-machine-learning-company-means-investing-in-foundational-technologies" rel="nofollow" target="_blank">“Becoming a machine learning company means investing in foundational technologies”</a></li> <li><a href="https://www.oreilly.com/ideas/managing-risk-in-machine-learning" rel="nofollow" target="_blank">“Managing risk in machine learning”</a></li> <li><a href="https://www.oreilly.com/ideas/what-are-model-governance-and-model-operations" rel="nofollow" target="_blank">“What are model governance and model operations?”</a></li> <li><a href="https://conferences.oreilly.com/artificial-intelligence/ai-ca/public/schedule/detail/77039" rel="nofollow" target="_blank">“Product management in the machine learning era”</a>: a tutorial at the Artificial Intelligence Conference in San Jose</li></ul>

Understanding deep neural networks

In this episode of the Data Show, I speak with Kesha Williams, technical instructor at A Cloud Guru, a training company focused on cloud computing. As a full stack web developer, Williams became intrigued by machine learning and started teaching herself the ML tools on Amazon Web Services. Fast forward to today, Williams has built some well-regarded Alexa skills, mastered ML services on AWS, and has now firmly added machine learning to her developer toolkit.Anatomy of an Alexa skill. Image by Kesha Williams, used with permission.We had a great conversation spanning many topics, including:  How she got started and made the transition into a full-fledged machine learning practitioner. We discussed the evolution of ML tools and learning resources, and how accessible they’ve become for developers. How to build and monetize Alexa skills. Along the way, we took a deep dive and discussed some of the more interesting Alexa skills she has built, as well as one that she really admires.  Related resources:  “Product management in the machine learning era”: a new tutorial session at the Artificial Intelligence Conference in London Cassie Kozyrkov: “Make data science more useful” Kartik Hosanagar: “Algorithms are shaping our lives—here’s how we wrest back control” Francesca Lazzeri and Jaya Mathew: “Lessons learned while helping enterprises adopt machine learning” Jerry Overton: “Teaching and implementing data science and AI in the enterprise” “Becoming a machine learning company means investing in foundational technologies” “Managing risk in machine learning” “What are model governance and model operations?”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I speak with <a href="https://www.linkedin.com/in/java-rock-star-kesha/" rel="nofollow" target="_blank">Kesha Williams</a>, technical instructor at <a href="https://acloud.guru/" rel="nofollow" target="_blank">A Cloud Guru</a>, a training company focused on cloud computing. As a full stack web developer, Williams became intrigued by machine learning and started teaching herself the ML tools on Amazon Web Services. Fast forward to today, Williams has built some well-regarded Alexa skills, mastered ML services on AWS, and has now firmly added machine learning to her developer toolkit.Anatomy of an Alexa skill. Image by Kesha Williams, used with permission. We had a great conversation spanning many topics, including: <ul> <li>How she got started and made the transition into a full-fledged machine learning practitioner.</li> <li>We discussed the evolution of ML tools and learning resources, and how accessible they’ve become for developers.</li> <li>How to build and monetize Alexa skills. Along the way, we took a deep dive and discussed some of the more interesting Alexa skills she has built, as well as one that she really admires.</li> </ul> Related resources: <ul> <li><a href="https://conferences.oreilly.com/artificial-intelligence/ai-eu/public/schedule/detail/77906" rel="nofollow" target="_blank">“Product management in the machine learning era”</a>: a new tutorial session at the Artificial Intelligence Conference in London</li> <li>Cassie Kozyrkov: <a href="https://www.oreilly.com/ideas/make-data-science-more-useful" rel="nofollow" target="_blank">“Make data science more useful”</a></li> <li>Kartik Hosanagar: <a href="https://www.oreilly.com/ideas/algorithms-are-shaping-our-lives-heres-how-we-wrest-back-control" rel="nofollow" target="_blank">“Algorithms are shaping our lives—here’s how we wrest back control”</a></li> <li>Francesca Lazzeri and Jaya Mathew: <a href="https://www.oreilly.com/ideas/lessons-learned-while-helping-enterprises-adopt-machine-learning" rel="nofollow" target="_blank">“Lessons learned while helping enterprises adopt machine learning”</a></li> <li>Jerry Overton: <a href="https://www.oreilly.com/ideas/teaching-and-implementing-data-science-and-ai-in-the-enterprise" rel="nofollow" target="_blank">“Teaching and implementing data science and AI in the enterprise”</a></li> <li><a href="https://www.oreilly.com/ideas/becoming-a-machine-learning-company-means-investing-in-foundational-technologies" rel="nofollow" target="_blank">“Becoming a machine learning company means investing in foundational technologies”</a></li> <li><a href="https://www.oreilly.com/ideas/managing-risk-in-machine-learning" rel="nofollow" target="_blank">“Managing risk in machine learning”</a></li> <li><a href="https://www.oreilly.com/ideas/what-are-model-governance-and-model-operations" rel="nofollow" target="_blank">“What are model governance and model operations?”</a></li></ul>

Becoming a machine learning practitioner

In this episode of the Data Show, I speak with Alex Ratner, project lead for Stanford’s Snorkel open source project; Ratner also recently garnered a faculty position at the University of Washington and is currently working on a company supporting and extending the Snorkel project. Snorkel is a framework for building and managing training data. Based on our survey from earlier this year, labeled data remains a key bottleneck for organizations building machine learning applications and services. Ratner was a guest on the podcast a little over two years ago when Snorkel was a relatively new project. Since then, Snorkel has added more features, expanded into computer vision use cases, and now boasts many users, including Google, Intel, IBM, and other organizations. Along with his thesis advisor professor Chris Ré of Stanford, Ratner and his collaborators have long championed the importance of building tools aimed squarely at helping teams build and manage training data. With today’s release of Snorkel version 0.9, we are a step closer to having a framework that enables the programmatic creation of training data sets.Snorkel pipeline for data labeling. Source: Alex Ratner, used with permission.We had a great conversation spanning many topics, including:  Why he and his collaborators decided to focus on “data programming” and tools for building and managing training data. A tour through Snorkel, including its target users and key components. What’s in the newly released version (v 0.9) of Snorkel. The number of Snorkel’s users has grown quite a bit since we last spoke, so we went through some of the common use cases for the project. Data lineage, AutoML, and end-to-end automation of machine learning pipelines. Holoclean and other projects focused on data quality and data programming. The need for tools that can ease the transition from raw data to derived data (e.g., entities), insights, and even knowledge.  Related resources:  “Product management in the machine learning era”: A tutorial at the Artificial Intelligence Conference in San Jose, September 9-12, 2019. Chris Ré: “Software 2.0 and Snorkel” Alex Ratner: “Creating large training data sets quickly” Ihab Ilyas and Ben Lorica on “The quest for high-quality data” Roger Chen: “Acquiring and sharing high-quality data” Jeff Jonas on “Real-time entity resolution made accessible” “Data collection and data markets in the age of privacy and machine learning”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I speak with <a href="https://ajratner.github.io/" rel="nofollow" target="_blank">Alex Ratner</a>, project lead for Stanford’s <a href="http://snorkel.org/" rel="nofollow" target="_blank">Snorkel</a> open source project; Ratner also recently garnered a faculty position at the University of Washington and is currently working on a company supporting and extending the Snorkel project. Snorkel is a framework for building and managing training data. Based on our <a href="https://www.oreilly.com/data/free/ai-adoption-in-the-enterprise.csp" rel="nofollow" target="_blank">survey</a> from earlier this year, labeled data remains <a href="https://www.oreilly.com/ideas/the-quest-for-high-quality-data" rel="nofollow" target="_blank">a key bottleneck</a> for organizations building machine learning applications and services. Ratner was <a href="https://www.oreilly.com/ideas/creating-large-training-data-sets-quickly" rel="nofollow" target="_blank">a guest on the podcast</a> a little over two years ago when Snorkel was a relatively new project. Since then, Snorkel has added more features, expanded into computer vision use cases, and now boasts many users, including Google, Intel, IBM, and <a href="http://snorkel.org/" rel="nofollow" target="_blank">other organizations</a>. Along with his thesis advisor <a href="https://www.oreilly.com/ideas/software-2-and-snorkel" rel="nofollow" target="_blank">professor Chris Ré of Stanford</a>, Ratner and his collaborators have long championed the importance of building tools aimed squarely at helping teams build and manage training data. With today’s release of Snorkel version 0.9, we are a step closer to having <a href="https://www.oreilly.com/ideas/the-quest-for-high-quality-data" rel="nofollow" target="_blank">a framework that enables the programmatic creation of training data sets</a>.Snorkel pipeline for data labeling. Source: Alex Ratner, used with permission. We had a great conversation spanning many topics, including: <ul> <li>Why he and his collaborators decided to focus on <a href="https://arxiv.org/abs/1605.07723" rel="nofollow" target="_blank">“data programming”</a> and tools for building and managing training data.</li> <li>A tour through Snorkel, including its target users and key components.</li> <li>What’s in the newly released version (v 0.9) of Snorkel.</li> <li>The number of Snorkel’s users has grown quite a bit since we last spoke, so we went through some of the common use cases for the project.</li> <li>Data lineage, AutoML, and end-to-end automation of machine learning pipelines.</li> <li><a href="http://www.holoclean.io/" rel="nofollow" target="_blank">Holoclean</a> and other projects focused on data quality and data programming.</li> <li>The need for tools that can ease the transition <a href="https://gradientflow.com/2019/07/17/youll-want-nexars-newly-released-live-map-for-your-city/" rel="nofollow" target="_blank">from raw data to derived data (e.g., entities), insights</a>, and even knowledge.</li> </ul> Related resources: <ul> <li><a href="https://conferences.oreilly.com/artificial-intelligence/ai-ca/public/schedule/detail/77039" rel="nofollow" target="_blank">“Product management in the machine learning era”</a>: A tutorial at the Artificial Intelligence Conference in San Jose, September 9-12, 2019.</li> <li>Chris Ré: <a href="https://www.oreilly.com/ideas/software-2-and-snorkel" rel="nofollow" target="_blank">“Software 2.0 and Snorkel”</a></li> <li>Alex Ratner: <a href="https://www.oreilly.com/ideas/creating-large-training-data-sets-quickly" rel="nofollow" target="_blank">“Creating large training data sets quickly”</a></li> <li>Ihab Ilyas and Ben Lorica on <a href="https://www.oreilly.com/ideas/the-quest-for-high-quality-data" rel="nofollow" target="_blank">“The quest for high-quality data”</a></li> <li>Roger Chen: <a href="https://www.oreilly.com/ideas/acquiring-and-sharing-high-quality-data" rel="nofollow" target="_blank">“Acquiring and sharing high-quality data”</a></li> <li>Jeff Jonas on <a href="https://www.oreilly.com/ideas/real-time-entity-resolution-made-accessible" rel="nofollow" target="_blank">“Real-time entity resolution made accessible”</a></li> <li><a href="https://www.oreilly.com/ideas/data-collection-and-data-markets-in-the-age-of-privacy-and-machine-learning" rel="nofollow" target="_blank">“Data collection and data markets in the age of privacy and machine learning”</a></li></ul>

Labeling, transforming, and structuring training data sets for machine learning

In this episode of the Data Show, I speak with Cassie Kozyrkov, technical director and chief decision scientist at Google Cloud. She describes “decision intelligence” as an interdisciplinary field concerned with all aspects of decision-making, and which combines data science with the behavioral sciences. Most recently she has been focused on developing best practices that can help practitioners make safe, effective use of AI and data. Kozyrkov uses her platform to help data scientists develop skills that will enable them to connect data and AI with their organizations’ core businesses. We had a great conversation spanning many topics, including:  How data science can be more useful The importance of the human side of data The leadership talent shortage in data science Is data science a bubble?  Related resources:  “Managing machine learning in the enterprise: Lessons from banking and health care” “Managing risk in machine learning” “What are model governance and model operations?” “Becoming a machine learning company means investing in foundational technologies” Forough Poursabzi Sangdeh: “It’s time for data scientists to collaborate with researchers in other disciplines” Jacob Ward: “How social science research can inform the design of AI systems” “AI and machine learning will require retraining your entire organization” Ihab Ilyas and Ben lorica on “The quest for high-quality data” “Product management in the machine learning era”—a tutorial at the Artificial Intelligence Conference in San Jose

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I speak with <a href="https://www.linkedin.com/in/cassie-kozyrkov-9531919/" rel="nofollow" target="_blank">Cassie Kozyrkov</a>, technical director and chief decision scientist at Google Cloud. She describes “decision intelligence” as an interdisciplinary field concerned with all aspects of decision-making, and which combines data science with the behavioral sciences. Most recently she has been focused on developing best practices that can help practitioners make safe, effective use of AI and data. Kozyrkov uses her platform to help data scientists develop skills that will enable them to connect data and AI with their organizations’ core businesses. We had a great conversation spanning many topics, including: <ul> <li>How data science can be more useful</li> <li>The importance of the human side of data</li> <li>The leadership talent shortage in data science</li> <li>Is data science a bubble?</li> </ul> Related resources: <ul> <li><a href="https://www.oreilly.com/ideas/managing-machine-learning-in-the-enterprise-lessons-from-banking-and-health-care" rel="nofollow" target="_blank">“Managing machine learning in the enterprise: Lessons from banking and health care”</a></li> <li><a href="https://www.oreilly.com/ideas/managing-risk-in-machine-learning" rel="nofollow" target="_blank">“Managing risk in machine learning”</a></li> <li><a href="https://www.oreilly.com/ideas/what-are-model-governance-and-model-operations" rel="nofollow" target="_blank">“What are model governance and model operations?”</a></li> <li><a href="https://www.oreilly.com/ideas/becoming-a-machine-learning-company-means-investing-in-foundational-technologies" rel="nofollow" target="_blank">“Becoming a machine learning company means investing in foundational technologies”</a></li> <li>Forough Poursabzi Sangdeh: <a href="https://www.oreilly.com/ideas/its-time-for-data-scientists-to-collaborate-with-researchers-in-other-disciplines" rel="nofollow" target="_blank">“It’s time for data scientists to collaborate with researchers in other disciplines”</a></li> <li>Jacob Ward: <a href="https://www.oreilly.com/ideas/how-social-science-research-can-inform-the-design-of-ai-systems" rel="nofollow" target="_blank">“How social science research can inform the design of AI systems”</a></li> <li><a href="https://www.oreilly.com/ideas/ai-and-machine-learning-will-require-retraining-your-entire-organization" rel="nofollow" target="_blank">“AI and machine learning will require retraining your entire organization”</a></li> <li>Ihab Ilyas and Ben lorica on <a href="https://www.oreilly.com/ideas/the-quest-for-high-quality-data" rel="nofollow" target="_blank">“The quest for high-quality data”</a></li> <li><a href="https://conferences.oreilly.com/artificial-intelligence/ai-ca/public/schedule/detail/77039" rel="nofollow" target="_blank">“Product management in the machine learning era”</a>—a tutorial at the Artificial Intelligence Conference in San Jose</li></ul>

Make data science more useful

In this episode of the Data Show, I spoke with Roger Chen, co-founder and CEO of Computable Labs, a startup focused on building tools for the creation of data networks and data exchanges. Chen has also served as co-chair of O’Reilly’s Artificial Intelligence Conference since its inception in 2016. This conversation took place the day after Chen and his collaborators released an interesting new white paper, Fair value and decentralized governance of data. Current-generation AI and machine learning technologies rely on large amounts of data, and to the extent they can use their large user bases to create “data silos,” large companies in large countries (like the U.S. and China) enjoy a competitive advantage. With that said, we are awash in articles about the dangers posed by these data silos. Privacy and security, disinformation, bias, and a lack of transparency and control are just some of the issues that have plagued the perceived owners of “data monopolies.” In recent years, researchers and practitioners have begun building tools focused on helping organizations acquire, build, and share high-quality data. Chen and his collaborators are doing some of the most interesting work in this space, and I recommend their new white paper and accompanying open source projects.Sequence of basic market transactions in the Computable Labs protocol. Source: Roger Chen, used with permission.We had a great conversation spanning many topics, including:  Why he chose to focus on data governance and data markets. The unique and fundamental challenges in accurately pricing data. The importance of data lineage and provenance, and the approach they took in their proposed protocol. What cooperative governance is and why it’s necessary. How their protocol discourages an unscrupulous user from just scraping all data available in a data market.  Related resources:  Roger Chen: “Data liquidity in the age of inference” Ihab Ilyas and Ben lorica on “The quest for high-quality data” Chris Ré: “Software 2.0 and Snorkel” Alex Ratner on “Creating large training data sets quickly” Jeff Jonas on “Real-time entity resolution made accessible” “Data collection and data markets in the age of privacy and machine learning” Guillaume Chaslot on “The importance of transparency and user control in machine learning”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with Roger Chen, co-founder and CEO of <a href="https://www.computable.io/" rel="nofollow" target="_blank">Computable Labs</a>, a startup focused on building tools for the creation of data networks and data exchanges. Chen has also served as co-chair of <a href="http://theaiconf.com/" rel="nofollow" target="_blank">O’Reilly’s Artificial Intelligence Conference</a> since its inception in 2016. This conversation took place the day after Chen and his collaborators <a href="https://medium.com/computable-blog/computable-whitepaper-a-fair-market-protocol-for-data-f56f0b4143f8" rel="nofollow" target="_blank">released</a> an interesting new white paper, <a href="https://github.com/computablelabs/computable/blob/master/whitepaper/computable_whitepaper.pdf" rel="nofollow" target="_blank">Fair value and decentralized governance of data</a>. Current-generation AI and machine learning technologies rely on large amounts of data, and to the extent they can use their large user bases to create “data silos,” large companies in large countries (like the U.S. and China) enjoy a competitive advantage. With that said, we are awash in articles about the dangers posed by these data silos. Privacy and security, disinformation, bias, and a <a href="https://www.oreilly.com/ideas/the-importance-of-transparency-and-user-control-in-machine-learning" rel="nofollow" target="_blank">lack of transparency and control</a> are just some of the issues that have plagued the perceived owners of “data monopolies.” In recent years, researchers and practitioners have begun building tools focused on helping organizations acquire, build, and share high-quality data. Chen and his collaborators are doing some of the most interesting work in this space, and I recommend their <a href="https://github.com/computablelabs/computable/blob/master/whitepaper/computable_whitepaper.pdf" rel="nofollow" target="_blank">new white paper</a> and accompanying <a href="https://github.com/computablelabs" rel="nofollow" target="_blank">open source projects</a>.Sequence of basic market transactions in the <a href="https://github.com/computablelabs/computable/blob/master/whitepaper/computable_whitepaper.pdf" rel="nofollow" target="_blank">Computable Labs protocol</a>. Source: Roger Chen, used with permission. We had a great conversation spanning many topics, including: <ul> <li>Why he chose to focus on data governance and data markets.</li> <li>The unique and fundamental challenges in accurately pricing data.</li> <li>The importance of data lineage and provenance, and the approach they took in their proposed protocol.</li> <li>What cooperative governance is and why it’s necessary.</li> <li>How their protocol discourages an unscrupulous user from just scraping all data available in a data market.</li> </ul> Related resources: <ul> <li>Roger Chen: <a href="https://www.oreilly.com/ideas/data-liquidity-in-the-age-of-inference" rel="nofollow" target="_blank">“Data liquidity in the age of inference”</a></li> <li>Ihab Ilyas and Ben lorica on <a href="https://www.oreilly.com/ideas/the-quest-for-high-quality-data" rel="nofollow" target="_blank">“The quest for high-quality data”</a></li> <li>Chris Ré: <a href="https://www.oreilly.com/ideas/software-2-and-snorkel" rel="nofollow" target="_blank">“Software 2.0 and Snorkel”</a></li> <li>Alex Ratner on <a href="https://www.oreilly.com/ideas/creating-large-training-data-sets-quickly" rel="nofollow" target="_blank">“Creating large training data sets quickly”</a></li> <li>Jeff Jonas on <a href="https://www.oreilly.com/ideas/real-time-entity-resolution-made-accessible" rel="nofollow" target="_blank">“Real-time entity resolution made accessible”</a></li> <li><a href="https://www.oreilly.com/ideas/data-collection-and-data-markets-in-the-age-of-privacy-and-machine-learning" rel="nofollow" target="_blank">“Data collection and data markets in the age of privacy and machine learning”</a></li> <li>Guillaume Chaslot on <a href="https://www.oreilly.com/ideas/the-importance-of-transparency-and-user-control-in-machine-learning" rel="nofollow" target="_blank">“The importance of transparency and user control in machine learning”</a></li></ul>

Acquiring and sharing high-quality data

In this week’s episode of the Data Show, we’re featuring an interview Data Show host Ben Lorica participated in for the Software Engineering Daily Podcast, where he was interviewed by Jeff Meyerson. Their conversation mainly centered around data engineering, data architecture and infrastructure, and machine learning (ML). Here are a few highlights: Tools for productive collaboration A data catalog, at a high level, basically answers questions around the data that’s available and who is using it so an enterprise can understand access patterns. … The term “data catalog” is generally used when you’ve gotten to the point where you have a team of data scientists and you need a place where they can use libraries in a setting where they can collaborate, and where they can share not only models but maybe even data pipelines and features. The more advanced data science platforms will have automation tools built in. … The ideal scenario is the data science platform is not just for prototyping, but also for pushing things to production. Tools for ML development We have tools for software development, and now we’re beginning to hear about tools for machine learning development—there’s a company here at Strata called Comet.ml, and there’s another startup called Verta.ai. But what has really caught my attention is an open source project from Databricks called MLflow. When it first came out, I thought, ‘Oh, yeah, so we don’t have anything like this. Might have a decent chance of success.’ But I didn’t pay close attention until recently; fast forward to today, there are 80 contributors for 40 companies and 200+ companies using it. What’s good about MLflow is that it has three components and you’re free to pick and choose—you can use one, two, or three. Based on their surveys, the most popular component is the one for tracking and managing machine learning experiments. It’s designed to be useful for individual data scientists, but it’s also designed to be used by teams of data scientists, so they have documented use-cases of MLflow where you have a company managing thousands of models and productions.

In this week’s episode of the Data Show, we’re featuring <a href="https://softwareengineeringdaily.com/2019/04/04/data-with-ben-lorica/" rel="nofollow" target="_blank">an interview Data Show host Ben Lorica participated in for the Software Engineering Daily Podcast</a>, where he was interviewed by <a href="https://twitter.com/the_prion" rel="nofollow" target="_blank">Jeff Meyerson</a>. Their conversation mainly centered around data engineering, data architecture and infrastructure, and machine learning (ML). Here are a few highlights: <h2>Tools for productive collaboration</h2> <blockquote>A data catalog, at a high level, basically answers questions around the data that’s available and who is using it so an enterprise can understand access patterns. … The term “data catalog” is generally used when you’ve gotten to the point where you have a team of data scientists and you need a place where they can use libraries in a setting where they can collaborate, and where they can share not only models but maybe even data pipelines and features. The more advanced data science platforms will have automation tools built in. … The ideal scenario is the data science platform is not just for prototyping, but also for pushing things to production.</blockquote> <h2>Tools for ML development</h2> <blockquote>We have tools for software development, and now we’re beginning to hear about tools for machine learning development—there’s a company here at Strata called <a href="https://www.comet.ml/" rel="nofollow" target="_blank">Comet.ml</a>, and there’s another startup called <a href="https://www.verta.ai/" rel="nofollow" target="_blank">Verta.ai</a>. But what has really caught my attention is an open source project from Databricks called <a href="https://mlflow.org/" rel="nofollow" target="_blank">MLflow</a>. When it first came out, I thought, ‘Oh, yeah, so we don’t have anything like this. Might have a decent chance of success.’ But I didn’t pay close attention until recently; fast forward to today, there are 80 contributors for 40 companies and 200+ companies using it. What’s good about MLflow is that it has three components and you’re free to pick and choose—you can use one, two, or three. Based on their surveys, the most popular component is the one for tracking and managing machine learning experiments. It’s designed to be useful for individual data scientists, but it’s also designed to be used by teams of data scientists, so they have documented use-cases of MLflow where you have a company managing thousands of models and productions.</blockquote>

Tools for machine learning development

In this episode of the Data Show, I spoke with Nick Pentreath, principal engineer at IBM. Pentreath was an early and avid user of Apache Spark, and he subsequently became a Spark committer and PMC member. Most recently his focus has been on machine learning, particularly deep learning, and he is part of a group within IBM focused on building open source tools that enable end-to-end machine learning pipelines. We had a great conversation spanning many topics, including:  AI Fairness 360 (AIF360), a set of fairness metrics for data sets and machine learning models Adversarial Robustness Toolbox (ART), a Python library for adversarial attacks and defenses. Model Asset eXchange (MAX), a curated and standardized collection of free and open source deep learning models. Tools for model development, governance, and operations, including MLflow, Seldon Core, and Fabric for deep learning Reinforcement learning in the enterprise, and the emergence of relevant open source tools like Ray.  Related resources:  “Modern Deep Learning: Tools and Techniques”—a new tutorial at the Artificial Intelligence conference in San Jose Harish Doddi on “Simplifying machine learning lifecycle management” Sharad Goel and Sam Corbett-Davies on “Why it’s hard to design fair machine learning models” “Managing risk in machine learning”: considerations for a world where ML models are becoming mission critical “The evolution and expanding utility of Ray” “Local Interpretable Model-Agnostic Explanations (LIME): An Introduction” Forough Poursabzi Sangdeh on why “It’s time for data scientists to collaborate with researchers in other disciplines”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with <a href="https://www.linkedin.com/in/mlnick/?originalSubdomain=za" rel="nofollow" target="_blank">Nick Pentreath</a>, principal engineer at IBM. Pentreath was an early and avid user of Apache Spark, and he subsequently became a Spark committer and PMC member. Most recently his focus has been on machine learning, particularly deep learning, and he is part of a group within IBM focused on building open source tools that enable end-to-end machine learning pipelines. We had a great conversation spanning many topics, including: <ul> <li><a href="https://github.com/IBM/AIF360" rel="nofollow" target="_blank">AI Fairness 360 (AIF360)</a>, a set of fairness metrics for data sets and machine learning models</li> <li><a href="https://github.com/IBM/adversarial-robustness-toolbox" rel="nofollow" target="_blank">Adversarial Robustness Toolbox (ART)</a>, a Python library for adversarial attacks and defenses.</li> <li><a href="https://developer.ibm.com/code/components/model-asset-exchange/" rel="nofollow" target="_blank">Model Asset eXchange (MAX)</a>, a curated and standardized collection of free and open source deep learning models.</li> <li>Tools for model development, governance, and operations, including <a href="https://mlflow.org/" rel="nofollow" target="_blank">MLflow</a>, <a href="https://github.com/SeldonIO/seldon-core" rel="nofollow" target="_blank">Seldon Core</a>, and <a href="https://github.com/IBM/FfDL" rel="nofollow" target="_blank">Fabric for deep learning</a></li> <li>Reinforcement learning in the enterprise, and the <a href="https://www.oreilly.com/ideas/the-evolution-and-expanding-utility-of-ray" rel="nofollow" target="_blank">emergence of relevant open source tools like Ray</a>.</li> </ul> Related resources: <ul> <li><a href="https://conferences.oreilly.com/artificial-intelligence/ai-ca/public/schedule/detail/77041" rel="nofollow" target="_blank">“Modern Deep Learning: Tools and Techniques”</a>—a new tutorial at the Artificial Intelligence conference in San Jose</li> <li>Harish Doddi on <a href="https://www.oreilly.com/ideas/simplifying-machine-learning-lifecycle-management" rel="nofollow" target="_blank">“Simplifying machine learning lifecycle management”</a></li> <li>Sharad Goel and Sam Corbett-Davies on <a href="https://www.oreilly.com/ideas/why-its-hard-to-design-fair-machine-learning-models" rel="nofollow" target="_blank">“Why it’s hard to design fair machine learning models”</a></li> <li><a href="https://www.oreilly.com/ideas/managing-risk-in-machine-learning" rel="nofollow" target="_blank">“Managing risk in machine learning”</a>: considerations for a world where ML models are becoming mission critical</li> <li><a href="https://www.oreilly.com/ideas/the-evolution-and-expanding-utility-of-ray" rel="nofollow" target="_blank">“The evolution and expanding utility of Ray”</a></li> <li><a href="https://www.oreilly.com/learning/introduction-to-local-interpretable-model-agnostic-explanations-lime" rel="nofollow" target="_blank">“Local Interpretable Model-Agnostic Explanations (LIME): An Introduction”</a></li> <li>Forough Poursabzi Sangdeh on why <a href="https://www.oreilly.com/ideas/its-time-for-data-scientists-to-collaborate-with-researchers-in-other-disciplines" rel="nofollow" target="_blank">“It’s time for data scientists to collaborate with researchers in other disciplines”</a></li></ul>

Enabling end-to-end machine learning pipelines in real-world applications

In this episode of the Data Show, I spoke with Dhruba Borthakur (co-founder and CTO) and Shruti Bhat (SVP of Product) of Rockset, a startup focused on building solutions for interactive data science and live applications. Borthakur was the founding engineer of HDFS and creator of RocksDB, while Bhat is an experienced product and marketing executive focused on enterprise software and data products. Their new startup is focused on a few trends I’ve recently been thinking about, including the re-emergence of real-time analytics, and the hunger for simpler data architectures and tools.  Borthakur exemplifies the need for companies to continually evaluate new technologies: while he was the founding engineer for HDFS, these days he mostly works with object stores like S3. We had a great conversation spanning many topics, including:  RocksDB, an open source, embeddable key-value store originated by Facebook, and which is used in several other open source projects. Time-series databases. The importance of having solutions for real-time analytics, particularly now with the renewed interest in IoT applications and rollout of 5G technologies. Use cases for Rockset’s technologies—and more generally, applications of real-time analytics. The Aggregator Leaf Tailer architecture as an alternative to the Lambda architecture. Building data infrastructure in the cloud.The Aggregator Leaf Tailer (“CQRS for the data world”): A data architecture favored by web-scale companies. Source: Dhruba Borthakur, used with permission.Related resources:  Serverless Streaming Architectures &amp; Algorithms for the Enterprise – a new tutorial on September 24th at Strata Data NYC. “Becoming a machine learning company means investing in foundational technologies” Haoyuan Li: “In the age of AI, fundamental value resides in data” Harish Doddi: “Simplifying machine learning lifecycle management” Eric Jonas: “A Berkeley view on serverless computing” “Specialized tools for machine learning development and model governance are becoming essential” Avner Braaverman: “What data scientists and data engineers can do with current generation serverless technologies”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with <a href="https://www.linkedin.com/in/dhruba/" rel="nofollow" target="_blank">Dhruba Borthakur</a> (co-founder and CTO) and <a href="https://www.linkedin.com/in/shrutibhat/" rel="nofollow" target="_blank">Shruti Bhat</a> (SVP of Product) of <a href="https://rockset.com/" rel="nofollow" target="_blank">Rockset</a>, a startup focused on building solutions for interactive data science and live applications. Borthakur was the founding engineer of <a href="https://en.wikipedia.org/wiki/Apache_Hadoop" rel="nofollow" target="_blank">HDFS</a> and creator of <a href="https://en.wikipedia.org/wiki/RocksDB" rel="nofollow" target="_blank">RocksDB</a>, while Bhat is an experienced product and marketing executive focused on enterprise software and data products. Their new startup is focused on a few trends I’ve recently been thinking about, including the re-emergence of real-time analytics, and the hunger for simpler data architectures and tools.  Borthakur exemplifies the need for companies to continually evaluate new technologies: while he was the founding engineer for HDFS, these days he mostly works with object stores like S3. We had a great conversation spanning many topics, including: <ul> <li><a href="https://rocksdb.org/" rel="nofollow" target="_blank">RocksDB</a>, an open source, embeddable key-value store originated by Facebook, and which is used in several <a href="https://www.cockroachlabs.com/blog/cockroachdb-on-rocksd/" rel="nofollow" target="_blank">other</a> open source <a href="https://www.alluxio.io/blog/scalable-metadata-service-in-alluxio-storing-billions-of-files/" rel="nofollow" target="_blank">projects</a>.</li> <li>Time-series databases.</li> <li>The importance of having solutions for real-time analytics, particularly now with the renewed interest in IoT applications and rollout of 5G technologies.</li> <li>Use cases for Rockset’s technologies—and more generally, applications of real-time analytics.</li> <li><a href="https://rockset.com/blog/aggregator-leaf-tailer-an-architecture-for-live-analytics-on-event-streams/" rel="nofollow" target="_blank">The Aggregator Leaf Tailer architecture</a> as an alternative to the Lambda architecture.</li> <li>Building data infrastructure in the cloud.</li></ul>The Aggregator Leaf Tailer (<a href="https://twitter.com/dhruba_rocks/status/1134329626967175168" rel="nofollow" target="_blank">“CQRS for the data world”)</a>: A data architecture favored by web-scale companies. Source: Dhruba Borthakur, used with permission. Related resources: <ul> <li><a href="https://conferences.oreilly.com/strata/strata-ny/public/schedule/detail/77672" rel="nofollow" target="_blank">Serverless Streaming Architectures &amp; Algorithms for the Enterprise</a> – a new tutorial on September 24th at Strata Data NYC.</li> <li><a href="https://www.oreilly.com/ideas/becoming-a-machine-learning-company-means-investing-in-foundational-technologies" rel="nofollow" target="_blank">“Becoming a machine learning company means investing in foundational technologies”</a></li> <li>Haoyuan Li: <a href="https://www.oreilly.com/ideas/in-the-age-of-ai-fundamental-value-resides-in-data" rel="nofollow" target="_blank">“In the age of AI, fundamental value resides in data”</a></li> <li>Harish Doddi: <a href="https://www.oreilly.com/ideas/simplifying-machine-learning-lifecycle-management" rel="nofollow" target="_blank">“Simplifying machine learning lifecycle management”</a></li> <li>Eric Jonas: <a href="https://learning.oreilly.com/library/view/strata-data-conference/9781492050520/video324252.html" rel="nofollow" target="_blank">“A Berkeley view on serverless computing”</a></li> <li><a href="https://www.oreilly.com/ideas/specialized-tools-for-machine-learning-development-and-model-governance-are-becoming-essential" rel="nofollow" target="_blank">“Specialized tools for machine learning development and model governance are becoming essential”</a></li> <li>Avner Braaverman: <a href="https://www.oreilly.com/ideas/what-data-scientists-and-data-engineers-can-do-with-current-generation-serverless-technologies" rel="nofollow" target="_blank">“What data scientists and data engineers can do with current generation serverless technologies”</a></li></ul>

Bringing scalable real-time analytics to the enterprise

The O'Reilly Data Show Podcast explores the opportunities and techniques driving big data, data science, and AI.

In this episode of the Data Show, I spoke with Jike Chong, chief data scientist at Acorns, a startup focused on building tools for micro-investing. Chong has extensive experience using analytics and machine learning in financial services, and he has experience building data science teams in the U.S. and in China. We had a great conversation spanning many topics, including:  Potential applications of data science in financial services. The current state of data science in financial services in both the U.S. and China. His experience recruiting, training, and managing data science teams in both the U.S. and China.  Here are some highlights from our conversation: Opportunities in financial services There’s a customer acquisition piece and then there’s a customer retention piece. For customer acquisition, we can see that new technologies can really add value by looking at all sorts of data sources that can help a financial service company identify who they want to target to provide those services. So, it’s a great place where data science can help find the product market fit, not just at one instance like identifying who you want to target, but also in a continuous form where you can evolve a product and then continuously find the audience that would best fit the product and continue to analyze the audience so you can design the next generation product. … Once you have a specific cohort of users who you want to target, there’s a need to be able to precisely convert them, which means understanding the stage of the customer’s thought process and understanding how to form the narrative to convince the user or the customer that a particular piece of technology or particular piece of service is the current service they need. … On the customer serving or retention side, for financial services we commonly talk about building hundred-year businesses, right? They have to be profitable businesses, and for financial service to be profitable, there are operational considerations—quantifying risk requires a lot of data science; preventing fraud is really important, and there is garnering the long-term trust with the customer so they stay with you, which means having the work ethic to be able to take care of customer’s data and able to serve the customer better with automated services whenever and wherever the customer is. It’s all those opportunities where I see we can help serve the customer by having the right services presented to them and being able to serve them in the long term. Opportunities in China A few important areas in the financial space in China include mobile payments, wealth management, lending, and insurance—basically, the major areas for the financial industry. For these areas, China may be a forerunner in using internet technologies, especially mobile internet technologies for FinTech, and I think the wave started way back in the 2012/2013 time frame. If you look at mobile payments, like Alipay and WeChat, those have hundreds of millions of active users. The latest data from Alipay is about 608 million users, and these are monthly active users we’re talking about. This is about two times the U.S. population actively using Alipay on a monthly basis, which is a crazy number if you consider all the data that can generate and all the things you can see people buying to be able to understand how to serve the users better. If you look at WeChat, they’re boasting one billion users, monthly active users, early this year. Those are the huge players, and with that amount of traffic, they are able to generate a lot of interest for the lower-frequency services like wealth management and lending, as well as insurance. Related resources:  Kai-Fu Lee outlines the factors that enabled China’s rapid ascension in AI Gary Kazantsev on how “Data science makes an impact on Wall Street” Juan Huerta on “Upcoming challenges and opportunities for data technologies in consumer finance” Geoffrey Bradway on “Programming collective intelligence for financial trading” Jason Dai on why “Companies in China are moving quickly to embrace AI technologies” Haoyuan Li on why “In the age of AI, fundamental value resides in data”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with <a href="https://www.linkedin.com/in/jikechong/" rel="nofollow" target="_blank">Jike Chong</a>, chief data scientist at <a href="https://www.acorns.com/" rel="nofollow" target="_blank">Acorns</a>, a startup focused on building tools for micro-investing. Chong has extensive experience using analytics and machine learning in financial services, and he has experience building data science teams in the U.S. and in China. We had a great conversation spanning many topics, including: <ul> <li>Potential applications of data science in financial services.</li> <li>The current state of data science in financial services in both the U.S. and China.</li> <li>His experience recruiting, training, and managing data science teams in both the U.S. and China.</li> </ul> Here are some highlights from our conversation: <h2>Opportunities in financial services</h2> <blockquote>There’s a customer acquisition piece and then there’s a customer retention piece. For customer acquisition, we can see that new technologies can really add value by looking at all sorts of data sources that can help a financial service company identify who they want to target to provide those services. So, it’s a great place where data science can help find the product market fit, not just at one instance like identifying who you want to target, but also in a continuous form where you can evolve a product and then continuously find the audience that would best fit the product and continue to analyze the audience so you can design the next generation product. … Once you have a specific cohort of users who you want to target, there’s a need to be able to precisely convert them, which means understanding the stage of the customer’s thought process and understanding how to form the narrative to convince the user or the customer that a particular piece of technology or particular piece of service is the current service they need. … On the customer serving or retention side, for financial services we commonly talk about building hundred-year businesses, right? They have to be profitable businesses, and for financial service to be profitable, there are operational considerations—quantifying risk requires a lot of data science; preventing fraud is really important, and there is garnering the long-term trust with the customer so they stay with you, which means having the work ethic to be able to take care of customer’s data and able to serve the customer better with automated services whenever and wherever the customer is. It’s all those opportunities where I see we can help serve the customer by having the right services presented to them and being able to serve them in the long term.</blockquote> <h2>Opportunities in China</h2> <blockquote>A few important areas in the financial space in China include mobile payments, wealth management, lending, and insurance—basically, the major areas for the financial industry. For these areas, China may be a forerunner in using internet technologies, especially mobile internet technologies for FinTech, and I think the wave started way back in the 2012/2013 time frame. If you look at mobile payments, like Alipay and WeChat, those have hundreds of millions of active users. The latest data from Alipay is about 608 million users, and these are monthly active users we’re talking about. This is about two times the U.S. population actively using Alipay on a monthly basis, which is a crazy number if you consider all the data that can generate and all the things you can see people buying to be able to understand how to serve the users better. If you look at WeChat, they’re boasting one billion users, monthly active users, early this year. Those are the huge players, and with that amount of traffic, they are able to generate a lot of interest for the lower-frequency services like wealth management and lending, as well as insurance.</blockquote> Related resources: <ul> <li>Kai-Fu Lee outlines the <a href="https://www.oreilly.com/ideas/china-ai-superpower" rel="nofollow" target="_blank">factors that enabled China’s rapid ascension in AI</a></li> <li>Gary Kazantsev on how <a href="https://www.oreilly.com/ideas/data-science-makes-an-impact-on-wall-street" rel="nofollow" target="_blank">“Data science makes an impact on Wall Street”</a></li> <li>Juan Huerta on <a href="https://www.oreilly.com/library/view/strata-hadoop/9781491944660/video282643.html" rel="nofollow" target="_blank">“Upcoming challenges and opportunities for data technologies in consumer finance”</a></li> <li>Geoffrey Bradway on <a href="https://www.oreilly.com/ideas/programming-collective-intelligence-for-financial-trading" rel="nofollow" target="_blank">“Programming collective intelligence for financial trading”</a></li> <li>Jason Dai on why <a href="https://www.oreilly.com/ideas/companies-in-china-are-moving-quickly-to-embrace-ai-technologies" rel="nofollow" target="_blank">“Companies in China are moving quickly to embrace AI technologies”</a></li> <li>Haoyuan Li on why <a href="https://www.oreilly.com/ideas/in-the-age-of-ai-fundamental-value-resides-in-data" rel="nofollow" target="_blank">“In the age of AI, fundamental value resides in data”</a></li></ul>

Applications of data science and machine learning in financial services

In this episode of the Data Show, I spoke with Jeff Jonas, CEO, founder and chief scientist of Senzing, a startup focused on making real-time entity resolution technologies broadly accessible. He was previously a fellow and chief scientist of context computing at IBM. Entity resolution (ER) refers to techniques and tools for identifying and linking manifestations of the same entity/object/individual. Ironically, ER itself has many different names (e.g., record linkage, duplicate detection, object consolidation/reconciliation, etc.). ER is an essential first step in many domains, including marketing (cleaning up databases), law enforcement (background checks and counterterrorism), and financial services and investing. Knowing exactly who your customers are is an important task for security, fraud detection, marketing, and personalization. The proliferation of data sources and services has made ER very challenging in the internet age. In addition, many applications now increasingly require near real-time entity resolution. We had a great conversation spanning many topics including:  Why ER is interesting and challenging How ER technologies have evolved over the years How Senzing is working to democratize ER by making real-time AI technologies accessible to developers Some early use cases for Senzing’s technologies Some items on their research agenda  Here are a few highlights from our conversation: Entity Resolution through years In the early ’90s, I worked on a much more advanced version of entity resolution for the casinos in Las Vegas and created software called NORA, non-obvious relationship awareness. Its purpose was to help casinos better understand who they were doing business with. We would ingest data from the loyalty club, everybody making hotel reservations, people showing up without reservations, everybody applying for jobs, people terminated, vendors, and 18 different lists of different kinds of bad people, some of them card counters (which aren’t that bad), some cheaters. And they wanted to figure out across all these identities when somebody was the same, and then when people were related. Some people were using 32 different names and a bunch of different social security numbers. … Ultimately, IBM bought my company and this technology became what is known now at IBM as “identity insight.” Identity insight is a real-time entity resolution engine that gets used to solve many kinds of problems. MoneyGram implemented it and their fraud complaints dropped 72%. They saved a few hundred million just in their first few years. … But while at IBM, I had a grand vision about a new type of entity resolution engine that would have been unlike anything that’s ever existed. It’s almost like a Swiss Army knife for ER. Recent developments The Senzing entity resolution engine works really well on two records from a domain that you’ve never even seen before. Say you’ve never done entity resolution on restaurants from Singapore. The first two records you feed it, it’s really, really already smart. And then as you feed it more data, it gets smarter and smarter. … So, there are two things that we’ve intertwined. One is common sense. One type of common sense is the names—Dick, Dickie, Richie, Rick, Ricardo are all part of the same name family. Why should it have to study millions and millions of records to learn that again? … Next to common sense, there’s real-time learning. In real-time learning, we do a few things. You might have somebody named Bob, but who now goes by a nickname or an alias of Andy. Eventually, you might come to learn that. So, now you know you have to learn over time that Bob also has this nickname, and Bob lived at three addresses, and this is his credit card number, and now he’s got four phone numbers. So you want to learn those over time. … These systems we’re creating, our entity resolution systems—which really resolve entities and graph them (call it index of identities and how they’re related)—never has to be reloaded. It literally cleans itself up in the past. You can do maintenance on it while you’re querying it, while you’re loading new transactional data, while you’re loading historical data. There’s nothing else like it that can work at this scale. It’s really hard to do. Related resources:  Jeff Jonas on “Context Computing” David Ferrucci on why “Language understanding remains one of AI’s grand challenges” David Blei on “Topic models: Past, present, and future” “Lessons learned building natural language processing systems in health care” “Building a contacts graph from activity data” “Customer record deduplication using Spark and Reifier”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with <a href="https://www.linkedin.com/in/jeff-jonas/" rel="nofollow" target="_blank">Jeff Jonas</a>, CEO, founder and chief scientist of <a href="https://senzing.com/" rel="nofollow" target="_blank">Senzing</a>, a startup focused on making real-time entity resolution technologies broadly accessible. He was previously a fellow and chief scientist of context computing at IBM. <a href="https://en.wikipedia.org/wiki/Record_linkage#Entity_resolution" rel="nofollow" target="_blank">Entity resolution</a> (ER) refers to techniques and tools for identifying and linking manifestations of the same entity/object/individual. Ironically, ER itself has many different names (e.g., record linkage, duplicate detection, object consolidation/reconciliation, etc.). ER is an essential first step in many domains, including marketing (cleaning up databases), law enforcement (background checks and counterterrorism), and financial services and <a href="https://www.institutionalinvestor.com/article/b1f6yg8n93jyfh/The-Ruthless-Secretive-and-Sometimes-Seedy-World-of-Hedge-Fund-Private-Investigators" rel="nofollow" target="_blank">investing</a>. Knowing exactly who your customers are is an important task for security, fraud detection, marketing, and personalization. The proliferation of data sources and services has made ER very challenging in the internet age. In addition, many applications now increasingly require near real-time entity resolution. We had a great conversation spanning many topics including: <ul> <li>Why ER is interesting and challenging</li> <li>How ER technologies have evolved over the years</li> <li>How Senzing is working to democratize ER by making real-time AI technologies accessible to developers</li> <li>Some early use cases for Senzing’s technologies</li> <li>Some items on their research agenda</li> </ul> Here are a few highlights from our conversation: <h2>Entity Resolution through years</h2> <blockquote>In the early ’90s, I worked on a much more advanced version of entity resolution for the casinos in Las Vegas and created software called NORA, non-obvious relationship awareness. Its purpose was to help casinos better understand who they were doing business with. We would ingest data from the loyalty club, everybody making hotel reservations, people showing up without reservations, everybody applying for jobs, people terminated, vendors, and 18 different lists of different kinds of bad people, some of them card counters (which aren’t that bad), some cheaters. And they wanted to figure out across all these identities when somebody was the same, and then when people were related. Some people were using 32 different names and a bunch of different social security numbers. … Ultimately, IBM bought my company and this technology became what is known now at IBM as “identity insight.” Identity insight is a real-time entity resolution engine that gets used to solve many kinds of problems. MoneyGram implemented it and their fraud complaints dropped 72%. They saved a few hundred million just in their first few years. … But while at IBM, I had a grand vision about a new type of entity resolution engine that would have been unlike anything that’s ever existed. It’s almost like a Swiss Army knife for ER.</blockquote> <h2>Recent developments</h2> <blockquote>The Senzing entity resolution engine works really well on two records from a domain that you’ve never even seen before. Say you’ve never done entity resolution on restaurants from Singapore. The first two records you feed it, it’s really, really already smart. And then as you feed it more data, it gets smarter and smarter. … So, there are two things that we’ve intertwined. One is common sense. One type of common sense is the names—Dick, Dickie, Richie, Rick, Ricardo are all part of the same name family. Why should it have to study millions and millions of records to learn that again? … Next to common sense, there’s real-time learning. In real-time learning, we do a few things. You might have somebody named Bob, but who now goes by a nickname or an alias of Andy. Eventually, you might come to learn that. So, now you know you have to learn over time that Bob also has this nickname, and Bob lived at three addresses, and this is his credit card number, and now he’s got four phone numbers. So you want to learn those over time. … These systems we’re creating, our entity resolution systems—which really resolve entities and graph them (call it index of identities and how they’re related)—never has to be reloaded. It literally cleans itself up in the past. You can do maintenance on it while you’re querying it, while you’re loading new transactional data, while you’re loading historical data. There’s nothing else like it that can work at this scale. It’s really hard to do.</blockquote> Related resources: <ul> <li>Jeff Jonas on <a href="https://www.oreilly.com/ideas/context-computing" rel="nofollow" target="_blank">“Context Computing”</a></li> <li>David Ferrucci on why <a href="https://www.oreilly.com/ideas/language-understanding-remains-one-of-ais-grand-challenges" rel="nofollow" target="_blank">“Language understanding remains one of AI’s grand challenges”</a></li> <li>David Blei on <a href="https://www.oreilly.com/ideas/topic-models-past-present-and-future" rel="nofollow" target="_blank">“Topic models: Past, present, and future”</a></li> <li><a href="https://www.oreilly.com/ideas/lessons-learned-building-natural-language-processing-systems-in-health-care" rel="nofollow" target="_blank">“Lessons learned building natural language processing systems in health care”</a></li> <li><a href="https://learning.oreilly.com/videos/strata-data-conference/9781492025955/9781492025955-video319027" rel="nofollow" target="_blank">“Building a contacts graph from activity data”</a></li> <li><a href="https://learning.oreilly.com/videos/strata-hadoop/9781491944561/9781491944561-video234828" rel="nofollow" target="_blank">“Customer record deduplication using Spark and Reifier”</a></li></ul>

Real-time entity resolution made accessible

In this episode of the Data Show, I spoke with Neelesh Salian, software engineer at Stitch Fix, a company that combines machine learning and human expertise to personalize shopping. As companies integrate machine learning into their products and systems, there are important foundational technologies that come into play. This shouldn’t come as a shock, as current machine learning and AI technologies require large amounts of data—specifically, labeled data for training models. There are also many other considerations—including security, privacy, reliability/safety—that are encouraging companies to invest in a suite of data technologies. In conversations with data engineers, data scientists, and AI researchers, the need for solutions that can help track data lineage and provenance keeps popping up. There are several San Francisco Bay Area companies that have embarked on building data lineage systems—including Salian and his colleagues at Stitch Fix. I wanted to find out how they arrived at the decision to build such a system and what capabilities they are building into it. Here are some highlights from our conversation: Data lineage Data lineage is not something new. It’s something that is borne out of the necessity of understanding how data is being written and interacted with in the data warehouse. I like to tell this story when I’m describing data lineage: think of it as a journey for data. The data takes a journey entering into your warehouse. This can be transactional data, dashboards, or recommendations. What is lost in that collection of data is the information about how it came about. If you knew what journey and exactly what constituted that data to come into being into your data warehouse or any other storage appliance you use, that would be really useful. … Think about data lineage as helping issues about quality of data, understanding if something is corrupted. On the security side, think of GDPR … which was one of the hot topics I heard about at the Strata Data Conference in London in 2018. Why companies are suddenly building data lineage solutions A data lineage system becomes necessary as time progresses. It becomes easier for maintainability. You need it for audit trails, for security and compliance. But you also need to think of the benefit of managing the data sets you’re working with. If you’re working with 10 databases, you need to know what’s going on in them. If I have to give you a vision of a data lineage system, think of it as a final graph or view of some data set, and it shows you a graph of what it’s linked to. Then it gives you some metadata information so you can drill down. Let’s say you have corrupted data, let’s say you want to debug something. All these cases tie into the actual use cases for which we want to build it. Related resources:  “Deep automation in machine learning” Vitaly Gordon on “Building tools for enterprise data science” “Managing risk in machine learning” Haoyuan Li explains why “In the age of AI, fundamental value resides in data” “What machine learning means for software development” Joe Hellerstein on how “Metadata services can lead to performance and organizational improvements”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with <a href="https://www.linkedin.com/in/neeleshsalian" rel="nofollow" target="_blank">Neelesh Salian</a>, software engineer at <a href="https://support.stitchfix.com/hc/en-us/articles/204222994-FAQ" rel="nofollow" target="_blank">Stitch Fix</a>, a company that combines machine learning and human expertise to personalize shopping. As companies integrate machine learning into their products and systems, there are important <a href="https://www.oreilly.com/ideas/deep-automation-in-machine-learning" rel="nofollow" target="_blank">foundational technologies</a> that come into play. This shouldn’t come as a shock, as current machine learning and AI technologies require large amounts of data—specifically, labeled data for training models. There are also many other considerations—including security, privacy, reliability/safety—that are encouraging companies to invest in a suite of data technologies. In conversations with data engineers, data scientists, and AI researchers, the need for solutions that can help track data lineage and provenance keeps popping up. There are several San Francisco Bay Area companies that have embarked on building data lineage systems—including Salian and his colleagues at Stitch Fix. I wanted to find out how they arrived at the decision to build such a system and what capabilities they are building into it. Here are some highlights from our conversation: <h2>Data lineage</h2> <blockquote>Data lineage is not something new. It’s something that is borne out of the necessity of understanding how data is being written and interacted with in the data warehouse. I like to tell this story when I’m describing data lineage: think of it as a journey for data. The data takes a journey entering into your warehouse. This can be transactional data, dashboards, or recommendations. What is lost in that collection of data is the information about how it came about. If you knew what journey and exactly what constituted that data to come into being into your data warehouse or any other storage appliance you use, that would be really useful. … Think about data lineage as helping issues about quality of data, understanding if something is corrupted. On the security side, think of GDPR … which was one of the hot topics I heard about at the Strata Data Conference in London in 2018.</blockquote> <h2>Why companies are suddenly building data lineage solutions</h2> <blockquote>A data lineage system becomes necessary as time progresses. It becomes easier for maintainability. You need it for audit trails, for security and compliance. But you also need to think of the benefit of managing the data sets you’re working with. If you’re working with 10 databases, you need to know what’s going on in them. If I have to give you a vision of a data lineage system, think of it as a final graph or view of some data set, and it shows you a graph of what it’s linked to. Then it gives you some metadata information so you can drill down. Let’s say you have corrupted data, let’s say you want to debug something. All these cases tie into the actual use cases for which we want to build it.</blockquote> Related resources: <ul> <li><a href="https://www.oreilly.com/ideas/deep-automation-in-machine-learning" rel="nofollow" target="_blank">“Deep automation in machine learning”</a></li> <li>Vitaly Gordon on <a href="https://www.oreilly.com/ideas/building-tools-for-enterprise-data-science" rel="nofollow" target="_blank">“Building tools for enterprise data science”</a></li> <li><a href="https://www.oreilly.com/ideas/managing-risk-in-machine-learning" rel="nofollow" target="_blank">“Managing risk in machine learning”</a></li> <li>Haoyuan Li explains why <a href="https://www.oreilly.com/ideas/in-the-age-of-ai-fundamental-value-resides-in-data" rel="nofollow" target="_blank">“In the age of AI, fundamental value resides in data”</a></li> <li><a href="https://www.oreilly.com/ideas/what-machine-learning-means-for-software-development" rel="nofollow" target="_blank">“What machine learning means for software development”</a></li> <li>Joe Hellerstein on how <a href="https://www.oreilly.com/ideas/metadata-services-can-lead-to-performance-and-organizational-improvements" rel="nofollow" target="_blank">“Metadata services can lead to performance and organizational improvements”</a></li></ul>

Why companies are in need of data lineage solutions

In this episode of the Data Show, I spoke with Avner Braverman, co-founder and CEO of Binaris, a startup that aims to bring serverless to web-scale and enterprise applications. This conversation took place shortly after the release of a seminal paper from UC Berkeley (“Cloud Programming Simplified: A Berkeley View on Serverless Computing”), and this paper seeded a lot of our conversation during this episode. Serverless is clearly on the radar of data engineers and architects. In a recent survey, we found 85% of respondents already had parts of their data infrastructure in one of the public clouds, and 38% were already using at least one of the serverless offerings we listed. As more serverless offerings get rolled out—e.g., things like PyWren that target scientists—I expect these numbers to rise. We had a great conversation spanning many topics, including:  A short history of cloud computing. The fundamental differences between serverless and conventional cloud computing. The reasons serverless—specifically AWS Lambda—took off so quickly. What can data scientists and data engineers do with the current generation serverless offerings. What is missing from serverless today and what should users expect in the near future.  Related resources:  “The evolution and expanding utility of Ray” Results of a new survey: “Evolving Data Infrastructure: Tools and Best Practices for Advanced Analytics and AI” Eric Jonas on “Building accessible tools for large-scale computation and machine learning” “7 data trends on our radar” “Handling real-time data operations in the enterprise” “Progress for big data in Kubernetes”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with <a href="https://www.linkedin.com/in/avnerbraverman/" rel="nofollow" target="_blank">Avner Braverman</a>, co-founder and CEO of <a href="https://binaris.com/" rel="nofollow" target="_blank">Binaris</a>, a startup that aims to bring serverless to web-scale and enterprise applications. This conversation took place shortly after the release of a seminal paper from UC Berkeley (<a href="https://arxiv.org/abs/1902.03383" rel="nofollow" target="_blank">“Cloud Programming Simplified: A Berkeley View on Serverless Computing”</a>), and this paper seeded a lot of our conversation during this episode. Serverless is clearly on the radar of data engineers and architects. In a <a href="https://www.oreilly.com/data/free/evolving-data-infrastructure.csp" rel="nofollow" target="_blank">recent survey</a>, we found 85% of respondents already had parts of their data infrastructure in one of the public clouds, and 38% were already using at least one of the serverless offerings we listed. As more serverless offerings get rolled out—e.g., things like <a href="http://pywren.io/" rel="nofollow" target="_blank">PyWren</a> that target scientists—I expect these numbers to rise. We had a great conversation spanning many topics, including: <ul> <li>A short history of cloud computing.</li> <li>The fundamental differences between serverless and conventional cloud computing.</li> <li>The reasons serverless—specifically AWS Lambda—took off so quickly.</li> <li>What can data scientists and data engineers do with the current generation serverless offerings.</li> <li>What is missing from serverless today and what should users expect in the near future.</li> </ul> Related resources: <ul> <li><a href="https://www.oreilly.com/ideas/the-evolution-and-expanding-utility-of-ray" rel="nofollow" target="_blank">“The evolution and expanding utility of Ray”</a></li> <li>Results of a new survey: <a href="https://www.oreilly.com/data/free/evolving-data-infrastructure.csp" rel="nofollow" target="_blank">“Evolving Data Infrastructure: Tools and Best Practices for Advanced Analytics and AI”</a></li> <li>Eric Jonas on <a href="https://www.oreilly.com/ideas/building-accessible-tools-for-large-scale-computation-and-machine-learning" rel="nofollow" target="_blank">“Building accessible tools for large-scale computation and machine learning”</a></li> <li><a href="https://www.oreilly.com/ideas/7-data-trends-on-our-radar" rel="nofollow" target="_blank">“7 data trends on our radar”</a></li> <li><a href="https://www.oreilly.com/ideas/handling-real-time-data-operations-in-the-enterprise" rel="nofollow" target="_blank">“Handling real-time data operations in the enterprise”</a></li> <li><a href="https://www.oreilly.com/ideas/progress-for-big-data-in-kubernetes" rel="nofollow" target="_blank">“Progress for big data in Kubernetes”</a></li></ul>

What data scientists and data engineers can do with current generation serverless technologies

In this episode of the Data Show, I spoke with Forough Poursabzi-Sangdeh, a postdoctoral researcher at Microsoft Research New York City. Poursabzi works in the interdisciplinary area of interpretable and interactive machine learning. As models and algorithms become more widespread, many important considerations are becoming active research areas: fairness and bias, safety and reliability, security and privacy, and Poursabzi’s area of focus—explainability and interpretability. We had a great conversation spanning many topics, including:  Current best practices and state-of-the-art methods used to explain or interpret deep learning—or, more generally, machine learning models. The limitations of current model interpretability methods. The lack of clear/standard metrics for comparing different approaches used for model interpretability Many current AI and machine learning applications augment humans, and, thus, Poursabzi believes it’s important for data scientists to work closely with researchers in other disciplines. The importance of using human subjects in model interpretability studies.  Related resources:  “Local Interpretable Model-Agnostic Explanations (LIME): An Introduction” “Interpreting predictive models with Skater: Unboxing model opacity” Jacob Ward on “How social science research can inform the design of AI systems” Sharad Goel and Sam Corbett-Davies on “Why it’s hard to design fair machine learning models” “Managing risk in machine learning”: considerations for a world where ML models are becoming mission critical Francesca Lazzeri and Jaya Mathew on “Lessons learned while helping enterprises adopt machine learning” Jerry Overton on “Teaching and implementing data science and AI in the enterprise”

In this episode of the <a href="https://www.oreilly.com/ideas/topics/oreilly-data-show-podcast" rel="nofollow" target="_blank">Data Show</a>, I spoke with <a href="https://www.linkedin.com/in/forough-poursabzi-sangdeh-479156a1/" rel="nofollow" target="_blank">Forough Poursabzi-Sangdeh</a>, a postdoctoral researcher at Microsoft Research New York City. Poursabzi works in the interdisciplinary area of interpretable and interactive machine learning. As models and algorithms become more widespread, many important considerations are becoming active research areas: fairness and bias, safety and reliability, security and privacy, and Poursabzi’s area of focus—explainability and interpretability. We had a great conversation spanning many topics, including: <ul> <li>Current best practices and state-of-the-art methods used to explain or interpret deep learning—or, more generally, machine learning models.</li> <li>The limitations of current model interpretability methods.</li> <li>The lack of clear/standard metrics for comparing different approaches used for model interpretability</li> <li>Many current AI and machine learning applications augment humans, and, thus, Poursabzi believes it’s important for data scientists to work closely with researchers in other disciplines.</li> <li>The importance of using human subjects in model interpretability studies.</li> </ul> Related resources: <ul> <li><a href="https://www.oreilly.com/learning/introduction-to-local-interpretable-model-agnostic-explanations-lime" rel="nofollow" target="_blank">“Local Interpretable Model-Agnostic Explanations (LIME): An Introduction”</a></li> <li><a href="https://www.oreilly.com/ideas/interpreting-predictive-models-with-skater-unboxing-model-opacity" rel="nofollow" target="_blank">“Interpreting predictive models with Skater: Unboxing model opacity”</a></li> <li>Jacob Ward on <a href="https://www.oreilly.com/ideas/how-social-science-research-can-inform-the-design-of-ai-systems" rel="nofollow" target="_blank">“How social science research can inform the design of AI systems”</a></li> <li>Sharad Goel and Sam Corbett-Davies on <a href="https://www.oreilly.com/ideas/why-its-hard-to-design-fair-machine-learning-models" rel="nofollow" target="_blank">“Why it’s hard to design fair machine learning models”</a></li> <li><a href="https://www.oreilly.com/ideas/managing-risk-in-machine-learning" rel="nofollow" target="_blank">“Managing risk in machine learning”</a>: considerations for a world where ML models are becoming mission critical</li> <li>Francesca Lazzeri and Jaya Mathew on <a href="https://www.oreilly.com/ideas/lessons-learned-while-helping-enterprises-adopt-machine-learning" rel="nofollow" target="_blank">“Lessons learned while helping enterprises adopt machine learning”</a></li> <li>Jerry Overton on <a href="https://www.oreilly.com/ideas/teaching-and-implementing-data-science-and-ai-in-the-enterprise" rel="nofollow" target="_blank">“Teaching and implementing data science and AI in the enterprise”</a></li></ul>

It’s time for data scientists to collaborate with researchers in other disciplines

Ben and his wide variety of knowledgeable guests are truly rockstars! They drop quality (and free!) knowledge bombs in each and every episode. The great advice they provide, combined with the relatable way in which they deliver it had me hooked from the very first listen. Thanks for putting out such a stellar show Ben - keep up the great work!

Dropping Knowledge Bombs

Great way to catch up on the history and evolution of DS.

Great to hear from those in the front lines

O'Reilly Data Show Podcast

The best podcast episodes on non-current politics. Covering topics such as universal basic income, democracy, poverty & justice and more. For anyone interested in learning more about politics that affect that world, not just now, but in the longer term. Add episodes you're interested into your queue below!

Best Non-Current Politics Podcasts

The best podcasts on investing. For anyone interested in the stories in the investing industry, whether it's an interview with Ray Dalio or Ed Thorp to the writer of The Big Short. This topic includes the most fascinating stories from all the best investors. Add episodes you're interested into your queue below!