In this end-of-the-year edition of the Talking Data podcast, Senior Executive Editor Ed Scannell joined me to speak with Mike Matchett, founder and principal analyst of the Small World Big Data consultancy, as we rambled through some of the signal events of big data in 2018.
Mergers and acquisitions, naturally, tend to be the stepping stones when you look back at the path just traveled. Cloudera and Hortonworks, IBM and Red Hat – these deals set the tone for our end-of-year big data ruminations.
But what rises in importance in our podcasters’ ponderings, are not the mergers in their dollar terms but instead the mergers as they reveal the underlying currents and eddies of telling trends. What surfaces?
*Hadoop-centric big data analytics is morphing into machine learning and deep learning analytics.
*It is not that the shortcomings of Hadoop data processing have been solved, however.
*Rather, the vendors have declared victory, and moved on to the next world to conquer – the more mysterious one of AI, machine learning and statistics safely beyond the layperson’s ken. It’s happened before.
*AI is what you do with big data. The Web and cloud have become irresistible honeypots for said data, and the result is that the balance of power – for data, IT and business — is moving to the cloud.
*A long view would say that it’s taken more than 10 years for cloud computing to become an overnight success, and that assorted after effects will play out for some time to come.
In the podcast we talk about the pendulum effect, of which 1990s client/server computing is a ready example. In that case there was a swing away from central IT, which was called “the glass house.” The era saw independent departments within businesses beginning to set their own technology courses.
We see that with cloud today. A pendulum swing has put more technology decision making in the hands of developers within lines of business. They can use credit cards to start projects, and they can get very high-end systems via top cloud providers.
We may look back one day and see things shifting back toward central IT. If so, it will no more resemble today’s central IT than today’s resembles the IT shop of the glass house days.
The recent years have been topsy-turvy – and not just on the big data front. Thanks for hanging with us on the Talking Data podcast. – Jack Vaughan
The post Currents – Talking Data End-of-Year Podcast 2018 appeared first on Talking Data Podcast » Episodes.


In this end-of-the-year edition of the Talking Data podcast, Senior Executive Editor Ed Scannell joined me to speak with Mike Matchett, founder and principal analyst of the Small World Big Data consultancy, as we rambled through some of the signal events of big data in 2018. Mergers and acquisitions, naturally, tend to be the stepping stones when you look back at the path just traveled. Cloudera and Hortonworks, IBM and Red Hat – these deals set the tone for our end-of-year big data ruminations. But what rises in importance in our podcasters’ ponderings, are not the mergers in their dollar terms but instead the mergers as they reveal the underlying currents and eddies of telling trends. What surfaces? *Hadoop-centric big data analytics is morphing into machine learning and deep learning analytics. *It is not that the shortcomings of Hadoop data processing have been solved, however. *Rather, the vendors have declared victory, and moved on to the next world to conquer – the more mysterious one of AI, machine learning and statistics safely beyond the layperson’s ken. It’s happened before. *AI is what you do with big data. The Web and cloud have become irresistible honeypots for said data, and the result is that the balance of power – for data, IT and business — is moving to the cloud. *A long view would say that it’s taken more than 10 years for cloud computing to become an overnight success, and that assorted after effects will play out for some time to come. In the podcast we talk about the pendulum effect, of which 1990s client/server computing is a ready example. In that case there was a swing away from central IT, which was called “the glass house.” The era saw independent departments within businesses beginning to set their own technology courses. We see that with cloud today. A pendulum swing has put more technology decision making in the hands of developers within lines of business. They can use credit cards to start projects, and they can get very high-end systems via top cloud providers. We may look back one day and see things shifting back toward central IT. If so, it will no more resemble today’s central IT than today’s resembles the IT shop of the glass house days. The recent years have been topsy-turvy – and not just on the big data front. Thanks for hanging with us on the Talking Data podcast. – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/currents-talking-data-end-of-year-podcast-2018/" rel="nofollow" target="_blank">Currents – Talking Data End-of-Year Podcast 2018</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Currents – Talking Data End-of-Year Podcast 2018

As some TechTarget reporters were finishing their last podcasts for the year, we sat down briefly and tried to view the longer picture, to look through the glass darkly toward the past.
Now, you are taught not to dwell on history from your first days in this field called journalism; people can buy books if that is what they want.
But a calendar with days rapidly dwindling might lead you to do just that, and best editorial practices be dammed.
And the tentative conclusion on some of our parts was that the big mergers of 2018 don’t stack up to those of yore.
That is even though the transactions hit some pretty heady dollar amounts.
They don’t really seem on par with the big mergers of the past 20 years, these jaundiced observers ventured.
IBM buying Lotus, Oracle buying Sun — those were some game changers. They signaled big industry shifts or put bookends on identifiable tech eras. Maybe it was the outsized nature of some of the characters involved.
An ongoing move to cloud computing is behind IBM’s bid for Red Hat, or Microsoft’s deal for GitHub, which are the topics discussed in this podcast. The move to cloud now seems predestined, but how it will actually transpire for these noted player will be determined by customers. Stay tuned.
This is part of a series of end-of-the year podcasts. I joined Senior Executive Editor Ed Scannell and analyst Mike Matchett, principal and founder of the Big Data Small World consultancy, for this  SearchDataManagement-hosted look-back at 2018 podcast.
The post Both IBM and Microsoft get open source religion in big 2018 acquisitions appeared first on Talking Data Podcast » Episodes.


As some TechTarget reporters were finishing their last podcasts for the year, we sat down briefly and tried to view the longer picture, to look through the glass darkly toward the past. Now, you are taught not to dwell on history from your first days in this field called journalism; people can buy books if that is what they want. But a calendar with days rapidly dwindling might lead you to do just that, and best editorial practices be dammed. And the tentative conclusion on some of our parts was that the big mergers of 2018 don’t stack up to those of yore. That is even though the transactions hit some pretty heady dollar amounts. They don’t really seem on par with the big mergers of the past 20 years, these jaundiced observers ventured. IBM buying Lotus, Oracle buying Sun — those were some game changers. They signaled big industry shifts or put bookends on identifiable tech eras. Maybe it was the outsized nature of some of the characters involved. An ongoing move to cloud computing is behind IBM’s bid for Red Hat, or Microsoft’s deal for GitHub, which are the topics discussed in this podcast. The move to cloud now seems predestined, but how it will actually transpire for these noted player will be determined by customers. Stay tuned. This is part of a series of end-of-the year podcasts. I joined Senior Executive Editor Ed Scannell and analyst Mike Matchett, principal and founder of the Big Data Small World consultancy, for this  SearchDataManagement-hosted look-back at 2018 podcast. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/ibm-and-microsoft-get-open-source-religion-in-bit-2018-acquisitions/" rel="nofollow" target="_blank">Both IBM and Microsoft get open source religion in big 2018 acquisitions</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Both IBM and Microsoft get open source religion in big 2018 acquisitions

New apps for cloud have found a home on Azure’s cloud database. What about existing apps? On closer inspection it appears that there is work ahead. At PASS 2018, Craig Stedman encountered signs of progress therein. Kicking off the event was Microsoft’s database group leader Roland Kumar who, Stedman reports, discussed managed instances of SQL Server on the cloud that more functionally equivalate with downhome SQL Server on premises. In any case, the pace is quick. Check out the latest Talking Data Podcast and related SearchSQLServer coverage for all things PASS. – Jack Vaughan
The post More things PASS appeared first on Talking Data Podcast » Episodes.


New apps for cloud have found a home on Azure’s cloud database. What about existing apps? On closer inspection it appears that there is work ahead. At PASS 2018, Craig Stedman encountered signs of progress therein. Kicking off the event was Microsoft’s database group leader Roland Kumar who, Stedman reports, discussed managed instances of SQL Server on the cloud that more functionally equivalate with downhome SQL Server on premises. In any case, the pace is quick. Check out the latest Talking Data Podcast and related <a href="https://searchsqlserver.techtarget.com/news/252453564/Faster-RD-pace-complicates-SQL-Server-upgrades-for-users" rel="nofollow" target="_blank">SearchSQLServer coverag</a>e for all things PASS. – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/more-things-pass/" rel="nofollow" target="_blank">More things PASS</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

More things PASS

This podcast considers how likely it is for existing users of Oracle and Microsoft to move to the cloud, as well as what obstacles they may face if they make the leap. Senior Executive Editor Craig Stedman tells us that’s still a work somewhat in progress. And, I get a chance to provide a take on Oracle’s comparable moves, hearkening again to my days at Oracle Open World in October.  Download the podcast and learn as we compare notes from our recent travels. Be there when “worlds collide.” – Jack Vaughan
The post Looking at Oracle and Microsoft and recent showcase events appeared first on Talking Data Podcast » Episodes.


This podcast considers how likely it is for existing users of Oracle and Microsoft to move to the cloud, as well as what obstacles they may face if they make the leap. Senior Executive Editor Craig Stedman tells us that’s still a work somewhat in progress. And, I get a chance to provide a take on Oracle’s comparable moves, hearkening again to my days at Oracle Open World in October.  Download the podcast and learn as we compare notes from our recent travels. Be there when “worlds collide.” – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/looking-at-oracle-and-microsoft-and-recent-showcase-events/" rel="nofollow" target="_blank">Looking at Oracle and Microsoft and recent showcase events</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Looking at Oracle and Microsoft and recent showcase events

Larry Ellison

Last month we ventured West to cover Oracle Open World in San Francisco. Now, in a Talking Data Podcast edition recorded live on tape from San Francisco’s Moscone Center, intrepid reporters Jack Vaughan and David Essex discuss what they saw.
Some of it was familiar – as always, Oracle’s Larry Ellison delivered a notable keynote. Some of it was new – Ellison’s discussion was much about cyber trust, impenetrable barriers and the gremlins lurking in the cloud.
The post Larry Ellison’s cloud-borne cyberthreats and bots, oh my! appeared first on Talking Data Podcast » Episodes.


Last month we ventured West to cover Oracle Open World in San Francisco. Now, in a Talking Data Podcast edition recorded live on tape from San Francisco’s Moscone Center, intrepid reporters Jack Vaughan and David Essex discuss what they saw. Some of it was familiar – as always, Oracle’s Larry Ellison delivered a notable keynote. Some of it was new – Ellison’s discussion was much about cyber trust, impenetrable barriers and the gremlins lurking in the cloud. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/larry-ellisons-cloud-borne-cyberthreats-and-bots-oh-my/" rel="nofollow" target="_blank">Larry Ellison’s cloud-borne cyberthreats and bots, oh my!</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Larry Ellison’s cloud-borne cyberthreats and bots, oh my!

Remember when the Web first caught on?
One thing I remember is people saying “yeah, it is pretty cool, but, you know, it is stateless.”
As most of what I heard on this issue was from enterprise software vendors, with all the bias that could entail, I should have taken what I was told with a grain of salt. The first big problem these folks saw with the Web was its statelessness, which made it far different from the synchronously connect clients and servers (at that time, Java servers) they were used to.
The first problem the Web presented, as the enterprise crew saw it was to connect the Web to the database, which – no question – was a transactional relational database.
The first response to the problem was CGI, which quickly faded, but which, alas, still shows up in a URL address window every once and a while.
There soon followed JMS message queues, Web Services and SOA, and then REST and AJAX. Then the Web turned into the Cloud and NoSQL, Kafka, container-based microservices and Kubernetes orchestration hit the beach.
These thoughts were like an elusive butterfly in my mind as I ventured recently by Amtrak to cover the Strata Data Conference at the Jacob Javits Center on the Hudson River in New York City. Kafka certainly did seem to be a common theme in the schema presenters displayed in the technical sessions, and the Kubernetes sessions were overflow.
At the event I had a chance to speak with Jay Kreps, CEO and co-founder of Confluent, and one of the creators of the aforementioned Kafka publish-and-subscribe messaging bus. He told me that event processing is gaining a commanding presence on the scene. You could say it’s “what’s happening.”
All along, the general trend toward event-based microservices architectures has overlapped with new distributed data architectures, which are edging toward becoming mainstream competitors to traditional enterprise data warehouses.
You could think of Kubernetes as the other key part of the middleware replacement story that is going on today, he said. At the same time, he added, “Nothing in the enterprise goes away overnight.”
There is more from my conversation with Krebs in the latest episode of the Talking Data Podcast, including a conversation on the new architecture with expert analyst Mike Matchett of Small World Big Data and the ruminations of the author as the train to New York drew near Penn Station for Strata. – Jack Vaughan
The post Web, what have you wrought? On Strata, microservices and more appeared first on Talking Data Podcast » Episodes.


Remember when the Web first caught on? One thing I remember is people saying “yeah, it is pretty cool, but, you know, it is stateless.” As most of what I heard on this issue was from enterprise software vendors, with all the bias that could entail, I should have taken what I was told with a grain of salt. The first big problem these folks saw with the Web was its statelessness, which made it far different from the synchronously connect clients and servers (at that time, Java servers) they were used to. The first problem the Web presented, as the enterprise crew saw it was to connect the Web to the database, which – no question – was a transactional relational database. The first response to the problem was CGI, which quickly faded, but which, alas, still shows up in a URL address window every once and a while. There soon followed JMS message queues, Web Services and SOA, and then REST and AJAX. Then the Web turned into the Cloud and NoSQL, Kafka, container-based microservices and Kubernetes orchestration hit the beach. These thoughts were like an elusive butterfly in my mind as I ventured recently by Amtrak to cover the Strata Data Conference at the <a href="https://en.wikipedia.org/wiki/Jacob_Javits" rel="nofollow" target="_blank">Jacob Javits</a> Center on the Hudson River in New York City. Kafka certainly did seem to be a common theme in the schema presenters displayed in the technical sessions, and the Kubernetes sessions were overflow. At the event I had a chance to speak with Jay Kreps, CEO and co-founder of Confluent, and one of the creators of the aforementioned <a href="https://searchdatamanagement.techtarget.com/news/2240222951/Apache-Kafka-committer-Jay-Kreps-on-the-way-of-the-log" rel="nofollow" target="_blank">Kafka publish-and-subscribe messaging bus</a>. He told me that event processing is gaining a commanding presence on the scene. You could say it’s “what’s happening.” All along, the general trend toward event-based microservices architectures has overlapped with new distributed data architectures, which are edging toward becoming mainstream competitors to traditional enterprise data warehouses. You could think of Kubernetes as the other key part of the middleware replacement story that is going on today, he said. At the same time, he added, “Nothing in the enterprise goes away overnight.” There is more from my conversation with Krebs in the latest episode of the Talking Data Podcast, including a conversation on the new architecture with expert analyst Mike Matchett of <a href="http://smallworldbigdata.com/" rel="nofollow" target="_blank">Small World Big Data</a> and the ruminations of the author as the train to New York drew near Penn Station for Strata. – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/web-what-have-you-wrought-on-strata-microservices-and-more/" rel="nofollow" target="_blank">Web, what have you wrought? On Strata, microservices and more</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Web, what have you wrought? On Strata, microservices and more

In this episode of the Talking Data Podcast we are joined by Nicole Laskowski, senior news writer for SearchCIO.com. She tells us about a podcast series she and her colleagues have created known as Schooled in AI. This series looks at cutting-edge AI research being done at Carnegie Mellon University in order to give IT leaders in businesses a clear view on where things are headed. This discussion is preceded by Laskowki’s comments on a recent O’Reilly survey that appears to show – in what may be a surprise to many — that business folk are quite aware of the bias that AI can bring out as it reaches data-driven conclusions. Listen to this Talking Data episode, and be sure to visit Schooled in AI as well. – Jack Vaughan
The post Back to school time – Learning and AI at CMU appeared first on Talking Data Podcast » Episodes.


In this episode of the Talking Data Podcast we are joined by Nicole Laskowski, senior news writer for <a href="http://SearchCIO.com" rel="nofollow" target="_blank">SearchCIO.com</a>. She tells us about a podcast series she and her colleagues have created known as Schooled in AI. This series looks at cutting-edge AI research being done at Carnegie Mellon University in order to give IT leaders in businesses a clear view on where things are headed. This discussion is preceded by Laskowki’s comments on a recent O’Reilly survey that appears to show – in what may be a surprise to many — that business folk are quite aware of the bias that AI can bring out as it reaches data-driven conclusions. Listen to this Talking Data episode, and be sure to visit <a href="https://searchcio.techtarget.com/series/Schooled-in-AI" rel="nofollow" target="_blank">Schooled in AI</a> as well. – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/back-to-school-time-learning-and-ai-at-cmu/" rel="nofollow" target="_blank">Back to school time – Learning and AI at CMU</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Back to school time – Learning and AI at CMU

For this episode of the Talking Data podcast, Mark Labbe takes a look at the MIT Startup Exchange. This program gives members of the MIT community a chance to show their wares, and as you may have guessed, those wares these days have a lot to do with AI and machine learning. Among the underlying trends, Labbe tells us, are natural language processing and geo-location. Labbe came across the MIT startup activity as part of his coverage of the recent Forrester AI Forum in Boston. Also discussed,the work of an IBM machine learning system versed in debate strategy and tactics. Listen to Talking Data and get a feel for where AI may be headed.
The post Start-ups ply the AI trade – language and location are emerging themes appeared first on Talking Data Podcast » Episodes.


For this episode of the Talking Data podcast, Mark Labbe takes a look at the MIT Startup Exchange. This program gives members of the MIT community a chance to show their wares, and as you may have guessed, those wares these days have a lot to do with AI and machine learning. Among the underlying trends, Labbe tells us, are natural language processing and geo-location. Labbe came across the MIT startup activity as part of his coverage of the recent Forrester AI Forum in Boston. Also discussed,the work of an IBM machine learning system versed in debate strategy and tactics. Listen to Talking Data and get a feel for where AI may be headed. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/start-ups-ply-the-ai-trade-language-and-location-are-emerging-themes/" rel="nofollow" target="_blank">Start-ups ply the AI trade – language and location are emerging themes</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Start-ups ply the AI trade – language and location are emerging themes

At times the era of big data has taken on the flavor of the old West – the kind depicted in a movie like The Treasure of the Sierra Madre. While it was seldom an outright confrontation, there’s little question that conscientious data stewards were usurped in some organization by developers who slightly resembled freewheeling bandits such as those you didn’t “need no badges” as they went about their business in John Houston’s film.
We are a few years into this, and now there are signs that a bit of taming is going on in the Hadoop ecosphere. The recent approaches for bringing Hadoop-style data processing into wider production seem to bespeak a change. The General Data Protection Directive (GDPR) is in some part a driver of that change.
At last month’s DataWorks Summit in San Jose, California we spoke with Constellation Research analyst Doug Henschen, who agreed the shift of enterprises to include large-scale open-source distributed data processing in their analytics arsenal is now tempered by increased interest in data governance.
“What you see is companies re-platforming – that the buzz,” Henschen said in this episode of the Talking Data podcast. “Companies understand that they need a sort of next-generation information architecture.”
We have seen attempts before to add tooling to data lakes to tag and curate data, but now the push may be more fevered, and GDPR may be the impetus.
“The push for GDPR has gotten people thinking more and more about the governance aspects of that,” Henschen said. “As they are re-platforming they have an increased eye toward data governance, data lineage, access control, security — all of these good things that we have long required but haven’t necessarily nailed.”
Catch up with the big data doings in this edition of Talking Data. – Jack Vaughan
The post Governance is coming to next-generation information architecture appeared first on Talking Data Podcast » Episodes.


At times the era of big data has taken on the flavor of the old West – the kind depicted in a movie like <a href="https://en.wikipedia.org/wiki/Stinking_badges" rel="nofollow" target="_blank">The Treasure of the Sierra Madre</a>. While it was seldom an outright confrontation, there’s little question that conscientious data stewards were usurped in some organization by developers who slightly resembled freewheeling bandits such as those you didn’t “need no badges” as they went about their business in John Houston’s film. We are a few years into this, and now there are signs that a bit of taming is going on in the Hadoop ecosphere. The recent approaches for bringing Hadoop-style data processing into wider production seem to bespeak a change. The General Data Protection Directive (GDPR) is in some part a driver of that change. At last month’s DataWorks Summit in San Jose, California we spoke with Constellation Research analyst Doug Henschen, who agreed the shift of enterprises to include large-scale open-source distributed data processing in their analytics arsenal is now tempered by increased interest in data governance. “What you see is companies re-platforming – that the buzz,” Henschen said in this episode of the Talking Data podcast. “Companies understand that they need a sort of next-generation information architecture.” We have seen attempts before to add tooling to data lakes to tag and curate data, but now the push may be more fevered, and GDPR may be the impetus. “The push for GDPR has gotten people thinking more and more about the governance aspects of that,” Henschen said. “As they are re-platforming they have an increased eye toward data governance, data lineage, access control, security — all of these good things that we have long required but haven’t necessarily nailed.” Catch up with the big data doings in this edition of Talking Data. – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/governance-is-a-comin-to-next-generation-information-architecture/" rel="nofollow" target="_blank">Governance is coming to next-generation information architecture</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Governance is coming to next-generation information architecture

Real estate listing firm Trulia is on the cutting edge of applying computer vision. In this edition of the Talking Data podcast, we talk with the company’s vice president of engineering, Deep Varma, to learn more about how his team is applying computer vision.
As you’d expect, Trulia’s computer vision processes are built around deep learning algorithms. These are the machine learning models powering most of today’s most advanced AI applications. And while engineers have made significant advances in the functionality of these models, impactful business applications have been slower to come around.
Trulia, however, has found an interesting way to implement image recognition deep learning models to build computer vision applications that are capable of identifying and describing specific objects in images. This gives prospective home buyers an idea of what they should expect from a listing before clicking on it and enables Trulia’s recommendation engines to surface more relevant results.
Listen to the podcast to learn more about how the company is deploying deep learning models in the area of computer vision.
The post How Trulia deploys computer vision appeared first on Talking Data Podcast » Episodes.


Real estate listing firm Trulia is on the cutting edge of applying computer vision. In this edition of the Talking Data podcast, we talk with the company’s vice president of engineering, Deep Varma, to learn more about how his team is applying computer vision. As you’d expect, Trulia’s computer vision processes are built around deep learning algorithms. These are the machine learning models powering most of today’s most advanced AI applications. And while engineers have made significant advances in the functionality of these models, impactful business applications have been slower to come around. Trulia, however, has found an interesting way to implement image recognition deep learning models to build computer vision applications that are capable of identifying and describing specific objects in images. This gives prospective home buyers an idea of what they should expect from a listing before clicking on it and enables Trulia’s recommendation engines to surface more relevant results. Listen to the podcast to learn more about how the company is deploying deep learning models in the area of computer vision. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/how-trulia-deploys-computer-vision/" rel="nofollow" target="_blank">How Trulia deploys computer vision</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

How Trulia deploys computer vision

The top of trends in software practices for big data management and business analytics.

What a great podcast, keep up the good work!!

Great Podcast

Talking Data Podcast » Episodes

Kafka and Spark Streaming are arising as central parts of new real time data architecture. In this podcast, the Talking Data crew hooks up with Jay Kreps and Doug Cutting, of Confluent and Cloudera, respectively, who outline some of big data streaming’s pertinent facts.
The post Kafka and Spark Streaming appeared first on Talking Data Podcast » Episodes.


Kafka and Spark Streaming are arising as central parts of new real time data architecture. In this podcast, the Talking Data crew hooks up with Jay Kreps and Doug Cutting, of Confluent and Cloudera, respectively, who outline some of big data streaming’s pertinent facts. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/kafka-spark-streaming/" rel="nofollow" target="_blank">Kafka and Spark Streaming</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Kafka and Spark Streaming

We’ve all heard the scare stories about AI eliminating jobs, but we’ve also heard the Pollyanna voices saying everything will be fine on the jobs front.
The reality may be somewhere in the middle, according to Goldman Sachs analyst Heath Terry. In a presentation at the AI World Conference &amp; Expo in Boston, held in December, Terry talked about how the risk of people losing their jobs to AI in the short term is very real. Jobs may recover long-term, but people should expect some disruption soon, he said.
He also talked about the likelihood that established tech players like Amazon and Google are not likely be the dominant vendors when it comes to AI. Instead, he said, he expects some new, unknown vendor is likely to innovate.
Listen to this podcast to hear more about Terry’s predictions and how they may play out in the jobs and tech markets.
The post How AI will upset tech and job markets appeared first on Talking Data Podcast » Episodes.


We’ve all heard the scare stories about AI eliminating jobs, but we’ve also heard the Pollyanna voices saying everything will be fine on the jobs front. The reality may be somewhere in the middle, according to Goldman Sachs analyst Heath Terry. In a presentation at the AI World Conference &amp; Expo in Boston, held in December, Terry talked about how the risk of people losing their jobs to AI in the short term is very real. Jobs may recover long-term, but people should expect some disruption soon, he said. He also talked about the likelihood that established tech players like Amazon and Google are not likely be the dominant vendors when it comes to AI. Instead, he said, he expects some new, unknown vendor is likely to innovate. Listen to this podcast to hear more about Terry’s predictions and how they may play out in the jobs and tech markets. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/ai-will-upset-tech-job-markets/" rel="nofollow" target="_blank">How AI will upset tech and job markets</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

How AI will upset tech and job markets

Neha Narkhede

In this podcast, we get a chance to speak with Neha Narkhede. As a development lead at LinkedIn, she helped forge the messenger called Kafka. Now as CTO at Confluent, she is charting the course of Kafka as a streaming engine. Part of that is Exactly Once messaging, which will be among the items on tap at Confluent’s upcoming Kafka Summit. Why do they call it Kafka? We are not telling here. You must listen to the podcast to learn.
The post Confluent’s Neha Narkhede: Get your Kafka messages, exactly once appeared first on Talking Data Podcast » Episodes.


In this podcast, we get a chance to speak with Neha Narkhede. As a development lead at LinkedIn, she helped forge the messenger called Kafka. Now as CTO at Confluent, she is charting the course of Kafka as a streaming engine. Part of that is Exactly Once messaging, which will be among the items on tap at Confluent’s upcoming Kafka Summit. Why do they call it Kafka? We are not telling here. You must listen to the podcast to learn. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/confluents-neha-narkhede-get-kafka-messages-exactly/" rel="nofollow" target="_blank">Confluent’s Neha Narkhede: Get your Kafka messages, exactly once</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Confluent’s Neha Narkhede: Get your Kafka messages, exactly once

The data side of Microsoft will be front and center at the upcoming Ignite conference, scheduled for Sept. 24 through 29 in Orlando, Fla. Sessions at the event will flesh out important details concerning SQL Server 2017 for Linux, Azure SQL Data Warehouse and the company’s most recent NoSQL database entry — Azure Cosmos DB. The Redmond giant has increasingly used SQL Server as a launching pad for analytics efforts that have come to rival those of database; one such effort is new Python support for the data warehouse, which also will be among the topics considered at Ignite. Catch this version of the Talking Data podcast, which looks back at this summer’s Microsoft data doings, and forward to the conference.
The post Ignite upcoming: Azure Cosmos DB, SQL Server 2017 for Linux, Python, and more appeared first on Talking Data Podcast » Episodes.


The data side of Microsoft will be front and center at the upcoming Ignite conference, scheduled for Sept. 24 through 29 in Orlando, Fla. Sessions at the event will flesh out important details concerning SQL Server 2017 for Linux, Azure SQL Data Warehouse and the company’s most recent NoSQL database entry — Azure Cosmos DB. The Redmond giant has increasingly used SQL Server as a launching pad for analytics efforts that have come to rival those of database; one such effort is new Python support for the data warehouse, which also will be among the topics considered at Ignite. Catch this version of the Talking Data podcast, which looks back at this summer’s Microsoft data doings, and forward to the conference. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/ignite-upcoming-azure-cosmos-db-sql-server-2017-linux-python/" rel="nofollow" target="_blank">Ignite upcoming: Azure Cosmos DB, SQL Server 2017 for Linux, Python, and more</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Ignite upcoming: Azure Cosmos DB, SQL Server 2017 for Linux, Python, and more

Yes, the BI army will continue to churn out those weekly and monthly reports, as in days of yore. But something else is going on too. Analytics is being connected to operations in near real time. Too, the path of data in organizations does not end when the data gets to the data warehouse. With the rise of data scientists, data is a two-way street.  The shape of data management in the face of these changes is the topic of the latest edition of the Talking Data Podcast. Listen up!
The post For data management, real time means time to change appeared first on Talking Data Podcast » Episodes.


Yes, the BI army will continue to churn out those weekly and monthly reports, as in days of yore. But something else is going on too. Analytics is being connected to operations in near real time. Too, the path of data in organizations does not end when the data gets to the data warehouse. With the rise of data scientists, data is a two-way street.  The shape of data management in the face of these changes is the topic of the latest edition of the Talking Data Podcast. Listen up! The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/data-management-real-time-means-time-change/" rel="nofollow" target="_blank">For data management, real time means time to change</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

For data management, real time means time to change

In the year just past, data warehousing took a noticeable shift toward the cloud, as Microsoft, Oracle, Snowflake and others played catch up in pursuit of cloud leader Amazon. Just as remarkable, Hadoop distribution providers found themselves spinning up new versions of their offerings that were especially tailored to compete with Amazon’s style of Hadoop instances. These and other issues are under inspection in an edition of the Talking Data Podcast that looks back at 2016 in earnest and forward to 2017 in anticipation.
The post Data warehouses, Hadoop get cloud-happy appeared first on Talking Data Podcast » Episodes.


In the year just past, data warehousing took a noticeable shift toward the cloud, as Microsoft, Oracle, Snowflake and others played catch up in pursuit of cloud leader Amazon. Just as remarkable, Hadoop distribution providers found themselves spinning up new versions of their offerings that were especially tailored to compete with Amazon’s style of Hadoop instances. These and other issues are under inspection in an edition of the Talking Data Podcast that looks back at 2016 in earnest and forward to 2017 in anticipation. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/data-warehouses-hadoop-get-cloud-happy/" rel="nofollow" target="_blank">Data warehouses, Hadoop get cloud-happy</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Data warehouses, Hadoop get cloud-happy

Deep learning is great and all, but how do you implement in a production environment?
That’s a question that a lot of businesses are asking. Deep learning may look tempting when you think about how powerful it is. Research projects have shown it capable of replicating human vision and other types of thought processes. But it also can bring some complications to business processes.
In this edition of Talking Data we look at some of the business implications of deep learning, particularly when taking it from research projects to production environments.
The post Deep learning tools create business complications appeared first on Talking Data Podcast » Episodes.


Deep learning is great and all, but how do you implement in a production environment? That’s a question that a lot of businesses are asking. Deep learning may look tempting when you think about how powerful it is. Research projects have shown it capable of replicating human vision and other types of thought processes. But it also can bring some complications to business processes. In this edition of Talking Data we look at some of the business implications of deep learning, particularly when taking it from research projects to production environments. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/deep-learning-tools-create-business-complications/" rel="nofollow" target="_blank">Deep learning tools create business complications</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Deep learning tools create business complications

The scale of HDFS continues to soar upward. For large social media and cloud providers, the size of Hadoop clusters is such that it is hard to test out this basic component of classic Hadoop at scale before roll outs. That is another one of those niggling issues that slows Hadoop adoption.
At LinkedIn, the challenges of successfully making even small configuration changes across broad arrays of HDFS led a team to create Dynamometer. This load and stress test suite uses actual NameNodes, combined with simulated DataNodes to prove out changes to settings across large the Hadoop data farms that help LinkedIn link folks together.
Today, many issues are impossible to test out without running a cluster that is similar in size to what were is used in production, according to Carl Steinbach, senior staff software engineer at LinkedIn. He said that one of the goals of the project is to have positive “upstream effect” on the work of Apache community members’ releases, to, in effect, make testing at scale foremost in the effort.
Steinbach’s colleague, engineer Erik Krogen, adds that HDFS developers are looking toward the day when they can find bugs before new versions are committed, rather than six -months later when new software comes to cover very large scale clusters.
In this edition of the Talking Data Podcast, the crew speaks with analyst Mike Matchett, of the SmallWorldBigData consultancy, to get a better view into Dynamometer. Testing tools of this kind will only gain in importance going forward, he suggested.
“Whatever big data we have today, it’s going to be bigger tomorrow,” said Matchett.
Also on tap in this podcast is a discussion of TensorFlow from Google. The company has supported work on this machine learning framework on CPUs, GPUs, and, most recently TPUs – these being Tensor Processing Units build especially to accomplish highly iterative neural network computations. Word is that Google is preparing to open up TPU processing to outsiders that use its Google Cloud Platform. – Jack Vaughan
 
The post LinkedIn open sources Dynamometer load and stress tester for HDFS appeared first on Talking Data Podcast » Episodes.


The scale of HDFS continues to soar upward. For large social media and cloud providers, the size of Hadoop clusters is such that it is hard to test out this basic component of classic Hadoop at scale before roll outs. That is another one of those niggling issues that slows Hadoop adoption. At LinkedIn, the challenges of successfully making even small configuration changes across broad arrays of HDFS led a team to create <a href="https://engineering.linkedin.com/blog/2018/02/dynamometer--scale-testing-hdfs-on-minimal-hardware-with-maximum" rel="noopener nofollow" target="_blank">Dynamometer.</a> This load and stress test suite uses actual NameNodes, combined with simulated DataNodes to prove out changes to settings across large the Hadoop data farms that help LinkedIn link folks together. Today, many issues are impossible to test out without running a cluster that is similar in size to what were is used in production, according to Carl Steinbach, senior staff software engineer at LinkedIn. He said that one of the goals of the project is to have positive “upstream effect” on the work of Apache community members’ releases, to, in effect, make testing at scale foremost in the effort. Steinbach’s colleague, engineer Erik Krogen, adds that HDFS developers are looking toward the day when they can find bugs before new versions are committed, rather than six -months later when new software comes to cover very large scale clusters. In this edition of the Talking Data Podcast, the crew speaks with analyst Mike Matchett, of the SmallWorldBigData consultancy, to get a better view into Dynamometer. Testing tools of this kind will only gain in importance going forward, he suggested. “Whatever big data we have today, it’s going to be bigger tomorrow,” said Matchett. Also on tap in this podcast is a discussion of TensorFlow from Google. The company has supported work on this machine learning framework on CPUs, GPUs, and, most recently TPUs – these being Tensor Processing Units build especially to accomplish highly iterative neural network computations. Word is that Google is preparing to open up TPU processing to outsiders that use its Google Cloud Platform. – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/linkedin-open-sources-dynamometer-load-stress-tester-hdfs/" rel="nofollow" target="_blank">LinkedIn open sources Dynamometer load and stress tester for HDFS</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

LinkedIn open sources Dynamometer load and stress tester for HDFS

The recent PBS film The Human Face of Big Data stirred plenty of reaction of social media and in blogs. In this edition of Talking Data, we take a look at what the show got right and what it might have missed.
The documentary was certainly a high-level overview of big data geared mostly toward a popular audience. With that in mind, it did do a good job of introducing some positive examples of big data and analytics. But while the show was not uncritical, particularly around the areas of privacy and security, it missed some important opportunities to discuss the potential downside of big data, mainly as it relates to distributing the benefits of technology throughout society.
Take a listen to this podcast to hear more about how people are reacting to the documentary.
The post PBS documentary takes a look at big data benefits appeared first on Talking Data Podcast » Episodes.


The recent PBS film The Human Face of Big Data stirred plenty of reaction of social media and in blogs. In this edition of Talking Data, we take a look at what the show got right and what it might have missed. The documentary was certainly a high-level overview of big data geared mostly toward a popular audience. With that in mind, it did do a good job of introducing some positive examples of big data and analytics. But while the show was not uncritical, particularly around the areas of privacy and security, it missed some important opportunities to discuss the potential downside of big data, mainly as it relates to distributing the benefits of technology throughout society. Take a listen to this podcast to hear more about how people are reacting to the documentary. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/pbs-documentary-takes-look-big-data-benefits/" rel="nofollow" target="_blank">PBS documentary takes a look at big data benefits</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

PBS documentary takes a look at big data benefits

The year just passed would not have been the same without machine learning, deep learning and artificial intelligence. Trade and popular press alike zeroed in on these analytics trends with great fervor. In this edition of the Talking Data Podcast, TechTarget editors mull the meaning of it all. One question asked: Are we at the point where we can see adoption panning out at scale for machine learning and the like? To find out more, listen here.
The post Machine learning in 2016: What hath AI wrought? appeared first on Talking Data Podcast » Episodes.


The year just passed would not have been the same without machine learning, deep learning and artificial intelligence. Trade and popular press alike zeroed in on these analytics trends with great fervor. In this edition of the Talking Data Podcast, TechTarget editors mull the meaning of it all. One question asked: Are we at the point where we can see adoption panning out at scale for machine learning and the like? To find out more, listen here. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/machine-learning-2016-hath-ai-wrought/" rel="nofollow" target="_blank">Machine learning in 2016: What hath AI wrought?</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Machine learning in 2016: What hath AI wrought?

In some ways, big data these days is a very much a conglomeration of open source application frameworks. It started with Apache Hadoop, but it has come to include Apache Spark, Apache Flink, Apache Kudu and others, with more in the wings. In this edition of the Talking Data podcast, Craig Stedman outlines the pros and cons of such bounty. For IT teams, he said, putting together the pieces can be a daunting task. Also discussed is Hadoop on the cloud. Surprisingly, perhaps, Hadoop configurations by and large evolved in on-premise implementations, rather than on the cloud. That is changing quickly as users opt for easy-to-spin-up pay-as-you-go setups. Learn more. Listen to the podcast.
The post Rich cornucopia: Hadoop’s blessing and curse? appeared first on Talking Data Podcast » Episodes.


In some ways, big data these days is a very much a conglomeration of open source application frameworks. It started with Apache Hadoop, but it has come to include Apache Spark, Apache Flink, Apache Kudu and others, with more in the wings. In this edition of the Talking Data podcast, Craig Stedman outlines the pros and cons of such bounty. For IT teams, he said, putting together the pieces can be a daunting task. Also discussed is Hadoop on the cloud. Surprisingly, perhaps, Hadoop configurations by and large evolved in on-premise implementations, rather than on the cloud. That is changing quickly as users opt for easy-to-spin-up pay-as-you-go setups. Learn more. Listen to the podcast. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/rich-cornucopia-hadoops-blessing-curse/" rel="nofollow" target="_blank">Rich cornucopia: Hadoop’s blessing and curse?</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Rich cornucopia: Hadoop’s blessing and curse?

The development of AI had been stalled out for years, but all of a sudden there’s been a huge surge in interest. Why now? The answer is big data. It turns out big data was the missing knowledge bank that was needed to make machines truly intelligent. But now that enterprises have stashed huge volumes of data, they are starting to unleash learning algorithms on it, creating large-scale learning opportunities.
The post Big data drives growth in AI development appeared first on Talking Data Podcast » Episodes.


The development of AI had been stalled out for years, but all of a sudden there’s been a huge surge in interest. Why now? The answer is big data. It turns out big data was the missing knowledge bank that was needed to make machines truly intelligent. But now that enterprises have stashed huge volumes of data, they are starting to unleash learning algorithms on it, creating large-scale learning opportunities. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/big-data-drives-growth-ai-development/" rel="nofollow" target="_blank">Big data drives growth in AI development</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Big data drives growth in AI development

While there is much focus on building out new data-oriented applications using open-source data frameworks, some development managers still opt for something more turnkey. This podcast looks at the new tenor of the age-old build vs. buy conundrum from both sides. Actually, there are more than two sides, because ‘rent’ is becoming part of the equation. Just because you can do it, doesn’t mean you should, right?
The post Build vs. rent: The big data conundrum appeared first on Talking Data Podcast » Episodes.


While there is much focus on building out new data-oriented applications using open-source data frameworks, some development managers still opt for something more turnkey. This podcast looks at the new tenor of the age-old build vs. buy conundrum from both sides. Actually, there are more than two sides, because ‘rent’ is becoming part of the equation. Just because you can do it, doesn’t mean you should, right? The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/build-vs-vs-rent-big-data-conundrum/" rel="nofollow" target="_blank">Build vs. rent: The big data conundrum</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Build vs. rent: The big data conundrum

As 2017 winds down, we invite you to take a look behind the big data curtain. There, you will find data engineers, data scientists, end-users and others working to move a big data concept into production. It doesn’t take much digging to find that more self-service capabilities are needed at each stage in the data life cycle.
That is among the take-aways from this latest edition of the Talking Data Podcast. In this and a subsequent episode, Ed Burns and I discuss recent user stories that graced the editorial pages of SearchBusinessAnalytics.com and SearchDataManagement.com – ones that speak to some of the outstanding trends of the year just winding down.
One of the telling threads we found was self-service; that is, self-service as it relates to ETL, as it relates to interactive data queries, and as it relates to cluster configuration. In the latter case we have as example restaurateur Panera Bread. The chain is among the company’s with particularly aggressive web initiatives underway.
More and more, when lunchtime arrives, incoming orders come in via cell phone. That can stress operational systems. Aware of this threat, Panera Bread built a Spark-Hadoop system to analyze computing needs for the processing involved in handling the lunchtime crush. It was the first in a series of Hadoop apps that Panera is spinning up quickly, after deciding to use automated container configuration software.
Panera announced earlier this year that annual digital sales had gone past $1 billion, and that projected digital sales could double by 2019. The ability to let individuals spin up big data jobs at will become handier going forward, one of the company’s engineering leads said.
Self-service that empowers more individuals in the data pipeline is a fact of life that IT has generally come to accept. It seems now to be a big part of moving at the speed of innovation. Listen to this podcast and feel free to come back for seconds.
The post Big data life cycle gets the self-service treatment appeared first on Talking Data Podcast » Episodes.


As 2017 winds down, we invite you to take a look behind the big data curtain. There, you will find data engineers, data scientists, end-users and others working to move a big data concept into production. It doesn’t take much digging to find that more self-service capabilities are needed at each stage in the data life cycle. That is among the take-aways from this latest edition of the Talking Data Podcast. In this and a subsequent episode, Ed Burns and I discuss recent user stories that graced the editorial pages of <a href="https://www.techtarget.com/contributor/Ed-Burns/2017" rel="nofollow" target="_blank">SearchBusinessAnalytics.com</a> and <a href="https://www.techtarget.com/contributor/Jack-Vaughan/2017" rel="nofollow" target="_blank">SearchDataManagement.com</a> – ones that speak to some of the outstanding trends of the year just winding down. One of the telling threads we found was self-service; that is, self-service as it relates to<a href="https://searchdatamanagement.techtarget.com/feature/Bank-sees-ETL-processes-evolve-from-IT-to-front-line-users" rel="nofollow" target="_blank"> ETL</a>, as it relates to<a href="https://searchdatamanagement.techtarget.com/news/450431143/Apache-Impala-gets-top-level-status-as-open-source-Hadoop-tool" rel="nofollow" target="_blank"> interactive data queries,</a> and as it relates to <a href="https://searchdatamanagement.techtarget.com/feature/Panera-meets-big-data-challenge-of-lunchtime-operations" rel="nofollow" target="_blank">cluster configuration</a>. In the latter case we have as example restaurateur Panera Bread. The chain is among the company’s with particularly aggressive web initiatives underway. More and more, when lunchtime arrives, incoming orders come in via cell phone. That can stress operational systems. Aware of this threat, Panera Bread built a Spark-Hadoop system to analyze computing needs for the processing involved in handling the lunchtime crush. It was the first in a series of <a href="https://itknowledgeexchange.techtarget.com/talking-data/week-big-data-included-hadoop-machine-learning-quantum-computing/" rel="nofollow" target="_blank">Hadoop</a> apps that Panera is spinning up quickly, after deciding to use automated container configuration software. Panera announced earlier this year that annual digital sales had gone past $1 billion, and that projected digital sales could double by 2019. The ability to let individuals spin up big data jobs at will become handier going forward, one of the company’s engineering leads said. Self-service that empowers more individuals in the data pipeline is a fact of life that IT has generally come to accept. It seems now to be a big part of moving at the speed of innovation. Listen to this podcast and feel free to come back for seconds. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/big-data-life-cycle-gets-self-service-treatment/" rel="nofollow" target="_blank">Big data life cycle gets the self-service treatment</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Big data life cycle gets the self-service treatment

Spark continues to gain attention as a unifying platform for analytics, machine learning, data streaming, and SQL querying. Surely, it is advanced technology, and, just as surely, Spark and its users will have to go through some maturation process. The steps in that process were on display in February at Spark Summit East 2017 in a snow-bound Boston. That and more is discussed in this Talking Data podcast episode by Trea Lavery and Jack Vaughan.
The post Spark analytics step forward at Boston event appeared first on Talking Data Podcast » Episodes.


Spark continues to gain attention as a unifying platform for analytics, machine learning, data streaming, and SQL querying. Surely, it is advanced technology, and, just as surely, Spark and its users will have to go through some maturation process. The steps in that process were on display in February at Spark Summit East 2017 in a snow-bound Boston. That and more is discussed in this Talking Data podcast episode by Trea Lavery and Jack Vaughan. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/spark-analytics-step-forward-boston-event/" rel="nofollow" target="_blank">Spark analytics step forward at Boston event</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Spark analytics step forward at Boston event

Machine learning was the big story of 2017, and we here at SearchBusinessAnalytics spent a lot of time talking with businesses who use the technology.
In this edition of the Talking Data podcast, we recap some of the best interviews we did on the topic. The interviews look at everything from the role of engineers to avoiding black box functionality in models.
Talking with people who actually use a given technology is generally one of the best ways to learn about its real importance, and we spend a lot of time trying to get this perspective from our stories. As we bring 2017 to a close, we hope you can learn something useful from our efforts to drive your machine learning initiatives into the new year. Happy holidays!
The post Users discuss their machine learning implementations appeared first on Talking Data Podcast » Episodes.


Machine learning was the big story of 2017, and we here at SearchBusinessAnalytics spent a lot of time talking with businesses who use the technology. In this edition of the Talking Data podcast, we recap some of the best interviews we did on the topic. The interviews look at everything from the role of engineers to avoiding black box functionality in models. Talking with people who actually use a given technology is generally one of the best ways to learn about its real importance, and we spend a lot of time trying to get this perspective from our stories. As we bring 2017 to a close, we hope you can learn something useful from our efforts to drive your machine learning initiatives into the new year. Happy holidays! The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/users-discuss-machine-learning-implementations/" rel="nofollow" target="_blank">Users discuss their machine learning implementations</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Users discuss their machine learning implementations

C-suite folks and others have taken notice this week as Facebook finds itself in a sack of woe. Data privacy is at issue.
The Silicon Valley high flyer has gained the kind of publicity you don’t want, in the wake of news that its social media platform was used to gather up Facebook profile information of thousands (or millions — the full details of the story are still coming in) of users for political consultancy Cambridge Analytica for still to be determined purposes.
Cambridge Analytica did its gathering via a third-party that fielded a “thisisyourditigallife” survey app that walked users through personality quizzes and, incidentally, scraped info from their and their friend’s profiles.
Facebook in its responses to this news at first stridently held this was not actually a data breach, but was instead a rogue third-party developer’s wandering from company data policy. Let’s call it a “data faux pas of the developer kind.” In the face of general uproar, that somewhat dismissive response was somewhat dialed back.
Which brings us to GDPR. Facebook’s latest egg-on-its-face moment comes only a month after COO Sheryl Sandberg had assured a Brussels, Belgium crowd that the company was ready for the General Data Protection Regulation, or GDPR, which is the EU’s comprehensive data privacy edict, due to go into enforcement in late May.
GDPR is intended to give web users more control over their on-line data profiles – that is just the type of control that seems now to have been lacking in the Facebook-Cambridge Analytica episode.
Data professionals have been grappling of late with GDPR which, by some measures, is meant to bring about a firm style of data governance — one that might have gone missing during the big data gold rush of which Facebook was a big part.
How ready data professionals are for GDPR is a matter of conjecture, and it is the topic of this edition of the Talking Data podcast, recorded after Sandberg’s Brussels pronouncement, but just before the news on Facebook and Cambridge Analytica broke.
The podcasters discuss GDPR, and the different uptake rates it’s likely to exhibit in different industries and departments within companies. Marketing, they suggest, may be a little late to the GDPR party but starting to get involved.
Whether you call the Facebook-Cambridge Analytica event a data breach, a data faux pas, or what have you, it is fair to say the latest doings will quickly bring data privacy and GDPR to more people’s attention. Many viewers expect Facebook will be among the first to hear the GDPR enforcers knocking. – Jack Vaughan
The post Facebook data privacy missteps seen in light of GDPR appeared first on Talking Data Podcast » Episodes.


C-suite folks and others have taken notice this week as Facebook finds itself in a sack of woe. Data privacy is at issue. The Silicon Valley high flyer has gained the kind of publicity you don’t want, in the wake of news that its social media platform was used to gather up Facebook profile information of thousands (or millions — the full details of the story are still coming in) of users for political consultancy Cambridge Analytica for still to be determined purposes. Cambridge Analytica did its gathering via a third-party that fielded a “thisisyourditigallife” survey app that walked users through personality quizzes and, incidentally, scraped info from their and their friend’s profiles. Facebook in its responses to this news at first stridently held this was not actually a data breach, but was instead a rogue third-party developer’s wandering from company data policy. Let’s call it a “data faux pas of the developer kind.” In the face of general uproar, that somewhat dismissive response was somewhat dialed back. Which brings us to GDPR. Facebook’s latest egg-on-its-face moment comes only a month after COO Sheryl Sandberg had assured a Brussels, Belgium crowd that the company was ready for the General Data Protection Regulation, or GDPR, which is the EU’s comprehensive data privacy edict, due to go into enforcement in late May. GDPR is intended to give web users more control over their on-line data profiles – that is just the type of control that seems now to have been lacking in the Facebook-Cambridge Analytica episode. Data professionals have been grappling of late with <a href="https://searchdatamanagement.techtarget.com/answer/What-is-included-in-the-GDPR-definition-of-personal-data" rel="nofollow" target="_blank">GDPR</a> which, by some measures, is meant to bring about a firm style of data governance — one that might have gone missing during the big data gold rush of which Facebook was a big part. How ready data professionals are for GDPR is a matter of conjecture, and it is the topic of this edition of the Talking Data podcast, recorded after Sandberg’s Brussels pronouncement, but just before the news on Facebook and <a href="https://itknowledgeexchange.techtarget.com/it-downtime-blog/sweet-life-cambridge-analytica/" rel="nofollow" target="_blank">Cambridge Analytica</a> broke. The podcasters discuss GDPR, and the different uptake rates it’s likely to exhibit in different industries and departments within companies. Marketing, they suggest, may be a little late to the GDPR party but starting to get involved. Whether you call the Facebook-Cambridge Analytica event a data breach, a data faux pas, or what have you, it is fair to say the latest doings will quickly bring data privacy and GDPR to more people’s attention. Many viewers expect Facebook will be among the first to hear the GDPR enforcers knocking. – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/facebook-data-privacy-missteps-seen-light-gdpr/" rel="nofollow" target="_blank">Facebook data privacy missteps seen in light of GDPR</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Facebook data privacy missteps seen in light of GDPR

Data science is nothing new, but despite the fact that it’s been around for years, businesses are still looking for ways to get value from it.
There’s an inherent tension between the research mindset required to perform good data science and the results-based focus of business processes. But by bending towards each other both areas can benefit.
In this edition of the Talking Data podcast, we recap some perspectives on how businesses can derive value from data science as presented at the Big Data Innovation Summit in Boston. One of the keys is to make sure that data science efforts serve the business. Projects don’t need to be perfect. As soon as data science team glean any kind of insight from data they should report it to business teams.
But that’s just the tip of the iceberg. Listen to this podcast to learn more about data science and business teams can better mesh their efforts and deliver real value to their enterprise.
The post Businesses look for ways to cash in on data science appeared first on Talking Data Podcast » Episodes.


Data science is nothing new, but despite the fact that it’s been around for years, businesses are still looking for ways to get value from it. There’s an inherent tension between the research mindset required to perform good data science and the results-based focus of business processes. But by bending towards each other both areas can benefit. In this edition of the Talking Data podcast, we recap some perspectives on how businesses can derive value from data science as presented at the Big Data Innovation Summit in Boston. One of the keys is to make sure that data science efforts serve the business. Projects don’t need to be perfect. As soon as data science team glean any kind of insight from data they should report it to business teams. But that’s just the tip of the iceberg. Listen to this podcast to learn more about data science and business teams can better mesh their efforts and deliver real value to their enterprise. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/businesses-look-ways-cash-data-science/" rel="nofollow" target="_blank">Businesses look for ways to cash in on data science</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Businesses look for ways to cash in on data science

A new project spearheaded by a researcher at Carnegie Mellon University is aiming to use AI to spot examples of fake news. But what at first may sound like a promising and relatively straightforward undertaking may in fact be a monumental lift.
The Fake News Challenge (#FakeNewsChallenge) is offering $2,000 to any programmer who is able to develop an AI algorithm that makes progress toward spotting fake news. But the challenges related to the project get at the very core of what makes true AI so hard.
Take a listen to this podcast to learn more about the Fake News Challenge, how researchers are trying to use AI to address the problem and why this task is so difficult.
The post Tackling the problem of fake news with AI appeared first on Talking Data Podcast » Episodes.


A new project spearheaded by a researcher at Carnegie Mellon University is aiming to use AI to spot examples of fake news. But what at first may sound like a promising and relatively straightforward undertaking may in fact be a monumental lift. The Fake News Challenge (#FakeNewsChallenge) is offering $2,000 to any programmer who is able to develop an AI algorithm that makes progress toward spotting fake news. But the challenges related to the project get at the very core of what makes true AI so hard. Take a listen to this podcast to learn more about the Fake News Challenge, how researchers are trying to use AI to address the problem and why this task is so difficult. The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/tackling-problem-fake-news-ai/" rel="nofollow" target="_blank">Tackling the problem of fake news with AI</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

Tackling the problem of fake news with AI

Starburst

The trend that sees the SQL query engine appearing on Hadoop, is just the start of a movement; the SQL query engine running on data other than HDFS may follow. If these trends portend fitful change for users, they also affect vendors.
One vendor’s journey here is particularly telling. Starburst Data might be called a ‘re-start-up.’ The company was the brainchild of some young data technicians that included Daniel Abadi, an academic researcher who helped forward the notion of column-store parallel databases in the early 2000s. In 2011, he helped form Hadapt — one of the first Hadoop-on-SQL providers.
In 2014, the company was purchased by Teradata. The timing proved a bit odd, as it nearly coincided with Facebook ceding much development responsibility to Teradata for Presto, a SQL-on-Hadoop tool that the social media giant had forged in-house, and which has subsequently been endorsed by no less than Amazon for its Athena SQL engine. The former-Hadapt group within Teradata shifted its efforts to improved performance for a Presto-compatible SQL query engine.
At the end of 2017, Hadapt principals within Teradata spun-out to form Starburst, with Teradata’s blessings. A Starburst goal is to bring SQL engine prowess to SMBs that are still outliers in Teradata’s more familiar big player universe. An early effort for standalone Starburst has been a Cost Based Optimizer for Presto, built in collaboration with Facebook technicians. For the many lovers of SQL joins, the new optimizer supports Join Reordering and Join Distribution Choice.
The picture emerging shows differences in use cases between plain vanilla Hadoop and SQL on Hadoop – the difference is between Hadoop being fit for the purposes of small data science groups and skunk works to Hadoop being useful for the interactive needs of wider groups of SQL business analytics users. We are also seeing HDFS, the file system at the base of Hadoop, giving way as more people choose to pursue these types of applications on the cloud rather than on the premises.
Listen to the latest Talking Data podcast, which features Starburst Data CEO Justin Borgman. We left a noisy restaurant to record the interview, and found a noisy Boston waterfront, with massively loud construction if full throat. Enjoy! – Jack Vaughan
The post SQL query engine – Presto change-o Starburst appeared first on Talking Data Podcast » Episodes.


The trend that sees the SQL query engine appearing on Hadoop, is just the start of a movement; the SQL query engine running on data other than HDFS may follow. If these trends portend fitful change for users, they also affect vendors. One vendor’s journey here is particularly telling. Starburst Data might be called a ‘re-start-up.’ The company was the brainchild of some young data technicians that included Daniel Abadi, an academic researcher who helped forward the notion of column-store parallel databases in the early 2000s. In 2011, he helped form <a href="http://www.dbms2.com/2011/03/23/hadapt-commercialized-hadoopdb/" rel="noopener nofollow" target="_blank">Hadapt</a> — one of the first Hadoop-on-SQL providers. In 2014, the company was purchased by Teradata. The timing proved a bit odd, as it nearly coincided with Facebook ceding much development responsibility to Teradata for Presto, a SQL-on-Hadoop tool that the social media giant had forged in-house, and which has subsequently been endorsed by no less than Amazon for its Athena SQL engine. The former-Hadapt group within Teradata shifted its efforts to improved performance for a Presto-compatible SQL query engine. At the end of 2017, Hadapt principals within Teradata spun-out to form Starburst, with Teradata’s blessings. A Starburst goal is to bring SQL engine prowess to SMBs that are still outliers in Teradata’s more familiar big player universe. An early effort for standalone Starburst has been a Cost Based Optimizer for Presto, built in collaboration with Facebook technicians. For the many lovers of SQL joins, the new optimizer supports Join Reordering and Join Distribution Choice. The picture emerging shows differences in use cases between plain vanilla Hadoop and SQL on Hadoop – the difference is between Hadoop being fit for the purposes of small data science groups and skunk works to Hadoop being useful for the interactive needs of wider groups of SQL business analytics users. We are also seeing HDFS, the file system at the base of Hadoop, giving way as more people choose to pursue these types of applications on the cloud rather than on the premises. Listen to the latest Talking Data podcast, which features Starburst Data CEO Justin Borgman. We left a noisy restaurant to record the interview, and found a noisy Boston waterfront, with massively loud construction if full throat. Enjoy! – Jack Vaughan The post <a href="https://itknowledgeexchange.techtarget.com/talking-data/sql-query-engine-presto-change-o-starburst/" rel="nofollow" target="_blank">SQL query engine – Presto change-o Starburst</a> appeared first on <a href="https://itknowledgeexchange.techtarget.com/talking-data" rel="nofollow" target="_blank">Talking Data Podcast » Episodes</a>.

SQL query engine – Presto change-o Starburst

The best self improvement podcast episodes. From improving productivity, to finding purpose in your life to what constitutes freedom, this topic is on anything and everything that can help people to improve their lives. Add episodes you're interested into your queue below!

Best Episodes on Self Improvement, Growth & Development

The best philosophy podcast episodes. Asking questions about how to live a better life, what it means to be and do good, to the idea of God. This topic includes episodes that bring about important questions that everyone should be asking themselves. Add episodes you're interested into your queue below!