Pramod Sadalage's guest appearances

Pramod Sadalage

Software Engineering Radio - the podcast for professional software developers

Data Engineering Podcast

Tech Lead Journal

Nikita Shamgunov

Christopher Ryan

Emily Miller

Peter Bull

Patrick Hunt

Jonathan Katz

Kevin Moore

Dan Robinson

Matthew Rocklin

Maxime Beauchemin

Jean Georges Perrin

Todd Walter

Mark Marinelli

Andy LoPresto

Joe Crobak

OwlTail

“The notion of transaction, consistency, and ACID compliance are many times tech imposed. It should be the business that makes the decision. We as technologists should not make that decision." Pramod Sadalage is a Director at ThoughtWorks and the co-author of the Jolt Award winning “Refactoring Databases”. In this episode, we discussed data essentials in software architecture. Pramod started by explaining why dealing with data is hard in software architecture and some data related concerns we should think about when making architecture decisions. He then shared the thought process of how we can choose the right database for our purpose and shared insights on data modeling differences between SQL and NoSQL. Pramod also touched on the important considerations in managing transactions and the trade-offs between ACID and eventual consistency. Towards the end, Pramod shared practical advice on the step-by-step how we can split a monolithic database through database refactoring.   Listen out for:  Career Journey - [00:04:23] Data is Hard - [00:15:57] Data Related Architecture Concerns - [00:18:36] Choosing the Right Database - [00:24:19] Data Modeling in SQL vs NoSQL - [00:30:28] Managing Transactions - [00:37:31] Tradeoff Between ACID &amp; Eventual Consistency - [00:44:06] Refactoring Database - [00:46:58] 3 Tech Lead Wisdom - [00:54:58]  _____ Pramod Sadalage’s BioPramod Sadalage is Director at ThoughtWorks where he enjoys the rare role of bridging the divide between database professionals and application developers. In the early 00’s he developed techniques to allow relational databases to be designed in an evolutionary manner based on version-controlled schema migrations. He is co-author of Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures, co-author for Building Evolutionary Architectures - Automated Software Governance, co-author of Refactoring Databases: Evolutionary Database Design, co-author of NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence, author of Recipes for Continuous Database Integration and continues to speak and write about the insights he and his clients learn. Follow Pramod Sadalage:  Twitter – @pramodsadalage LinkedIn – linkedin.com/in/pramodsadalage Website – sadalage.com Database Refactoring – databaserefactoring.com DevOps for DBA – devopsfordba.com Agile Data – agiledata.org  _____ Our Sponsors Are you looking for a new cool swag? Tech Lead Journal now offers you some swags that you can purchase online. These swags are printed on-demand based on your preference, and will be delivered safely to you all over the world where shipping is available. Check out all the cool swags available by visiting techleadjournal.dev/shop. And don't forget to brag yourself once you receive any of those swags.  Like this episode? Show notes &amp; transcript: techleadjournal.dev/episodes/131 Follow @techleadjournal on LinkedIn, Twitter, and Instagram. Buy me a coffee or become a patron.

<p><em>“The notion of transaction, consistency, and ACID compliance are many times tech imposed. It should be the business that makes the decision. We as technologists should not make that decision."</em></p> <p>Pramod Sadalage is a Director at ThoughtWorks and the co-author of the Jolt Award winning “Refactoring Databases”. In this episode, we discussed data essentials in software architecture. Pramod started by explaining why dealing with data is hard in software architecture and some data related concerns we should think about when making architecture decisions. He then shared the thought process of how we can choose the right database for our purpose and shared insights on data modeling differences between SQL and NoSQL. Pramod also touched on the important considerations in managing transactions and the trade-offs between ACID and eventual consistency. Towards the end, Pramod shared practical advice on the step-by-step how we can split a monolithic database through database refactoring.  </p> <p>Listen out for:</p> <ul> <li>Career Journey - [00:04:23]</li> <li>Data is Hard - [00:15:57]</li> <li>Data Related Architecture Concerns - [00:18:36]</li> <li>Choosing the Right Database - [00:24:19]</li> <li>Data Modeling in SQL vs NoSQL - [00:30:28]</li> <li>Managing Transactions - [00:37:31]</li> <li>Tradeoff Between ACID &amp; Eventual Consistency - [00:44:06]</li> <li>Refactoring Database - [00:46:58]</li> <li>3 Tech Lead Wisdom - [00:54:58]</li> </ul> <p>_____</p> <p><em>Pramod Sadalage’s Bio</em><br/>Pramod Sadalage is Director at ThoughtWorks where he enjoys the rare role of bridging the divide between database professionals and application developers. In the early 00’s he developed techniques to allow relational databases to be designed in an evolutionary manner based on version-controlled schema migrations. He is co-author of Software Architecture: The Hard Parts: Modern Trade-Off Analyses for Distributed Architectures, co-author for Building Evolutionary Architectures - Automated Software Governance, co-author of Refactoring Databases: Evolutionary Database Design, co-author of NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot Persistence, author of Recipes for Continuous Database Integration and continues to speak and write about the insights he and his clients learn.</p> <p>Follow Pramod Sadalage:</p> <ul> <li>Twitter – @pramodsadalage</li> <li>LinkedIn – <a href="http://linkedin.com/in/pramodsadalage" rel="nofollow" target="_blank">linkedin.com/in/pramodsadalage</a></li> <li>Website – <a href="http://sadalage.com" rel="nofollow" target="_blank">sadalage.com</a></li> <li>Database Refactoring – <a href="http://databaserefactoring.com" rel="nofollow" target="_blank">databaserefactoring.com</a></li> <li>DevOps for DBA – <a href="http://devopsfordba.com" rel="nofollow" target="_blank">devopsfordba.com</a></li> <li>Agile Data – <a href="http://agiledata.org" rel="nofollow" target="_blank">agiledata.org</a></li> </ul> <p>_____</p> <p><em>Our Sponsors</em></p> <p>Are you looking for a new cool swag? Tech Lead Journal now offers you some swags that you can purchase online. These swags are printed on-demand based on your preference, and will be delivered safely to you all over the world where shipping is available. Check out all the cool swags available by visiting <a href="https://techleadjournal.dev/shop" rel="noopener noreferer nofollow" target="_blank">techleadjournal.dev/shop</a>. And don't forget to brag yourself once you receive any of those swags.</p> <p><br/></p> <p><em>Like this episode?</em></p> <p>Show notes &amp; transcript: <a href="https://techleadjournal.dev/episodes/131" rel="noopener noreferer nofollow" target="_blank">techleadjournal.dev/episodes/131</a> Follow @techleadjournal on <a href="https://www.linkedin.com/company/techleadjournal/" rel="noopener noreferer nofollow" target="_blank">LinkedIn</a>, <a href="https://twitter.com/techleadjournal" rel="noopener noreferer nofollow" target="_blank">Twitter</a>, and <a href="https://www.instagram.com/techleadjournal/" rel="noopener noreferer nofollow" target="_blank">Instagram</a>. Buy me a <a href="https://techleadjournal.dev/tip" rel="nofollow" target="_blank">coffee</a> or become a <a href="https://techleadjournal.dev/patron" rel="nofollow" target="_blank">patron</a>.</p>

#131 - Data Essentials in Software Architecture - Pramod Sadalage

Summary As software lifecycles move faster, the database needs to be able to keep up. Practices such as version controlled migration scripts and iterative schema evolution provide the necessary mechanisms to ensure that your data layer is as agile as your application. Pramod Sadalage saw the need for these capabilities during the early days of the introduction of modern development practices and co-authored a book to codify a large number of patterns to aid practitioners, and in this episode he reflects on the current state of affairs and how things have changed over the past 12 years. Preamble  Hello and welcome to the Data Engineering Podcast, the show about modern data infrastructure When you’re ready to launch your next project you’ll need somewhere to deploy it. Check out Linode at dataengineeringpodcast.com/linode and get a $20 credit to try out their fast and reliable Linux virtual servers for running your data pipelines or trying out the tools you hear about on the show. Go to dataengineeringpodcast.com to subscribe to the show, sign up for the newsletter, read the show notes, and get in touch. You can help support the show by checking out the Patreon page which is linked from the site. To help other people find the show you can leave a review on iTunes, or Google Play Music, and tell your friends and co-workers Your host is Tobias Macey and today I’m interviewing Pramod Sadalage about refactoring databases and integrating database design into an iterative development workflow  Interview  Introduction How did you get involved in the area of data management? You first co-authored Refactoring Databases in 2006. What was the state of software and database system development at the time and why did you find it necessary to write a book on this subject? What are the characteristics of a database that make them more difficult to manage in an iterative context? How does the practice of refactoring in the context of a database compare to that of software? How has the prevalence of data abstractions such as ORMs or ODMs impacted the practice of schema design and evolution? Is there a difference in strategy when refactoring the data layer of a system when using a non-relational storage system? How has the DevOps movement and the increased focus on automation affected the state of the art in database versioning and evolution? What have you found to be the most problematic aspects of databases when trying to evolve the functionality of a system? Looking back over the past 12 years, what has changed in the areas of database design and evolution?  How has the landscape of tooling for managing and applying database versioning changed since you first wrote Refactoring Databases? What do you see as the biggest challenges facing us over the next few years?    Contact Info  Website pramodsadalage on GitHub @pramodsadalage on Twitter  Parting Question  From your perspective, what is the biggest gap in the tooling or technology for data management today?  Links  Database Refactoring  Website Book   Thoughtworks Martin Fowler Agile Software Development XP (Extreme Programming) Continuous Integration  The Book Wikipedia   Test First Development DDL (Data Definition Language) DML (Data Modification Language) DevOps Flyway Liquibase DBMaintain Hibernate SQLAlchemy ORM (Object Relational Mapper) ODM (Object Document Mapper) NoSQL Document Database MongoDB OrientDB CouchBase CassandraDB Neo4j ArangoDB Unit Testing Integration Testing OLAP (On-Line Analytical Processing) OLTP (On-Line Transaction Processing) Data Warehouse Docker QA==Quality Assurance HIPAA (Health Insurance Portability and Accountability Act) PCI DSS (Payment Card Industry Data Security Standard) Polyglot Persistence Toplink Java ORM Ruby on Rails ActiveRecord Gem  The intro and outro music is from The Hug by The Freak Fandango Orchestra  / CC BY-SASupport Data Engineering Podcast

<h2>Summary</h2> <p>As software lifecycles move faster, the database needs to be able to keep up. Practices such as version controlled migration scripts and iterative schema evolution provide the necessary mechanisms to ensure that your data layer is as agile as your application. Pramod Sadalage saw the need for these capabilities during the early days of the introduction of modern development practices and co-authored a book to codify a large number of patterns to aid practitioners, and in this episode he reflects on the current state of affairs and how things have changed over the past 12 years.</p> <h2>Preamble</h2> <ul> <li>Hello and welcome to the Data Engineering Podcast, the show about modern data infrastructure</li> <li>When you’re ready to launch your next project you’ll need somewhere to deploy it. Check out Linode at <a href="https://www.dataengineeringpodcast.com/linode?utm_source=rss&amp;utm_medium=rss" rel="nofollow" target="_blank">dataengineeringpodcast.com/linode</a> and get a $20 credit to try out their fast and reliable Linux virtual servers for running your data pipelines or trying out the tools you hear about on the show.</li> <li>Go to <a href="https://www.dataengineeringpodcast.com?utm_source=rss&amp;utm_medium=rss" rel="nofollow" target="_blank">dataengineeringpodcast.com</a> to subscribe to the show, sign up for the newsletter, read the show notes, and get in touch.</li> <li>You can help support the show by checking out the <a href="https://www.patreon.com/dataengineeringpodcast?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Patreon page</a> which is linked from the site.</li> <li>To help other people find the show you can leave a review on <a href="https://itunes.apple.com/us/podcast/data-engineering-podcast/id1193040557?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">iTunes</a>, or <a href="https://goo.gl/app/playmusic?ibi=com.google.PlayMusic&amp;isi=691797987&amp;ius=googleplaymusic&amp;link=https://play.google.com/music/m/Ivucmwlkrxbgfe5dhj562xgev4u?t%3DData_Engineering_Podcast%26pcampaignid%3DMKT-na-all-co-pr-mu-pod-16&amp;utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Google Play Music</a>, and tell your friends and co-workers</li> <li>Your host is Tobias Macey and today I’m interviewing Pramod Sadalage about refactoring databases and integrating database design into an iterative development workflow</li> </ul> <h2>Interview</h2> <ul> <li>Introduction</li> <li>How did you get involved in the area of data management?</li> <li>You first co-authored Refactoring Databases in 2006. What was the state of software and database system development at the time and why did you find it necessary to write a book on this subject?</li> <li>What are the characteristics of a database that make them more difficult to manage in an iterative context?</li> <li>How does the practice of refactoring in the context of a database compare to that of software?</li> <li>How has the prevalence of data abstractions such as ORMs or ODMs impacted the practice of schema design and evolution?</li> <li>Is there a difference in strategy when refactoring the data layer of a system when using a non-relational storage system?</li> <li>How has the DevOps movement and the increased focus on automation affected the state of the art in database versioning and evolution?</li> <li>What have you found to be the most problematic aspects of databases when trying to evolve the functionality of a system?</li> <li>Looking back over the past 12 years, what has changed in the areas of database design and evolution? <ul> <li>How has the landscape of tooling for managing and applying database versioning changed since you first wrote Refactoring Databases?</li> <li>What do you see as the biggest challenges facing us over the next few years?</li> </ul> <p></p></li> </ul><p></p> <h2>Contact Info</h2> <ul> <li><a href="http://sadalage.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Website</a></li> <li><a href="http://github.com/pramodsadalage?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">pramodsadalage</a> on GitHub</li> <li><a href="http://twitter.com/pramodsadalage?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">@pramodsadalage</a> on Twitter</li> </ul> <h2>Parting Question</h2> <ul> <li>From your perspective, what is the biggest gap in the tooling or technology for data management today?</li> </ul> <h2>Links</h2> <ul> <li>Database Refactoring <ul> <li><a href="http://databaserefactoring.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Website</a></li> <li><a href="http://amzn.to/2FIO4zy?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Book</a></li> </ul> <p></p></li> <li><a href="https://www.thoughtworks.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Thoughtworks</a></li> <li><a href="https://martinfowler.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Martin Fowler</a></li> <li><a href="https://en.wikipedia.org/wiki/Agile_software_development?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Agile Software Development</a></li> <li><a href="https://en.wikipedia.org/wiki/Extreme_programming?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">XP (Extreme Programming)</a></li> <li>Continuous Integration<p></p> <ul> <li><a href="http://amzn.to/2Fy8PdW?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">The Book</a></li> <li><a href="https://en.wikipedia.org/wiki/Continuous_integration?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Wikipedia</a></li> </ul> <p></p></li> <li><a href="http://www.extremeprogramming.org/rules/testfirst.html?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Test First Development</a></li> <li><a href="https://en.wikipedia.org/wiki/Data_definition_language?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">DDL (Data Definition Language)</a></li> <li><a href="https://en.wikipedia.org/wiki/Data_manipulation_language?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">DML (Data Modification Language)</a></li> <li><a href="https://en.wikipedia.org/wiki/DevOps?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">DevOps</a></li> <li><a href="https://flywaydb.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Flyway</a></li> <li><a href="http://www.liquibase.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Liquibase</a></li> <li><a href="http://www.dbmaintain.org/overview.html?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">DBMaintain</a></li> <li><a href="http://hibernate.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Hibernate</a></li> <li><a href="http://www.sqlalchemy.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">SQLAlchemy</a></li> <li><a href="https://en.wikipedia.org/wiki/Object-relational_mapping?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">ORM (Object Relational Mapper)</a></li> <li><a href="https://www.quora.com/What-is-Object-Document-Mapping?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">ODM (Object Document Mapper)</a></li> <li><a href="https://en.wikipedia.org/wiki/NoSQL?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">NoSQL</a></li> <li><a href="https://en.wikipedia.org/wiki/Document-oriented_database?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Document Database</a></li> <li><a href="https://www.mongodb.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">MongoDB</a></li> <li><a href="https://orientdb.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">OrientDB</a></li> <li><a href="https://www.couchbase.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">CouchBase</a></li> <li><a href="http://cassandra.apache.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">CassandraDB</a></li> <li><a href="https://neo4j.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Neo4j</a></li> <li><a href="https://www.arangodb.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">ArangoDB</a></li> <li><a href="https://en.wikipedia.org/wiki/Unit_testing?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Unit Testing</a></li> <li><a href="https://en.wikipedia.org/wiki/Integration_testing?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Integration Testing</a></li> <li><a href="https://en.wikipedia.org/wiki/Online_analytical_processing?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">OLAP (On-Line Analytical Processing)</a></li> <li><a href="https://en.wikipedia.org/wiki/Online_transaction_processing?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">OLTP (On-Line Transaction Processing)</a></li> <li><a href="https://en.wikipedia.org/wiki/Data_warehouse?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Data Warehouse</a></li> <li><a href="https://www.docker.com/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Docker</a></li> <li><a href="https://en.wikipedia.org/wiki/Quality_assurance?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">QA==Quality Assurance</a></li> <li><a href="https://en.wikipedia.org/wiki/Health_Insurance_Portability_and_Accountability_Act?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">HIPAA (Health Insurance Portability and Accountability Act)</a></li> <li><a href="https://en.wikipedia.org/wiki/Payment_Card_Industry_Data_Security_Standard?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">PCI DSS (Payment Card Industry Data Security Standard)</a></li> <li><a href="https://martinfowler.com/bliki/PolyglotPersistence.html?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Polyglot Persistence</a></li> <li><a href="https://en.wikipedia.org/wiki/TopLink?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Toplink</a> Java ORM</li> <li><a href="http://rubyonrails.org/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">Ruby on Rails</a></li> <li><a href="https://github.com/rails/rails/tree/master/activerecord?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">ActiveRecord Gem</a></li> </ul><p></p> <p>The intro and outro music is from <a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/Love_death_and_a_drunken_monkey/04_-_The_Hug?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">The Hug</a> by <a href="http://freemusicarchive.org/music/The_Freak_Fandango_Orchestra/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">The Freak Fandango Orchestra</a>  / <a href="http://creativecommons.org/licenses/by-sa/3.0/?utm_source=rss&amp;utm_medium=rss" rel="noopener nofollow" target="_blank">CC BY-SA</a></p><p><a href="https://dataengineering.supercast.com/" rel="payment nofollow" target="_blank">Support Data Engineering Podcast</a></p>

Database Refactoring Patterns with Pramod Sadalage - Episode 22