Peter Bourgon's guest appearances

Peter Bourgon

The InfoQ Podcast

Anurag Gupta

Adrian Cockcroft

Greg Murphy

Grady Booch

Bryan Liles

Lin Clark

Cathy O'Neil

Mike Lee

Michael Feathers

Arun Gupta

Anastasiia Voitova

David Wells

Guy Podjarny

Kolton Andrus

Kelsey Hightower

OwlTail

Today on The InfoQ Podcast, Wes Reisz talks with Peter Bourgon. Peter is a distributed system engineer working on Fastly. His area of interest is around coordination free replicated systems. The two engineers talk about the space of Conflict-Free Replicated Data Types (CRDTs) specifically in the context of edge compute. Topics covered on the podcast include Edge compute, CRDTs, CAP Theorem, and challenges around building distributed systems. Why listen to this podcast: - CRDTs (conflict-free replicated data types) are a class of coordination free replication systems (or systems that don’t require strategies such as leader election). - An easy way to think of a CRDT is as an associative, commutative, and idempotent data structure plus the operations needed to use it.The edge is an overloaded term that people tend to define based on where they sit on a spectrum between the customer and the data center. Fastly’s edge is away from the data center and but not to the telephone pole or handset.  - RAFT and Gossip are two alternative approaches to using a coordination free replication system like CRDTs.To get the properties of a CRDT and have useful data types, you have to pay a cost in size and often bytes on the wire. These are challenges that continue to need solutions. - Modern Distributed systems and data structures like CRDTs require you to start thinking about state in the system itself. It’s not unusual for a system today to give you multiple results back that the system will have to handle or merge.More on this: Quick scan our curated show notes on InfoQ https://bit.ly/3dTZOO4You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. bit.ly/24x3IVqSubscribe: www.youtube.com/infoqLike InfoQ on Facebook: bit.ly/2jmlyG8Follow on Twitter: twitter.com/InfoQFollow on LinkedIn: www.linkedin.com/company/infoqCheck the landing page on InfoQ: https://bit.ly/3dTZOO4

Today on The InfoQ Podcast, Wes Reisz talks with Peter Bourgon. Peter is a distributed system engineer working on Fastly. His area of interest is around coordination free replicated systems. The two engineers talk about the space of Conflict-Free Replicated Data Types (CRDTs) specifically in the context of edge compute. Topics covered on the podcast include Edge compute, CRDTs, CAP Theorem, and challenges around building distributed systems. Why listen to this podcast: - CRDTs (conflict-free replicated data types) are a class of coordination free replication systems (or systems that don’t require strategies such as leader election). - An easy way to think of a CRDT is as an associative, commutative, and idempotent data structure plus the operations needed to use it. The edge is an overloaded term that people tend to define based on where they sit on a spectrum between the customer and the data center. Fastly’s edge is away from the data center and but not to the telephone pole or handset. - RAFT and Gossip are two alternative approaches to using a coordination free replication system like CRDTs. To get the properties of a CRDT and have useful data types, you have to pay a cost in size and often bytes on the wire. These are challenges that continue to need solutions. - Modern Distributed systems and data structures like CRDTs require you to start thinking about state in the system itself. It’s not unusual for a system today to give you multiple results back that the system will have to handle or merge. More on this: Quick scan our curated show notes on InfoQ <a href="https://bit.ly/3dTZOO4" rel="nofollow" target="_blank">https://bit.ly/3dTZOO4</a> You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. <a href="http://bit.ly/24x3IVq" rel="nofollow" target="_blank">bit.ly/24x3IVq</a> Subscribe: <a href="http://www.youtube.com/infoq" rel="nofollow" target="_blank">www.youtube.com/infoq</a> Like InfoQ on Facebook: <a href="http://bit.ly/2jmlyG8" rel="nofollow" target="_blank">bit.ly/2jmlyG8</a> Follow on Twitter: <a href="http://twitter.com/InfoQ" rel="nofollow" target="_blank">twitter.com/InfoQ</a> Follow on LinkedIn: <a href="http://www.linkedin.com/company/infoq" rel="nofollow" target="_blank">www.linkedin.com/company/infoq</a> Check the landing page on InfoQ: <a href="https://bit.ly/3dTZOO4" rel="nofollow" target="_blank">https://bit.ly/3dTZOO4</a>

Peter Bourgon on CRDTs and State at the Edge

Paxos

Peter Bourgon discusses his work at Weaveworks, discovering and imlemeting CRDTs for time-stamped events at Soundcloud, Microservices in Go with Go Kit and the state of package management in Go.Why listen to this podcast: - We’ve hit the limits of Moore’s law so when we want to scale we have to think about how we do communication across unreliable links between unreliable machines. - In an AP algorithm like Gossip you still make forward progress in case of a failure. In Paxos you stop and return failures. - CRDTs give us a rigours set of rules to accommodate failures for maps, sets etc. in communication that result in am eventually consistent system. - Go is optimised to readers/maintainers vs. making the programmers’ life easier. Go is closer to C than Java in that it allows you to layout memory very precisely, allowing you to, for example, optimise cache lines in your CPU.  - Bourgon started a project called Go Kit, which is designed for building microservices in Go. It takes inspiration from Tiwtter’s Scala-based Finagle which solved a lot of Micoservice concerns.  - Go has a number of community-maintained package managers but no good solution; work in ongoing to try and resolve this.Notes and links can be found on: http://bit.ly/2kaHC9kWork at WeaveworksGossip vs. PaxosCRDTs at SoundCloudGoGo in large teamsGo and Java package managementMicroservices in Go with Go KitLogging and tracing in a distributed environmentMore on this:Quick scan our curated show notes on InfoQ. http://bit.ly/2kaHC9kYou can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. bit.ly/24x3IVq

Peter Bourgon discusses his work at Weaveworks, discovering and imlemeting CRDTs for time-stamped events at Soundcloud, Microservices in Go with Go Kit and the state of package management in Go. Why listen to this podcast: - We’ve hit the limits of Moore’s law so when we want to scale we have to think about how we do communication across unreliable links between unreliable machines. - In an AP algorithm like Gossip you still make forward progress in case of a failure. In Paxos you stop and return failures. - CRDTs give us a rigours set of rules to accommodate failures for maps, sets etc. in communication that result in am eventually consistent system. - Go is optimised to readers/maintainers vs. making the programmers’ life easier. Go is closer to C than Java in that it allows you to layout memory very precisely, allowing you to, for example, optimise cache lines in your CPU. - Bourgon started a project called Go Kit, which is designed for building microservices in Go. It takes inspiration from Tiwtter’s Scala-based Finagle which solved a lot of Micoservice concerns. - Go has a number of community-maintained package managers but no good solution; work in ongoing to try and resolve this. Notes and links can be found on: <a href="http://bit.ly/2kaHC9k" rel="nofollow" target="_blank">http://bit.ly/2kaHC9k</a> Work at Weaveworks Gossip vs. Paxos CRDTs at SoundCloud Go Go in large teams Go and Java package management Microservices in Go with Go Kit Logging and tracing in a distributed environment More on this: Quick scan our curated show notes on InfoQ. <a href="http://bit.ly/2kaHC9k" rel="nofollow" target="_blank">http://bit.ly/2kaHC9k</a> You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. <a href="http://bit.ly/24x3IVq" rel="nofollow" target="_blank">bit.ly/24x3IVq</a>

Peter Bourgon on Gossip, Paxos, Microservices in Go, and CRDTs at SoundCloud