Data Engineering Podcast

Designing Data Transfer Systems That Scale

December 4th, 2023  •  1 hr 3 mins  •  Download (36.2 MB)  •  Link with Timestamp

RSS Feed

The first step of data pipelines is to move the data to a place where you can process and prepare it for its eventual purpose. Data transfer systems are a critical component of data enablement, and building them to support large volumes of information is a complex endeavor. Andrei Tserakhau has dedicated his careeer to this problem, and in this episode he shares the lessons that he has learned and the work he is doing on his most recent data transfer system at DoubleCloud.