Data Engineering Podcast

Automate Your Pipeline Creation For Streaming Data Transformations With SQLake

January 8th, 2023  •  44 mins 5 secs  •  Download (23.4 MB)  •  Link with Timestamp

RSS Feed

Managing end-to-end data flows becomes complex and unwieldy as the scale of data and its variety of applications in an organization grows. Part of this complexity is due to the transformation and orchestration of data living in disparate systems. The team at Upsolver is taking aim at this problem with the latest iteration of their platform in the form of SQLake. In this episode Ori Rafael explains how they are automating the creation and scheduling of orchestration flows and their related transforations in a unified SQL interface.