Published On Dec 18, 2023
Presented by Shubham Gupta and Bhanu Mittal.
Talk abstract:
- Migrating from a traditional data warehouse to Trino powered data lakehouse
- Enabling analytics at Zomato to create fast & easy custom data marts through Iceberg Connector
- Updating data marts every 15 minutes to power a fast-changing lake house
- Tackling challenges around iceberg table maintenance
Timestamps:
- 0:00 Introduction
- 0:56 About Zomato and Blinkit
- 3:48 Scale of data at Blinkit
- 4:34 Trino clusters powering analytics
- 6:00 Solving data marts at scale
- 7:15 Choosing the Trino Iceberg connector
- 10:44 Implementing the Trino Iceberg connector
- 14:00 Results of iceberg connector
- 16:15 Tips for a successful workflow
- 19:29 Future scope