Postgres on Google Cloud | Kafka KRaft | Debezium Connect | Data Generation & Streaming
Prasoon Parashar Prasoon Parashar
1.31K subscribers
1,246 views
42

 Published On Jul 1, 2023

In this tutorial where we explore the world of data generation and real-time streaming using Postgres, Kafka, and Debezium Connect. We dive deeper into the setup process, starting with configuring Postgres on Google Cloud. We'll walk you through the steps to generate streaming data, set up a Kafka-kraft cluster, and establish a connection to the Kafka UI. Finally, we'll guide you in setting up Debezium Connect for seamless data streaming.

Github code is present on Chapter 2 https://github.com/Noosarpparashar/st...

Medium : -   / how-to-set-up-cdc-with-kafka-debezium-and-...  

LinkedIn:-   / prasoon-parashar-47433919b  

Introduction: (0:00-0:24)
Setting Up PostgreSQL on Google Cloud: (0:25-1:38)
Allowing Access to Your Localhost: (1:39-2:30)
Creating User and Password for Your Database: (2:30-2:52)
Setting Up pgAdmin: (2:53-4:05)
Granting Replication Access to the User: (4:06-4:23)
Setting Up Database, Schema, and Tables: (4:24-5:22)
Setting Up the Repository, Modifying Code, and Building it: (5:23-6:48)
Explaining Docker Compose: Kafka, Debezium, Kafka UI: (6:49-7:55)
Starting Docker to Run Kafka, Debezium, and Kafka UI: (7:56-8:20)
Visualizing Kafka Cluster on Kafka UI: (8:21-8:45)
Generating and Loading Streaming Data to Tables: (8:46-9:56)
Creating a Debezium Connector using Postman: (9:57-11:09)
Visualizing Data on Kafka Topics through Kafka UI: (11:10-11:32)
Thank You: (11:34-11:44)

show more

Share/Embed