Introduction: Kafka, a distributed streaming platform, has become a vital component in modern data-driven applications. However, interacting with Kafka and performing testing and administrative tasks can often be complex and time-consuming. That’s where Kafka Play comes in — a powerful and user-friendly application designed to simplify Kafka message testing and…

This is a small blog on dumping the data from Kafka (source) to MongoDb (Sink). User Story The requirement here is, we already have a lot of record coming to different Kafka topic and what we want is any information coming to the topic need to be dumped into the…

Rest Proxy — Get all the topics using rest proxy server:port/topics (GET) ex: http://localhost:8082/topics [ "connect-configs", "_confluent-ksql-default__command_topic", "_confluent-controlcenter-6-1-0-1-group-aggregate-store-ONE_MINUTE-repartition", "_confluent-controlcenter-6-1-0-1-MonitoringMessageAggregatorWindows-ONE_MINUTE-repartition", "purchases" ] Get topic by name:

Post installation of confuent on Ubuntu WSL: if ubuntu don’t recoginise kafka: Do environment variable setup: export CONFLUENT_HOME=~/confluent-6.1.0 export PATH=$CONFLUENT_HOME/bin:$PATH If confluent kafka no restarting even after multiple retires on windows local. Try clearing temp in path cd ~/tmp for kafka. Rest Endpoints:

In this blog we will try to build an end to end app which will let the end user to search for a book in the store seamlessly with the information available to them in almost real time. For this purpose we will be leveraging the use of Solr in…

Part 3: The Sales Consumer — You can find the the whole source code over here. GitHub - Parasmani300/sales-data-consumer You can't perform that action at this time. You signed in with another tab or window. You signed out in another tab or…github.com So till the part 2 we have seen how the sales-publisher-app had produced the data for Kafka. As the next part of this app we will be consuming the data produced.

Part 2: The Sales Producer — Architecture of the Sales Producer You can find the whole code here: GitHub - Parasmani300/sales-publisher You can't perform that action at this time. You signed in with another tab or window. You signed out in another tab or…github.com So lets start a code walk through and understand what each part represent. First let’s have a look into the project structure of the app:

Part 1: Creating a Springboot Scheduler App which will randomly pick a store and book a order form some item. DB Schema: Note: We have not maintained any constraint to table for simplicity purpose. If you want then you can proceed with full fledge relation. Our next step will be populating our Items table and Store table with data. …

The kafka cookbook for reference: Ok Done.