Use Apache Pinot to stream ingesting movie rating events across countries from a Kafka topic and make them available for immediate querying from a Sourceset. The Streaming events are produced from a Spring Boot application (A random data). We will visualize the data through Superset. — I have presented about OLAP Real-Time Analytics in Thoughtworks Geek night. Please find the youtube link here. What is OLAP?

This story focuses on Geo-Spatial data manipulation similar to Postgis extension for PostgreSQL, Mongo DB, and Redis. In this article, we’ll look at Elasticsearch’s Geo queries, how you can set up mappings and indices, and provide you with some examples of how you can query your data. Geo Data In Elastic Search Elasticsearch allows you…

This story focuses on different types of queries on elastic-search like a match, term, multi-match, regexp, wildcard, range, geometry, multi-index search. Finally, we will see spring boot code using High-Level Rest Client of Elastic Search. I have used Elastic Search 7.3.0 version for this demo. Below is the snapshot of…

In this story, I provide an overview of Apache Avro and the Confluent Schema Registry. How they work, Problems they solve, and a sample Java spring boot and node js example. Kafka doesn’t validate the incoming data Kafka takes bytes as an input and sends bytes as an output. …

This story focuses on various features that JSONB provides and formulated with a sample and explained with scenarios where unstructured data can be stored and queried. Also discussed are data validations from the application layer. What is JSONB? The data type JSON and JSONB, as defined by the PostgreSQL documentation, are almost identical…

This story talks about writing Spring Cloud Functions using Java Functional Program. Before that, we can write using @EnableBinding, @Input, @Output. But these annotations have been deprecated as of 3.1 in favor of the functional programming model. …

This story talks about how efficiently we can exchange data between microservices in event-driven architecture. How outbox pattern helps in achieve this and what problem does it solve and what else it can not solve. If you’ve built a couple of microservices, you’ll probably agree that the hardest part about…

This story focuses on Change Data Capture (CDC), What is it? Where it is used and what problems does it solve and finally a real-world sample code. What is CDC? CDC is a set of technologies/processes that allow in identifying and capturing the data that has changed in the database. …

In this story, I am talking about What is N+1 Problem and what is the impact on application performance, and how to overcome this in the application. This article will demonstrate how N+1 queries occur and their solution through an example in spring boot. It is most common question asked…