KafkaStreams : Aggregating

So last time we looked at a whole bunch of stateless operations. This time we will continue our journey to look at how we can start to do aggregations, and make use of state stores. Where is the code? The code for this post is all contained here And the tests are all contained here Introduction to Stateful operations Stateful operations (unlike stateless operations) require a state store for processing purposes. We briefly touched on state stores last time, but today I wanted to drill in a bit more into this. Kafka comes with some inbuilt state stores PersistentKeyValueStore Storage Engine : Rocks DB Fault Tolerant : Yes by default The recommended store type for most use cases. Stores its data on local disk. Storage capacity: managed local state can be larger than the memory (heap space) of an application instance, but must fit into the available local disk space. RocksDB settings can be fine-tuned, see RocksDB configuration. Available store variants: time window key-value store, session window key-value store.

✔ Read More...

I guess you came to this post by searching similar kind of issues in any of the search engine and hope that this resolved your problem. If you find this tips useful, just drop a line below and share the link to others and who knows they might find it useful too.

Stay tuned to my blog, twitter or facebook to read more articles, tutorials, news, tips & tricks on various technology fields. Also Subscribe to our Newsletter with your Email ID to keep you updated on latest posts. We will send newsletter to your registered email address. We will not share your email address to anybody as we respect privacy.

This article is related to

Kafka