Streams currently only has support for a RocksDB window store, but users have been requesting an in-memory version. This KIP introduces a design for an in-memory window store implementation.
https://cwiki.apache.org/confluence/display/KAFKA/KIP-428%3A+Add+in-memory+window+store