[jira] [Resolved] (KAFKA-7233) InMemoryKeyValueStore is not thread-safe for Interactive Queries
[ https://issues.apache.org/jira/browse/KAFKA-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hashan Gayasri Udugahapattuwa resolved KAFKA-7233. -- Resolution: Invalid The implementation is correct > InMemoryKeyValueStore is not thread-safe for Interactive Queries > > > Key: KAFKA-7233 > URL: https://issues.apache.org/jira/browse/KAFKA-7233 > Project: Kafka > Issue Type: Bug > Components: streams >Affects Versions: 1.1.0, 2.0.0 > Environment: Fedora 27 >Reporter: Hashan Gayasri Udugahapattuwa >Priority: Critical > > When querying externally from via the > [ReadOnlyKeyValueStore|https://github.com/apache/kafka/blob/1.0/streams/src/main/java/org/apache/kafka/streams/state/ReadOnlyKeyValueStore.java] > API (Interactive Queries), the InMemoryKeyValueStore does not protect its > internal map from concurrent reads and writes which may produce incorrect > results to the ReadOnlyKeyValueStore API. Note that reads(query thread) and > writes(stream thread) can happen concurrently. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KAFKA-7233) InMemoryKeyValueStore is not thread-safe for Interactive Queries
Hashan Gayasri Udugahapattuwa created KAFKA-7233: Summary: InMemoryKeyValueStore is not thread-safe for Interactive Queries Key: KAFKA-7233 URL: https://issues.apache.org/jira/browse/KAFKA-7233 Project: Kafka Issue Type: Bug Components: streams Affects Versions: 2.0.0, 1.1.0 Environment: Fedora 27 Reporter: Hashan Gayasri Udugahapattuwa When querying externally from via the [ReadOnlyKeyValueStore|https://github.com/apache/kafka/blob/1.0/streams/src/main/java/org/apache/kafka/streams/state/ReadOnlyKeyValueStore.java] API (Interactive Queries), the InMemoryKeyValueStore does not protect its internal map from concurrent reads and writes which may produce incorrect results to the ReadOnlyKeyValueStore API. Note that reads(query thread) and writes(stream thread) can happen concurrently. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KAFKA-7115) InMemoryKeyValueLoggedStore does not flush the changelog
[ https://issues.apache.org/jira/browse/KAFKA-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hashan Gayasri Udugahapattuwa resolved KAFKA-7115. -- Resolution: Not A Problem This the expected behaviour > InMemoryKeyValueLoggedStore does not flush the changelog > > > Key: KAFKA-7115 > URL: https://issues.apache.org/jira/browse/KAFKA-7115 > Project: Kafka > Issue Type: Bug > Components: streams >Affects Versions: 1.1.0 > Environment: Fedora 27 >Reporter: Hashan Gayasri Udugahapattuwa >Priority: Major > > The InMemoryKeyValueLoggedStore does not flush the underlying RecordCollector. > *Please close this if this is not the intended behaviour and if the > RecordCollector is supposed to be flushed by the StreamTask only.* -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KAFKA-7115) InMemoryKeyValueLoggedStore does not flush the changelog
Hashan Gayasri Udugahapattuwa created KAFKA-7115: Summary: InMemoryKeyValueLoggedStore does not flush the changelog Key: KAFKA-7115 URL: https://issues.apache.org/jira/browse/KAFKA-7115 Project: Kafka Issue Type: Bug Components: streams Affects Versions: 1.1.0 Environment: Fedora 27 Reporter: Hashan Gayasri Udugahapattuwa The InMemoryKeyValueLoggedStore does not flush the underlying RecordCollector. *Please close this if this is not the intended behaviour and if the RecordCollector is supposed to be flushed by the StreamTask only.* -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KAFKA-7079) ValueTransformer#transform does not pass the key
Hashan Gayasri Udugahapattuwa created KAFKA-7079: Summary: ValueTransformer#transform does not pass the key Key: KAFKA-7079 URL: https://issues.apache.org/jira/browse/KAFKA-7079 Project: Kafka Issue Type: Bug Components: streams Affects Versions: 1.1.0 Environment: Fedora 27 Reporter: Hashan Gayasri Udugahapattuwa ValueTransformers' transform method doesn't pass the key to user-code. Reporting this as a bug since it currently requires workarounds. Context: I'm currently in the process of converting two stateful "*aggregate*" DSL operations to the Processor API since the state of those operations are relatively large and takes 99% + of CPU time (when profiled) for serializing and deserializing them via Kryo. Since DSL aggregations use state stores of [Bytes, Array[Byte]]] even when using the in-memory state store, it seems like the only way to reduce the serialization/deserialization overhead is to convert heavy aggregates to *transform*s. In my case, *ValueTransformer* seems to be the option. However, since ValueTransformers' _transform_ method only exposes the _value_, I'd either have to pre-process and add the key to the value or use *Transformer* instead (which is not my intent). As internal _*InternalValueTransformerWithKey*_ already has the readOnlyKey, it seems like a good idea to pass the key to the transform method as well, esp since in a stateful transformation, generally the state store has to be queried by the key. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KAFKA-6816) Tables in documentation are truncated
Hashan Gayasri Udugahapattuwa created KAFKA-6816:
Summary: Tables in documentation are truncated
Key: KAFKA-6816
URL: https://issues.apache.org/jira/browse/KAFKA-6816
Project: Kafka
Issue Type: Bug
Components: documentation
Affects Versions: 1.1.0
Environment: Firefox,Chrome (Fedora release 27)
Reporter: Hashan Gayasri Udugahapattuwa
Attachments: Screenshot from 2018-04-23 12-17-11.png
Example page :
[https://kafka.apache.org/documentation/streams/developer-guide/dsl-api.html#id10]
[https://kafka.apache.org/css/styles.css] : 394
.right\{overflow:hidden}
causes data in tables to be truncated
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
