Re: caching permantly disabled in Kafka Streams

Sure. Another observation I've made is that before I started modifying these properties I could spot quite a few duplicates in the state store. Then I applied exactly once semantics which removed most of the duplicates. Finally I disabled cache by setting CACHE_MAX_BYTES_BUFFERING_CONFIG to 0 whic

Re: caching permantly disabled in Kafka Streams

Could you show us the testing code snippet that shows how you set the configs and how you read from it for verification? Guozhang On Wed, Dec 13, 2017 at 1:07 PM, Artur Mrozowski wrote: > Hello Guozhang, > > I print out some values that I assign to StreamsConfig in the console, but > the CACH

Re: Class Files\OpenLink not found

Which release of Kafka did you download ? The error seems to be (in English): unable to find or load the main class I searched Kafka source code but didn't find reference to OpenLink. Can you give the complete error ? Thanks On Wed, Dec 13, 2017 at 12:55 AM, Thomas JASSEM wrote: > Hello, >

Class Files\OpenLink not found

Hello, I am not able to run kafka on my computer because I have an error when I try to launch Kafka with the command .\bin\windows\kafka-server-start.bat \config\server.properties or even with the command .\bin\windows\kafka-server-start.bat abcd (just to try): Erreur : impossible de trouver ou ch

Re: caching permantly disabled in Kafka Streams

Hello Guozhang, I print out some values that I assign to StreamsConfig in the console, but the CACHE_MAX_BYTES_BUFFERING_CONFIG is always null. I disabled caching by setting it to 0 today, and it seems to have the expected effect. But after this I am not able to assign any value to it, it is alway

Kafka isync replica

Hi, I have a Kafka cluster and it is running from a long time, just today I realize that some of the topic partition are not in good state, there Isr is been reduced to 2 from 3 even though the node of the lost replica is working Like Topic: XYZ Partition 82 Leader: 1 Replicas:1,2,3 Isr:1,2 <

Re: Kafka mailing list subscription

See https://kafka.apache.org/contact for instructions. -Matthias On 12/13/17 12:01 AM, Seslav Lazarov wrote: > unsubscribe > signature.asc Description: OpenPGP digital signature

Re: caching permantly disabled in Kafka Streams

Just some DEBUG level logging from when you start up your Streams application would be great. Thanks, Bill On Wed, Dec 13, 2017 at 11:02 AM, Artur Mrozowski wrote: > Hi Bill, > No, but I'll be happy to generate it. How do I generate logs for > StreamsConfig? > > Thanks, > Artur > > On Wed, Dec

Re: caching permantly disabled in Kafka Streams

Hello Artur, What do you mean exactly by "It simply returns null no matter what value I provide."? Guozhang On Wed, Dec 13, 2017 at 8:02 AM, Artur Mrozowski wrote: > Hi Bill, > No, but I'll be happy to generate it. How do I generate logs for > StreamsConfig? > > Thanks, > Artur > > On Wed, D

Re: Need help in storing key along with value of _schemas topic using s3 sink connector.

Hi Ted, Yes after I posted this query in this group , I also found an open issue related to this. https://github.com/confluentinc/kafka-connect-storage-cloud/issues/119 Thanks, Pratik On Wed, Dec 13, 2017 at 9:25 PM, Ted Yu wrote: > Have you checked s3 connector issue listing ? > > C

Re: caching permantly disabled in Kafka Streams

Hi Bill, No, but I'll be happy to generate it. How do I generate logs for StreamsConfig? Thanks, Artur On Wed, Dec 13, 2017 at 3:44 PM, Bill Bejeck wrote: > H Artur, > > Do you have any log files you can share for this issue? > > Thanks, > Bill > > On Wed, Dec 13, 2017 at 8:15 AM, Artur Mrozows

Re: Need help in storing key along with value of _schemas topic using s3 sink connector.

Have you checked s3 connector issue listing ? Cheers On Wed, Dec 13, 2017 at 2:38 AM, Pratik Shah wrote: > Hi All, > I am using kafka s3 sink connector ( version 4.0) to backup the > _schemas topic for its backup. > The issue is that the content stored in S3 is only the valu

Re: deduplication strategy for Kafka Streams DSL

Hi Artur, The most direct way for deduplication (I'm using the term deduplication to mean records with the same key, but not necessarily the same value, where later records are considered) is to set the CACHE_MAX_BYTES_BUFFERING_CONFIG setting to a value greater than zero. Your other option is t

RE: Kafka & Canary Release

If you haven’t built in logic from the start (with micro-service version 1) then I think you’ll need some sort of “router” in the middle that knows the routing logic. -Dave From: Assaf Katz [mailto:assaf.k...@amdocs.com] Sent: Wednesday, December 13, 2017 3:12 AM To: Yuval Alon ; users@kafka.a

Re: caching permantly disabled in Kafka Streams

H Artur, Do you have any log files you can share for this issue? Thanks, Bill On Wed, Dec 13, 2017 at 8:15 AM, Artur Mrozowski wrote: > Actually I can see all other properties being set, except for > CACHE_MAX_BYTES_BUFFERING_CONFIG that is null. > I use 0.11.0.2 Kafka Streams. > Has anyone en

Re: caching permantly disabled in Kafka Streams

Actually I can see all other properties being set, except for CACHE_MAX_BYTES_BUFFERING_CONFIG that is null. I use 0.11.0.2 Kafka Streams. Has anyone encountered this issue? /Artur On Wed, Dec 13, 2017 at 1:11 PM, Artur Mrozowski wrote: > Hi, > I played around with caching on Confluent platform

caching permantly disabled in Kafka Streams

Hi, I played around with caching on Confluent platform 3.3 by first disabling, setting to zero. Now, it seems I can not enable it again. It simply returns null no matter what value I provide. e.g settings.put(StreamsConfig.CACHE_MAX_BYTES_BUFFERING_CONFIG,10*1024*1024L); How can I enable it again

deduplication strategy for Kafka Streams DSL

Hi I run an app where I transform KTable to stream and then I groupBy and aggregate and capture the results in KTable again. That generates many duplicates. I have played with exactly once semantics that seems to reduce duplicates for records that should be unique. But I still get duplicates on ke

Unordered messaging without partitions

Hi All, In our company, we extensively use kafka and love the scalability and durability guarantees that it offers. However, almost all use cases in the company are for unordered messages, where there are latency sensitive "online" producers pumping messages to kafka, which is then processed leis

Need help in storing key along with value of _schemas topic using s3 sink connector.

Hi All, I am using kafka s3 sink connector ( version 4.0) to backup the _schemas topic for its backup. The issue is that the content stored in S3 is only the value part of the kafka message stored in _schemas topic. How can I configure the connector to store the key as

RE: Kafka & Canary Release

No From: Yuval Alon Sent: Wednesday, 13 December 2017 10:52 To: users@kafka.apache.org Cc: Zeevik Liak ; Assaf Katz Subject: RE: Kafka & Canary Release Hi, Any reply on our last comment? Yuval Alon amdocs technology – Digital Mobile: +972-52-6148937 Office: +972-9-7789641 email: yuva...@amd

RE: Kafka & Canary Release

Hi, Any reply on our last comment? Yuval Alon amdocs technology – Digital Mobile: +972-52-6148937 Office: +972-9-7789641 email: yuva...@amdocs.com [amdocs-a] From: Assaf Katz Sent: Wednesday, November 29, 2017 6:51 PM To: users@kafka.apache.org Cc: Zeevik Liak ; Yuv

Re: Getting install error ...

Kishore You can create a bat file and copy your respective path *cd C:\kafka_2.10-0.10.2.0-SNAPSHOTtitle "9092:0" & .\bin\windows\kafka-server-start.bat config\server.properties* Courtesy Abhit !wq On Mon, Dec 11, 2017 at 4:27 PM, kish babu wrote: > Hi, > I am trying to setup Kafka on my w

Kafka mailing list subscription

unsubscribe