Re: [Gluster-users] GlusterFS and Kafka

I was stupid enough to copy an additional newline from email. So, sorry for the noise. Works so far. Thanks for getting that solved, best Chris Raghavendra Talur schrieb am Mo., 29. Mai 2017 um 13:18 Uhr: > > > On 29-May-2017 3:49 PM, "Christopher Schmidt"

Re: [Gluster-users] GlusterFS and Kafka

On 29-May-2017 3:49 PM, "Christopher Schmidt" wrote: Hi Raghavendra Talur, this does not work for me. Most certainly because I forgot something. So just put the file in the folder, make it executable and create a volume? Thats all? If I am doing this, there is no

Re: [Gluster-users] GlusterFS and Kafka

Hi Raghavendra Talur, this does not work for me. Most certainly because I forgot something. So just put the file in the folder, make it executable and create a volume? Thats all? If I am doing this, there is no /var/lib/glusterd/hooks/1/create/post/log file and the Performance Translator is

Re: [Gluster-users] GlusterFS and Kafka

On Thu, May 25, 2017 at 8:39 PM, Joe Julian wrote: > Maybe hooks? Yes, we were thinking of the same :) Christopher, Gluster has hook-scripts facility that admins can write and set those to be run on certain events in Gluster. We have a event for volume creation. Here are

Re: [Gluster-users] GlusterFS and Kafka

Maybe hooks? On May 25, 2017 6:48:04 AM PDT, Christopher Schmidt wrote: >Hi Humble, > >thanks for that, it is really appreciated. > >In the meanwhile, using K8s 1.5, what can I do to disable the >performance >translator that doesn't work with Kafka? Maybe something while

Re: [Gluster-users] GlusterFS and Kafka

Hi Christopher, We are experimenting few other options to get rid of this issue. We will provide an update as soon as we have it. On Thu, May 25, 2017 at 7:18 PM, Christopher Schmidt wrote: > Hi Humble, > > thanks for that, it is really appreciated. > > In the meanwhile,

Re: [Gluster-users] GlusterFS and Kafka

Hi Humble, thanks for that, it is really appreciated. In the meanwhile, using K8s 1.5, what can I do to disable the performance translator that doesn't work with Kafka? Maybe something while generating the Glusterfs container for Kubernetes? Best Christopher Humble Chirammal

Re: [Gluster-users] GlusterFS and Kafka

On Thu, May 25, 2017 at 11:21 AM, Christopher Schmidt wrote: > So this change of the Gluster Volume Plugin will make it into K8s 1.7 or > 1.8. Unfortunately too late for me. > > Does anyone know how to disable performance translators by default? Humble, Do you know of any

Re: [Gluster-users] GlusterFS and Kafka

So this change of the Gluster Volume Plugin will make it into K8s 1.7 or 1.8. Unfortunately too late for me. Does anyone know how to disable performance translators by default? Raghavendra Talur schrieb am Mi., 24. Mai 2017, 19:30: > On Wed, May 24, 2017 at 4:08 PM,

Re: [Gluster-users] GlusterFS and Kafka

On Wed, May 24, 2017 at 4:08 PM, Christopher Schmidt wrote: > > > Vijay Bellur schrieb am Mi., 24. Mai 2017 um 05:53 Uhr: >> >> On Tue, May 23, 2017 at 1:39 AM, Christopher Schmidt >> wrote: >>> >>> OK, seems that this works now. >>>

Re: [Gluster-users] GlusterFS and Kafka

Vijay Bellur schrieb am Mi., 24. Mai 2017 um 05:53 Uhr: > On Tue, May 23, 2017 at 1:39 AM, Christopher Schmidt > wrote: > >> OK, seems that this works now. >> >> A couple of questions: >> - What do you think, are all these options necessary for Kafka? >>

Re: [Gluster-users] GlusterFS and Kafka

Vijay Bellur schrieb am Mi., 24. Mai 2017 um 05:53 Uhr: > On Tue, May 23, 2017 at 1:39 AM, Christopher Schmidt > wrote: > >> OK, seems that this works now. >> >> A couple of questions: >> - What do you think, are all these options necessary for Kafka? >>

Re: [Gluster-users] GlusterFS and Kafka

On 05/23/2017 11:15 AM, Joe Julian wrote: If this was multiple clients I could see that possibility, but the single fuse client by which this file is being accessed should have a consistent state to the single application regardless of the state of the servers. How (and be specific, please, so I

Re: [Gluster-users] GlusterFS and Kafka

On Tue, May 23, 2017 at 1:39 AM, Christopher Schmidt wrote: > OK, seems that this works now. > > A couple of questions: > - What do you think, are all these options necessary for Kafka? > I am not entirely certain what subset of options will make it work as I do not

Re: [Gluster-users] GlusterFS and Kafka

If this was multiple clients I could see that possibility, but the single fuse client by which this file is being accessed should have a consistent state to the single application regardless of the state of the servers. How (and be specific, please, so I can understand the actual mechanism and

Re: [Gluster-users] GlusterFS and Kafka

Well, a "turning off caching" warning is ok. But without doing anything, Kafka definitely doesn't work. Which is somehow strange because it is a normal (IMHO) JVM process written in Scala. I am wondering if there are some issues with other tools too. Vijay Bellur schrieb am

Re: [Gluster-users] GlusterFS and Kafka

This may be asking too much, but can you explain why or how it's even possible to bypass the cache like this, Vijay? On May 22, 2017 7:41:40 AM PDT, Vijay Bellur wrote: >Looks like a problem with caching. Can you please try by disabling all >performance translators? The

Re: [Gluster-users] GlusterFS and Kafka

Looks like a problem with caching. Can you please try by disabling all performance translators? The following configuration commands would disable performance translators in the gluster client stack: gluster volume set performance.quick-read off gluster volume set performance.io-cache off

[Gluster-users] GlusterFS and Kafka

Hi all, has anyone ever successfully deployed a Kafka (Cluster) on GlusterFS volumes? I my case it's a Kafka Kubernetes-StatefulSet and a Heketi GlusterFS. Needless to say that I am getting a lot of filesystem related exceptions like this one: Failed to read `log header` from file channel