Re: Kafka streaming and topic filter whitelist
They will be automatically added and removed. On Mon, 3 Oct 2016 at 14:59 Gary Ogden wrote: > What if topics are created or deleted after the application has started? > Will they be added/removed automatically, or do we need to restart the > application to pick up the changes? > > On 1 October 2016 at 04:42, Damian Guy wrote: > > > That is correct. > > > > On Fri, 30 Sep 2016 at 18:00 Gary Ogden wrote: > > > > > So how exactly would that work? For example, I can currently do this: > > > > > > KStream > > > textLines = builder.stream(stringSerde, stringSerde, > > SYSTEM_TOPIC); > > > > > > Are you saying that I could put a regex in place of the SYSTEM_TOPIC > and > > > that one KStream would be streaming from multiple topics that match > that > > > regex? > > > > > > If so, that could be useful. > > > > > > Gary > > > > > > > > > On 30 September 2016 at 13:35, Damian Guy > wrote: > > > > > > > Hi Gary, > > > > > > > > In the upcoming 0.10.1 release you can do regex subscription - will > > that > > > > help? > > > > > > > > Thanks, > > > > Damian > > > > > > > > On Fri, 30 Sep 2016 at 14:57 Gary Ogden wrote: > > > > > > > > > Is it possible to use the topic filter whitelist within a Kafka > > > Streaming > > > > > application? Or can it only be done in a consumer job? > > > > > > > > > > > > > > >
Re: Kafka streaming and topic filter whitelist
What if topics are created or deleted after the application has started? Will they be added/removed automatically, or do we need to restart the application to pick up the changes? On 1 October 2016 at 04:42, Damian Guy wrote: > That is correct. > > On Fri, 30 Sep 2016 at 18:00 Gary Ogden wrote: > > > So how exactly would that work? For example, I can currently do this: > > > > KStream > > textLines = builder.stream(stringSerde, stringSerde, > SYSTEM_TOPIC); > > > > Are you saying that I could put a regex in place of the SYSTEM_TOPIC and > > that one KStream would be streaming from multiple topics that match that > > regex? > > > > If so, that could be useful. > > > > Gary > > > > > > On 30 September 2016 at 13:35, Damian Guy wrote: > > > > > Hi Gary, > > > > > > In the upcoming 0.10.1 release you can do regex subscription - will > that > > > help? > > > > > > Thanks, > > > Damian > > > > > > On Fri, 30 Sep 2016 at 14:57 Gary Ogden wrote: > > > > > > > Is it possible to use the topic filter whitelist within a Kafka > > Streaming > > > > application? Or can it only be done in a consumer job? > > > > > > > > > >
Re: Kafka streaming and topic filter whitelist
That is correct. On Fri, 30 Sep 2016 at 18:00 Gary Ogden wrote: > So how exactly would that work? For example, I can currently do this: > > KStream > textLines = builder.stream(stringSerde, stringSerde, SYSTEM_TOPIC); > > Are you saying that I could put a regex in place of the SYSTEM_TOPIC and > that one KStream would be streaming from multiple topics that match that > regex? > > If so, that could be useful. > > Gary > > > On 30 September 2016 at 13:35, Damian Guy wrote: > > > Hi Gary, > > > > In the upcoming 0.10.1 release you can do regex subscription - will that > > help? > > > > Thanks, > > Damian > > > > On Fri, 30 Sep 2016 at 14:57 Gary Ogden wrote: > > > > > Is it possible to use the topic filter whitelist within a Kafka > Streaming > > > application? Or can it only be done in a consumer job? > > > > > >
Re: Kafka streaming and topic filter whitelist
So how exactly would that work? For example, I can currently do this: KStream textLines = builder.stream(stringSerde, stringSerde, SYSTEM_TOPIC); Are you saying that I could put a regex in place of the SYSTEM_TOPIC and that one KStream would be streaming from multiple topics that match that regex? If so, that could be useful. Gary On 30 September 2016 at 13:35, Damian Guy wrote: > Hi Gary, > > In the upcoming 0.10.1 release you can do regex subscription - will that > help? > > Thanks, > Damian > > On Fri, 30 Sep 2016 at 14:57 Gary Ogden wrote: > > > Is it possible to use the topic filter whitelist within a Kafka Streaming > > application? Or can it only be done in a consumer job? > > >
Re: Kafka streaming and topic filter whitelist
Hi Gary, In the upcoming 0.10.1 release you can do regex subscription - will that help? Thanks, Damian On Fri, 30 Sep 2016 at 14:57 Gary Ogden wrote: > Is it possible to use the topic filter whitelist within a Kafka Streaming > application? Or can it only be done in a consumer job? >
Kafka streaming and topic filter whitelist
Is it possible to use the topic filter whitelist within a Kafka Streaming application? Or can it only be done in a consumer job?