hi all,

i have a pipeline that reads message from kafka, generates pcollection
of keys (using Keys.create)
and then access to redis with these keys:

PCollection<KV<String, String>> redisOutput =
pcollectionKeys.apply(RedisIO.readKeyPatterns().withEndpoint(PipelineUtil.REDIS_HOST,
PipelineUtil.REDIS_PORT);

When using the default configuration OutputParallelization = true,
the pipeline gets stuck and no output is returned in the redisOutput
pcollection;

It seems that the Reparallelize PTransform which is activated after
the mget operation from redis is getting stuck.

Does anyone have any experience with this?

Thanks
Sigalit

Reply via email to