hi all, i have a pipeline that reads message from kafka, generates pcollection of keys (using Keys.create) and then access to redis with these keys:
PCollection<KV<String, String>> redisOutput = pcollectionKeys.apply(RedisIO.readKeyPatterns().withEndpoint(PipelineUtil.REDIS_HOST, PipelineUtil.REDIS_PORT); When using the default configuration OutputParallelization = true, the pipeline gets stuck and no output is returned in the redisOutput pcollection; It seems that the Reparallelize PTransform which is activated after the mget operation from redis is getting stuck. Does anyone have any experience with this? Thanks Sigalit