[
https://issues.apache.org/jira/browse/BEAM-3925?focusedWorklogId=397121&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-397121
]
ASF GitHub Bot logged work on BEAM-3925:
----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Mar/20 23:14
Start Date: 03/Mar/20 23:14
Worklog Time Spent: 10m
Work Description: rangadi commented on issue #6636: [BEAM-3925] [DO NOT
MERGE] KafkaIO : Value provider support for reader configuration.
URL: https://github.com/apache/beam/pull/6636#issuecomment-594220066
@pseudomuto @davidheryanto : The main issue we need to address is proper
support for `.numSplits()` interface. If user sets `numSplits` to 20 and Kafka
topic has only 5 partitions, 15 splits (`readers`) will not have any work. We
just need to handle that properly. I don't think it is that much more work.
cc: @aromanenko-dev.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 397121)
Time Spent: 7h 40m (was: 7.5h)
> Support ValueProviders in KafkaIO
> ---------------------------------
>
> Key: BEAM-3925
> URL: https://issues.apache.org/jira/browse/BEAM-3925
> Project: Beam
> Issue Type: Improvement
> Components: io-java-kafka
> Reporter: Sameer Abhyankar
> Assignee: Pramod Upamanyu
> Priority: Major
> Time Spent: 7h 40m
> Remaining Estimate: 0h
>
> Add ValueProvider support for the various methods in KafkaIO. This would
> allow us to use KafkaIO in reusable pipeline templates.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
