[jira] [Commented] (FLINK-3542) FlinkKafkaConsumer09 cannot handle changing number of partitions
[
https://issues.apache.org/jira/browse/FLINK-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329838#comment-17329838
]
Flink Jira Bot commented on FLINK-3542:
---
This issue has been labeled "stale-minor" for 7 days. It is closed now. If you
are still affected by this or would like to raise the priority of this ticket
please re-open, removing the label "auto-closed" and raise the ticket priority
accordingly.
> FlinkKafkaConsumer09 cannot handle changing number of partitions
>
>
> Key: FLINK-3542
> URL: https://issues.apache.org/jira/browse/FLINK-3542
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Kafka
>Affects Versions: 1.0.0
>Reporter: Till Rohrmann
>Priority: Minor
> Labels: stale-minor
>
> The current {{FlinkKafkaConsumer09}} cannot handle increasing the number of
> partitions of a topic while running. The consumer will simply leave the newly
> created partitions out and thus miss all data which is written to the new
> partitions. The reason seems to be a static assignment of partitions to
> consumer tasks when the job is started.
> We should either fix this behaviour or clearly document it in the online and
> code docs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-3542) FlinkKafkaConsumer09 cannot handle changing number of partitions
[
https://issues.apache.org/jira/browse/FLINK-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321735#comment-17321735
]
Flink Jira Bot commented on FLINK-3542:
---
This issue and all of its Sub-Tasks have not been updated for 180 days. So, it
has been labeled "stale-minor". If you are still affected by this bug or are
still interested in this issue, please give an update and remove the label. In
7 days the issue will be closed automatically.
> FlinkKafkaConsumer09 cannot handle changing number of partitions
>
>
> Key: FLINK-3542
> URL: https://issues.apache.org/jira/browse/FLINK-3542
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Kafka
>Affects Versions: 1.0.0
>Reporter: Till Rohrmann
>Priority: Minor
> Labels: stale-minor
>
> The current {{FlinkKafkaConsumer09}} cannot handle increasing the number of
> partitions of a topic while running. The consumer will simply leave the newly
> created partitions out and thus miss all data which is written to the new
> partitions. The reason seems to be a static assignment of partitions to
> consumer tasks when the job is started.
> We should either fix this behaviour or clearly document it in the online and
> code docs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-3542) FlinkKafkaConsumer09 cannot handle changing number of partitions
[
https://issues.apache.org/jira/browse/FLINK-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162054#comment-16162054
]
Hai Zhou commented on FLINK-3542:
-
[~till.rohrmann]
In flink 1.3.x, FlinkKafkaConsumer08 also have this problem ?
> FlinkKafkaConsumer09 cannot handle changing number of partitions
>
>
> Key: FLINK-3542
> URL: https://issues.apache.org/jira/browse/FLINK-3542
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
>Affects Versions: 1.0.0
>Reporter: Till Rohrmann
>Priority: Minor
>
> The current {{FlinkKafkaConsumer09}} cannot handle increasing the number of
> partitions of a topic while running. The consumer will simply leave the newly
> created partitions out and thus miss all data which is written to the new
> partitions. The reason seems to be a static assignment of partitions to
> consumer tasks when the job is started.
> We should either fix this behaviour or clearly document it in the online and
> code docs.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
