[jira] [Updated] (KAFKA-15548) Handling close() properly
[
https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kirk True updated KAFKA-15548:
--
Component/s: clients
> Handling close() properly
> -
>
> Key: KAFKA-15548
> URL: https://issues.apache.org/jira/browse/KAFKA-15548
> Project: Kafka
> Issue Type: Sub-task
> Components: clients, consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
> Labels: consumer-threading-refactor, kip-848,
> kip-848-client-support, kip-848-e2e, kip-848-preview
>
> Upon closing of the {{Consumer}} we need to:
> # Complete pending commits
> # Revoke assignment (Note that the revocation involves stop fetching,
> committing offsets if auto-commit enabled and invoking the
> onPartitionsRevoked callback)
> # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
> group (or -2 if static member)
> # Close any fetch sessions on the brokers
> # Poll the NetworkClient to complete pending I/O
> There is a mechanism introduced in PR
> [14406|https://github.com/apache/kafka/pull/14406] that allows for performing
> network I/O on shutdown. The new method
> {{DefaultBackgroundThread.runAtClose()}} will be executed when
> {{Consumer.close()}} is invoked.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (KAFKA-15548) Handling close() properly
[
https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lianet Magrans updated KAFKA-15548:
---
Description:
Upon closing of the {{Consumer}} we need to:
# Complete pending commits
# Revoke assignment (Note that the revocation involves stop fetching,
committing offsets if auto-commit enabled and invoking the onPartitionsRevoked
callback)
# Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
group (or -2 if static member)
# Close any fetch sessions on the brokers
# Poll the NetworkClient to complete pending I/O
There is a mechanism introduced in PR
[14406|https://github.com/apache/kafka/pull/14406] that allows for performing
network I/O on shutdown. The new method
{{DefaultBackgroundThread.runAtClose()}} will be executed when
{{Consumer.close()}} is invoked.
was:
Upon closing of the {{Consumer}} we need to:
# Complete pending commits
# Auto-commit if needed
# Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
group (or -2 if static member)
# Close any fetch sessions on the brokers
# Poll the NetworkClient to complete pending I/O
There is a mechanism introduced in PR
[14406|https://github.com/apache/kafka/pull/14406] that allows for performing
network I/O on shutdown. The new method
{{DefaultBackgroundThread.runAtClose()}} will be executed when
{{Consumer.close()}} is invoked.
> Handling close() properly
> -
>
> Key: KAFKA-15548
> URL: https://issues.apache.org/jira/browse/KAFKA-15548
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
> Labels: consumer-threading-refactor, kip-848,
> kip-848-client-support, kip-848-e2e, kip-848-preview
>
> Upon closing of the {{Consumer}} we need to:
> # Complete pending commits
> # Revoke assignment (Note that the revocation involves stop fetching,
> committing offsets if auto-commit enabled and invoking the
> onPartitionsRevoked callback)
> # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
> group (or -2 if static member)
> # Close any fetch sessions on the brokers
> # Poll the NetworkClient to complete pending I/O
> There is a mechanism introduced in PR
> [14406|https://github.com/apache/kafka/pull/14406] that allows for performing
> network I/O on shutdown. The new method
> {{DefaultBackgroundThread.runAtClose()}} will be executed when
> {{Consumer.close()}} is invoked.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (KAFKA-15548) Handling close() properly
[
https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lianet Magrans updated KAFKA-15548:
---
Description:
Upon closing of the {{Consumer}} we need to:
# Complete pending commits
# Auto-commit if needed
# Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
group (or -2 if static member)
# Close any fetch sessions on the brokers
# Poll the NetworkClient to complete pending I/O
There is a mechanism introduced in PR
[14406|https://github.com/apache/kafka/pull/14406] that allows for performing
network I/O on shutdown. The new method
{{DefaultBackgroundThread.runAtClose()}} will be executed when
{{Consumer.close()}} is invoked.
was:
Upon closing of the {{Consumer}} we need to:
# Complete pending commits
# Auto-commit if needed
# Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
group
# Close any fetch sessions on the brokers
# Poll the NetworkClient to complete pending I/O
There is a mechanism introduced in PR
[14406|https://github.com/apache/kafka/pull/14406] that allows for performing
network I/O on shutdown. The new method
{{DefaultBackgroundThread.runAtClose()}} will be executed when
{{Consumer.close()}} is invoked.
> Handling close() properly
> -
>
> Key: KAFKA-15548
> URL: https://issues.apache.org/jira/browse/KAFKA-15548
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
> Labels: consumer-threading-refactor, kip-848,
> kip-848-client-support, kip-848-e2e, kip-848-preview
>
> Upon closing of the {{Consumer}} we need to:
> # Complete pending commits
> # Auto-commit if needed
> # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
> group (or -2 if static member)
> # Close any fetch sessions on the brokers
> # Poll the NetworkClient to complete pending I/O
> There is a mechanism introduced in PR
> [14406|https://github.com/apache/kafka/pull/14406] that allows for performing
> network I/O on shutdown. The new method
> {{DefaultBackgroundThread.runAtClose()}} will be executed when
> {{Consumer.close()}} is invoked.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (KAFKA-15548) Handling close() properly
[
https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philip Nee updated KAFKA-15548:
---
Labels: consumer-threading-refactor kip-848 kip-848-client-support
kip-848-e2e kip-848-preview (was: consumer-threading-refactor kip-848
kip-848-client-support kip-848-preview)
> Handling close() properly
> -
>
> Key: KAFKA-15548
> URL: https://issues.apache.org/jira/browse/KAFKA-15548
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
> Labels: consumer-threading-refactor, kip-848,
> kip-848-client-support, kip-848-e2e, kip-848-preview
>
> Upon closing of the {{Consumer}} we need to:
> # Complete pending commits
> # Auto-commit if needed
> # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
> group
> # Close any fetch sessions on the brokers
> # Poll the NetworkClient to complete pending I/O
> There is a mechanism introduced in PR
> [14406|https://github.com/apache/kafka/pull/14406] that allows for performing
> network I/O on shutdown. The new method
> {{DefaultBackgroundThread.runAtClose()}} will be executed when
> {{Consumer.close()}} is invoked.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (KAFKA-15548) Handling close() properly
[
https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Ding updated KAFKA-15548:
Labels: consumer-threading-refactor kip-848 kip-848-client-support
kip-848-preview (was: consumer-threading-refactor kip-)
> Handling close() properly
> -
>
> Key: KAFKA-15548
> URL: https://issues.apache.org/jira/browse/KAFKA-15548
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
> Labels: consumer-threading-refactor, kip-848,
> kip-848-client-support, kip-848-preview
>
> Upon closing of the {{Consumer}} we need to:
> # Complete pending commits
> # Auto-commit if needed
> # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
> group
> # Close any fetch sessions on the brokers
> # Poll the NetworkClient to complete pending I/O
> There is a mechanism introduced in PR
> [14406|https://github.com/apache/kafka/pull/14406] that allows for performing
> network I/O on shutdown. The new method
> {{DefaultBackgroundThread.runAtClose()}} will be executed when
> {{Consumer.close()}} is invoked.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (KAFKA-15548) Handling close() properly
[
https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Ding updated KAFKA-15548:
Labels: consumer-threading-refactor kip- (was: consumer-threading-refactor)
> Handling close() properly
> -
>
> Key: KAFKA-15548
> URL: https://issues.apache.org/jira/browse/KAFKA-15548
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
> Labels: consumer-threading-refactor, kip-
>
> Upon closing of the {{Consumer}} we need to:
> # Complete pending commits
> # Auto-commit if needed
> # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
> group
> # Close any fetch sessions on the brokers
> # Poll the NetworkClient to complete pending I/O
> There is a mechanism introduced in PR
> [14406|https://github.com/apache/kafka/pull/14406] that allows for performing
> network I/O on shutdown. The new method
> {{DefaultBackgroundThread.runAtClose()}} will be executed when
> {{Consumer.close()}} is invoked.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (KAFKA-15548) Handling close() properly
[
https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kirk True updated KAFKA-15548:
--
Description:
Upon closing of the {{Consumer}} we need to:
# Complete pending commits
# Auto-commit if needed
# Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
group
# Close any fetch sessions on the brokers
# Poll the NetworkClient to complete pending I/O
There is a mechanism introduced in PR
[14406|https://github.com/apache/kafka/pull/14406] that allows for performing
network I/O on shutdown. The new method
{{DefaultBackgroundThread.runAtClose()}} will be executed when
{{Consumer.close()}} is invoked.
was:
Upon closing we need to:
# Complete pending commits
# Auto-commit if needed
# Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
group
# poll the NetworkClient to complete pending I/O
> Handling close() properly
> -
>
> Key: KAFKA-15548
> URL: https://issues.apache.org/jira/browse/KAFKA-15548
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
>Reporter: Philip Nee
>Assignee: Philip Nee
>Priority: Major
> Labels: consumer-threading-refactor
>
> Upon closing of the {{Consumer}} we need to:
> # Complete pending commits
> # Auto-commit if needed
> # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the
> group
> # Close any fetch sessions on the brokers
> # Poll the NetworkClient to complete pending I/O
> There is a mechanism introduced in PR
> [14406|https://github.com/apache/kafka/pull/14406] that allows for performing
> network I/O on shutdown. The new method
> {{DefaultBackgroundThread.runAtClose()}} will be executed when
> {{Consumer.close()}} is invoked.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (KAFKA-15548) Handling close() properly
[ https://issues.apache.org/jira/browse/KAFKA-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee updated KAFKA-15548: --- Parent: KAFKA-14246 Issue Type: Sub-task (was: Bug) > Handling close() properly > - > > Key: KAFKA-15548 > URL: https://issues.apache.org/jira/browse/KAFKA-15548 > Project: Kafka > Issue Type: Sub-task > Components: consumer >Reporter: Philip Nee >Assignee: Philip Nee >Priority: Major > Labels: consumer-threading-refactor > > Upon closing we need to: > # Complete pending commits > # Auto-commit if needed > # Send the last GroupConsumerHeartbeatRequest with epoch = -1 to leave the > group > # poll the NetworkClient to complete pending I/O -- This message was sent by Atlassian Jira (v8.20.10#820010)
