momo-jun commented on code in PR #643: URL: https://github.com/apache/pulsar-site/pull/643#discussion_r1266826137
########## release-notes/versioned/pulsar-2.11.2.md: ########## @@ -0,0 +1,117 @@ +--- +id: pulsar-2.11.2 +title: Apache Pulsar 2.11.2 +sidebar_label: Apache Pulsar 2.11.2 +--- + +#### 2023-07-18 + +### Broker +- Fix broker restart logic [#20113](https://github.com/apache/pulsar/pull/20113) +- Fast fix infinite HTTP call getSubscriptions caused by wrong topicName [#20131](https://github.com/apache/pulsar/pull/20131) +- Fix getPartitionedStats miss subscription's messageAckRate [#19870](https://github.com/apache/pulsar/pull/19870) +- Fix deadlock of zkSessionWatcher when zkConnection loss [#20122](https://github.com/apache/pulsar/pull/20122) +- Fix Return value of getPartitionedStats doesn't contain subscription type [#20210](https://github.com/apache/pulsar/pull/20210) +- Producer created by replicator is not displayed in topic stats [#20229](https://github.com/apache/pulsar/pull/20229) +- Fix infinite ack of Replicator after topic is closed [#20232](https://github.com/apache/pulsar/pull/20232) +- Skip split bundle if only one broker [#20190](https://github.com/apache/pulsar/pull/20190) +- Fix RoaringBitmap.contains can't check value 65535 [#20176](https://github.com/apache/pulsar/pull/20176) +- Get lowest PositionImpl from NavigableSet [#18278](https://github.com/apache/pulsar/pull/18278) +- Fix the behavior of delayed message in Key_Shared mode [#20233](https://github.com/apache/pulsar/pull/20233) +- Fix use error TimeUnit to record publish latency [#20074](https://github.com/apache/pulsar/pull/20074) +- Fix the thread safety issue of BrokerData#getTimeAverageData access [#19889](https://github.com/apache/pulsar/pull/19889) +- Fix can't send ErrorCommand when message is null value [#19899](https://github.com/apache/pulsar/pull/19899) +- Make LedgerOffloaderFactory can load the old nar [#19913](https://github.com/apache/pulsar/pull/19913) +- Ignore and remove the replicator cursor when the remote cluster is absent [#19972](https://github.com/apache/pulsar/pull/19972) +- Fix the reason label of authentication metrics [#20030](https://github.com/apache/pulsar/pull/20030) +- Optimize the ack/send future in TransactionImpl [#20271](https://github.com/apache/pulsar/pull/20271) +- Fix NPE cause by topic publish rate limiter [#20302](https://github.com/apache/pulsar/pull/20302) +- Fix default bundle size used while setting bookie affinity [#20250](https://github.com/apache/pulsar/pull/20250) +- Fix ledger left in OPEN state when enable inactiveLedgerRollOverTimeMs [#20276](https://github.com/apache/pulsar/pull/20276) +- Fix deadlock of metadata store [#20189](https://github.com/apache/pulsar/pull/20189) +- Fix class name typo PrecisPublishLimiter to "Precise" [#20310](https://github.com/apache/pulsar/pull/20310) +- Fix consume stuck of shared streaming dispatcher [#18315](https://github.com/apache/pulsar/pull/18315) +- Fix entry filter feature for the non-persistent topic [#20141](https://github.com/apache/pulsar/pull/20141) +- Fix partitioned __change_events topic is policy topic [#20392](https://github.com/apache/pulsar/pull/20392) +- If ledger lost, cursor mark delete position can not forward [#18620](https://github.com/apache/pulsar/pull/18620) +- Invalidate metadata children cache after key deleted [#20363](https://github.com/apache/pulsar/pull/20363) +- Avoid PersistentSubscription.expireMessages logic check backlog twice [#20416](https://github.com/apache/pulsar/pull/20416) +- Switch to the metadata store thread after zk operation [#20303](https://github.com/apache/pulsar/pull/20303) +- Fix skip message API when hole messages exists [#20326](https://github.com/apache/pulsar/pull/20326) +- Do not filter system topic while shedding [#18949](https://github.com/apache/pulsar/pull/18949) +- Restore solution for certain topic unloading race conditions [#20527](https://github.com/apache/pulsar/pull/20527) +- There are two same-named managed ledgers in the one broker [#18688](https://github.com/apache/pulsar/pull/18688) +- REST Client Producer fails with TLS only [#20535](https://github.com/apache/pulsar/pull/20535) +- Save createIfMissing in TopicLoadingContext [#19993](https://github.com/apache/pulsar/pull/19993) +- Unwrap the completion exception [#20396](https://github.com/apache/pulsar/pull/20396) +- Release orphan replicator after topic closed [#20582](https://github.com/apache/pulsar/pull/20582) +- Fix the publish latency spike issue with large number of producers [#20607](https://github.com/apache/pulsar/pull/20607) +- Support cgroup v2 by using jdk.internal.platform.Metrics in Pulsar Loadbalancer [#16832](https://github.com/apache/pulsar/pull/16832) +- Validate authz earlier in delete subscription logic [#20549](https://github.com/apache/pulsar/pull/20549) +- Fix the publish latency spike from the contention of MessageDeduplication [#20647](https://github.com/apache/pulsar/pull/20647) +- Adding the missed bookie id in the registration manager [#20641](https://github.com/apache/pulsar/pull/20641) +- Fix NPE when reset Replicator's cursor by position [#20597](https://github.com/apache/pulsar/pull/20597) +- Topic policy can not be work well if replay policy message has any exception [#20613](https://github.com/apache/pulsar/pull/20613) +- Bookie Info lost by notification race condition [#20642](https://github.com/apache/pulsar/pull/20642) +- Update new bundle-range to policies after bundle split [#17797](https://github.com/apache/pulsar/pull/17797) +- Fix consumer can receive aborted txn message when readType is replay [#19815](https://github.com/apache/pulsar/pull/19815) +- Fix return the earliest position when query position by timestamp [#20457](https://github.com/apache/pulsar/pull/20457) + +### Clients +- [Java] Use scheduled executor in BinaryProtoLookupService [#20043](https://github.com/apache/pulsar/pull/20043) +- [Java] Release the orphan producers after the primary consumer is closed [#19858](https://github.com/apache/pulsar/pull/19858) +- [Java] Fix NPE when acknowledging multiple messages [#19874](https://github.com/apache/pulsar/pull/19874) +- [Java] Cache empty schema version in ProducerImpl schemaCache [#19929](https://github.com/apache/pulsar/pull/19929) +- [Java] Fix where the function getMsgNumInReceiverQueue always returns 0 when using message listener [#20245](https://github.com/apache/pulsar/pull/20245) +- [Java] Fix deadlock issue of consumer while using multiple IO threads [#20669](https://github.com/apache/pulsar/pull/20669) +- [Java] Make the whole grabCnx() progress atomic [#20595](https://github.com/apache/pulsar/pull/20595) +- [Java] Messages lost when consumer reconnect [#20695](https://github.com/apache/pulsar/pull/20695) + +### Pulsar IO and Pulsar Functions +- [Functions] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom SerDe classes [#20115](https://github.com/apache/pulsar/pull/20115) +- [Functions] Make pulsar-admin support update py/go with package url [#19897](https://github.com/apache/pulsar/pull/19897) +- [Functions] Fix JavaInstanceStarter inferring type class name error [#20426](https://github.com/apache/pulsar/pull/20426) +- [Functions] Go functions must retrieve consumers by non-partitioned topic ID [#20413](https://github.com/apache/pulsar/pull/20413) +- [Functions] Fix function update error [#19895](https://github.com/apache/pulsar/pull/19895) +- [Functions] Reset idle timer correctly #20450 [#20450](https://github.com/apache/pulsar/pull/20450) +- [Functions] Go functions need to use static grpcPort in k8s runtime [#20404](https://github.com/apache/pulsar/pull/20404) +- [Functions] Configure pulsar admin for TLS [#20533](https://github.com/apache/pulsar/pull/20533) +- [Functions] Make KubernetesRuntime translate characters in function tenant, namespace, and name during function removal to avoid label errors [#19584](https://github.com/apache/pulsar/pull/19584) +- [Functions] Exit JVM when main thread throws exception [#20689](https://github.com/apache/pulsar/pull/20689) +- [IO Connector] Close the kafka source connector if there is uncaught exception [#20480](https://github.com/apache/pulsar/pull/20480) +- [IO Connector] Close the kafka source connector got stuck [#20698](https://github.com/apache/pulsar/pull/20698) + +### Observability +- [Broker] Fix the partitioned publisher topic stat aggregation bug [#18807](https://github.com/apache/pulsar/pull/18807) +- [Broker] Fix topic with double quote breaks the prometheus format [#20230](https://github.com/apache/pulsar/pull/20230) +- [Broker] Add JVM start time metric [#20381](https://github.com/apache/pulsar/pull/20381) +- [Offload] Fix offload metrics error [#20366](https://github.com/apache/pulsar/pull/20366) + +### CLI +- [CLI] Allow pulser-client consume create a replicated subscription [#20316](https://github.com/apache/pulsar/pull/20316) Review Comment: ```suggestion - [CLI] Allow pulser-client consumer to create a replicated subscription [#20316](https://github.com/apache/pulsar/pull/20316) ``` ########## release-notes/versioned/pulsar-2.11.2.md: ########## @@ -0,0 +1,117 @@ +--- +id: pulsar-2.11.2 +title: Apache Pulsar 2.11.2 +sidebar_label: Apache Pulsar 2.11.2 +--- + +#### 2023-07-18 + +### Broker +- Fix broker restart logic [#20113](https://github.com/apache/pulsar/pull/20113) +- Fast fix infinite HTTP call getSubscriptions caused by wrong topicName [#20131](https://github.com/apache/pulsar/pull/20131) +- Fix getPartitionedStats miss subscription's messageAckRate [#19870](https://github.com/apache/pulsar/pull/19870) +- Fix deadlock of zkSessionWatcher when zkConnection loss [#20122](https://github.com/apache/pulsar/pull/20122) +- Fix Return value of getPartitionedStats doesn't contain subscription type [#20210](https://github.com/apache/pulsar/pull/20210) +- Producer created by replicator is not displayed in topic stats [#20229](https://github.com/apache/pulsar/pull/20229) +- Fix infinite ack of Replicator after topic is closed [#20232](https://github.com/apache/pulsar/pull/20232) +- Skip split bundle if only one broker [#20190](https://github.com/apache/pulsar/pull/20190) +- Fix RoaringBitmap.contains can't check value 65535 [#20176](https://github.com/apache/pulsar/pull/20176) +- Get lowest PositionImpl from NavigableSet [#18278](https://github.com/apache/pulsar/pull/18278) +- Fix the behavior of delayed message in Key_Shared mode [#20233](https://github.com/apache/pulsar/pull/20233) +- Fix use error TimeUnit to record publish latency [#20074](https://github.com/apache/pulsar/pull/20074) +- Fix the thread safety issue of BrokerData#getTimeAverageData access [#19889](https://github.com/apache/pulsar/pull/19889) +- Fix can't send ErrorCommand when message is null value [#19899](https://github.com/apache/pulsar/pull/19899) +- Make LedgerOffloaderFactory can load the old nar [#19913](https://github.com/apache/pulsar/pull/19913) +- Ignore and remove the replicator cursor when the remote cluster is absent [#19972](https://github.com/apache/pulsar/pull/19972) +- Fix the reason label of authentication metrics [#20030](https://github.com/apache/pulsar/pull/20030) +- Optimize the ack/send future in TransactionImpl [#20271](https://github.com/apache/pulsar/pull/20271) +- Fix NPE cause by topic publish rate limiter [#20302](https://github.com/apache/pulsar/pull/20302) +- Fix default bundle size used while setting bookie affinity [#20250](https://github.com/apache/pulsar/pull/20250) +- Fix ledger left in OPEN state when enable inactiveLedgerRollOverTimeMs [#20276](https://github.com/apache/pulsar/pull/20276) +- Fix deadlock of metadata store [#20189](https://github.com/apache/pulsar/pull/20189) +- Fix class name typo PrecisPublishLimiter to "Precise" [#20310](https://github.com/apache/pulsar/pull/20310) +- Fix consume stuck of shared streaming dispatcher [#18315](https://github.com/apache/pulsar/pull/18315) +- Fix entry filter feature for the non-persistent topic [#20141](https://github.com/apache/pulsar/pull/20141) +- Fix partitioned __change_events topic is policy topic [#20392](https://github.com/apache/pulsar/pull/20392) +- If ledger lost, cursor mark delete position can not forward [#18620](https://github.com/apache/pulsar/pull/18620) +- Invalidate metadata children cache after key deleted [#20363](https://github.com/apache/pulsar/pull/20363) +- Avoid PersistentSubscription.expireMessages logic check backlog twice [#20416](https://github.com/apache/pulsar/pull/20416) +- Switch to the metadata store thread after zk operation [#20303](https://github.com/apache/pulsar/pull/20303) +- Fix skip message API when hole messages exists [#20326](https://github.com/apache/pulsar/pull/20326) +- Do not filter system topic while shedding [#18949](https://github.com/apache/pulsar/pull/18949) +- Restore solution for certain topic unloading race conditions [#20527](https://github.com/apache/pulsar/pull/20527) +- There are two same-named managed ledgers in the one broker [#18688](https://github.com/apache/pulsar/pull/18688) +- REST Client Producer fails with TLS only [#20535](https://github.com/apache/pulsar/pull/20535) +- Save createIfMissing in TopicLoadingContext [#19993](https://github.com/apache/pulsar/pull/19993) +- Unwrap the completion exception [#20396](https://github.com/apache/pulsar/pull/20396) +- Release orphan replicator after topic closed [#20582](https://github.com/apache/pulsar/pull/20582) +- Fix the publish latency spike issue with large number of producers [#20607](https://github.com/apache/pulsar/pull/20607) +- Support cgroup v2 by using jdk.internal.platform.Metrics in Pulsar Loadbalancer [#16832](https://github.com/apache/pulsar/pull/16832) +- Validate authz earlier in delete subscription logic [#20549](https://github.com/apache/pulsar/pull/20549) +- Fix the publish latency spike from the contention of MessageDeduplication [#20647](https://github.com/apache/pulsar/pull/20647) +- Adding the missed bookie id in the registration manager [#20641](https://github.com/apache/pulsar/pull/20641) +- Fix NPE when reset Replicator's cursor by position [#20597](https://github.com/apache/pulsar/pull/20597) +- Topic policy can not be work well if replay policy message has any exception [#20613](https://github.com/apache/pulsar/pull/20613) +- Bookie Info lost by notification race condition [#20642](https://github.com/apache/pulsar/pull/20642) +- Update new bundle-range to policies after bundle split [#17797](https://github.com/apache/pulsar/pull/17797) +- Fix consumer can receive aborted txn message when readType is replay [#19815](https://github.com/apache/pulsar/pull/19815) +- Fix return the earliest position when query position by timestamp [#20457](https://github.com/apache/pulsar/pull/20457) + +### Clients +- [Java] Use scheduled executor in BinaryProtoLookupService [#20043](https://github.com/apache/pulsar/pull/20043) +- [Java] Release the orphan producers after the primary consumer is closed [#19858](https://github.com/apache/pulsar/pull/19858) +- [Java] Fix NPE when acknowledging multiple messages [#19874](https://github.com/apache/pulsar/pull/19874) +- [Java] Cache empty schema version in ProducerImpl schemaCache [#19929](https://github.com/apache/pulsar/pull/19929) +- [Java] Fix where the function getMsgNumInReceiverQueue always returns 0 when using message listener [#20245](https://github.com/apache/pulsar/pull/20245) +- [Java] Fix deadlock issue of consumer while using multiple IO threads [#20669](https://github.com/apache/pulsar/pull/20669) +- [Java] Make the whole grabCnx() progress atomic [#20595](https://github.com/apache/pulsar/pull/20595) +- [Java] Messages lost when consumer reconnect [#20695](https://github.com/apache/pulsar/pull/20695) + +### Pulsar IO and Pulsar Functions +- [Functions] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom SerDe classes [#20115](https://github.com/apache/pulsar/pull/20115) +- [Functions] Make pulsar-admin support update py/go with package url [#19897](https://github.com/apache/pulsar/pull/19897) +- [Functions] Fix JavaInstanceStarter inferring type class name error [#20426](https://github.com/apache/pulsar/pull/20426) +- [Functions] Go functions must retrieve consumers by non-partitioned topic ID [#20413](https://github.com/apache/pulsar/pull/20413) +- [Functions] Fix function update error [#19895](https://github.com/apache/pulsar/pull/19895) +- [Functions] Reset idle timer correctly #20450 [#20450](https://github.com/apache/pulsar/pull/20450) +- [Functions] Go functions need to use static grpcPort in k8s runtime [#20404](https://github.com/apache/pulsar/pull/20404) +- [Functions] Configure pulsar admin for TLS [#20533](https://github.com/apache/pulsar/pull/20533) +- [Functions] Make KubernetesRuntime translate characters in function tenant, namespace, and name during function removal to avoid label errors [#19584](https://github.com/apache/pulsar/pull/19584) +- [Functions] Exit JVM when main thread throws exception [#20689](https://github.com/apache/pulsar/pull/20689) +- [IO Connector] Close the kafka source connector if there is uncaught exception [#20480](https://github.com/apache/pulsar/pull/20480) +- [IO Connector] Close the kafka source connector got stuck [#20698](https://github.com/apache/pulsar/pull/20698) + +### Observability +- [Broker] Fix the partitioned publisher topic stat aggregation bug [#18807](https://github.com/apache/pulsar/pull/18807) +- [Broker] Fix topic with double quote breaks the prometheus format [#20230](https://github.com/apache/pulsar/pull/20230) +- [Broker] Add JVM start time metric [#20381](https://github.com/apache/pulsar/pull/20381) +- [Offload] Fix offload metrics error [#20366](https://github.com/apache/pulsar/pull/20366) + +### CLI +- [CLI] Allow pulser-client consume create a replicated subscription [#20316](https://github.com/apache/pulsar/pull/20316) +- [CLI] Update nar maven plugin version to fix excessive downloads [#20410](https://github.com/apache/pulsar/pull/20410) +- [CLI] Speed up OWASP dependency check in Pulsar CI workflow [#20412](https://github.com/apache/pulsar/pull/20412) +- [CLI] Fulfill add-opens to function-localrunner also [#20417](https://github.com/apache/pulsar/pull/20417) +- [Admin] Return BAD_REQUEST on cluster data is null for createCluster [#20346](https://github.com/apache/pulsar/pull/20346) +- [Admin] Report earliest msg in partitioned backlog [#19465](https://github.com/apache/pulsar/pull/19465) + +### Others +- [Build] Duplicate entry when merging services [#17659](https://github.com/apache/pulsar/pull/17659) +- [Offload] Use filesystem offloader with class not found error [#20365](https://github.com/apache/pulsar/pull/20365) +- [Perf] PerformanceProducer do not produce expected number of messages [#19775](https://github.com/apache/pulsar/pull/19775) Review Comment: ```suggestion - [Perf] PerformanceProducer does not produce the expected number of messages [#19775](https://github.com/apache/pulsar/pull/19775) ``` ########## release-notes/versioned/pulsar-2.11.2.md: ########## @@ -0,0 +1,117 @@ +--- +id: pulsar-2.11.2 +title: Apache Pulsar 2.11.2 +sidebar_label: Apache Pulsar 2.11.2 +--- + +#### 2023-07-18 + +### Broker +- Fix broker restart logic [#20113](https://github.com/apache/pulsar/pull/20113) +- Fast fix infinite HTTP call getSubscriptions caused by wrong topicName [#20131](https://github.com/apache/pulsar/pull/20131) +- Fix getPartitionedStats miss subscription's messageAckRate [#19870](https://github.com/apache/pulsar/pull/19870) +- Fix deadlock of zkSessionWatcher when zkConnection loss [#20122](https://github.com/apache/pulsar/pull/20122) +- Fix Return value of getPartitionedStats doesn't contain subscription type [#20210](https://github.com/apache/pulsar/pull/20210) +- Producer created by replicator is not displayed in topic stats [#20229](https://github.com/apache/pulsar/pull/20229) +- Fix infinite ack of Replicator after topic is closed [#20232](https://github.com/apache/pulsar/pull/20232) +- Skip split bundle if only one broker [#20190](https://github.com/apache/pulsar/pull/20190) +- Fix RoaringBitmap.contains can't check value 65535 [#20176](https://github.com/apache/pulsar/pull/20176) +- Get lowest PositionImpl from NavigableSet [#18278](https://github.com/apache/pulsar/pull/18278) +- Fix the behavior of delayed message in Key_Shared mode [#20233](https://github.com/apache/pulsar/pull/20233) +- Fix use error TimeUnit to record publish latency [#20074](https://github.com/apache/pulsar/pull/20074) +- Fix the thread safety issue of BrokerData#getTimeAverageData access [#19889](https://github.com/apache/pulsar/pull/19889) +- Fix can't send ErrorCommand when message is null value [#19899](https://github.com/apache/pulsar/pull/19899) +- Make LedgerOffloaderFactory can load the old nar [#19913](https://github.com/apache/pulsar/pull/19913) +- Ignore and remove the replicator cursor when the remote cluster is absent [#19972](https://github.com/apache/pulsar/pull/19972) +- Fix the reason label of authentication metrics [#20030](https://github.com/apache/pulsar/pull/20030) +- Optimize the ack/send future in TransactionImpl [#20271](https://github.com/apache/pulsar/pull/20271) +- Fix NPE cause by topic publish rate limiter [#20302](https://github.com/apache/pulsar/pull/20302) +- Fix default bundle size used while setting bookie affinity [#20250](https://github.com/apache/pulsar/pull/20250) +- Fix ledger left in OPEN state when enable inactiveLedgerRollOverTimeMs [#20276](https://github.com/apache/pulsar/pull/20276) +- Fix deadlock of metadata store [#20189](https://github.com/apache/pulsar/pull/20189) +- Fix class name typo PrecisPublishLimiter to "Precise" [#20310](https://github.com/apache/pulsar/pull/20310) +- Fix consume stuck of shared streaming dispatcher [#18315](https://github.com/apache/pulsar/pull/18315) +- Fix entry filter feature for the non-persistent topic [#20141](https://github.com/apache/pulsar/pull/20141) +- Fix partitioned __change_events topic is policy topic [#20392](https://github.com/apache/pulsar/pull/20392) +- If ledger lost, cursor mark delete position can not forward [#18620](https://github.com/apache/pulsar/pull/18620) +- Invalidate metadata children cache after key deleted [#20363](https://github.com/apache/pulsar/pull/20363) +- Avoid PersistentSubscription.expireMessages logic check backlog twice [#20416](https://github.com/apache/pulsar/pull/20416) +- Switch to the metadata store thread after zk operation [#20303](https://github.com/apache/pulsar/pull/20303) +- Fix skip message API when hole messages exists [#20326](https://github.com/apache/pulsar/pull/20326) +- Do not filter system topic while shedding [#18949](https://github.com/apache/pulsar/pull/18949) +- Restore solution for certain topic unloading race conditions [#20527](https://github.com/apache/pulsar/pull/20527) +- There are two same-named managed ledgers in the one broker [#18688](https://github.com/apache/pulsar/pull/18688) +- REST Client Producer fails with TLS only [#20535](https://github.com/apache/pulsar/pull/20535) +- Save createIfMissing in TopicLoadingContext [#19993](https://github.com/apache/pulsar/pull/19993) +- Unwrap the completion exception [#20396](https://github.com/apache/pulsar/pull/20396) +- Release orphan replicator after topic closed [#20582](https://github.com/apache/pulsar/pull/20582) +- Fix the publish latency spike issue with large number of producers [#20607](https://github.com/apache/pulsar/pull/20607) +- Support cgroup v2 by using jdk.internal.platform.Metrics in Pulsar Loadbalancer [#16832](https://github.com/apache/pulsar/pull/16832) +- Validate authz earlier in delete subscription logic [#20549](https://github.com/apache/pulsar/pull/20549) +- Fix the publish latency spike from the contention of MessageDeduplication [#20647](https://github.com/apache/pulsar/pull/20647) +- Adding the missed bookie id in the registration manager [#20641](https://github.com/apache/pulsar/pull/20641) +- Fix NPE when reset Replicator's cursor by position [#20597](https://github.com/apache/pulsar/pull/20597) +- Topic policy can not be work well if replay policy message has any exception [#20613](https://github.com/apache/pulsar/pull/20613) +- Bookie Info lost by notification race condition [#20642](https://github.com/apache/pulsar/pull/20642) +- Update new bundle-range to policies after bundle split [#17797](https://github.com/apache/pulsar/pull/17797) +- Fix consumer can receive aborted txn message when readType is replay [#19815](https://github.com/apache/pulsar/pull/19815) +- Fix return the earliest position when query position by timestamp [#20457](https://github.com/apache/pulsar/pull/20457) + +### Clients +- [Java] Use scheduled executor in BinaryProtoLookupService [#20043](https://github.com/apache/pulsar/pull/20043) +- [Java] Release the orphan producers after the primary consumer is closed [#19858](https://github.com/apache/pulsar/pull/19858) +- [Java] Fix NPE when acknowledging multiple messages [#19874](https://github.com/apache/pulsar/pull/19874) +- [Java] Cache empty schema version in ProducerImpl schemaCache [#19929](https://github.com/apache/pulsar/pull/19929) +- [Java] Fix where the function getMsgNumInReceiverQueue always returns 0 when using message listener [#20245](https://github.com/apache/pulsar/pull/20245) +- [Java] Fix deadlock issue of consumer while using multiple IO threads [#20669](https://github.com/apache/pulsar/pull/20669) +- [Java] Make the whole grabCnx() progress atomic [#20595](https://github.com/apache/pulsar/pull/20595) +- [Java] Messages lost when consumer reconnect [#20695](https://github.com/apache/pulsar/pull/20695) + +### Pulsar IO and Pulsar Functions +- [Functions] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom SerDe classes [#20115](https://github.com/apache/pulsar/pull/20115) +- [Functions] Make pulsar-admin support update py/go with package url [#19897](https://github.com/apache/pulsar/pull/19897) +- [Functions] Fix JavaInstanceStarter inferring type class name error [#20426](https://github.com/apache/pulsar/pull/20426) +- [Functions] Go functions must retrieve consumers by non-partitioned topic ID [#20413](https://github.com/apache/pulsar/pull/20413) +- [Functions] Fix function update error [#19895](https://github.com/apache/pulsar/pull/19895) +- [Functions] Reset idle timer correctly #20450 [#20450](https://github.com/apache/pulsar/pull/20450) +- [Functions] Go functions need to use static grpcPort in k8s runtime [#20404](https://github.com/apache/pulsar/pull/20404) +- [Functions] Configure pulsar admin for TLS [#20533](https://github.com/apache/pulsar/pull/20533) +- [Functions] Make KubernetesRuntime translate characters in function tenant, namespace, and name during function removal to avoid label errors [#19584](https://github.com/apache/pulsar/pull/19584) +- [Functions] Exit JVM when main thread throws exception [#20689](https://github.com/apache/pulsar/pull/20689) +- [IO Connector] Close the kafka source connector if there is uncaught exception [#20480](https://github.com/apache/pulsar/pull/20480) +- [IO Connector] Close the kafka source connector got stuck [#20698](https://github.com/apache/pulsar/pull/20698) + +### Observability +- [Broker] Fix the partitioned publisher topic stat aggregation bug [#18807](https://github.com/apache/pulsar/pull/18807) +- [Broker] Fix topic with double quote breaks the prometheus format [#20230](https://github.com/apache/pulsar/pull/20230) +- [Broker] Add JVM start time metric [#20381](https://github.com/apache/pulsar/pull/20381) +- [Offload] Fix offload metrics error [#20366](https://github.com/apache/pulsar/pull/20366) + +### CLI +- [CLI] Allow pulser-client consume create a replicated subscription [#20316](https://github.com/apache/pulsar/pull/20316) +- [CLI] Update nar maven plugin version to fix excessive downloads [#20410](https://github.com/apache/pulsar/pull/20410) +- [CLI] Speed up OWASP dependency check in Pulsar CI workflow [#20412](https://github.com/apache/pulsar/pull/20412) +- [CLI] Fulfill add-opens to function-localrunner also [#20417](https://github.com/apache/pulsar/pull/20417) +- [Admin] Return BAD_REQUEST on cluster data is null for createCluster [#20346](https://github.com/apache/pulsar/pull/20346) +- [Admin] Report earliest msg in partitioned backlog [#19465](https://github.com/apache/pulsar/pull/19465) + +### Others +- [Build] Duplicate entry when merging services [#17659](https://github.com/apache/pulsar/pull/17659) +- [Offload] Use filesystem offloader with class not found error [#20365](https://github.com/apache/pulsar/pull/20365) +- [Perf] PerformanceProducer do not produce expected number of messages [#19775](https://github.com/apache/pulsar/pull/19775) +- [SQL] Remove useless configuration for Pulsar SQL [#20605](https://github.com/apache/pulsar/pull/20605) +- [WS] Remove unnecessary ping/pong implementation [#20605](https://github.com/apache/pulsar/pull/20733) +- [Schema] Only handle exception when there has [#20730](https://github.com/apache/pulsar/pull/20730) + +### Library updates +- Upgrade snakeyaml version to 2.0 [#20120](https://github.com/apache/pulsar/pull/20120) Review Comment: ```suggestion - Upgrade SnakeYAML version to 2.0 [#20120](https://github.com/apache/pulsar/pull/20120) ``` ########## release-notes/versioned/pulsar-2.11.2.md: ########## @@ -0,0 +1,117 @@ +--- +id: pulsar-2.11.2 +title: Apache Pulsar 2.11.2 +sidebar_label: Apache Pulsar 2.11.2 +--- + +#### 2023-07-18 + +### Broker +- Fix broker restart logic [#20113](https://github.com/apache/pulsar/pull/20113) +- Fast fix infinite HTTP call getSubscriptions caused by wrong topicName [#20131](https://github.com/apache/pulsar/pull/20131) +- Fix getPartitionedStats miss subscription's messageAckRate [#19870](https://github.com/apache/pulsar/pull/19870) +- Fix deadlock of zkSessionWatcher when zkConnection loss [#20122](https://github.com/apache/pulsar/pull/20122) +- Fix Return value of getPartitionedStats doesn't contain subscription type [#20210](https://github.com/apache/pulsar/pull/20210) +- Producer created by replicator is not displayed in topic stats [#20229](https://github.com/apache/pulsar/pull/20229) +- Fix infinite ack of Replicator after topic is closed [#20232](https://github.com/apache/pulsar/pull/20232) +- Skip split bundle if only one broker [#20190](https://github.com/apache/pulsar/pull/20190) +- Fix RoaringBitmap.contains can't check value 65535 [#20176](https://github.com/apache/pulsar/pull/20176) +- Get lowest PositionImpl from NavigableSet [#18278](https://github.com/apache/pulsar/pull/18278) +- Fix the behavior of delayed message in Key_Shared mode [#20233](https://github.com/apache/pulsar/pull/20233) +- Fix use error TimeUnit to record publish latency [#20074](https://github.com/apache/pulsar/pull/20074) +- Fix the thread safety issue of BrokerData#getTimeAverageData access [#19889](https://github.com/apache/pulsar/pull/19889) +- Fix can't send ErrorCommand when message is null value [#19899](https://github.com/apache/pulsar/pull/19899) +- Make LedgerOffloaderFactory can load the old nar [#19913](https://github.com/apache/pulsar/pull/19913) +- Ignore and remove the replicator cursor when the remote cluster is absent [#19972](https://github.com/apache/pulsar/pull/19972) +- Fix the reason label of authentication metrics [#20030](https://github.com/apache/pulsar/pull/20030) +- Optimize the ack/send future in TransactionImpl [#20271](https://github.com/apache/pulsar/pull/20271) +- Fix NPE cause by topic publish rate limiter [#20302](https://github.com/apache/pulsar/pull/20302) +- Fix default bundle size used while setting bookie affinity [#20250](https://github.com/apache/pulsar/pull/20250) +- Fix ledger left in OPEN state when enable inactiveLedgerRollOverTimeMs [#20276](https://github.com/apache/pulsar/pull/20276) +- Fix deadlock of metadata store [#20189](https://github.com/apache/pulsar/pull/20189) +- Fix class name typo PrecisPublishLimiter to "Precise" [#20310](https://github.com/apache/pulsar/pull/20310) +- Fix consume stuck of shared streaming dispatcher [#18315](https://github.com/apache/pulsar/pull/18315) +- Fix entry filter feature for the non-persistent topic [#20141](https://github.com/apache/pulsar/pull/20141) +- Fix partitioned __change_events topic is policy topic [#20392](https://github.com/apache/pulsar/pull/20392) +- If ledger lost, cursor mark delete position can not forward [#18620](https://github.com/apache/pulsar/pull/18620) +- Invalidate metadata children cache after key deleted [#20363](https://github.com/apache/pulsar/pull/20363) +- Avoid PersistentSubscription.expireMessages logic check backlog twice [#20416](https://github.com/apache/pulsar/pull/20416) +- Switch to the metadata store thread after zk operation [#20303](https://github.com/apache/pulsar/pull/20303) +- Fix skip message API when hole messages exists [#20326](https://github.com/apache/pulsar/pull/20326) +- Do not filter system topic while shedding [#18949](https://github.com/apache/pulsar/pull/18949) +- Restore solution for certain topic unloading race conditions [#20527](https://github.com/apache/pulsar/pull/20527) +- There are two same-named managed ledgers in the one broker [#18688](https://github.com/apache/pulsar/pull/18688) +- REST Client Producer fails with TLS only [#20535](https://github.com/apache/pulsar/pull/20535) +- Save createIfMissing in TopicLoadingContext [#19993](https://github.com/apache/pulsar/pull/19993) +- Unwrap the completion exception [#20396](https://github.com/apache/pulsar/pull/20396) +- Release orphan replicator after topic closed [#20582](https://github.com/apache/pulsar/pull/20582) +- Fix the publish latency spike issue with large number of producers [#20607](https://github.com/apache/pulsar/pull/20607) +- Support cgroup v2 by using jdk.internal.platform.Metrics in Pulsar Loadbalancer [#16832](https://github.com/apache/pulsar/pull/16832) +- Validate authz earlier in delete subscription logic [#20549](https://github.com/apache/pulsar/pull/20549) +- Fix the publish latency spike from the contention of MessageDeduplication [#20647](https://github.com/apache/pulsar/pull/20647) +- Adding the missed bookie id in the registration manager [#20641](https://github.com/apache/pulsar/pull/20641) +- Fix NPE when reset Replicator's cursor by position [#20597](https://github.com/apache/pulsar/pull/20597) +- Topic policy can not be work well if replay policy message has any exception [#20613](https://github.com/apache/pulsar/pull/20613) +- Bookie Info lost by notification race condition [#20642](https://github.com/apache/pulsar/pull/20642) +- Update new bundle-range to policies after bundle split [#17797](https://github.com/apache/pulsar/pull/17797) +- Fix consumer can receive aborted txn message when readType is replay [#19815](https://github.com/apache/pulsar/pull/19815) +- Fix return the earliest position when query position by timestamp [#20457](https://github.com/apache/pulsar/pull/20457) + +### Clients +- [Java] Use scheduled executor in BinaryProtoLookupService [#20043](https://github.com/apache/pulsar/pull/20043) +- [Java] Release the orphan producers after the primary consumer is closed [#19858](https://github.com/apache/pulsar/pull/19858) +- [Java] Fix NPE when acknowledging multiple messages [#19874](https://github.com/apache/pulsar/pull/19874) +- [Java] Cache empty schema version in ProducerImpl schemaCache [#19929](https://github.com/apache/pulsar/pull/19929) +- [Java] Fix where the function getMsgNumInReceiverQueue always returns 0 when using message listener [#20245](https://github.com/apache/pulsar/pull/20245) +- [Java] Fix deadlock issue of consumer while using multiple IO threads [#20669](https://github.com/apache/pulsar/pull/20669) +- [Java] Make the whole grabCnx() progress atomic [#20595](https://github.com/apache/pulsar/pull/20595) +- [Java] Messages lost when consumer reconnect [#20695](https://github.com/apache/pulsar/pull/20695) + +### Pulsar IO and Pulsar Functions +- [Functions] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom SerDe classes [#20115](https://github.com/apache/pulsar/pull/20115) +- [Functions] Make pulsar-admin support update py/go with package url [#19897](https://github.com/apache/pulsar/pull/19897) +- [Functions] Fix JavaInstanceStarter inferring type class name error [#20426](https://github.com/apache/pulsar/pull/20426) +- [Functions] Go functions must retrieve consumers by non-partitioned topic ID [#20413](https://github.com/apache/pulsar/pull/20413) +- [Functions] Fix function update error [#19895](https://github.com/apache/pulsar/pull/19895) +- [Functions] Reset idle timer correctly #20450 [#20450](https://github.com/apache/pulsar/pull/20450) +- [Functions] Go functions need to use static grpcPort in k8s runtime [#20404](https://github.com/apache/pulsar/pull/20404) +- [Functions] Configure pulsar admin for TLS [#20533](https://github.com/apache/pulsar/pull/20533) +- [Functions] Make KubernetesRuntime translate characters in function tenant, namespace, and name during function removal to avoid label errors [#19584](https://github.com/apache/pulsar/pull/19584) +- [Functions] Exit JVM when main thread throws exception [#20689](https://github.com/apache/pulsar/pull/20689) +- [IO Connector] Close the kafka source connector if there is uncaught exception [#20480](https://github.com/apache/pulsar/pull/20480) +- [IO Connector] Close the kafka source connector got stuck [#20698](https://github.com/apache/pulsar/pull/20698) + +### Observability +- [Broker] Fix the partitioned publisher topic stat aggregation bug [#18807](https://github.com/apache/pulsar/pull/18807) +- [Broker] Fix topic with double quote breaks the prometheus format [#20230](https://github.com/apache/pulsar/pull/20230) +- [Broker] Add JVM start time metric [#20381](https://github.com/apache/pulsar/pull/20381) +- [Offload] Fix offload metrics error [#20366](https://github.com/apache/pulsar/pull/20366) + +### CLI +- [CLI] Allow pulser-client consume create a replicated subscription [#20316](https://github.com/apache/pulsar/pull/20316) +- [CLI] Update nar maven plugin version to fix excessive downloads [#20410](https://github.com/apache/pulsar/pull/20410) +- [CLI] Speed up OWASP dependency check in Pulsar CI workflow [#20412](https://github.com/apache/pulsar/pull/20412) +- [CLI] Fulfill add-opens to function-localrunner also [#20417](https://github.com/apache/pulsar/pull/20417) +- [Admin] Return BAD_REQUEST on cluster data is null for createCluster [#20346](https://github.com/apache/pulsar/pull/20346) +- [Admin] Report earliest msg in partitioned backlog [#19465](https://github.com/apache/pulsar/pull/19465) + +### Others +- [Build] Duplicate entry when merging services [#17659](https://github.com/apache/pulsar/pull/17659) +- [Offload] Use filesystem offloader with class not found error [#20365](https://github.com/apache/pulsar/pull/20365) +- [Perf] PerformanceProducer do not produce expected number of messages [#19775](https://github.com/apache/pulsar/pull/19775) +- [SQL] Remove useless configuration for Pulsar SQL [#20605](https://github.com/apache/pulsar/pull/20605) +- [WS] Remove unnecessary ping/pong implementation [#20605](https://github.com/apache/pulsar/pull/20733) +- [Schema] Only handle exception when there has [#20730](https://github.com/apache/pulsar/pull/20730) + +### Library updates +- Upgrade snakeyaml version to 2.0 [#20120](https://github.com/apache/pulsar/pull/20120) +- Upgrade Kotlin version from 1.4.32 to 1.8.20 [#20089](https://github.com/apache/pulsar/pull/20089) +- Upgrade the jetty server version to 9.4.51.v20230217 [#20226](https://github.com/apache/pulsar/pull/20226) +- Upgrade sprint version to 5.3.27 [#20226](https://github.com/apache/pulsar/pull/20226) +- Upgrade swagger version to 1.6.10 [#20226](https://github.com/apache/pulsar/pull/20226) +- Upgrade sqlite-jdbc to resolve CVE-2023-32697 [#20411](https://github.com/apache/pulsar/pull/20411) Review Comment: ```suggestion - Upgrade SQLite JDBC to resolve CVE-2023-32697 [#20411](https://github.com/apache/pulsar/pull/20411) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
