[GitHub] [pulsar] merlimat opened a new pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
merlimat opened a new pull request #7406: URL: https://github.com/apache/pulsar/pull/7406 ### Motivation There are few issues with the current implementation of the broker-wide throttling based on max-outstanding bytes in broker that was added in #6178. 1. The current impleme

[GitHub] [pulsar] 97arushisharma commented on issue #7287: Not able to start Pulsar in Standalone mode with Functions-Worker

2020-07-01 Thread GitBox
97arushisharma commented on issue #7287: URL: https://github.com/apache/pulsar/issues/7287#issuecomment-652240553 @tuteng Thanks a lot. It worked. Apparantly, I was not including the `useTls=true` property in `functions_worker.yml` file. Just a question what is the difference between

[GitHub] [pulsar] matejsaravanja commented on issue #6945: Key-based batching and hashingScheme parameter for Python client

2020-07-01 Thread GitBox
matejsaravanja commented on issue #6945: URL: https://github.com/apache/pulsar/issues/6945#issuecomment-652251821 We changed our architecture a bit so key-based batching is not necessary anymore, but before that, creating multiple producers to imitate key-based batching wasn't an option be

[GitHub] [pulsar] fmiguelez commented on issue #4803: Pulsar schema doesn't support null value

2020-07-01 Thread GitBox
fmiguelez commented on issue #4803: URL: https://github.com/apache/pulsar/issues/4803#issuecomment-652252521 @gaoran10, @jiazhai I have opened a new ticket #7407 as indicated This is an automated message from the Apache Git S

[GitHub] [pulsar] fmiguelez opened a new pull request #7408: [Issue 7407] Support for tombstones (null value in messages) does not work

2020-07-01 Thread GitBox
fmiguelez opened a new pull request #7408: URL: https://github.com/apache/pulsar/pull/7408 Added check to prevent NPE when a tombstone (null value) is produced. Master Issue: #7407 ### Motivation *Explain here the context, and why you're making that change. What is t

[GitHub] [pulsar] codelipenghui opened a new pull request #7409: Fix batch ackset recycled multiple times.

2020-07-01 Thread GitBox
codelipenghui opened a new pull request #7409: URL: https://github.com/apache/pulsar/pull/7409 Fixes #7384 ### Motivation Fix batch ackset recycled multiple times. The root cause is a race condition in group ack flush and cumulative Ack. So add recycled state check for the

[GitHub] [pulsar] Anonymitaet opened a new pull request #7410: Update Kingsoft cloud logo

2020-07-01 Thread GitBox
Anonymitaet opened a new pull request #7410: URL: https://github.com/apache/pulsar/pull/7410 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [pulsar] ivankelly commented on a change in pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
ivankelly commented on a change in pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#discussion_r448195643 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/service/ServerCnx.java ## @@ -167,10 +171,26 @@ private volatile boolean autoRea

[GitHub] [pulsar] zymap commented on pull request #7341: Add more detail information of retry errors

2020-07-01 Thread GitBox
zymap commented on pull request #7341: URL: https://github.com/apache/pulsar/pull/7341#issuecomment-652299170 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message,

[pulsar] branch master updated: Update Kingsoft cloud logo (#7410)

2020-07-01 Thread penghui
This is an automated email from the ASF dual-hosted git repository. penghui pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 842fe06 Update Kingsoft cloud logo (#7410) 842

[GitHub] [pulsar] codelipenghui merged pull request #7410: Update Kingsoft cloud logo

2020-07-01 Thread GitBox
codelipenghui merged pull request #7410: URL: https://github.com/apache/pulsar/pull/7410 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [pulsar] codelipenghui commented on pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
codelipenghui commented on pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#issuecomment-652322280 > Regarding the lower limit per each IO thread, in which 1 single connection cannot use the entire memory space, I don't think it's an issue at all. There are some us

[GitHub] [pulsar] Huanli-Meng opened a new pull request #7411: [Doc] --Add a note about --state-storage-service-url in localrun command of Function

2020-07-01 Thread GitBox
Huanli-Meng opened a new pull request #7411: URL: https://github.com/apache/pulsar/pull/7411 Fixes #6215 https://github.com/apache/pulsar/issues/6215 ### Motivation Function localrun deployment cannot store state because the --state_storage_serviceurl should be manuall

[GitHub] [pulsar] Huanli-Meng commented on pull request #7411: [Doc] --Add a note about --state-storage-service-url in localrun command of Function

2020-07-01 Thread GitBox
Huanli-Meng commented on pull request #7411: URL: https://github.com/apache/pulsar/pull/7411#issuecomment-652323044 @Jennifer88huang , please add the tag for 2.6.0 and 2.6.1 for cherry-pick. This is an automated message from

[GitHub] [pulsar] codelipenghui commented on pull request #7389: [Issue 7347] Set default value for offload-deletion-lag

2020-07-01 Thread GitBox
codelipenghui commented on pull request #7389: URL: https://github.com/apache/pulsar/pull/7389#issuecomment-652328032 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [pulsar] Jennifer88huang commented on pull request #7411: [Doc] --Add a note about --state-storage-service-url in localrun command of Function

2020-07-01 Thread GitBox
Jennifer88huang commented on pull request #7411: URL: https://github.com/apache/pulsar/pull/7411#issuecomment-652329251 @jiazhai @tuteng shall we add labels for major releases, such as "release/2.6.0"? It seems that we can only add one milestone. --

[GitHub] [pulsar] Jennifer88huang opened a new issue #7412: Write a script to sync Pulsar configuration and CLI tools

2020-07-01 Thread GitBox
Jennifer88huang opened a new issue #7412: URL: https://github.com/apache/pulsar/issues/7412 **Is your feature request related to a problem? Please describe.** When someone update the configuration files in code, they might forget to update the content for docs on https://pulsar.apache.o

[GitHub] [pulsar] Jennifer88huang opened a new issue #7413: Write a script to sync doc updates to multiple versions

2020-07-01 Thread GitBox
Jennifer88huang opened a new issue #7413: URL: https://github.com/apache/pulsar/issues/7413 **Is your feature request related to a problem? Please describe.** When a doc change applies to multiple versions, writers have to update the same content in the `docs` folder and related `version

[GitHub] [pulsar] feeblefakie opened a new issue #7414: Broker throws an exception and then gets broken partially when LZ4/Snappy is used with Key_Shared in 2.6.0.

2020-07-01 Thread GitBox
feeblefakie opened a new issue #7414: URL: https://github.com/apache/pulsar/issues/7414 **Describe the bug** Broker throws an exception and then gets broken partially when LZ4/Snappy is used with Key_Shared in 2.6.0. **To Reproduce** Steps to reproduce the behavior: 1. Start

[GitHub] [pulsar] Huanli-Meng opened a new issue #7415: [Document & Website][Pulsar 2.5.0]--schema registry should be removed from the concept section

2020-07-01 Thread GitBox
Huanli-Meng opened a new issue #7415: URL: https://github.com/apache/pulsar/issues/7415 **Describe the bug** in Pulsar 2.5.0, The schema registry doc under the concept and architecture section as there is a Pulsar schema section ![image](https://user-images.githubusercont

[GitHub] [pulsar] merlimat commented on a change in pull request #7409: Fix batch ackset recycled multiple times.

2020-07-01 Thread GitBox
merlimat commented on a change in pull request #7409: URL: https://github.com/apache/pulsar/pull/7409#discussion_r448328640 ## File path: pulsar-common/src/main/java/org/apache/pulsar/common/util/collections/BitSetRecyclable.java ## @@ -1197,11 +1199,13 @@ private BitSetRecycl

[GitHub] [pulsar] merlimat commented on a change in pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
merlimat commented on a change in pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#discussion_r448332848 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/service/ServerCnx.java ## @@ -167,10 +171,26 @@ private volatile boolean autoRead

[GitHub] [pulsar] codelipenghui opened a new pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
codelipenghui opened a new pull request #7416: URL: https://github.com/apache/pulsar/pull/7416 Fixes #7414 ### Motivation Decompression payload if needed in KeyShared subscription ### Verifying this change Unit test added ### Does this pull request pote

[GitHub] [pulsar] merlimat commented on a change in pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
merlimat commented on a change in pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#discussion_r448333721 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/service/BrokerService.java ## @@ -2307,4 +2253,16 @@ private boolean isSystemTopic(Str

[GitHub] [pulsar] feeblefakie commented on pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
feeblefakie commented on pull request #7416: URL: https://github.com/apache/pulsar/pull/7416#issuecomment-652395111 @codelipenghui Oh, great. it is pretty fast. Was it related to the changes in between 2.5.0 and 2.6.0 ? Just asking because it doesn’t look so.

[GitHub] [pulsar] codelipenghui commented on pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
codelipenghui commented on pull request #7416: URL: https://github.com/apache/pulsar/pull/7416#issuecomment-652396037 @feeblefakie it's introduced by #7107. This is an automated message from the Apache Git Service. To respon

[GitHub] [pulsar] ivankelly closed pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
ivankelly closed pull request #7406: URL: https://github.com/apache/pulsar/pull/7406 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [pulsar] ivankelly commented on pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
ivankelly commented on pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#issuecomment-652396552 @codelipenghui A LongAdder would still cause contention on every entry, as to sum it has to view all cells. Th

[GitHub] [pulsar] feeblefakie commented on pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
feeblefakie commented on pull request #7416: URL: https://github.com/apache/pulsar/pull/7416#issuecomment-652396867 @codelipenghui Thank you ! 🙇‍♂️ This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [pulsar] merlimat commented on a change in pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
merlimat commented on a change in pull request #7416: URL: https://github.com/apache/pulsar/pull/7416#discussion_r448339719 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractBaseDispatcher.java ## @@ -153,13 +155,18 @@ public void resetCloseFut

[GitHub] [pulsar] ivankelly edited a comment on pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
ivankelly edited a comment on pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#issuecomment-652396552 @codelipenghui A LongAdder would still cause contention on every entry, as to sum it has to view all cells. To allow a single thread to use the full buffer when there's

[GitHub] [pulsar] Huanli-Meng opened a new pull request #7417: [Doc]--Added schema versioning to support multi version messages produce and consume

2020-07-01 Thread GitBox
Huanli-Meng opened a new pull request #7417: URL: https://github.com/apache/pulsar/pull/7417 ### Motivation Pulsar 2.4.0 Added schema versioning to support multi version messages produce and consume #3876 #3670 #4211 #4325 #4548. but the doc is not updated accordingly. ##

[GitHub] [pulsar] codelipenghui commented on a change in pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
codelipenghui commented on a change in pull request #7416: URL: https://github.com/apache/pulsar/pull/7416#discussion_r448344535 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractBaseDispatcher.java ## @@ -153,13 +155,18 @@ public void resetClo

[GitHub] [pulsar] Huanli-Meng commented on pull request #7396: [Doc]--Introduce GenericRecordBuilder and the Avro implementation

2020-07-01 Thread GitBox
Huanli-Meng commented on pull request #7396: URL: https://github.com/apache/pulsar/pull/7396#issuecomment-652402465 will check all docs and fix them one by one. Thx This is an automated message from the Apache Git Service. To

[GitHub] [pulsar] merlimat commented on pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
merlimat commented on pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#issuecomment-652403667 > There are some users who use few producers to publish messages, in order to have a better batch effect to improve throughput. I have, of course, tested it and as expecte

[GitHub] [pulsar] merlimat commented on a change in pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
merlimat commented on a change in pull request #7416: URL: https://github.com/apache/pulsar/pull/7416#discussion_r448350653 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractBaseDispatcher.java ## @@ -153,13 +155,18 @@ public void resetCloseFut

[GitHub] [pulsar] codelipenghui commented on pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
codelipenghui commented on pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#issuecomment-652412677 > Frequently looping over all the producers (just to get to the connections) is just burning a lot of CPU. I agree with this point. I just want to say the pending buf

[GitHub] [pulsar] codelipenghui commented on a change in pull request #7409: Fix batch ackset recycled multiple times.

2020-07-01 Thread GitBox
codelipenghui commented on a change in pull request #7409: URL: https://github.com/apache/pulsar/pull/7409#discussion_r448357625 ## File path: pulsar-common/src/main/java/org/apache/pulsar/common/util/collections/BitSetRecyclable.java ## @@ -1197,11 +1199,13 @@ private BitSetR

[GitHub] [pulsar] codelipenghui commented on a change in pull request #7416: Decompression payload if needed in KeyShared subscription

2020-07-01 Thread GitBox
codelipenghui commented on a change in pull request #7416: URL: https://github.com/apache/pulsar/pull/7416#discussion_r448363006 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractBaseDispatcher.java ## @@ -153,13 +155,18 @@ public void resetClo

[GitHub] [pulsar] Huanli-Meng commented on pull request #7396: [Doc]--Introduce GenericRecordBuilder and the Avro implementation

2020-07-01 Thread GitBox
Huanli-Meng commented on pull request #7396: URL: https://github.com/apache/pulsar/pull/7396#issuecomment-652426030 @Anonymitaet , docs have been updated, please help double check. Thanks. This is an automated message from th

[GitHub] [pulsar] ksenlaskar opened a new issue #7418: Pulsar metrics for prometheus does not work for short live consumers

2020-07-01 Thread GitBox
ksenlaskar opened a new issue #7418: URL: https://github.com/apache/pulsar/issues/7418 Steps to reproduce the behavior: 1.Create pulsar topic , and create a consumer which consume from the topic at an interval of 500 ms. 2. Configure prometheus for pulsar 3. Check the pulsar metric

[GitHub] [pulsar] merlimat commented on pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
merlimat commented on pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#issuecomment-652449856 > I just want to say the pending buffer is sensitive to write throughput, especially on machines with less memory. If we split it into multiple parts, when there are fewer conne

[GitHub] [pulsar] merlimat commented on issue #7418: Pulsar metrics for prometheus does not work for short live consumers

2020-07-01 Thread GitBox
merlimat commented on issue #7418: URL: https://github.com/apache/pulsar/issues/7418#issuecomment-652450521 Same problem happens for short-lived producers This is an automated message from the Apache Git Service. To respond t

[GitHub] [pulsar] codelipenghui commented on pull request #7406: Improved in max-pending-bytes mechanism for broker

2020-07-01 Thread GitBox
codelipenghui commented on pull request #7406: URL: https://github.com/apache/pulsar/pull/7406#issuecomment-652454604 > The io threads count not much, will we add up to a few numbers each time will become a bottleneck? > I'm not sure what you mean here. Sorry I didn't make it clea

[GitHub] [pulsar] addison commented on issue #6086: [docs] Add doc on how to run Pulsar Functions as pod in Kubernetes

2020-07-01 Thread GitBox
addison commented on issue #6086: URL: https://github.com/apache/pulsar/issues/6086#issuecomment-652464742 I think you have the wrong “Addison” here. I’m @addison rather than @addisonj Addison Addison Phillips Sr. Principal SDE – I18N (Amazon) Chair (W3C I18N WG) I

[GitHub] [pulsar] KannarFr closed issue #7399: Proxy tries connect unavailable broker

2020-07-01 Thread GitBox
KannarFr closed issue #7399: URL: https://github.com/apache/pulsar/issues/7399 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [pulsar] KannarFr opened a new issue #7419: Expose pulsar's metrics in a topic

2020-07-01 Thread GitBox
KannarFr opened a new issue #7419: URL: https://github.com/apache/pulsar/issues/7419 **Is your feature request related to a problem? Please describe.** Metrics fetch is currently using prometheus endpoint that exposes metrics. External metrics collector should now poll this endpoint.

[GitHub] [pulsar] jiazhai opened a new pull request #7420: [client authentication] add authentication client with oauth2 support

2020-07-01 Thread GitBox
jiazhai opened a new pull request #7420: URL: https://github.com/apache/pulsar/pull/7420 ### Motivation Pulsar supports authenticating clients using OAuth 2.0 access tokens. You can use tokens to identify a Pulsar client and associate with some "principal" (or "role") that is permit

[GitHub] [pulsar] jiazhai merged pull request #7417: [Doc]--Added schema versioning to support multi version messages produce and consume

2020-07-01 Thread GitBox
jiazhai merged pull request #7417: URL: https://github.com/apache/pulsar/pull/7417 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[pulsar] branch master updated (842fe06 -> 3c422f0)

2020-07-01 Thread zhaijia
This is an automated email from the ASF dual-hosted git repository. zhaijia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 842fe06 Update Kingsoft cloud logo (#7410) add 3c422f0 schema version (#7417) No new revisions were added b

[GitHub] [pulsar] jiazhai merged pull request #7411: [Doc] --Add a note about --state-storage-service-url in localrun command of Function

2020-07-01 Thread GitBox
jiazhai merged pull request #7411: URL: https://github.com/apache/pulsar/pull/7411 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [pulsar] jiazhai closed issue #6215: [Python Function] localrun deployment cannot store state

2020-07-01 Thread GitBox
jiazhai closed issue #6215: URL: https://github.com/apache/pulsar/issues/6215 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [pulsar] jiazhai commented on pull request #7408: [Issue 7407] Support for tombstones (null value in messages) does not work

2020-07-01 Thread GitBox
jiazhai commented on pull request #7408: URL: https://github.com/apache/pulsar/pull/7408#issuecomment-652501541 @gaoran10 @nlu90 Would you please also help review this change? This is an automated message from the Apache Git

[GitHub] [pulsar] jiazhai commented on pull request #7300: [pulsar-perf] Supports `tlsAllowInsecureConnection` in pulsar-perf produce/consume/read.

2020-07-01 Thread GitBox
jiazhai commented on pull request #7300: URL: https://github.com/apache/pulsar/pull/7300#issuecomment-652502576 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [pulsar] rdhabalia opened a new pull request #7421: [pulsar-doc] Add document for Pulasr SNI routing with ATS

2020-07-01 Thread GitBox
rdhabalia opened a new pull request #7421: URL: https://github.com/apache/pulsar/pull/7421 ### Motivation Add documentation for [PIP-60](https://github.com/apache/pulsar/wiki/PIP-60:-Support-Proxy-server-with-SNI-routing) with instrunction to setup proxy and configuration. ---

[GitHub] [pulsar] jiazhai commented on pull request #7420: [client authentication] add authentication client with oauth2 support

2020-07-01 Thread GitBox
jiazhai commented on pull request #7420: URL: https://github.com/apache/pulsar/pull/7420#issuecomment-652707042 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [pulsar] rdhabalia opened a new pull request #7422: [pulsar-cli] fix update-cluster cli updates proxy-url

2020-07-01 Thread GitBox
rdhabalia opened a new pull request #7422: URL: https://github.com/apache/pulsar/pull/7422 ### Motivation Pulsar-admin CLI doesn't update cluster-metadata with proxy-url and proxy-protocol. ### Modification Fix CLI to update proxy metadata. ---

[pulsar] branch master updated (aedf888 -> 9423abf)

2020-07-01 Thread liuyu
This is an automated email from the ASF dual-hosted git repository. liuyu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from aedf888 localrun of functions (#7411) add 9423abf Update docs for tiered storage (#7393) No new revisions wer

[GitHub] [pulsar] Anonymitaet merged pull request #7393: Update docs for tiered storage

2020-07-01 Thread GitBox
Anonymitaet merged pull request #7393: URL: https://github.com/apache/pulsar/pull/7393 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [pulsar] codelipenghui closed issue #7238: Schema registry section appear after search schema

2020-07-01 Thread GitBox
codelipenghui closed issue #7238: URL: https://github.com/apache/pulsar/issues/7238 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [pulsar] codelipenghui commented on issue #7395: Consumer.getLastMessageId() returns invalid MessageId

2020-07-01 Thread GitBox
codelipenghui commented on issue #7395: URL: https://github.com/apache/pulsar/issues/7395#issuecomment-652722103 @fmiguelez Looks this a bug, the broker should return a real message ID This is an automated message from the A

[GitHub] [pulsar] codelipenghui commented on issue #7394: Conflict when update partitions on non-persistent topic

2020-07-01 Thread GitBox
codelipenghui commented on issue #7394: URL: https://github.com/apache/pulsar/issues/7394#issuecomment-652723857 @aloyszhang Thanks for your replay, I think we can return clear information when update partitions on a non-partitioned topic first. Currently, "Reason: Topic is not partitioned

[GitHub] [pulsar] zymap commented on pull request #7341: Add more detail information of retry errors

2020-07-01 Thread GitBox
zymap commented on pull request #7341: URL: https://github.com/apache/pulsar/pull/7341#issuecomment-652724852 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [pulsar] Huanli-Meng commented on issue #6967: pulsar cli option documented but the code is not in the 2.5 branche

2020-07-01 Thread GitBox
Huanli-Meng commented on issue #6967: URL: https://github.com/apache/pulsar/issues/6967#issuecomment-652727614 @Mefl , how about the process? This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [pulsar] jiazhai commented on issue #7390: SQL worker can not start directly

2020-07-01 Thread GitBox
jiazhai commented on issue #7390: URL: https://github.com/apache/pulsar/issues/7390#issuecomment-652728121 @zymap What is the version of pulsar you are using? This is an automated message from the Apache Git Service. To respo

[GitHub] [pulsar] yingziyu007 opened a new issue #7423: v2.3.2 pulsar-admin CLI often return 502

2020-07-01 Thread GitBox
yingziyu007 opened a new issue #7423: URL: https://github.com/apache/pulsar/issues/7423 The same command return different result: success or fail. Why? ![1](https://user-images.githubusercontent.com/54094772/86306852-daeebb80-bc47-11ea-97cb-3e7ea2bdc3a5.png) ---

[GitHub] [pulsar] jiazhai commented on issue #7391: When creating function application, set parallelism greater than 1, and multiple jars will be copied under the same node.

2020-07-01 Thread GitBox
jiazhai commented on issue #7391: URL: https://github.com/apache/pulsar/issues/7391#issuecomment-652731075 Thanks @xuesong172500 for open this issue. This is a feature request. It may be good it we could do the function package management. @zymap has some investigation on this. @zymap Woul

[GitHub] [pulsar] jiazhai commented on issue #7392: 多集群自动切换问题

2020-07-01 Thread GitBox
jiazhai commented on issue #7392: URL: https://github.com/apache/pulsar/issues/7392#issuecomment-652733005 It seems the DNS cache is not cleared, and cause the consumer connection still using the old address. Could you set a shorter DNS cache time period?

[GitHub] [pulsar] jiazhai commented on issue #7392: 多集群自动切换问题

2020-07-01 Thread GitBox
jiazhai commented on issue #7392: URL: https://github.com/apache/pulsar/issues/7392#issuecomment-652733367 Would like to close this issue, is issue not solved, we could open new issue. This is an automated message from the Ap

[GitHub] [pulsar] jiazhai closed issue #7392: 多集群自动切换问题

2020-07-01 Thread GitBox
jiazhai closed issue #7392: URL: https://github.com/apache/pulsar/issues/7392 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [pulsar] jiazhai commented on issue #7394: Conflict when update partitions on non-persistent topic

2020-07-01 Thread GitBox
jiazhai commented on issue #7394: URL: https://github.com/apache/pulsar/issues/7394#issuecomment-652736018 The first step would be fix the error log: ``` 20:58:58.450 [AsyncHttpClient-7-1] WARN org.apache.pulsar.client.admin.internal.BaseResource - [http://localhost:8080/admin/v2/no

[GitHub] [pulsar] jiazhai commented on issue #7397: Failed to create subscription on non-persistent topic.

2020-07-01 Thread GitBox
jiazhai commented on issue #7397: URL: https://github.com/apache/pulsar/issues/7397#issuecomment-652736519 Thanks for @codelipenghui 's detailed report. mark it as `help wanted` for anyone interest to contribute to it. This

[GitHub] [pulsar] jiazhai commented on issue #7395: Consumer.getLastMessageId() returns invalid MessageId

2020-07-01 Thread GitBox
jiazhai commented on issue #7395: URL: https://github.com/apache/pulsar/issues/7395#issuecomment-652737294 looks like a regression when handling getLastMessageId in managedLedger. This is an automated message from the Apache

[GitHub] [pulsar] jiazhai commented on issue #7398: possible inconsistencies en broker local metadata cache

2020-07-01 Thread GitBox
jiazhai commented on issue #7398: URL: https://github.com/apache/pulsar/issues/7398#issuecomment-652738200 Thanks @KannarFr for open this issue. Are there steps to reproduce this issue? This is an automated message from the

[GitHub] [pulsar] jiazhai commented on issue #7405: Create function failed!

2020-07-01 Thread GitBox
jiazhai commented on issue #7405: URL: https://github.com/apache/pulsar/issues/7405#issuecomment-652740941 @xuesong172500 Thanks for open this issue. Seems there is some error logs need to analysis. ``` 10:38:47.798 [function-web-20-8] ERROR org.apache.pulsar.functions.worker.rest.

[GitHub] [pulsar] jiazhai commented on issue #7407: Support for tombstones (null value in messages) does not work

2020-07-01 Thread GitBox
jiazhai commented on issue #7407: URL: https://github.com/apache/pulsar/issues/7407#issuecomment-652741491 Thanks @fmiguelez for open the issue and related PR. @gaoran10 to help review the Pr. This is an automated message fr

[GitHub] [pulsar] jiazhai commented on issue #7412: Write a script to sync Pulsar configuration and CLI tools

2020-07-01 Thread GitBox
jiazhai commented on issue #7412: URL: https://github.com/apache/pulsar/issues/7412#issuecomment-652742516 Would like to unassign @tuteng . so that anyone interest to contribute to this feature could work on it. This is an a

[GitHub] [pulsar] jiazhai commented on issue #7418: Pulsar metrics for prometheus does not work for short live consumers

2020-07-01 Thread GitBox
jiazhai commented on issue #7418: URL: https://github.com/apache/pulsar/issues/7418#issuecomment-652746584 @ksenlaskar Thanks for open this issue. Seems it is not easy to handle this kind of behavior. It may be not good to sample the metrics with a very short period. @merlimat Is there an

[GitHub] [pulsar] jiazhai commented on issue #7419: Expose pulsar's metrics in topics

2020-07-01 Thread GitBox
jiazhai commented on issue #7419: URL: https://github.com/apache/pulsar/issues/7419#issuecomment-652748037 thanks @KannarFr for open this issue. this is a good feature. mark it as help wanted for anyone interest to contribute to it.

[GitHub] [pulsar] wolfstudy opened a new pull request #7424: [Issue: 7379] Improve security setting of Pulsar Functions

2020-07-01 Thread GitBox
wolfstudy opened a new pull request #7424: URL: https://github.com/apache/pulsar/pull/7424 Signed-off-by: xiaolong.ran Fixes #7379 ### Motivation Rename some settings to make those broker-client TLS settings clearer. ### Modifications - replace `clientAut

[GitHub] [pulsar] Anonymitaet commented on issue #6086: [docs] Add doc on how to run Pulsar Functions as pod in Kubernetes

2020-07-01 Thread GitBox
Anonymitaet commented on issue #6086: URL: https://github.com/apache/pulsar/issues/6086#issuecomment-652761551 @addison Thanks for your feedback. I think I have @ the correct person? I have @addisonj and he is the right one?

[GitHub] [pulsar] addisonj commented on issue #6086: [docs] Add doc on how to run Pulsar Functions as pod in Kubernetes

2020-07-01 Thread GitBox
addisonj commented on issue #6086: URL: https://github.com/apache/pulsar/issues/6086#issuecomment-652764057 Yep, that is me :) On Wed, Jul 1, 2020 at 9:33 PM Yu Liu wrote: > @addison Thanks for your feedback. > I think I have @ the correct perso

[GitHub] [pulsar] addisonj commented on issue #6086: [docs] Add doc on how to run Pulsar Functions as pod in Kubernetes

2020-07-01 Thread GitBox
addisonj commented on issue #6086: URL: https://github.com/apache/pulsar/issues/6086#issuecomment-652764225 Oh also, yes, please assign that to me. On Wed, Jul 1, 2020 at 9:43 PM Addison Higham wrote: > Yep, that is me :) > > On Wed, Jul 1, 2020 at 9:33 PM Yu Liu wrote:

[GitHub] [pulsar] jiazhai commented on pull request #7420: [client authentication] add authentication client with oauth2 support

2020-07-01 Thread GitBox
jiazhai commented on pull request #7420: URL: https://github.com/apache/pulsar/pull/7420#issuecomment-652778215 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [pulsar] sijie closed issue #7301: [pulsar-admin] weird error on wrong command

2020-07-01 Thread GitBox
sijie closed issue #7301: URL: https://github.com/apache/pulsar/issues/7301 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [pulsar] sijie merged pull request #7369: Add tenant name check in list namespaces function.

2020-07-01 Thread GitBox
sijie merged pull request #7369: URL: https://github.com/apache/pulsar/pull/7369 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [pulsar] sijie commented on a change in pull request #7420: [client authentication] add authentication client with oauth2 support

2020-07-01 Thread GitBox
sijie commented on a change in pull request #7420: URL: https://github.com/apache/pulsar/pull/7420#discussion_r448746698 ## File path: pulsar-client/src/main/java/org/apache/pulsar/client/impl/auth/oauth2/Readme.md ## @@ -0,0 +1,94 @@ +# Pulsar Client Authentication Plugin for

[pulsar] branch master updated: Add tenant name check in list namespaces function. (#7369)

2020-07-01 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 2b94d02 Add tenant name check in list namespaces

[GitHub] [pulsar] sijie commented on pull request #7389: [Issue 7347] Set default value for offload-deletion-lag

2020-07-01 Thread GitBox
sijie commented on pull request #7389: URL: https://github.com/apache/pulsar/pull/7389#issuecomment-652779862 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [pulsar] sijie commented on pull request #7396: [Doc]--Introduce GenericRecordBuilder and the Avro implementation

2020-07-01 Thread GitBox
sijie commented on pull request #7396: URL: https://github.com/apache/pulsar/pull/7396#issuecomment-652780045 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [pulsar] sijie commented on pull request #7408: [Issue 7407] Support for tombstones (null value in messages) does not work

2020-07-01 Thread GitBox
sijie commented on pull request #7408: URL: https://github.com/apache/pulsar/pull/7408#issuecomment-652780499 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [pulsar] sijie commented on pull request #7329: Added ability to delete and update records in ElasticSearch sink connector

2020-07-01 Thread GitBox
sijie commented on pull request #7329: URL: https://github.com/apache/pulsar/pull/7329#issuecomment-652780937 @codelipenghui can you review this again? This is an automated message from the Apache Git Service. To respond to t

[GitHub] [pulsar] sijie commented on pull request #7322: [Issue 7267] Fixing go instance config port

2020-07-01 Thread GitBox
sijie commented on pull request #7322: URL: https://github.com/apache/pulsar/pull/7322#issuecomment-652781065 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [pulsar] sijie commented on pull request #7316: [Issue 7315][docker-compose]

2020-07-01 Thread GitBox
sijie commented on pull request #7316: URL: https://github.com/apache/pulsar/pull/7316#issuecomment-652781397 /pulsarbot run-failure-checks This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [pulsar] sijie merged pull request #7300: [pulsar-perf] Supports `tlsAllowInsecureConnection` in pulsar-perf produce/consume/read.

2020-07-01 Thread GitBox
sijie merged pull request #7300: URL: https://github.com/apache/pulsar/pull/7300 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[pulsar] branch master updated (2b94d02 -> 9b178c8)

2020-07-01 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2b94d02 Add tenant name check in list namespaces function. (#7369) add 9b178c8 [pulsar-perf] Supports `tlsAllow

[pulsar] branch master updated (2b94d02 -> 9b178c8)

2020-07-01 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2b94d02 Add tenant name check in list namespaces function. (#7369) add 9b178c8 [pulsar-perf] Supports `tlsAllow

[GitHub] [pulsar] jerrypeng merged pull request #7388: Implement rebalance mechanism in Pulsar Functions

2020-07-01 Thread GitBox
jerrypeng merged pull request #7388: URL: https://github.com/apache/pulsar/pull/7388 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[pulsar] branch master updated (9b178c8 -> 8e4906c)

2020-07-01 Thread jerrypeng
This is an automated email from the ASF dual-hosted git repository. jerrypeng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 9b178c8 [pulsar-perf] Supports `tlsAllowInsecureConnection` in pulsar-perf produce/consume/read. (#7300) ad

[GitHub] [pulsar] sijie commented on a change in pull request #7424: [Issue: 7379] Improve security setting of Pulsar Functions

2020-07-01 Thread GitBox
sijie commented on a change in pull request #7424: URL: https://github.com/apache/pulsar/pull/7424#discussion_r448751767 ## File path: pulsar-broker/src/test/java/org/apache/pulsar/functions/worker/PulsarFunctionE2ESecurityTest.java ## @@ -177,10 +177,10 @@ void setup(Method m

  1   2   >