[GitHub] [pulsar] codelipenghui opened a new pull request #5680: [transaction-coordinator] Implementation of transaction coordinator client.
codelipenghui opened a new pull request #5680: [transaction-coordinator] Implementation of transaction coordinator client. URL: https://github.com/apache/pulsar/pull/5680 ### Motivation Implement transaction coordinator client. ### Modifications Add transaction coordinator client. Add transaction meta store handler to handle meta store request and response. ### Verifying this change Unit test added. ### Does this pull request potentially affect one of the following parts: *If `yes` was chosen, please highlight the changes* - Dependencies (does it add or upgrade a dependency): (no) - The public API: (no) - The schema: (no) - The default values of configurations: (no) - The wire protocol: (yes) - The rest endpoints: (no) - The admin cli options: (no) - Anything that affects deployment: (no) ### Documentation - Does this pull request introduce a new feature? (yes) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] huangdx0726 opened a new issue #5681: java client example error
huangdx0726 opened a new issue #5681: java client example error URL: https://github.com/apache/pulsar/issues/5681 **Describe the bug** java client example error **To Reproduce** Steps to reproduce the behavior: 1. Go to 'http://pulsar.apache.org/docs/en/client-libraries-java/' 2. Scroll down to 'Subscription modes' copy the example code ``` Producer producer = client.newProducer(Schema.STRING) .topic("my-topic") .enableBatch(false) .create(); // 3 messages with "key-1", 3 messages with "key-2", 2 messages with "key-3" and 2 messages with "key-4" producer.newMessage().key("key-1").value("message-1-1").send(); producer.newMessage().key("key-1").value("message-1-2").send(); producer.newMessage().key("key-1").value("message-1-3").send(); producer.newMessage().key("key-2").value("message-2-1").send(); producer.newMessage().key("key-2").value("message-2-2").send(); producer.newMessage().key("key-2").value("message-2-3").send(); producer.newMessage().key("key-3").value("message-3-1").send(); producer.newMessage().key("key-3").value("message-3-2").send(); producer.newMessage().key("key-4").value("message-4-1").send(); producer.newMessage().key("key-4").value("message-4-2").send(); ``` display no method enableBatch.Maybe the methodName is enableBatching. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon
sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon URL: https://github.com/apache/pulsar/pull/5675#discussion_r347310091 ## File path: bin/pulsar-perf ## @@ -29,6 +29,12 @@ then . "$PULSAR_HOME/conf/pulsar_env.sh" fi +# Check bookkeeper env and load bkenv.sh Review comment: same comment as in bin/pulsar This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon
sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon URL: https://github.com/apache/pulsar/pull/5675#discussion_r347309990 ## File path: bin/pulsar ## @@ -44,12 +44,18 @@ FUNCTIONS_EXTRA_DEPS_DIR=${PULSAR_FUNCTIONS_EXTRA_DEPS_DIR:-"${DEFAULT_FUNCTIONS SQL_HOME=$PULSAR_HOME/pulsar-sql PRESTO_HOME=${PULSAR_HOME}/lib/presto - +# Check pulsar env and load pulser_env.sh if [ -f "$PULSAR_HOME/conf/pulsar_env.sh" ] then . "$PULSAR_HOME/conf/pulsar_env.sh" fi +# Check bookkeeper env and load bkenv.sh Review comment: Move this before line 47 for backward compatibility consideration. So if people already define environments in pulsar_env, those env vars will not be overridden by bkenv.sh. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon
sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon URL: https://github.com/apache/pulsar/pull/5675#discussion_r347310245 ## File path: src/pulsar-io-gen ## @@ -28,6 +28,12 @@ then . "$PULSAR_HOME/conf/pulsar_env.sh" fi +# Check bookkeeper env and load bkenv.sh Review comment: same comment as above This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon
sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon URL: https://github.com/apache/pulsar/pull/5675#discussion_r347310163 ## File path: bin/pulsar-daemon ## @@ -45,6 +45,12 @@ then . "$PULSAR_HOME/conf/pulsar_env.sh" fi +# Check bookkeeper env and load bkenv.sh Review comment: same comment as above This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui opened a new issue #5682: Documentation for sticky consumer
codelipenghui opened a new issue #5682: Documentation for sticky consumer URL: https://github.com/apache/pulsar/issues/5682 This is a task tracker for create a document for sticky consumer since #5388 is merged. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #5680: [transaction-coordinator] Implementation of transaction coordinator client.
codelipenghui commented on issue #5680: [transaction-coordinator] Implementation of transaction coordinator client. URL: https://github.com/apache/pulsar/pull/5680#issuecomment-554964021 run integration tests run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] candlerb opened a new issue #5683: Cannot create topic under sample/standalone/ns1
candlerb opened a new issue #5683: Cannot create topic under sample/standalone/ns1 URL: https://github.com/apache/pulsar/issues/5683 **Describe the bug** In pulsar 2.4.1 standalone, a "sample/standalone/ns1" namespace is created by default, but I cannot create a topic under it using pulsar-admin - I get a 405 error. **To Reproduce** ``` $ apache-pulsar-2.4.1/bin/pulsar-admin tenants list public sample $ apache-pulsar-2.4.1/bin/pulsar-admin namespaces list sample sample/standalone/ns1 $ apache-pulsar-2.4.1/bin/pulsar-admin topics list sample/standalone/ns1 $ apache-pulsar-2.4.1/bin/pulsar-admin topics create persistent://sample/standalone/ns1/foo 12:21:18.021 [AsyncHttpClient-5-1] WARN org.apache.pulsar.client.admin.internal.BaseResource - [http://localhost:8080/admin/persistent/sample/standalone/ns1/foo] Failed to perform http put request: javax.ws.rs.NotAllowedException: HTTP 405 Method Not Allowed HTTP 405 Method Not Allowed Reason: HTTP 405 Method Not Allowed $ apache-pulsar-2.4.1/bin/pulsar-admin topics create persistent://sample/standalone%2Fns1/foo java.lang.IllegalArgumentException: Invalid named entity: standalone%2Fns1 at org.apache.pulsar.common.naming.NamedEntity.checkName(NamedEntity.java:39) ``` There is also odd behaviour with curl on the `/admin/v2/namespaces/` endpoint: it works for namespaces without slash, but not with slash. ``` ubuntu@ldex-pulsar:~$ curl http://localhost:8080/admin/v2/namespaces/public/default {"auth_policies":{"namespace_auth":...} ubuntu@ldex-pulsar:~$ $ curl http://localhost:8080/admin/v2/namespaces/public/sample/standalone/ns1 Error 404 Not Found HTTP ERROR 404 Problem accessing /admin/v2/namespaces/public/sample/standalone/ns1. Reason: Not Foundhttp://eclipse.org/jetty";>Powered by Jetty:// 9.4.12.v20180830 $ curl http://localhost:8080/admin/v2/namespaces/public/sample/standalone%2Fns1 Error 405 Method Not Allowed HTTP ERROR 405 Problem accessing /admin/v2/namespaces/public/sample/standalone%2Fns1. Reason: Method Not Allowedhttp://eclipse.org/jetty";>Powered by Jetty:// 9.4.12.v20180830 ``` **Expected behavior** Be able to create topic under this namespace. Note that I *can* create another namespace with slashes in its name: ``` $ apache-pulsar-2.4.1/bin/pulsar-admin namespaces create sample/standalone/ns2 $ apache-pulsar-2.4.1/bin/pulsar-admin namespaces list sample sample/standalone/ns1 sample/standalone/ns2 ``` It seems therefore that namespaces with multiple slashes *are* valid in themselves. **Documentation problems** I wasn't expecting to see the "sample" tenant or "sample/standalone/ns1" namespace. They are mentioned in [old documentation](https://pulsar.apache.org/docs/v1.21.0-incubating/getting-started/LocalCluster/), but references have been removed except in passing in the sample output of `show schemas in pulsar` in [SQL getting started](https://pulsar.apache.org/docs/en/sql-getting-started/). In the documentation for [topics](https://pulsar.apache.org/docs/en/concepts-messaging/#topics) or [namespaces](https://pulsar.apache.org/docs/en/concepts-messaging/#namespaces) I couldn't find information on what the rules are for naming namespaces and topics - not even whether slashes are allowed. If slashes are permitted in both namespace and topic, it would lead to ambiguity over how to parse `persistent://sample/foo/bar/baz/qux` into namespace and topic. By experimentation, it *looks* like only the last part is treated as the topic name: ``` $ apache-pulsar-2.4.1/bin/pulsar-admin topics create persistent://public/default/foo/bar 12:31:36.223 [AsyncHttpClient-5-1] WARN org.apache.pulsar.client.admin.internal.BaseResource - [http://localhost:8080/admin/persistent/public/default/foo/bar] Failed to perform http put request: javax.ws.rs.NotAllowedException: HTTP 405 Method Not Allowed HTTP 405 Method Not Allowed Reason: HTTP 405 Method Not Allowed $ apache-pulsar-2.4.1/bin/pulsar-admin topics create persistent://public/default/foo $ ``` But I can't be sure, since I get the same 405 error that I reported above. Finally, the [REST API documentation](https://pulsar.apache.org/docs/en/admin-api-namespaces/) doesn't explain how namespaces are handled in URL paths. If the action was `PUT /admin/v2/namespaces/:tenant/:namespace`, and the tenant was `sample` and the namespace was `standalone/ns1`, then I would expect to encode this as: `PUT /admin/v2/namespaces/sample/standalone%2Fns1` However, experiments suggest otherwise: the components of the namespace become components of the path. ``` $ curl -H "Accept: application/json" http://localhost:8080/admin/persistent
[GitHub] [pulsar] candlerb opened a new issue #5684: Documentation: units for storageSize
candlerb opened a new issue #5684: Documentation: units for storageSize URL: https://github.com/apache/pulsar/issues/5684 **Is your feature request related to a problem? Please describe.** ``` ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics stats public/default/avro-topic | grep storageSize "storageSize" : 1980, ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics stats public/default/my-topic | grep storageSize "storageSize" : 3579, ``` What are those units? Bytes, KiB, MiB, GiB, something else? **Describe the solution you'd like** Document at https://pulsar.apache.org/docs/en/pulsar-admin/#stats-1 and/or https://pulsar.apache.org/admin-rest-api/?version=2.4.1#operation/getStats This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] candlerb opened a new issue #5685: Documentation: skip-all versus clear-backlog
candlerb opened a new issue #5685: Documentation: skip-all versus clear-backlog URL: https://github.com/apache/pulsar/issues/5685 **Is your feature request related to a problem? Please describe.** Documentation shows [skip-all](https://pulsar.apache.org/docs/en/pulsar-admin/#skip-all) followed by [clear-backlog](https://pulsar.apache.org/docs/en/pulsar-admin/#clear-backlog-1), both at the topic with no description of what the difference is. I don't know when it's appropriate to use one or the other. Note: there is a separate [clear-backlog](https://pulsar.apache.org/docs/en/pulsar-admin/#clear-backlog) command documented at the namespace level (rather than the topic level) UPDATE 1: pulsar-admin doesn't seem to recognise `topics skip-all` at all. ``` ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics clear-backlog The following option is required: -s, --subscription Skip all the messages for the subscription Usage: clear-backlog [options] persistent://tenant/namespace/topic Options: * -s, --subscription Subscription to be cleared ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics skip-all Expected a command, got skip-all Exception in thread "main" com.beust.jcommander.ParameterException: Asking description for unknown command: null at com.beust.jcommander.JCommander.getCommandDescription(JCommander.java:1003) at com.beust.jcommander.JCommander.usage(JCommander.java:988) at com.beust.jcommander.JCommander.usage(JCommander.java:980) at com.beust.jcommander.JCommander.usage(JCommander.java:972) at org.apache.pulsar.admin.cli.CmdBase.run(CmdBase.java:49) at org.apache.pulsar.admin.cli.PulsarAdminTool.run(PulsarAdminTool.java:218) at org.apache.pulsar.admin.cli.PulsarAdminTool.main(PulsarAdminTool.java:260) ^C ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics skip-all persistent://public/default/my-topic -s my-subscription Expected a command, got skip-all Exception in thread "main" com.beust.jcommander.ParameterException: Asking description for unknown command: null at com.beust.jcommander.JCommander.getCommandDescription(JCommander.java:1003) at com.beust.jcommander.JCommander.usage(JCommander.java:988) at com.beust.jcommander.JCommander.usage(JCommander.java:980) at com.beust.jcommander.JCommander.usage(JCommander.java:972) at org.apache.pulsar.admin.cli.CmdBase.run(CmdBase.java:49) at org.apache.pulsar.admin.cli.PulsarAdminTool.run(PulsarAdminTool.java:218) at org.apache.pulsar.admin.cli.PulsarAdminTool.main(PulsarAdminTool.java:260) ^C ``` But there appears to be a test case for it in [pulsar-client-tools-test/src/test/java/org/apache/pulsar/admin/cli/PulsarAdminToolTest.java](https://github.com/apache/pulsar/blob/master/pulsar-client-tools-test/src/test/java/org/apache/pulsar/admin/cli/PulsarAdminToolTest.java#L714) ``` topics.run(split("skip-all persistent://myprop/clust/ns1/ds1 -s sub1")); verify(mockTopics).skipAllMessages("persistent://myprop/clust/ns1/ds1", "sub1"); ``` `clear-backlog` works at the topic+subscription level: ``` ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics clear-backlog persistent://public/default/my-topic -s my-subscription ubuntu@ldex-pulsar:~$ ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] yifan opened a new issue #3112: broker error for prometheus metrics
yifan opened a new issue #3112: broker error for prometheus metrics URL: https://github.com/apache/pulsar/issues/3112 Expected behavior I deployed pulsar with helm and minikube configuration in kubernetes. I tried multiple times, I having problem with one of the brokers, sometimes both brokers. The problem has been consistent for three deployments so far. Steps to reproduce deploy pulsar with helm System configuration **Pulsar version**: x.y image: apachepulsar/pulsar-all Error in Broker.log 06:40:34.280 [pulsar-web-30-30] INFO org.eclipse.jetty.server.RequestLog - 10.244.6.29 - - [03/Dec/2018:06:40:34 +] "GET //xx.xx.xx.xx:8080/metrics HTTP/1.1" 302 0 "-" "Prometheus/1.6.3" 1 06:40:34.287 [prometheus-stats-31-1] ERROR org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsServlet - Failed to generate prometheus stats org.eclipse.jetty.io.EofException: null at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:197) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:420) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.io.WriteFlusher.completeWrite(WriteFlusher.java:375) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.io.SelectChannelEndPoint$3.run(SelectChannelEndPoint.java:107) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.io.SelectChannelEndPoint.onSelected(SelectChannelEndPoint.java:193) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.processSelected(ManagedSelector.java:283) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:181) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) ~[org.eclipse.jetty-jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) ~[org.eclipse.jetty-jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721] at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) ~[org.eclipse.jetty-jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_171] at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [org.apache.pulsar-pulsar-functions-metrics-2.2.0.jar:?] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171] Caused by: java.io.IOException: Connection reset by peer at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[?:1.8.0_171] at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) ~[?:1.8.0_171] at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) ~[?:1.8.0_171] at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[?:1.8.0_171] at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) ~[?:1.8.0_171] at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:175) ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721] ... 13 more Error in Prometheus text format parsing error in line 182: second TYPE line for metric name "pulsar_subscription_back_log", or TYPE reported after samples This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #3112: broker error for prometheus metrics
codelipenghui commented on issue #3112: broker error for prometheus metrics URL: https://github.com/apache/pulsar/issues/3112#issuecomment-555062872 Seems the problem can still happens, but i can't get the restful response, broker is crashed at that time. ``` 21:23:33.629 [prometheus-stats-39-1] ERROR org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsServlet - Failed to generate prometheus stats org.eclipse.jetty.io.EofException: null at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:283) ~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422) ~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:277) ~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.io.AbstractEndPoint.write(AbstractEndPoint.java:381) ~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.server.HttpConnection$SendCallback.process(HttpConnection.java:818) ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.util.IteratingCallback.processing(IteratingCallback.java:241) ~[org.eclipse.jetty-jetty-util-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.util.IteratingCallback.iterate(IteratingCallback.java:223) ~[org.eclipse.jetty-jetty-util-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.server.HttpConnection.send(HttpConnection.java:549) ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.server.HttpChannel.sendResponse(HttpChannel.java:857) ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.server.HttpChannel.write(HttpChannel.java:929) ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:250) ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:226) ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813] at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:546) ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813] at org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsGenerator.generate(PrometheusMetricsGenerator.java:78) ~[org.apache.pulsar-pulsar-broker-2.5.0-d3cb10859.jar:2.5.0-d3cb10859] at org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsServlet.lambda$doGet$0(PrometheusMetricsServlet.java:70) ~[org.apache.pulsar-pulsar-broker-2.5.0-d3cb10859.jar:2.5.0-d3cb10859] at org.apache.bookkeeper.mledger.util.SafeRun$1.safeRun(SafeRun.java:32) [org.apache.pulsar-managed-ledger-2.5.0-d3cb10859.jar:2.5.0-d3cb10859] at org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36) [org.apache.bookkeeper-bookkeeper-common-4.9.2.jar:4.9.2] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_171] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_171] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_171] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_171] at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty-netty-common-4.1.43.Final.jar:4.1.43.Final] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171] Caused by: java.io.IOException: Broken pipe at sun.nio.ch.FileDispatcherImpl.writev0(Native Method) ~[?:1.8.0_171] at sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51) ~[?:1.8.0_171] at sun.nio.ch.IOUtil.write(IOUtil.java:148) ~[?:1.8.0_171] at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:504) ~[?:1.8.0_171] at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:263) ~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813] ... 24 more ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui opened a new issue #5686: NPE in RackwareEnsemblePlacementPolicyImpl.
codelipenghui opened a new issue #5686: NPE in RackwareEnsemblePlacementPolicyImpl. URL: https://github.com/apache/pulsar/issues/5686 **Describe the bug** ``` java.lang.NullPointerException: null at org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl.isEnsembleAdheringToPlacementPolicy(RackawareEnsemblePlacementPolicyImpl.java:1261) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl.replaceBookie(RackawareEnsemblePlacementPolicyImpl.java:681) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicy.replaceBookie(RackawareEnsemblePlacementPolicy.java:114) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.BookieWatcherImpl.replaceBookie(BookieWatcherImpl.java:278) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.EnsembleUtils.replaceBookiesInEnsemble(EnsembleUtils.java:71) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.LedgerHandle.lambda$ensembleChangeLoop$2(LedgerHandle.java:1908) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.MetadataUpdateLoop.writeLoop(MetadataUpdateLoop.java:122) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.MetadataUpdateLoop.run(MetadataUpdateLoop.java:111) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.LedgerHandle.ensembleChangeLoop(LedgerHandle.java:1927) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.LedgerHandle.handleBookieFailure(LedgerHandle.java:1876) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.PendingAddOp.writeComplete(PendingAddOp.java:360) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.proto.BookieClientImpl$1.safeRun(BookieClientImpl.java:280) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36) [org.apache.bookkeeper-bookkeeper-common-4.9.2.jar:4.9.2] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_171] at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty-netty-common-4.1.43.Final.jar:4.1.43.Final] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171] ``` **To Reproduce** Have no idea to reproduce it. **Additional context** in master branch This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] pedro93 opened a new issue #5687: Failed to enable State API in K8s installation
pedro93 opened a new issue #5687: Failed to enable State API in K8s installation URL: https://github.com/apache/pulsar/issues/5687 **Describe the bug** Can't enable State API in a minikube-based installation of Pulsar, despite adding the appropriate property `extraServerComponents` to the values-mini.yaml in the bookkeeper.configData section. **To Reproduce** Steps to reproduce the behavior: 1. Add the following line to values-mini.yaml under the bookkeeper.configData section: ```yaml extraServerComponents: "org.apache.bookkeeper.stream.server.StreamStorageLifecycleComponent" ``` 2. Launch pulsar cluster via helm (this is using the helm templates found in this repo): ``` helm install . --values values-mini.yaml helm -n pulsar ``` 3. When the K8s cluster is ready, check the configuration of the bookkeeper nodes and confirm that the `extraServerComponents` property in `conf/bookkeeper.conf` is not defined with the specified value. **Expected behavior** That following the steps to reproduce the bookkeeper nodes would have this property defined. **Desktop (please complete the following information):** - OS: Ubuntu 18.04 - Minikube (v1.4.0) deployment - Pulsar version v2.4.1 **Additional context** I believe this issue is due to https://github.com/apache/pulsar/commits/master/docker/pulsar/scripts/apply-config-from-env.py which ignores commented lines, as such to fix this issue, the extraServerComponents property should not be commented but defined with a default empty value. This issue is not limited to the aforementioned property only but to all properties that are commented out, as the setup/procedure to enable such features are not working for K8s deployments. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] bsideup commented on issue #5278: Fixed reader cursor seek with disconnection
bsideup commented on issue #5278: Fixed reader cursor seek with disconnection URL: https://github.com/apache/pulsar/pull/5278#issuecomment-555088289 FYI this one would make [Liiklus'](https://github.com/bsideup/liiklus) life so much easier. Since Liiklus is not using Pulsar's offset storage, it performs "seek" on every partition, and it causes the other connections to disconnect, and, when they connect it seeks again 😂 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] jerrypeng commented on issue #5628: Fix: Netty threads may still linger after client close
jerrypeng commented on issue #5628: Fix: Netty threads may still linger after client close URL: https://github.com/apache/pulsar/pull/5628#issuecomment-555109463 rerun java8 tests rerun integration tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] frejonb opened a new issue #5688: [Pulsar dashboard] dashboard docker image installs incorrect version of postgres
frejonb opened a new issue #5688: [Pulsar dashboard] dashboard docker image installs incorrect version of postgres URL: https://github.com/apache/pulsar/issues/5688 **Describe the bug** Docker image install postgres 11 instead of 9.6. This results in ``` Starting Pulsar dasboard + /pulsar/init-postgres.sh + rm -rf '/data/*' + chown -R postgres: /data + chmod 700 /data + sudo -u postgres /usr/lib/postgresql/9.6/bin/initdb /data/ sudo: /usr/lib/postgresql/9.6/bin/initdb: command not found ``` **To Reproduce** Steps to reproduce the behavior: 1. Build dashboard docker image from master 1. Run image **Expected behavior** Dashboard running **Screenshots** If applicable, add screenshots to help explain your problem. **Desktop (please complete the following information):** - OS: Docker **Additional context** Add any other context about the problem here. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] frejonb opened a new pull request #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile
frejonb opened a new pull request #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile URL: https://github.com/apache/pulsar/pull/5689 Fixes #5688 ### Modifications Fix debian release ### Verifying this change - [ ] Make sure that the change passes the CI checks. This change is a trivial rework / code cleanup without any test coverage. ### Does this pull request potentially affect one of the following parts: *If `yes` was chosen, please highlight the changes* - Dependencies (does it add or upgrade a dependency): (yes) - The public API: (no) - The schema: (no) - The default values of configurations: (no) - The wire protocol: (no) - The rest endpoints: (no) - The admin cli options: (no) - Anything that affects deployment: (don't know) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar-client-go] merlimat opened a new pull request #102: Updated zstd go library to avoid cgo dependency for compression
merlimat opened a new pull request #102: Updated zstd go library to avoid cgo dependency for compression URL: https://github.com/apache/pulsar-client-go/pull/102 ### Motivation So far, we were relying on the CGo based `valyala/gozstd` for Zstd compression, since the native go `klauspost/compress` wasn't supporting it. Newer version of that library now supports compression so we can get rid of CGo based one. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar-client-go] merlimat merged pull request #101: Add client function to list topics in a namespace.
merlimat merged pull request #101: Add client function to list topics in a namespace. URL: https://github.com/apache/pulsar-client-go/pull/101 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] jm7647 opened a new issue #5690: Elasticsearch 5.x Sink connector incompatible
jm7647 opened a new issue #5690: Elasticsearch 5.x Sink connector incompatible URL: https://github.com/apache/pulsar/issues/5690 **Describe the bug** Works with ES 7.x version Fails with ES 5.x version Didn't try other versions. **To Reproduce** Steps to reproduce the behavior: 1. Configure and run ES Sink 2. See error {"error":{"root_cause":[{"type":"invalid_type_name_exception","reason":"Document mapping type name can't start with '_', found: [_doc]"}],"type":"invalid_type_name_exception","reason":"Document mapping type name can't start with '_', found: [_doc]"},"status":400} at org.elasticsearch.client.RestClient$SyncResponseListener.get(RestClient.java:705) ~[?:?] at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[?:?] at org.elasticsearch.client.RestClient.performRequest(RestClient.java:198) ~[?:?] at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:522) ~[?:?] at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:508) ~[?:?] at org.elasticsearch.client.RestHighLevelClient.index(RestHighLevelClient.java:348) ~[?:?] at org.apache.pulsar.io.elasticsearch.ElasticSearchSink.write(ElasticSearchSink.java:91) ~[?:?] at org.apache.pulsar.functions.instance.JavaInstanceRunnable.sendOutputMessage(JavaInstanceRunnable.java:435) ~[org.apache.pulsar-pulsar-functions-instance-2.4.1.jar:?] at org.apache.pulsar.functions.instance.JavaInstanceRunnable.processResult(JavaInstanceRunnable.java:418) ~[org.apache.pulsar-pulsar-functions-instance-2.4.1.jar:?] at org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:272) [org.apache.pulsar-pulsar-functions-instance-2.4.1.jar:?] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212] Caused by: org.elasticsearch.client.ResponseException: method [POST], host [http://135.91.35.218:9200], URI [/eventslist/_doc?timeout=1m], status line [HTTP/1.1 400 Bad Request] {"error":{"root_cause":[{"type":"invalid_type_name_exception","reason":"Document mapping type name can't start with '_', found: [_doc]"}],"type":"invalid_type_name_exception","reason":"Document mapping type name can't start with '_', found: [_doc]"},"status":400} **Expected behavior** **Screenshots** **Desktop (please complete the following information):** - OS: Ubuntu 16 **Additional context** This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar-client-go] branch master updated (55b9a6f -> d91a2a2)
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-client-go.git. from 55b9a6f Add multi topic consumer. (#100) add d91a2a2 Add client function to list topics in a namespace. (#101) No new revisions were added by this update. Summary of changes: pulsar/{impl_client.go => client_impl.go} | 45 +++--- .../{impl_client_test.go => client_impl_test.go} | 96 +- pulsar/impl_partition_producer.go | 9 +- pulsar/internal/commands.go| 2 + pulsar/producer_test.go| 5 +- pulsar/test_helper.go | 58 +++-- 6 files changed, 186 insertions(+), 29 deletions(-) rename pulsar/{impl_client.go => client_impl.go} (73%) rename pulsar/{impl_client_test.go => client_impl_test.go} (69%)
[GitHub] [pulsar-client-go] merlimat merged pull request #102: Updated zstd go library to avoid cgo dependency for compression
merlimat merged pull request #102: Updated zstd go library to avoid cgo dependency for compression URL: https://github.com/apache/pulsar-client-go/pull/102 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar-client-go] branch master updated: Updated zstd go library to avoid cgo dependency for compression (#102)
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-client-go.git The following commit(s) were added to refs/heads/master by this push: new a0d96c8 Updated zstd go library to avoid cgo dependency for compression (#102) a0d96c8 is described below commit a0d96c89ad5dc2091f5e28c4386f73ebddf99a4a Author: Matteo Merli AuthorDate: Mon Nov 18 14:26:20 2019 -0800 Updated zstd go library to avoid cgo dependency for compression (#102) --- go.mod | 6 +--- go.sum | 15 ++ pkg/compression/zstd.go| 45 + pkg/compression/zstd_native.go | 64 -- 4 files changed, 30 insertions(+), 100 deletions(-) diff --git a/go.mod b/go.mod index dddb428..339748e 100644 --- a/go.mod +++ b/go.mod @@ -3,16 +3,12 @@ module github.com/apache/pulsar-client-go go 1.12 require ( - github.com/DataDog/zstd v1.4.0 // indirect github.com/beefsack/go-rate v0.0.0-20180408011153-efa7637bb9b6 github.com/bmizerany/perks v0.0.0-20141205001514-d9a9656a3a4b - github.com/cespare/xxhash v1.1.0 // indirect - github.com/deckarep/golang-set v1.7.1 github.com/golang/protobuf v1.3.1 github.com/google/go-cmp v0.3.0 // indirect github.com/inconshreveable/mousetrap v1.0.0 // indirect - github.com/klauspost/compress v1.6.2 - github.com/klauspost/cpuid v1.2.1 // indirect + github.com/klauspost/compress v1.9.2 github.com/pierrec/lz4 v2.0.5+incompatible github.com/pkg/errors v0.8.1 github.com/sirupsen/logrus v1.4.1 diff --git a/go.sum b/go.sum index a1ccf2f..c3fdcf6 100644 --- a/go.sum +++ b/go.sum @@ -1,28 +1,18 @@ -github.com/DataDog/zstd v1.4.0 h1:vhoV+DUHnRZdKW1i5UMjAk2G4JY8wN4ayRfYDNdEhwo= -github.com/DataDog/zstd v1.4.0/go.mod h1:1jcaCB/ufaK+sKp1NBhlGmpz41jOoPQ35bpF36t7BBo= -github.com/OneOfOne/xxhash v1.2.2 h1:KMrpdQIwFcEqXDklaen+P1axHaj9BSKzvpUUfnHldSE= -github.com/OneOfOne/xxhash v1.2.2/go.mod h1:HSdplMjZKSmBqAxg5vPj2TmRDmfkzw+cTzAElWljhcU= github.com/beefsack/go-rate v0.0.0-20180408011153-efa7637bb9b6 h1:KXlsf+qt/X5ttPGEjR0tPH1xaWWoKBEg9Q1THAj2h3I= github.com/beefsack/go-rate v0.0.0-20180408011153-efa7637bb9b6/go.mod h1:6YNgTHLutezwnBvyneBbwvB8C82y3dcoOj5EQJIdGXA= github.com/bmizerany/perks v0.0.0-20141205001514-d9a9656a3a4b h1:AP/Y7sqYicnjGDfD5VcY4CIfh1hRXBUavxrvELjTiOE= github.com/bmizerany/perks v0.0.0-20141205001514-d9a9656a3a4b/go.mod h1:ac9efd0D1fsDb3EJvhqgXRbFx7bs2wqZ10HQPeU8U/Q= -github.com/cespare/xxhash v1.1.0 h1:a6HrQnmkObjyL+Gs60czilIUGqrzKutQD6XZog3p+ko= -github.com/cespare/xxhash v1.1.0/go.mod h1:XrSqR1VqqWfGrhpAt58auRo0WTKS1nRRg3ghfAqPWnc= github.com/davecgh/go-spew v1.1.0/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38= github.com/davecgh/go-spew v1.1.1 h1:vj9j/u1bqnvCEfJOwUhtlOARqs3+rkHYY13jYWTU97c= github.com/davecgh/go-spew v1.1.1/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38= -github.com/deckarep/golang-set v1.7.1 h1:SCQV0S6gTtp6itiFrTqI+pfmJ4LN85S1YzhDf9rTHJQ= -github.com/deckarep/golang-set v1.7.1/go.mod h1:93vsz/8Wt4joVM7c2AVqh+YRMiUSc14yDtF28KmMOgQ= github.com/golang/protobuf v1.3.1 h1:YF8+flBXS5eO826T4nzqPrxfhQThhXl0YzfuUPu4SBg= github.com/golang/protobuf v1.3.1/go.mod h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U= github.com/google/go-cmp v0.3.0 h1:crn/baboCvb5fXaQ0IJ1SGTsTVrWpDsCWC8EGETZijY= github.com/google/go-cmp v0.3.0/go.mod h1:8QqcDgzrUqlUb/G2PQTWiueGozuR1884gddMywk6iLU= github.com/inconshreveable/mousetrap v1.0.0 h1:Z8tu5sraLXCXIcARxBp/8cbvlwVa7Z1NHg9XEKhtSvM= github.com/inconshreveable/mousetrap v1.0.0/go.mod h1:PxqpIevigyE2G7u3NXJIT2ANytuPF1OarO4DADm73n8= -github.com/klauspost/compress v1.6.2 h1:D9kM6nOc1x+yA/DW/k81uG1xdmwqCMQ/A266P1edQEw= -github.com/klauspost/compress v1.6.2/go.mod h1:RyIbtBH6LamlWaDj8nUwkbUhJ87Yi3uG0guNDohfE1A= -github.com/klauspost/cpuid v1.2.1 h1:vJi+O/nMdFt0vqm8NZBI6wzALWdA2X+egi0ogNyrC/w= -github.com/klauspost/cpuid v1.2.1/go.mod h1:Pj4uuM528wm8OyEC2QMXAi2YiTZ96dNQPGgoMS4s3ek= +github.com/klauspost/compress v1.9.2 h1:LfVyl+ZlLlLDeQ/d2AqfGIIH4qEDu0Ed2S5GyhCWIWY= +github.com/klauspost/compress v1.9.2/go.mod h1:RyIbtBH6LamlWaDj8nUwkbUhJ87Yi3uG0guNDohfE1A= github.com/konsorten/go-windows-terminal-sequences v1.0.1 h1:mweAR1A6xJ3oS2pRaGiHgQ4OO8tzTaLawm8vnODuwDk= github.com/konsorten/go-windows-terminal-sequences v1.0.1/go.mod h1:T0+1ngSBFLxvqU3pZ+m/2kptfBszLMUkC4ZK/EgS/cQ= github.com/pierrec/lz4 v2.0.5+incompatible h1:2xWsjqPFWcplujydGg4WmhC/6fZqK42wMM8aXeqhl0I= @@ -33,7 +23,6 @@ github.com/pmezard/go-difflib v1.0.0 h1:4DBwDE0NGyQoBHbLQYPwSUPoCMWR5BEzIk/f1lZb github.com/pmezard/go-difflib v1.0.0/go.mod h1:iKH77koFhYxTK1pcRnkKkqfTogsbg7gZNVY4sRDYZ/4= github.com/sirupsen/logrus v1.4.1 h1:GL2rEmy6nsikmW0r8opw9JIRScdMF5hA8cOYLH7In1k= github.com/sirupsen/logrus v1.4.1/go.mod h1:ni0Sbl
[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.
codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation. URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555277674 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] huangdx0726 opened a new pull request #5691: [Issues 5681] fix example code of java client
huangdx0726 opened a new pull request #5691: [Issues 5681] fix example code of java client URL: https://github.com/apache/pulsar/pull/5691 [Issues 5681] fix example code of java client Fixes #5681 ### Motivation The example code of java client can't work. ``` Producer producer = PulsarUtils.getClient().newProducer(Schema.STRING) .topic("my-topic") .enableBatch(false) .create(); // 3 messages with "key-1", 3 messages with "key-2", 2 messages with "key-3" and 2 messages with "key-4" producer.newMessage().key("key-1").value("message-1-1").send(); producer.newMessage().key("key-1").value("message-1-2").send(); producer.newMessage().key("key-1").value("message-1-3").send(); producer.newMessage().key("key-2").value("message-2-1").send(); producer.newMessage().key("key-2").value("message-2-2").send(); producer.newMessage().key("key-2").value("message-2-3").send(); producer.newMessage().key("key-3").value("message-3-1").send(); producer.newMessage().key("key-3").value("message-3-2").send(); producer.newMessage().key("key-4").value("message-4-1").send(); producer.newMessage().key("key-4").value("message-4-2").send(); ``` ### Modifications change the enableBatch method to enableBatching. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] tuteng closed issue #5474: Support CDC Connector for MongoDB
tuteng closed issue #5474: Support CDC Connector for MongoDB URL: https://github.com/apache/pulsar/issues/5474 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] tuteng merged pull request #5590: [Issue 5474][pulsar-io-debezium] Support CDC Connector for MongoDB
tuteng merged pull request #5590: [Issue 5474][pulsar-io-debezium] Support CDC Connector for MongoDB URL: https://github.com/apache/pulsar/pull/5590 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (69cd6eb -> 8d1f793)
This is an automated email from the ASF dual-hosted git repository. guangning pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 69cd6eb fix typo error (#5663) add 8d1f793 [Issue 5474][pulsar-io-debezium] Support CDC Connector for MongoDB (#5590) No new revisions were added by this update. Summary of changes: distribution/io/src/assemble/io.xml| 1 + .../{data-generator => debezium/mongodb}/pom.xml | 20 ++--- .../debezium/mongodb/DebeziumMongoDbSource.java} | 12 +-- .../resources/META-INF/services/pulsar-io.yaml | 6 +- .../resources/debezium-mongodb-source-config.yaml} | 25 +++ pulsar-io/debezium/pom.xml | 1 + ...ontainer.java => DebeziumMongoDbContainer.java} | 31 .../integration/functions/PulsarFunctionsTest.java | 62 .../io/DebeziumMongoDbSourceTester.java| 85 ++ .../integration/io/DebeziumMySqlSourceTester.java | 18 - .../io/DebeziumPostgreSqlSourceTester.java | 18 - .../pulsar/tests/integration/io/SourceTester.java | 31 12 files changed, 221 insertions(+), 89 deletions(-) copy pulsar-io/{data-generator => debezium/mongodb}/pom.xml (76%) copy pulsar-io/debezium/{mysql/src/main/java/org/apache/pulsar/io/debezium/mysql/DebeziumMysqlSource.java => mongodb/src/main/java/org/apache/pulsar/io/debezium/mongodb/DebeziumMongoDbSource.java} (85%) copy pulsar-io/{aerospike => debezium/mongodb}/src/main/resources/META-INF/services/pulsar-io.yaml (85%) copy pulsar-io/debezium/{postgres/src/main/resources/debezium-postgres-source-config.yaml => mongodb/src/main/resources/debezium-mongodb-source-config.yaml} (65%) copy tests/integration/src/test/java/org/apache/pulsar/tests/integration/containers/{DebeziumMySQLContainer.java => DebeziumMongoDbContainer.java} (63%) create mode 100644 tests/integration/src/test/java/org/apache/pulsar/tests/integration/io/DebeziumMongoDbSourceTester.java
[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.
codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation. URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555295316 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] tuteng commented on issue #5474: Support CDC Connector for MongoDB
tuteng commented on issue #5474: Support CDC Connector for MongoDB URL: https://github.com/apache/pulsar/issues/5474#issuecomment-555295267 Mongodb's connector is ready for use https://github.com/apache/pulsar/pull/5590. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] jiazhai commented on issue #5677: [Issue 5676][C++ client] Expose redelivery count
jiazhai commented on issue #5677: [Issue 5676][C++ client] Expose redelivery count URL: https://github.com/apache/pulsar/pull/5677#issuecomment-555296062 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] tuteng opened a new issue #5692: [Doc]Add document for mongodb connector
tuteng opened a new issue #5692: [Doc]Add document for mongodb connector URL: https://github.com/apache/pulsar/issues/5692 After adding MongoDB connector, we need to add a document to tell users how to use MongoDB connectors. Like this: http://pulsar.apache.org/docs/en/io-cdc-debezium/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar-manager] branch master updated: Remove streamnative from the project (#213)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git The following commit(s) were added to refs/heads/master by this push: new 30db686 Remove streamnative from the project (#213) 30db686 is described below commit 30db68604ea6e1d86fbc1f1b43b7cff0db02c254 Author: tuteng AuthorDate: Tue Nov 19 10:21:00 2019 +0800 Remove streamnative from the project (#213) --- CONTRIBUTING.md | 6 +++--- README.md | 18 ++ docker/Dockerfile | 6 +++--- docs/developer-guide.md | 10 +- front-end/README.md | 4 ++-- front-end/package.json | 4 ++-- src/README.md | 4 ++-- 7 files changed, 23 insertions(+), 29 deletions(-) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index eb1e4ff..0d70bb3 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -17,7 +17,7 @@ Node 10.15 | https://nodejs.org/en/ ### Fork pulsar-manager repository -Fork the [pulsar-manager](https://github.com/streamnative/pulsar-manager) repository to your GitHub repository. +Fork the [pulsar-manager](https://github.com/apache/pulsar-manager) repository to your GitHub repository. ### Install pulsar-manager dependency @@ -62,14 +62,14 @@ Follow the instructions [here](https://howtodoinjava.com/automation/lombok-eclip 1. Add a remote repository. ```bash -$ git remote add streamnative g...@github.com:streamnative/pulsar-manager.git +$ git remote add apache g...@github.com:apache/pulsar-manager.git ``` 2. Sync you local repository with the remote repository. ```bash $ git checkout master -$ git pull streamnative master +$ git pull apache master ``` 3. Create your PR and commit code changes. diff --git a/README.md b/README.md index 019f28d..c028a65 100644 --- a/README.md +++ b/README.md @@ -1,7 +1,5 @@ # Apache Pulsar manager -[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fpulsar-manager.svg?type=shield)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2Fpulsar-manager?ref=badge_shield) - Apache Pulsar manager is a web-based GUI management tool for managing and monitoring Pulsar. ## Feature @@ -67,7 +65,7 @@ The pulsar-manager can monitor topics and subscriptions. ## Prerequisites -* Java 8 or later +* Java JDK 1.8 * Node 10.15.3 or later * Npm 6.4.1 or later * Pulsar 2.4.0 or later @@ -101,7 +99,7 @@ The pulsar-manager can monitor topics and subscriptions. * `PASSWORD`: the password of MySQL ``` -docker pull streamnative/pulsar-manager +docker pull apache/pulsar-manager docker run -it -p 9527:9527 -e REDIRECT_HOST=front-end-ip -e REDIRECT_PORT=front-end-port -e DRIVER_CLASS_NAME=com.mysql.jdbc.Driver -e URL='jdbc-url' -e USERNAME=root -e PASSWORD=pulsar pulsar-manager /bin/sh ``` @@ -116,7 +114,7 @@ The pulsar-manager can monitor topics and subscriptions. (1) Download the source code. ``` -git clone https://github.com/streamnative/pulsar-manager +git clone https://github.com/apache/pulsar-manager ``` (2) Build and start the backend. @@ -150,7 +148,7 @@ Pulsar Manager bundles JDBC Drivers for [HerdDB](https://github.com/diennea/herd The default confguration starts and embedded in-memory only HerdDB database. HerdDB can be used in production, you just have to use the correct JDBC URL. -Follow the instructions in [application.properties](https://github.com/streamnative/pulsar-manager/blob/master/src/main/resources/application.properties) to switch the connection to a standalone HerdDB service or cluster. +Follow the instructions in [application.properties](https://github.com/apache/pulsar-manager/blob/master/src/main/resources/application.properties) to switch the connection to a standalone HerdDB service or cluster. The JDBC URL will look like this: jdbc:herddb:server:localhost:7000 @@ -164,14 +162,10 @@ In order to start and setup an HerdDB database follow the instructions on the [H ## Back end -For more information about the back end, see [pulsar-manager-backend](https://github.com/streamnative/pulsar-manager/blob/master/src/README.md). +For more information about the back end, see [pulsar-manager-backend](https://github.com/apache/pulsar-manager/blob/master/src/README.md). ## Front end -For more information about the front end, see [pulsar-manager-frontend](https://github.com/streamnative/pulsar-manager/blob/master/front-end/README.md). - - +For more information about the front end, see [pulsar-manager-frontend](https://github.com/apache/pulsar-manager/blob/master/front-end/README.md). -## License -[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fpulsar-manager.svg?type=large)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2F
[GitHub] [pulsar] sijie commented on issue #5691: [Issues 5681] fix example code of java client
sijie commented on issue #5691: [Issues 5681] fix example code of java client URL: https://github.com/apache/pulsar/pull/5691#issuecomment-555303234 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar-manager] branch master updated: Update readme for start backend service (#211)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git The following commit(s) were added to refs/heads/master by this push: new c3fd41f Update readme for start backend service (#211) c3fd41f is described below commit c3fd41fa06a1decfcfc56196e86aafa412bc93f9 Author: tuteng AuthorDate: Tue Nov 19 10:35:31 2019 +0800 Update readme for start backend service (#211) * Update readme for start backend service --- README.md | 14 -- docker/Dockerfile | 4 +++- docker/supervisord.conf | 2 +- src/README.md | 4 ++-- 4 files changed, 14 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index c028a65..b8033f0 100644 --- a/README.md +++ b/README.md @@ -90,17 +90,17 @@ The pulsar-manager can monitor topics and subscriptions. * `REDIRECT_PORT`: the port of the front-end server. -* `DRIVER_CLASS_NAME`: the driver class name of MySQL. +* `DRIVER_CLASS_NAME`: the driver class name of PostgreSQL. -* `URL`: the url of MySQL jdbc, example: jdbc:mysql://localhost:3306/pulsar_manager?useSSL=false +* `URL`: the url of PostgreSQL jdbc, example: jdbc:postgresql://127.0.0.1:5432/pulsar_manager -* `USERNAME`: the username of MySQL +* `USERNAME`: the username of PostgreSQL -* `PASSWORD`: the password of MySQL +* `PASSWORD`: the password of PostgreSQL ``` docker pull apache/pulsar-manager -docker run -it -p 9527:9527 -e REDIRECT_HOST=front-end-ip -e REDIRECT_PORT=front-end-port -e DRIVER_CLASS_NAME=com.mysql.jdbc.Driver -e URL='jdbc-url' -e USERNAME=root -e PASSWORD=pulsar pulsar-manager /bin/sh +docker run -it -p 9527:9527 -e REDIRECT_HOST=front-end-ip -e REDIRECT_PORT=front-end-port -e DRIVER_CLASS_NAME=org.postgresql.Driver -e URL='jdbc-url' -e USERNAME=root -e PASSWORD=pulsar pulsar-manager /bin/sh ``` This is an example: @@ -121,7 +121,9 @@ The pulsar-manager can monitor topics and subscriptions. ``` cd pulsar-manager ./gradlew build -x test -java -jar ./build/libs/pulsar-manager.jar +cd build/distributions +unzip pulsar-manager.zip or tar -zxvf pulsar-manager.tar +./pulsar-manager/bin/pulsar-manager ``` (3) Build and start the front end. diff --git a/docker/Dockerfile b/docker/Dockerfile index 223dd62..d5138f6 100644 --- a/docker/Dockerfile +++ b/docker/Dockerfile @@ -43,7 +43,9 @@ RUN mkdir -p /run/nginx WORKDIR /pulsar-manager -COPY build/libs/*.jar pulsar-manager.jar +COPY build/distributions/pulsar-manager.tar . + +RUN tar -zxvf pulsar-manager.tar COPY docker/supervisord.conf /etc/ diff --git a/docker/supervisord.conf b/docker/supervisord.conf index bd93427..0c990f2 100644 --- a/docker/supervisord.conf +++ b/docker/supervisord.conf @@ -28,5 +28,5 @@ minfds=1024 minprocs=200 [program:pulsar-manager-backend] -command = /usr/bin/java -jar /pulsar-manager/pulsar-manager.jar --redirect.host=%(ENV_REDIRECT_HOST)s --redirect.port=%(ENV_REDIRECT_PORT)s --spring.datasource.driver-class-name=%(ENV_DRIVER_CLASS_NAME)s --spring.datasource.url=%(ENV_URL)s --spring.datasource.username=%(ENV_USERNAME)s --spring.datasource.password=%(ENV_PASSWORD)s --spring.datasource.initialization-mode=never +command = /pulsar-manager/pulsar-manager/bin/pulsar-manager --redirect.host=%(ENV_REDIRECT_HOST)s --redirect.port=%(ENV_REDIRECT_PORT)s --spring.datasource.driver-class-name=%(ENV_DRIVER_CLASS_NAME)s --spring.datasource.url=%(ENV_URL)s --spring.datasource.username=%(ENV_USERNAME)s --spring.datasource.password=%(ENV_PASSWORD)s --spring.datasource.initialization-mode=never user = root diff --git a/src/README.md b/src/README.md index 542a62e..34bb30a 100644 --- a/src/README.md +++ b/src/README.md @@ -21,7 +21,7 @@ Pulsar manager backend is a supplement and improvement to Pulsar broker. ### How to set parameters when starting back-end services ``` -java -jar ./build/libs/pulsar-manager.jar --redirect.host=http://localhost --redirect.port=9527 insert.stats.interval=60 +./build/distributions/pulsar-manager/bin/pulsar-manager --redirect.host=http://localhost --redirect.port=9527 insert.stats.interval=60 ``` ### Use custom databases @@ -60,7 +60,7 @@ For more information, see [Apache Pulsar](http://pulsar.apache.org/docs/en/secur * Method 1: Use command-line tool ``` -java -jar ./build/libs/pulsar-manager.jar --redirect.host=http://localhost --redirect.port=9527 insert.stats.interval=60 --backend.jwt.token=token --jwt.broker.token.mode=PRIVATE --jwt.broker.private.key=file:///path/broker-private.key --jwt.broker.public.key=file:///path/broker-public.key +./build/distributions/pulsar-manager/bin/pulsar-manager --redirect.host=http://localhost --redirect.port=9
[GitHub] [pulsar] sijie commented on issue #5674: Parametrize grpc and metrics ports so that they can be configured
sijie commented on issue #5674: Parametrize grpc and metrics ports so that they can be configured URL: https://github.com/apache/pulsar/pull/5674#issuecomment-555306008 run integration tests run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5659: Fix prometheus access control not enough in kubernetes
sijie commented on issue #5659: Fix prometheus access control not enough in kubernetes URL: https://github.com/apache/pulsar/pull/5659#issuecomment-555306381 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5639: Fix ProxyLookupThrottlingTest
sijie commented on issue #5639: Fix ProxyLookupThrottlingTest URL: https://github.com/apache/pulsar/pull/5639#issuecomment-555306670 run cpp tests run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui opened a new issue #5693: [documentation] Clarify the messages(data) be invisible
codelipenghui opened a new issue #5693: [documentation] Clarify the messages(data) be invisible URL: https://github.com/apache/pulsar/issues/5693 **Is your feature request related to a problem? Please describe.** If all subscriptions mark delete at a position, the messages before that position will be delete. Always, users understand the mechanism like send a message to the topic, and a new consumer A create a new subscription SUB-A with the earliest position and acknowledge the message, then a new consumer B also create a new subscription SUB-B with the earliest position, since consumer A already acknowledge the message, and at that time topic only have SUB-A subscription, so consumer B should not receive that message. But, actually the consumer B also can receive that message, because broker will not delete the current active ledger in the topic, data will be invisible to the user until the ledger rollover happens. So, here add an issue to track the documentation of how messages be invisible works. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] tuteng commented on issue #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile
tuteng commented on issue #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile URL: https://github.com/apache/pulsar/pull/5689#issuecomment-555308259 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #5691: [Issues 5681] fix example code of java client
codelipenghui commented on issue #5691: [Issues 5681] fix example code of java client URL: https://github.com/apache/pulsar/pull/5691#issuecomment-555312365 run Integration Tests run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #5691: [Issues 5681] fix example code of java client
codelipenghui commented on issue #5691: [Issues 5681] fix example code of java client URL: https://github.com/apache/pulsar/pull/5691#issuecomment-555312447 run Integration Tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #5679: [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1
codelipenghui commented on issue #5679: [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1 URL: https://github.com/apache/pulsar/pull/5679#issuecomment-555312870 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] zymap commented on issue #5615: Fix hangs when type invalid args at command-line
zymap commented on issue #5615: Fix hangs when type invalid args at command-line URL: https://github.com/apache/pulsar/pull/5615#issuecomment-555313787 @sijie It will hang when we using command-line tools. The process hangs because there has a RuntimeException thrown and we are not handling. I found we exit the `PulsarAdminTool` by the `System.exit`. When we parse an unknown command it will throw a RuntimeException. We need a boolean value to check should we exit. When it threw an Exception, there is no value to return so it can not exit as usual. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.
codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation. URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555319019 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (8d1f793 -> 75c7229)
This is an automated email from the ASF dual-hosted git repository. zhaijia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 8d1f793 [Issue 5474][pulsar-io-debezium] Support CDC Connector for MongoDB (#5590) add 75c7229 Add epoch for connection handler to handle create producer timeout. (#5571) No new revisions were added by this update. Summary of changes: .../pulsar/broker/service/AbstractTopic.java | 67 ++-- .../pulsar/broker/service/BacklogQuotaManager.java | 5 +- .../org/apache/pulsar/broker/service/Producer.java | 29 -- .../apache/pulsar/broker/service/ServerCnx.java| 12 ++- .../org/apache/pulsar/broker/service/Topic.java| 3 +- .../service/nonpersistent/NonPersistentTopic.java | 52 -- .../broker/service/persistent/PersistentTopic.java | 63 +--- .../stats/prometheus/NamespaceStatsAggregator.java | 2 +- .../pulsar/broker/service/PersistentTopicTest.java | 62 +-- .../pulsar/client/api/ProducerCreationTest.java| 95 + .../client/impl/MessagePublishThrottlingTest.java | 4 +- .../pulsar/client/impl/ConnectionHandler.java | 18 +++- .../apache/pulsar/client/impl/ProducerImpl.java| 7 +- .../apache/pulsar/common/api/proto/PulsarApi.java | 114 + .../apache/pulsar/common/protocol/Commands.java| 7 +- pulsar-common/src/main/proto/PulsarApi.proto | 7 ++ 16 files changed, 435 insertions(+), 112 deletions(-) create mode 100644 pulsar-broker/src/test/java/org/apache/pulsar/client/api/ProducerCreationTest.java
[GitHub] [pulsar] jiazhai merged pull request #5571: Add epoch for connection handler to handle create producer timeout.
jiazhai merged pull request #5571: Add epoch for connection handler to handle create producer timeout. URL: https://github.com/apache/pulsar/pull/5571 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] jiazhai closed issue #5535: failed to add producer to topic after connection closed
jiazhai closed issue #5535: failed to add producer to topic after connection closed URL: https://github.com/apache/pulsar/issues/5535 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie closed issue #5346: bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1
sijie closed issue #5346: bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1 URL: https://github.com/apache/pulsar/issues/5346 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (75c7229 -> 568df47)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 75c7229 Add epoch for connection handler to handle create producer timeout. (#5571) add 568df47 [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1 (#5679) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/pulsar/PulsarStandaloneStarter.java | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-)
[GitHub] [pulsar] sijie commented on issue #5628: Fix: Netty threads may still linger after client close
sijie commented on issue #5628: Fix: Netty threads may still linger after client close URL: https://github.com/apache/pulsar/pull/5628#issuecomment-555331978 run java8 tests run integration tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie merged pull request #5679: [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1
sijie merged pull request #5679: [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1 URL: https://github.com/apache/pulsar/pull/5679 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5670: [Doc] Re-organize built-in connector guide
sijie commented on issue #5670: [Doc] Re-organize built-in connector guide URL: https://github.com/apache/pulsar/pull/5670#issuecomment-555332686 run cpp tests run integration tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] pradeep-mishra commented on issue #5610: Fluentd connector for Apache Pulsar
pradeep-mishra commented on issue #5610: Fluentd connector for Apache Pulsar URL: https://github.com/apache/pulsar/issues/5610#issuecomment-555332888 @zwzch thanks, i ll look into it. :) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5671: [Doc] Add HBase sink connector guide
sijie commented on issue #5671: [Doc] Add HBase sink connector guide URL: https://github.com/apache/pulsar/pull/5671#issuecomment-555333028 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5647: [docs] Update content of Pulsar SQL overview
sijie commented on issue #5647: [docs] Update content of Pulsar SQL overview URL: https://github.com/apache/pulsar/pull/5647#issuecomment-55526 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar-manager] 01/01: Merge branch 'master' into branch-0.1.0
This is an automated email from the ASF dual-hosted git repository. guangning pushed a commit to branch branch-0.1.0 in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git commit 962f93ddc49437487de1697f8e4650ee2634d41c Merge: 2643a78 c3fd41f Author: guangning AuthorDate: Tue Nov 19 12:57:19 2019 +0800 Merge branch 'master' into branch-0.1.0 CONTRIBUTING.md | 6 +++--- README.md | 32 ++-- docker/Dockerfile | 10 ++ docker/supervisord.conf | 2 +- docs/developer-guide.md | 10 +- front-end/README.md | 4 ++-- front-end/package.json | 4 ++-- src/README.md | 8 8 files changed, 37 insertions(+), 39 deletions(-)
[pulsar-manager] branch branch-0.1.0 updated (2643a78 -> 962f93d)
This is an automated email from the ASF dual-hosted git repository. guangning pushed a change to branch branch-0.1.0 in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git. from 2643a78 Merge branch 'master' into branch-0.1.0 add 30db686 Remove streamnative from the project (#213) add c3fd41f Update readme for start backend service (#211) new 962f93d Merge branch 'master' into branch-0.1.0 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: CONTRIBUTING.md | 6 +++--- README.md | 32 ++-- docker/Dockerfile | 10 ++ docker/supervisord.conf | 2 +- docs/developer-guide.md | 10 +- front-end/README.md | 4 ++-- front-end/package.json | 4 ++-- src/README.md | 8 8 files changed, 37 insertions(+), 39 deletions(-)
[GitHub] [pulsar] sijie commented on issue #5639: Fix ProxyLookupThrottlingTest
sijie commented on issue #5639: Fix ProxyLookupThrottlingTest URL: https://github.com/apache/pulsar/pull/5639#issuecomment-555333469 run cpp tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar-manager] annotated tag v0.1.0-candidate-4 updated (962f93d -> 0d80979)
This is an automated email from the ASF dual-hosted git repository. guangning pushed a change to annotated tag v0.1.0-candidate-4 in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git. *** WARNING: tag v0.1.0-candidate-4 was modified! *** from 962f93d (commit) to 0d80979 (tag) tagging 962f93ddc49437487de1697f8e4650ee2634d41c (commit) replaces v0.1.0-candidate-3 by guangning on Tue Nov 19 12:58:38 2019 +0800 - Log - Release 0.1.0-candidate-4 -BEGIN PGP SIGNATURE- iQFJBAABCAAzFiEEfLgyKwIZSFWNsgIYV3wHyoZ66RAFAl3Tdn4VHGd1YW5nbmlu Z0BhcGFjaGUub3JnAAoJEFd8B8qGeukQvk0H/0N9XbbB5bMTTmixSJxQetCV9GCh 80M4hq4/L7y2v64031u5PlTWO1dVgVqeAeYzqNb85LXFBi1SDpd4CKz5+S2EksKf pYfhNqI5+1u38ybER5Mn3QCD6AfAwb9IT4y7BwRcx7M7fLsLbo9uT2cZ2HC0Mp2L 4F2Q+a/fCtoxE1f+aR5z2BtXY82jgpzvcKDyO7O3ikrs+UFxlU8tOUs8c6MmrMKB UtPtvXcaa5adWxmMtaWrS+DukD4ozJmTF++ykqQM5s+9JkEzGAkjVxL6nGPP9mLF 6lqAHPNxu5JVSujOZD8F0gICvCZMdOwIObYzUAy201qEVqG8vd2Vruzn32Q= =nP4O -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
[GitHub] [pulsar] sijie commented on issue #5648: [docs] Update sql getting started
sijie commented on issue #5648: [docs] Update sql getting started URL: https://github.com/apache/pulsar/pull/5648#issuecomment-555333431 run java8 tests run integration tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on a change in pull request #5632: [Issue 5614] Deprecate brokerServicePurgeInactiveFrequencyInSeconds
sijie commented on a change in pull request #5632: [Issue 5614] Deprecate brokerServicePurgeInactiveFrequencyInSeconds URL: https://github.com/apache/pulsar/pull/5632#discussion_r345544337 ## File path: pulsar-broker-common/src/main/java/org/apache/pulsar/broker/ServiceConfiguration.java ## @@ -253,7 +253,7 @@ category = CATEGORY_POLICIES, doc = "How often to check for inactive topics" ) -private long brokerDeleteInactiveTopicsFrequencySeconds = 60; +private int brokerDeleteInactiveTopicsFrequencySeconds = 60; Review comment: Any particular reason that you need to change this type? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on a change in pull request #5632: [Issue 5614] Deprecate brokerServicePurgeInactiveFrequencyInSeconds
sijie commented on a change in pull request #5632: [Issue 5614] Deprecate brokerServicePurgeInactiveFrequencyInSeconds URL: https://github.com/apache/pulsar/pull/5632#discussion_r345544457 ## File path: pulsar-broker-common/src/main/java/org/apache/pulsar/broker/ServiceConfiguration.java ## @@ -1200,6 +1200,7 @@ doc = "How often broker checks for inactive topics to be deleted (topics with no subscriptions and no one connected)" ) private int brokerServicePurgeInactiveFrequencyInSeconds = 60; +@Deprecated Review comment: I don't think you add the `@Deprecated` annotation in the right place. You need add this annotation at line 1202. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5635: [Issue 5612] Use Reactivestreams client for Mongo Sink
sijie commented on issue #5635: [Issue 5612] Use Reactivestreams client for Mongo Sink URL: https://github.com/apache/pulsar/pull/5635#issuecomment-555333906 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5627: [Issue 5626][pulsar-function-go] Fix a memory leak of pulsar-function-go library regarding time.NewTimer()
sijie commented on issue #5627: [Issue 5626][pulsar-function-go] Fix a memory leak of pulsar-function-go library regarding time.NewTimer() URL: https://github.com/apache/pulsar/pull/5627#issuecomment-555334124 run integration tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5624: [Issue 4601,5215][pulsar-io-jdbc]Support postgresql,sqlserver,mariadb,clickhouse jdbc source sink
sijie commented on issue #5624: [Issue 4601,5215][pulsar-io-jdbc]Support postgresql,sqlserver,mariadb,clickhouse jdbc source sink URL: https://github.com/apache/pulsar/pull/5624#issuecomment-555334329 @huangdx0726 I don't think it is a good idea to put all drivers together. 1) it will make the NAR package very large; 2) it becomes very difficult to manage the dependencies. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5609: [Doc] Remove duplicate pages
sijie commented on issue #5609: [Doc] Remove duplicate pages URL: https://github.com/apache/pulsar/pull/5609#issuecomment-555334765 @tuteng @Jennifer88huang : since you are fixing the links between different versions of documentation, can you please take a look at this pull request? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar-manager.wiki] branch master updated: Updated Release process (markdown)
This is an automated email from the ASF dual-hosted git repository. guangning pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-manager.wiki.git The following commit(s) were added to refs/heads/master by this push: new 3fa9f68 Updated Release process (markdown) 3fa9f68 is described below commit 3fa9f6896768b297f44cf0f7f89b01d42b811e7d Author: tuteng AuthorDate: Tue Nov 19 13:04:23 2019 +0800 Updated Release process (markdown) --- Release-process.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/Release-process.md b/Release-process.md index 5a4ab4e..048f0ac 100644 --- a/Release-process.md +++ b/Release-process.md @@ -89,8 +89,8 @@ The src and bin artifacts need to be signed and uploaded to the dist SVN reposit ``` gpg -b --armor apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz gpg -b --armor apache-pulsar-manager-0.X.0-candidate-1-src.tar.gz -shasum -a 512 apache-pulsar-manager-0.X.0-candidate-2-bin.tar.gz > apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz.sha512 -shasum -a 512 apache-pulsar-manager-0.X.0-candidate-2-src.tar.gz > apache-pulsar-manager-0.X.0-candidate-2-src.tar.gz.sha512 +shasum -a 512 apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz > apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz.sha512 +shasum -a 512 apache-pulsar-manager-0.X.0-candidate-1-src.tar.gz > apache-pulsar-manager-0.X.0-candidate-1-src.tar.gz.sha512 svn co https://dist.apache.org/repos/dist/dev/pulsar/pulsar-manager pulsar-manager cd pulsar-manager
[GitHub] [pulsar] sijie commented on issue #5358: PIP-45: Switch ManagedLedger to use MetadataStore interface
sijie commented on issue #5358: PIP-45: Switch ManagedLedger to use MetadataStore interface URL: https://github.com/apache/pulsar/pull/5358#issuecomment-555335442 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie commented on issue #5342: Use simple GC settings when running integration tests
sijie commented on issue #5342: Use simple GC settings when running integration tests URL: https://github.com/apache/pulsar/pull/5342#issuecomment-555335484 run integration tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie merged pull request #5023: `hasMessageAvailable` should return false when Reader read from latest messages
sijie merged pull request #5023: `hasMessageAvailable` should return false when Reader read from latest messages URL: https://github.com/apache/pulsar/pull/5023 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie closed issue #4912: Java client Reader readNext and hasMessageAvailable not working when attempting to find last message in topic
sijie closed issue #4912: Java client Reader readNext and hasMessageAvailable not working when attempting to find last message in topic URL: https://github.com/apache/pulsar/issues/4912 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (568df47 -> bfcfdf6)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 568df47 [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1 (#5679) add bfcfdf6 `hasMessageAvailable` should return false when Reader read from latest messages (#5023) No new revisions were added by this update. Summary of changes: .../org/apache/pulsar/client/impl/ReaderTest.java | 32 ++ .../apache/pulsar/client/impl/ConsumerImpl.java| 7 + 2 files changed, 39 insertions(+)
[GitHub] [pulsar] sijie merged pull request #5615: Fix hangs when type invalid args at command-line
sijie merged pull request #5615: Fix hangs when type invalid args at command-line URL: https://github.com/apache/pulsar/pull/5615 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] sijie closed issue #5533: Missing CLI error handling in pulsar-admin
sijie closed issue #5533: Missing CLI error handling in pulsar-admin URL: https://github.com/apache/pulsar/issues/5533 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (bfcfdf6 -> d16e79a)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from bfcfdf6 `hasMessageAvailable` should return false when Reader read from latest messages (#5023) add d16e79a Fix hangs when type invalid args at command-line (#5615) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/pulsar/admin/cli/CmdBase.java | 13 +++-- 1 file changed, 11 insertions(+), 2 deletions(-)
[GitHub] [pulsar] sijie merged pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon
sijie merged pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon URL: https://github.com/apache/pulsar/pull/5675 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (d16e79a -> 16affa0)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from d16e79a Fix hangs when type invalid args at command-line (#5615) add 16affa0 fix bkenv has no effect bug when start bookie using bin/pulsar-daemon (#5675) No new revisions were added by this update. Summary of changes: bin/pulsar | 6 ++ bin/pulsar-daemon | 6 ++ bin/pulsar-perf| 6 ++ conf/pulsar_env.sh | 4 src/pulsar-io-gen | 6 ++ 5 files changed, 24 insertions(+), 4 deletions(-)
[GitHub] [pulsar] tuteng commented on issue #5609: [Doc] Remove duplicate pages
tuteng commented on issue #5609: [Doc] Remove duplicate pages URL: https://github.com/apache/pulsar/pull/5609#issuecomment-555336917 > @tuteng @Jennifer88huang : since you are fixing the links between different versions of documentation, can you please take a look at this pull request? I will try my best to fix this problem this afternoon and then create a pr. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] wolfstudy commented on issue #4741: Remove failed stale producer from the connection
wolfstudy commented on issue #4741: Remove failed stale producer from the connection URL: https://github.com/apache/pulsar/pull/4741#issuecomment-555337967 Change the Milestone to 2.4.2, because of conflict. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] wolfstudy commented on issue #4799: Test cleanup and simplification
wolfstudy commented on issue #4799: Test cleanup and simplification URL: https://github.com/apache/pulsar/pull/4799#issuecomment-555337827 Change the Milestone to 2.4.2, because of conflict. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] wolfstudy commented on issue #4751: Get schema info with topic partition
wolfstudy commented on issue #4751: Get schema info with topic partition URL: https://github.com/apache/pulsar/pull/4751#issuecomment-555340868 Change the Milestone to 2.4.2, because of conflict. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] wolfstudy commented on issue #4877: Add schema admin api get schema info with schema version
wolfstudy commented on issue #4877: Add schema admin api get schema info with schema version URL: https://github.com/apache/pulsar/pull/4877#issuecomment-555341776 Change the Milestone to 2.4.2, because of conflict. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
svn commit: r36820 - in /dev/pulsar/pulsar-manager: pulsar-manager-0.1.0-candidate-2/ pulsar-manager-0.1.0-candidate-3/ pulsar-manager-0.1.0-candidate-4/
Author: guangning Date: Tue Nov 19 05:53:05 2019 New Revision: 36820 Log: Staging artifacts and signature for Pulsar Manager release 0.1.0 Added: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/ dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz (with props) dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512 dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz (with props) dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.sha512 Removed: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-2/ dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-3/ Added: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz == Binary file - no diff available. Propchange: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz -- svn:mime-type = application/octet-stream Added: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc == --- dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc (added) +++ dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc Tue Nov 19 05:53:05 2019 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEfLgyKwIZSFWNsgIYV3wHyoZ66RAFAl3Td9EACgkQV3wHyoZ6 +6RBGYwgAww1LeifQzwZp8EiZkjouDZmlN7BJQeNt1Thum0kp96JMVG61DDxv8B+p +2aw1vVidcCLETq1+B6im6VICrXjlPyOwRVKit4r109+OQcVYa0z49lnBfeUK10Nm +aNRK6ny1vhLOHe54d/N65ar6tvQpdwqQfA/K/+zcR/OwJSRCcSolmaqqOnW4pmaC +3ymCBM8vbl+sTUd7E5q9xBGJqhPdbuJzVjjybLoKVZatuba5BYbsX1uDMKiRXSTt +QbjwCpMsvXvd7wIJXEEVP/pWPdXBUqG2X7LUnNOnDYdkwZ64lTxbFpn/b4THG6aB +aGJKhxOhWaj64nZuL6gDs3FsXppVoQ== +=P4u/ +-END PGP SIGNATURE- Added: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512 == --- dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512 (added) +++ dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512 Tue Nov 19 05:53:05 2019 @@ -0,0 +1 @@ +bc25543b1693efc9eb1e037a1ae8cb68a1fe30edf69b179cf415a27dcc61fc4398928ea1a52053bcaa7baf51e0365a2bd3d609b712de4e4ebe8ae105602ac3ef apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz Added: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz == Binary file - no diff available. Propchange: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz -- svn:mime-type = application/octet-stream Added: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc == --- dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc (added) +++ dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc Tue Nov 19 05:53:05 2019 @@ -0,0 +1,11 @@ +-BEGIN PGP SIGNATURE- + +iQEzBAABCAAdFiEEfLgyKwIZSFWNsgIYV3wHyoZ66RAFAl3Td9oACgkQV3wHyoZ6 +6RDFeAgA7wq4PVJrtWgO7kkVVYZ+ScOAZKXGUqQfk7+zxjBRji41ATIaXFcuj5Z8 +6AhWcNFc23uNiSzMqIqKXpTIcNyd9YR2R65NGwbK+SasbFYtfBCQPY0hpvQWyfme +Guh7S2dQtQGL5hsWaq55T3DADCZjwedST8ZGTwgSbQ7klWdiPjY9qhyiz0RZpDQQ +hK3ouqi1ozKxRr/RwHPLe4APSFVne99kbF8cB8rh/csQXC36udAjBgVgmdRzLiZm +qZVLjausH/xiQD5yQxiFGLcnXv5vlB2E764uepFq70fSq8hlcWymfhDBzz46PtwN +vHXrqPYyaO0ZvBPTtLyUHiIpL6mT4w== +=ofaN +-END PGP SIGNATURE- Added: dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.sha512 == --- dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-ma
[GitHub] [pulsar] lspgn opened a new issue #5695: Go: Segfault on messageId serialize after getting it from producer
lspgn opened a new issue #5695: Go: Segfault on messageId serialize after getting it from producer URL: https://github.com/apache/pulsar/issues/5695 **Describe the bug** Looks like the following Go code (also happens with async): ``` id, err := producer.SendAndGetMsgID(context.Background(), msg) if err != nil { log.Fatal(err) } fmt.Printf("the %s successfully published with id %v\n", string(msg.Payload), id.Serialize()) ``` causes the following: ``` fatal error: unexpected signal during runtime execution [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x49a2965] runtime stack: runtime.throw(0x44a9483, 0x2a) /usr/local/Cellar/go/1.13.3/libexec/src/runtime/panic.go:774 +0x72 runtime.sigpanic() /usr/local/Cellar/go/1.13.3/libexec/src/runtime/signal_unix.go:378 +0x47c goroutine 8 [syscall]: runtime.cgocall(0x43c0490, 0xccfc28, 0x0) /usr/local/Cellar/go/1.13.3/libexec/src/runtime/cgocall.go:128 +0x5b fp=0xccfbf8 sp=0xccfbc0 pc=0x400494b github.com/apache/pulsar/pulsar-client-go/pulsar._Cfunc_pulsar_message_id_serialize(0x700b7f0, 0xc00018a010, 0x0) _cgo_gotypes.go:1265 +0x4e fp=0xccfc28 sp=0xccfbf8 pc=0x43a2eae github.com/apache/pulsar/pulsar-client-go/pulsar.(*messageID).Serialize.func1(0xc100a8, 0xc00018a010, 0x4528cc0) /Users/me/go/pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20191115070645-69cd6eb660af/pulsar/c_message.go:187 +0x68 fp=0xccfc68 sp=0xccfc28 pc=0x43b2378 github.com/apache/pulsar/pulsar-client-go/pulsar.(*messageID).Serialize(0xc100a8, 0x0, 0x0, 0x0) /Users/me/go/pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20191115070645-69cd6eb660af/pulsar/c_message.go:187 +0x63 fp=0xccfce8 sp=0xccfc68 pc=0x43a9ff3 main.produceData(0x45352a0, 0xc13420, 0x449b5fb, 0xa) /Users/me/project/test/main.go:146 +0x40c fp=0xccffc0 sp=0xccfce8 pc=0x43be50c runtime.goexit() /usr/local/Cellar/go/1.13.3/libexec/src/runtime/asm_amd64.s:1357 +0x1 fp=0xccffc8 sp=0xccffc0 pc=0x405caa1 created by main.main /Users/me/project/test/main.go:177 +0x269 ``` Note: `id` is not null, it's a `*pulsar.messageId` pointer. **Desktop:** Mac OS 10.14.6 github.com/apache/pulsar/pulsar-client-go v0.0.0-20191115070645-69cd6eb660af Thank you :) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] merlimat closed issue #5688: [Pulsar dashboard] dashboard docker image installs incorrect version of postgres
merlimat closed issue #5688: [Pulsar dashboard] dashboard docker image installs incorrect version of postgres URL: https://github.com/apache/pulsar/issues/5688 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] merlimat merged pull request #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile
merlimat merged pull request #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile URL: https://github.com/apache/pulsar/pull/5689 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (16affa0 -> 5d6b78d)
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 16affa0 fix bkenv has no effect bug when start bookie using bin/pulsar-daemon (#5675) add 5d6b78d pin debian release (#5689) No new revisions were added by this update. Summary of changes: dashboard/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[GitHub] [pulsar] merlimat commented on issue #5677: [Issue 5676][C++ client] Expose redelivery count
merlimat commented on issue #5677: [Issue 5676][C++ client] Expose redelivery count URL: https://github.com/apache/pulsar/pull/5677#issuecomment-555351801 run java8 tests run cpp tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] utf7 opened a new pull request #5696: [pulsar-io] improve hbase sink performance
utf7 opened a new pull request #5696: [pulsar-io] improve hbase sink performance URL: https://github.com/apache/pulsar/pull/5696 Motivation multi columns add to single put can improve the performace this can improve hbase put performance in our test env, it can be better 2.x-3.x Modifications hbase sink : change one column with one put to one put with many columns This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.
codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation. URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555359026 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] Jennifer88huang closed issue #5681: Documentation java client example error
Jennifer88huang closed issue #5681: Documentation java client example error URL: https://github.com/apache/pulsar/issues/5681 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] Jennifer88huang merged pull request #5691: [Issues 5681] fix example code of java client
Jennifer88huang merged pull request #5691: [Issues 5681] fix example code of java client URL: https://github.com/apache/pulsar/pull/5691 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (5d6b78d -> dd9e669)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 5d6b78d pin debian release (#5689) add dd9e669 fix example code of java client (#5691) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.4.0/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.4.1/client-libraries-java.md | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-)
[GitHub] [pulsar] jiazhai merged pull request #4621: [PIP-38] Support batch receive in java client.
jiazhai merged pull request #4621: [PIP-38] Support batch receive in java client. URL: https://github.com/apache/pulsar/pull/4621 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[pulsar] branch master updated (dd9e669 -> 56517d5)
This is an automated email from the ASF dual-hosted git repository. zhaijia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from dd9e669 fix example code of java client (#5691) add 56517d5 [PIP-38] Support batch receive in java client. (#4621) No new revisions were added by this update. Summary of changes: distribution/server/licenses/LICENSE-jcip.txt | 7 + distribution/server/src/assemble/LICENSE.bin.txt | 4 + distribution/server/src/assemble/NOTICE.bin.txt| 3 + pom.xml| 8 +- .../client/api/ConsumerBatchReceiveTest.java | 296 + .../pulsar/client/api/BatchReceivePolicy.java | 145 ++ .../org/apache/pulsar/client/api/Consumer.java | 75 ++ .../apache/pulsar/client/api/ConsumerBuilder.java | 15 ++ .../apache/pulsar/client/api/ConsumerStats.java| 10 + .../api/{package-info.java => Messages.java} | 13 +- pulsar-client/pom.xml | 5 + .../apache/pulsar/client/impl/ConsumerBase.java| 267 +++ .../pulsar/client/impl/ConsumerBuilderImpl.java| 9 + .../apache/pulsar/client/impl/ConsumerImpl.java| 78 +- .../pulsar/client/impl/ConsumerStatsDisabled.java | 15 ++ .../pulsar/client/impl/ConsumerStatsRecorder.java | 2 + .../client/impl/ConsumerStatsRecorderImpl.java | 32 ++- .../apache/pulsar/client/impl/MessagesImpl.java| 80 ++ .../client/impl/MultiTopicsConsumerImpl.java | 76 +- .../impl/conf/ConsumerConfigurationData.java | 5 +- .../client/impl/ConsumerBuilderImplTest.java | 14 + .../pulsar/client/impl/ConsumerImplTest.java | 2 + .../pulsar/PulsarConsumerSourceTests.java | 26 ++ pulsar-sql/presto-distribution/LICENSE | 4 + site2/docs/client-libraries-java.md| 40 +++ src/check-binary-license | 2 +- 26 files changed, 1161 insertions(+), 72 deletions(-) create mode 100644 distribution/server/licenses/LICENSE-jcip.txt create mode 100644 pulsar-broker/src/test/java/org/apache/pulsar/client/api/ConsumerBatchReceiveTest.java create mode 100644 pulsar-client-api/src/main/java/org/apache/pulsar/client/api/BatchReceivePolicy.java copy pulsar-client-api/src/main/java/org/apache/pulsar/client/api/{package-info.java => Messages.java} (80%) create mode 100644 pulsar-client/src/main/java/org/apache/pulsar/client/impl/MessagesImpl.java
[GitHub] [pulsar] Jennifer88huang commented on a change in pull request #5609: [Doc] Remove duplicate pages
Jennifer88huang commented on a change in pull request #5609: [Doc] Remove duplicate pages URL: https://github.com/apache/pulsar/pull/5609#discussion_r347764901 ## File path: site2/docs/deploy-bare-metal.md ## @@ -447,7 +447,7 @@ bin/pulsar-admin functions create \ --name exclamation ``` -Check if the function runs as expected by [triggering](functions-deploying.md#triggering-pulsar-functions) the function. +Check if the function runs as expected by [triggering](functions-deploy.md#triggering-pulsar-functions) the function. Review comment: ```suggestion Check if the function runs as expected by [triggering](functions-deploy.md#trigger-pulsar-functions) the function. ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [pulsar] Jennifer88huang commented on issue #5647: [docs] Update content of Pulsar SQL overview
Jennifer88huang commented on issue #5647: [docs] Update content of Pulsar SQL overview URL: https://github.com/apache/pulsar/pull/5647#issuecomment-555372795 run java8 tests This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services