[GitHub] [pulsar] codelipenghui opened a new pull request #5680: [transaction-coordinator] Implementation of transaction coordinator client.

2019-11-18 Thread GitBox
codelipenghui opened a new pull request #5680: [transaction-coordinator] 
Implementation of transaction coordinator client.
URL: https://github.com/apache/pulsar/pull/5680
 
 
   ### Motivation
   
   Implement transaction coordinator client.
   
   ### Modifications
   
   Add transaction coordinator client.
   Add transaction meta store handler to handle meta store request and response.
   
   ### Verifying this change
   
   Unit test added.
   
   ### Does this pull request potentially affect one of the following parts:
   
   *If `yes` was chosen, please highlight the changes*
   
 - Dependencies (does it add or upgrade a dependency): (no)
 - The public API: (no)
 - The schema: (no)
 - The default values of configurations: (no)
 - The wire protocol: (yes)
 - The rest endpoints: (no)
 - The admin cli options: (no)
 - Anything that affects deployment: (no)
   
   ### Documentation
   
 - Does this pull request introduce a new feature? (yes)
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] huangdx0726 opened a new issue #5681: java client example error

2019-11-18 Thread GitBox
huangdx0726 opened a new issue #5681: java client example error
URL: https://github.com/apache/pulsar/issues/5681
 
 
   **Describe the bug**
   java client example error
   
   **To Reproduce**
   Steps to reproduce the behavior:
   1. Go to 'http://pulsar.apache.org/docs/en/client-libraries-java/'
   2. Scroll down to 'Subscription modes'
   
   copy the example code 
   ```
   Producer producer = client.newProducer(Schema.STRING)
   .topic("my-topic")
   .enableBatch(false)
   .create();
   // 3 messages with "key-1", 3 messages with "key-2", 2 messages with "key-3" 
and 2 messages with "key-4"
   producer.newMessage().key("key-1").value("message-1-1").send();
   producer.newMessage().key("key-1").value("message-1-2").send();
   producer.newMessage().key("key-1").value("message-1-3").send();
   producer.newMessage().key("key-2").value("message-2-1").send();
   producer.newMessage().key("key-2").value("message-2-2").send();
   producer.newMessage().key("key-2").value("message-2-3").send();
   producer.newMessage().key("key-3").value("message-3-1").send();
   producer.newMessage().key("key-3").value("message-3-2").send();
   producer.newMessage().key("key-4").value("message-4-1").send();
   producer.newMessage().key("key-4").value("message-4-2").send();
   ```
   
   display no method enableBatch.Maybe the methodName is enableBatching.
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon

2019-11-18 Thread GitBox
sijie commented on a change in pull request #5675: fix bkenv has no effect bug 
when start bookie using bin/pulsar-daemon
URL: https://github.com/apache/pulsar/pull/5675#discussion_r347310091
 
 

 ##
 File path: bin/pulsar-perf
 ##
 @@ -29,6 +29,12 @@ then
 . "$PULSAR_HOME/conf/pulsar_env.sh"
 fi
 
+# Check bookkeeper env and load bkenv.sh
 
 Review comment:
   same comment as in bin/pulsar


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon

2019-11-18 Thread GitBox
sijie commented on a change in pull request #5675: fix bkenv has no effect bug 
when start bookie using bin/pulsar-daemon
URL: https://github.com/apache/pulsar/pull/5675#discussion_r347309990
 
 

 ##
 File path: bin/pulsar
 ##
 @@ -44,12 +44,18 @@ 
FUNCTIONS_EXTRA_DEPS_DIR=${PULSAR_FUNCTIONS_EXTRA_DEPS_DIR:-"${DEFAULT_FUNCTIONS
 SQL_HOME=$PULSAR_HOME/pulsar-sql
 PRESTO_HOME=${PULSAR_HOME}/lib/presto
 
-
+# Check pulsar env and load pulser_env.sh
 if [ -f "$PULSAR_HOME/conf/pulsar_env.sh" ]
 then
 . "$PULSAR_HOME/conf/pulsar_env.sh"
 fi
 
+# Check bookkeeper env and load bkenv.sh
 
 Review comment:
   Move this before line 47 for backward compatibility consideration.
   So if people already define environments in pulsar_env, those env vars will 
not be overridden by bkenv.sh.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon

2019-11-18 Thread GitBox
sijie commented on a change in pull request #5675: fix bkenv has no effect bug 
when start bookie using bin/pulsar-daemon
URL: https://github.com/apache/pulsar/pull/5675#discussion_r347310245
 
 

 ##
 File path: src/pulsar-io-gen
 ##
 @@ -28,6 +28,12 @@ then
 . "$PULSAR_HOME/conf/pulsar_env.sh"
 fi
 
+# Check bookkeeper env and load bkenv.sh
 
 Review comment:
   same comment as above


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on a change in pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon

2019-11-18 Thread GitBox
sijie commented on a change in pull request #5675: fix bkenv has no effect bug 
when start bookie using bin/pulsar-daemon
URL: https://github.com/apache/pulsar/pull/5675#discussion_r347310163
 
 

 ##
 File path: bin/pulsar-daemon
 ##
 @@ -45,6 +45,12 @@ then
 . "$PULSAR_HOME/conf/pulsar_env.sh"
 fi
 
+# Check bookkeeper env and load bkenv.sh
 
 Review comment:
   same comment as above


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui opened a new issue #5682: Documentation for sticky consumer

2019-11-18 Thread GitBox
codelipenghui opened a new issue #5682: Documentation for sticky consumer
URL: https://github.com/apache/pulsar/issues/5682
 
 
   This is a task tracker for create a document for sticky consumer since #5388 
is merged.
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui commented on issue #5680: [transaction-coordinator] Implementation of transaction coordinator client.

2019-11-18 Thread GitBox
codelipenghui commented on issue #5680: [transaction-coordinator] 
Implementation of transaction coordinator client.
URL: https://github.com/apache/pulsar/pull/5680#issuecomment-554964021
 
 
   run integration tests
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] candlerb opened a new issue #5683: Cannot create topic under sample/standalone/ns1

2019-11-18 Thread GitBox
candlerb opened a new issue #5683: Cannot create topic under 
sample/standalone/ns1
URL: https://github.com/apache/pulsar/issues/5683
 
 
   **Describe the bug**
   In pulsar 2.4.1 standalone, a "sample/standalone/ns1" namespace is created 
by default, but I cannot create a topic under it using pulsar-admin - I get a 
405 error.
   
   **To Reproduce**
   
   ```
   $ apache-pulsar-2.4.1/bin/pulsar-admin tenants list
   public
   sample
   
   $ apache-pulsar-2.4.1/bin/pulsar-admin namespaces list sample
   sample/standalone/ns1
   
   $ apache-pulsar-2.4.1/bin/pulsar-admin topics list sample/standalone/ns1
   
   $ apache-pulsar-2.4.1/bin/pulsar-admin topics create 
persistent://sample/standalone/ns1/foo
   12:21:18.021 [AsyncHttpClient-5-1] WARN  
org.apache.pulsar.client.admin.internal.BaseResource - 
[http://localhost:8080/admin/persistent/sample/standalone/ns1/foo] Failed to 
perform http put request: javax.ws.rs.NotAllowedException: HTTP 405 Method Not 
Allowed
   HTTP 405 Method Not Allowed
   
   Reason: HTTP 405 Method Not Allowed
   
   $ apache-pulsar-2.4.1/bin/pulsar-admin topics create 
persistent://sample/standalone%2Fns1/foo
   java.lang.IllegalArgumentException: Invalid named entity: standalone%2Fns1
at 
org.apache.pulsar.common.naming.NamedEntity.checkName(NamedEntity.java:39)
   ```
   
   There is also odd behaviour with curl on the `/admin/v2/namespaces/` 
endpoint: it works for namespaces without slash, but not with slash.
   
   ```
   ubuntu@ldex-pulsar:~$ curl 
http://localhost:8080/admin/v2/namespaces/public/default
   {"auth_policies":{"namespace_auth":...}
   
   ubuntu@ldex-pulsar:~$
   $ curl http://localhost:8080/admin/v2/namespaces/public/sample/standalone/ns1
   
   
   
   Error 404 Not Found
   
   HTTP ERROR 404
   Problem accessing /admin/v2/namespaces/public/sample/standalone/ns1. 
Reason:
   Not Foundhttp://eclipse.org/jetty";>Powered 
by Jetty:// 9.4.12.v20180830
   
   
   
   
   $ curl 
http://localhost:8080/admin/v2/namespaces/public/sample/standalone%2Fns1
   
   
   
   Error 405 Method Not Allowed
   
   HTTP ERROR 405
   Problem accessing /admin/v2/namespaces/public/sample/standalone%2Fns1. 
Reason:
   Method Not Allowedhttp://eclipse.org/jetty";>Powered by Jetty:// 9.4.12.v20180830
   
   
   
   ```
   
   **Expected behavior**
   Be able to create topic under this namespace.
   
   Note that I *can* create another namespace with slashes in its name:
   
   ```
   $ apache-pulsar-2.4.1/bin/pulsar-admin namespaces create 
sample/standalone/ns2
   $ apache-pulsar-2.4.1/bin/pulsar-admin namespaces list sample
   sample/standalone/ns1
   sample/standalone/ns2
   ```
   
   It seems therefore that namespaces with multiple slashes *are* valid in 
themselves.
   
   **Documentation problems**
   I wasn't expecting to see the "sample" tenant or "sample/standalone/ns1" 
namespace. They are mentioned in [old 
documentation](https://pulsar.apache.org/docs/v1.21.0-incubating/getting-started/LocalCluster/),
 but references have been removed except in passing in the sample output of 
`show schemas in pulsar` in [SQL getting 
started](https://pulsar.apache.org/docs/en/sql-getting-started/).
   
   In the documentation for 
[topics](https://pulsar.apache.org/docs/en/concepts-messaging/#topics) or 
[namespaces](https://pulsar.apache.org/docs/en/concepts-messaging/#namespaces) 
I couldn't find information on what the rules are for naming namespaces and 
topics - not even whether slashes are allowed.
   
   If slashes are permitted in both namespace and topic, it would lead to 
ambiguity over how to parse `persistent://sample/foo/bar/baz/qux` into 
namespace and topic.
   
   By experimentation, it *looks* like only the last part is treated as the 
topic name:
   
   ```
   $ apache-pulsar-2.4.1/bin/pulsar-admin topics create 
persistent://public/default/foo/bar
   12:31:36.223 [AsyncHttpClient-5-1] WARN  
org.apache.pulsar.client.admin.internal.BaseResource - 
[http://localhost:8080/admin/persistent/public/default/foo/bar] Failed to 
perform http put request: javax.ws.rs.NotAllowedException: HTTP 405 Method Not 
Allowed
   HTTP 405 Method Not Allowed
   
   Reason: HTTP 405 Method Not Allowed
   
   $ apache-pulsar-2.4.1/bin/pulsar-admin topics create 
persistent://public/default/foo
   $
   ```
   
   But I can't be sure, since I get the same 405 error that I reported above.
   
   Finally, the [REST API 
documentation](https://pulsar.apache.org/docs/en/admin-api-namespaces/) doesn't 
explain how namespaces are handled in URL paths.  If the action was `PUT 
/admin/v2/namespaces/:tenant/:namespace`, and the tenant was `sample` and the 
namespace was `standalone/ns1`, then I would expect to encode this as:
   
   `PUT /admin/v2/namespaces/sample/standalone%2Fns1`
   
   However, experiments suggest otherwise: the components of the namespace 
become components of the path.
   
   ```
   $ curl -H "Accept: application/json" 
http://localhost:8080/admin/persistent

[GitHub] [pulsar] candlerb opened a new issue #5684: Documentation: units for storageSize

2019-11-18 Thread GitBox
candlerb opened a new issue #5684: Documentation: units for storageSize
URL: https://github.com/apache/pulsar/issues/5684
 
 
   **Is your feature request related to a problem? Please describe.**
   
   ```
   ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics stats 
public/default/avro-topic | grep storageSize
 "storageSize" : 1980,
   ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics stats 
public/default/my-topic | grep storageSize
 "storageSize" : 3579,
   ```
   
   What are those units? Bytes, KiB, MiB, GiB, something else?
   
   **Describe the solution you'd like**
   Document at https://pulsar.apache.org/docs/en/pulsar-admin/#stats-1 and/or 
https://pulsar.apache.org/admin-rest-api/?version=2.4.1#operation/getStats


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] candlerb opened a new issue #5685: Documentation: skip-all versus clear-backlog

2019-11-18 Thread GitBox
candlerb opened a new issue #5685: Documentation: skip-all versus clear-backlog
URL: https://github.com/apache/pulsar/issues/5685
 
 
   **Is your feature request related to a problem? Please describe.**
   Documentation shows 
[skip-all](https://pulsar.apache.org/docs/en/pulsar-admin/#skip-all) followed 
by 
[clear-backlog](https://pulsar.apache.org/docs/en/pulsar-admin/#clear-backlog-1),
 both at the topic with no description of what the difference is.
   
   I don't know when it's appropriate to use one or the other.
   
   Note: there is a separate 
[clear-backlog](https://pulsar.apache.org/docs/en/pulsar-admin/#clear-backlog) 
command documented at the namespace level (rather than the topic level)
   
   UPDATE 1: pulsar-admin doesn't seem to recognise `topics skip-all` at all. 
   
   ```
   ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics 
clear-backlog
   The following option is required: -s, --subscription
   
   Skip all the messages for the subscription
   Usage: clear-backlog [options] persistent://tenant/namespace/topic
 Options:
 * -s, --subscription
  Subscription to be cleared
   
   ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics skip-all
   Expected a command, got skip-all
   
   Exception in thread "main" com.beust.jcommander.ParameterException: Asking 
description for unknown command: null
at 
com.beust.jcommander.JCommander.getCommandDescription(JCommander.java:1003)
at com.beust.jcommander.JCommander.usage(JCommander.java:988)
at com.beust.jcommander.JCommander.usage(JCommander.java:980)
at com.beust.jcommander.JCommander.usage(JCommander.java:972)
at org.apache.pulsar.admin.cli.CmdBase.run(CmdBase.java:49)
at 
org.apache.pulsar.admin.cli.PulsarAdminTool.run(PulsarAdminTool.java:218)
at 
org.apache.pulsar.admin.cli.PulsarAdminTool.main(PulsarAdminTool.java:260)
   ^C
   
   ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics skip-all 
persistent://public/default/my-topic -s my-subscription
   Expected a command, got skip-all
   
   Exception in thread "main" com.beust.jcommander.ParameterException: Asking 
description for unknown command: null
at 
com.beust.jcommander.JCommander.getCommandDescription(JCommander.java:1003)
at com.beust.jcommander.JCommander.usage(JCommander.java:988)
at com.beust.jcommander.JCommander.usage(JCommander.java:980)
at com.beust.jcommander.JCommander.usage(JCommander.java:972)
at org.apache.pulsar.admin.cli.CmdBase.run(CmdBase.java:49)
at 
org.apache.pulsar.admin.cli.PulsarAdminTool.run(PulsarAdminTool.java:218)
at 
org.apache.pulsar.admin.cli.PulsarAdminTool.main(PulsarAdminTool.java:260)
   ^C
   ```
   
   But there appears to be a test case for it in 
[pulsar-client-tools-test/src/test/java/org/apache/pulsar/admin/cli/PulsarAdminToolTest.java](https://github.com/apache/pulsar/blob/master/pulsar-client-tools-test/src/test/java/org/apache/pulsar/admin/cli/PulsarAdminToolTest.java#L714)
   
   ```
   topics.run(split("skip-all persistent://myprop/clust/ns1/ds1 -s 
sub1"));
   
verify(mockTopics).skipAllMessages("persistent://myprop/clust/ns1/ds1", "sub1");
   ```
   
   `clear-backlog` works at the topic+subscription level:
   
   ```
   ubuntu@ldex-pulsar:~$ apache-pulsar-2.4.1/bin/pulsar-admin topics 
clear-backlog persistent://public/default/my-topic -s my-subscription
   ubuntu@ldex-pulsar:~$
   ```
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] yifan opened a new issue #3112: broker error for prometheus metrics

2019-11-18 Thread GitBox
yifan opened a new issue #3112: broker error for prometheus metrics
URL: https://github.com/apache/pulsar/issues/3112
 
 
    Expected behavior
   I deployed pulsar with helm and minikube configuration in kubernetes. I 
tried multiple times, I having problem with one of the brokers, sometimes both 
brokers.  The problem has been consistent for three deployments so far.
   
    Steps to reproduce
   deploy pulsar with helm
   
    System configuration
   **Pulsar version**: x.y
   image: apachepulsar/pulsar-all
   
    Error in Broker.log
   06:40:34.280 [pulsar-web-30-30] INFO  org.eclipse.jetty.server.RequestLog - 
10.244.6.29 - - [03/Dec/2018:06:40:34 +] "GET //xx.xx.xx.xx:8080/metrics 
HTTP/1.1" 302 0 "-" "Prometheus/1.6.3" 1
   06:40:34.287 [prometheus-stats-31-1] ERROR 
org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsServlet - Failed to 
generate prometheus stats
   org.eclipse.jetty.io.EofException: null
   at 
org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:197) 
~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:420) 
~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.io.WriteFlusher.completeWrite(WriteFlusher.java:375) 
~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.io.SelectChannelEndPoint$3.run(SelectChannelEndPoint.java:107)
 ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.io.SelectChannelEndPoint.onSelected(SelectChannelEndPoint.java:193)
 ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.io.ManagedSelector$SelectorProducer.processSelected(ManagedSelector.java:283)
 ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:181)
 ~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
 ~[org.eclipse.jetty-jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
 ~[org.eclipse.jetty-jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
 ~[org.eclipse.jetty-jetty-util-9.3.11.v20160721.jar:9.3.11.v20160721]
   at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_171]
   at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_171]
   at 
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
 [org.apache.pulsar-pulsar-functions-metrics-2.2.0.jar:?]
   at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171]
   Caused by: java.io.IOException: Connection reset by peer
   at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[?:1.8.0_171]
   at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) 
~[?:1.8.0_171]
   at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) 
~[?:1.8.0_171]
   at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[?:1.8.0_171]
   at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) 
~[?:1.8.0_171]
   at 
org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:175) 
~[org.eclipse.jetty-jetty-io-9.3.11.v20160721.jar:9.3.11.v20160721]
   ... 13 more
   
    Error in Prometheus
   text format parsing error in line 182: second TYPE line for metric name 
"pulsar_subscription_back_log", or TYPE reported after samples


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui commented on issue #3112: broker error for prometheus metrics

2019-11-18 Thread GitBox
codelipenghui commented on issue #3112: broker error for prometheus metrics
URL: https://github.com/apache/pulsar/issues/3112#issuecomment-555062872
 
 
   Seems the problem can still happens, but i can't get the restful response, 
broker is crashed at that time.
   ```
   21:23:33.629 [prometheus-stats-39-1] ERROR 
org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsServlet - Failed to 
generate prometheus stats
   org.eclipse.jetty.io.EofException: null
at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:283) 
~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422) 
~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:277) 
~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at 
org.eclipse.jetty.io.AbstractEndPoint.write(AbstractEndPoint.java:381) 
~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at 
org.eclipse.jetty.server.HttpConnection$SendCallback.process(HttpConnection.java:818)
 ~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at 
org.eclipse.jetty.util.IteratingCallback.processing(IteratingCallback.java:241) 
~[org.eclipse.jetty-jetty-util-9.4.20.v20190813.jar:9.4.20.v20190813]
at 
org.eclipse.jetty.util.IteratingCallback.iterate(IteratingCallback.java:223) 
~[org.eclipse.jetty-jetty-util-9.4.20.v20190813.jar:9.4.20.v20190813]
at 
org.eclipse.jetty.server.HttpConnection.send(HttpConnection.java:549) 
~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at 
org.eclipse.jetty.server.HttpChannel.sendResponse(HttpChannel.java:857) 
~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpChannel.write(HttpChannel.java:929) 
~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:250) 
~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:226) 
~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:546) 
~[org.eclipse.jetty-jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at 
org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsGenerator.generate(PrometheusMetricsGenerator.java:78)
 ~[org.apache.pulsar-pulsar-broker-2.5.0-d3cb10859.jar:2.5.0-d3cb10859]
at 
org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsServlet.lambda$doGet$0(PrometheusMetricsServlet.java:70)
 ~[org.apache.pulsar-pulsar-broker-2.5.0-d3cb10859.jar:2.5.0-d3cb10859]
at 
org.apache.bookkeeper.mledger.util.SafeRun$1.safeRun(SafeRun.java:32) 
[org.apache.pulsar-managed-ledger-2.5.0-d3cb10859.jar:2.5.0-d3cb10859]
at 
org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36) 
[org.apache.bookkeeper-bookkeeper-common-4.9.2.jar:4.9.2]
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
[?:1.8.0_171]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
[?:1.8.0_171]
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
 [?:1.8.0_171]
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
 [?:1.8.0_171]
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_171]
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_171]
at 
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
 [io.netty-netty-common-4.1.43.Final.jar:4.1.43.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171]
   Caused by: java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.writev0(Native Method) ~[?:1.8.0_171]
at sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51) 
~[?:1.8.0_171]
at sun.nio.ch.IOUtil.write(IOUtil.java:148) ~[?:1.8.0_171]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:504) 
~[?:1.8.0_171]
at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:263) 
~[org.eclipse.jetty-jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
... 24 more
   ```


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui opened a new issue #5686: NPE in RackwareEnsemblePlacementPolicyImpl.

2019-11-18 Thread GitBox
codelipenghui opened a new issue #5686: NPE in 
RackwareEnsemblePlacementPolicyImpl.
URL: https://github.com/apache/pulsar/issues/5686
 
 
   **Describe the bug**
   ```
   java.lang.NullPointerException: null
at 
org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl.isEnsembleAdheringToPlacementPolicy(RackawareEnsemblePlacementPolicyImpl.java:1261)
 ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl.replaceBookie(RackawareEnsemblePlacementPolicyImpl.java:681)
 ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicy.replaceBookie(RackawareEnsemblePlacementPolicy.java:114)
 ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.BookieWatcherImpl.replaceBookie(BookieWatcherImpl.java:278)
 ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.EnsembleUtils.replaceBookiesInEnsemble(EnsembleUtils.java:71)
 ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.LedgerHandle.lambda$ensembleChangeLoop$2(LedgerHandle.java:1908)
 ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.MetadataUpdateLoop.writeLoop(MetadataUpdateLoop.java:122)
 [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.MetadataUpdateLoop.run(MetadataUpdateLoop.java:111)
 [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.LedgerHandle.ensembleChangeLoop(LedgerHandle.java:1927)
 [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.LedgerHandle.handleBookieFailure(LedgerHandle.java:1876)
 [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.client.PendingAddOp.writeComplete(PendingAddOp.java:360) 
[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.proto.BookieClientImpl$1.safeRun(BookieClientImpl.java:280)
 [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]
at 
org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36) 
[org.apache.bookkeeper-bookkeeper-common-4.9.2.jar:4.9.2]
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[?:1.8.0_171]
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[?:1.8.0_171]
at 
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
 [io.netty-netty-common-4.1.43.Final.jar:4.1.43.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_171]
   ```
   **To Reproduce**
   Have no idea to reproduce it.
   
   **Additional context**
   in master branch


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] pedro93 opened a new issue #5687: Failed to enable State API in K8s installation

2019-11-18 Thread GitBox
pedro93 opened a new issue #5687: Failed to enable State API in K8s installation
URL: https://github.com/apache/pulsar/issues/5687
 
 
   **Describe the bug**
   Can't enable State API in a minikube-based installation of Pulsar, despite 
adding the appropriate property `extraServerComponents` to the values-mini.yaml 
in the bookkeeper.configData section.
   
   **To Reproduce**
   Steps to reproduce the behavior:
   1. Add the following line to values-mini.yaml under the 
bookkeeper.configData section:
   ```yaml
   extraServerComponents: 
"org.apache.bookkeeper.stream.server.StreamStorageLifecycleComponent"
   ```
   2. Launch pulsar cluster via helm (this is using the helm templates found in 
this repo):
   ```
   helm install . --values values-mini.yaml helm -n pulsar
   ```
   3. When the K8s cluster is ready, check the configuration of the bookkeeper 
nodes and confirm that the `extraServerComponents` property in 
`conf/bookkeeper.conf` is not defined with the specified value.
   
   **Expected behavior**
   That following the steps to reproduce the bookkeeper nodes would have this 
property defined.
   
   **Desktop (please complete the following information):**
- OS: Ubuntu 18.04
- Minikube (v1.4.0) deployment
- Pulsar version v2.4.1
   
   **Additional context**
   I believe this issue is due to 
https://github.com/apache/pulsar/commits/master/docker/pulsar/scripts/apply-config-from-env.py
 which ignores commented lines, as such to fix this issue, the 
extraServerComponents property should not be commented but defined with a 
default empty value. This issue is not limited to the aforementioned property 
only but to all properties that are commented out, as the setup/procedure to 
enable such features are not working for K8s deployments.
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] bsideup commented on issue #5278: Fixed reader cursor seek with disconnection

2019-11-18 Thread GitBox
bsideup commented on issue #5278: Fixed reader cursor seek with disconnection
URL: https://github.com/apache/pulsar/pull/5278#issuecomment-555088289
 
 
   FYI this one would make [Liiklus'](https://github.com/bsideup/liiklus) life 
so much easier.
   Since Liiklus is not using Pulsar's offset storage, it performs "seek" on 
every partition, and it causes the other connections to disconnect, and, when 
they connect it seeks again 😂 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] jerrypeng commented on issue #5628: Fix: Netty threads may still linger after client close

2019-11-18 Thread GitBox
jerrypeng commented on issue #5628: Fix: Netty threads may still linger after 
client close
URL: https://github.com/apache/pulsar/pull/5628#issuecomment-555109463
 
 
   rerun java8 tests
   rerun integration tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] frejonb opened a new issue #5688: [Pulsar dashboard] dashboard docker image installs incorrect version of postgres

2019-11-18 Thread GitBox
frejonb opened a new issue #5688: [Pulsar dashboard] dashboard docker image 
installs incorrect version of postgres
URL: https://github.com/apache/pulsar/issues/5688
 
 
   **Describe the bug**
   Docker image install postgres 11 instead of 9.6. This results in
   ```
   Starting Pulsar dasboard
   + /pulsar/init-postgres.sh
   + rm -rf '/data/*'
   + chown -R postgres: /data
   + chmod 700 /data
   + sudo -u postgres /usr/lib/postgresql/9.6/bin/initdb /data/
   sudo: /usr/lib/postgresql/9.6/bin/initdb: command not found
   ```
   
   **To Reproduce**
   Steps to reproduce the behavior:
   1. Build dashboard docker image from master
   1. Run image
   
   **Expected behavior**
   Dashboard running
   
   **Screenshots**
   If applicable, add screenshots to help explain your problem.
   
   **Desktop (please complete the following information):**
- OS: Docker
   
   **Additional context**
   Add any other context about the problem here.
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] frejonb opened a new pull request #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile

2019-11-18 Thread GitBox
frejonb opened a new pull request #5689: [Issue 5688][dashboard] Fix postgres 
version in dockerfile
URL: https://github.com/apache/pulsar/pull/5689
 
 
   
   Fixes #5688
   
   
   ### Modifications
   
   Fix debian release
   
   ### Verifying this change
   
   - [ ] Make sure that the change passes the CI checks.
   
   This change is a trivial rework / code cleanup without any test coverage.
   
   
   ### Does this pull request potentially affect one of the following parts:
   
   *If `yes` was chosen, please highlight the changes*
   
 - Dependencies (does it add or upgrade a dependency): (yes)
 - The public API: (no)
 - The schema: (no)
 - The default values of configurations: (no)
 - The wire protocol: (no)
 - The rest endpoints: (no)
 - The admin cli options: (no)
 - Anything that affects deployment: (don't know)
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar-client-go] merlimat opened a new pull request #102: Updated zstd go library to avoid cgo dependency for compression

2019-11-18 Thread GitBox
merlimat opened a new pull request #102: Updated zstd go library to avoid cgo 
dependency for compression
URL: https://github.com/apache/pulsar-client-go/pull/102
 
 
   ### Motivation
   
   So far, we were relying on the CGo based `valyala/gozstd` for Zstd 
compression, since the native go `klauspost/compress` wasn't supporting it. 
Newer version of that library now supports compression so we can get rid of CGo 
based one.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar-client-go] merlimat merged pull request #101: Add client function to list topics in a namespace.

2019-11-18 Thread GitBox
merlimat merged pull request #101: Add client function to list topics in a 
namespace.
URL: https://github.com/apache/pulsar-client-go/pull/101
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] jm7647 opened a new issue #5690: Elasticsearch 5.x Sink connector incompatible

2019-11-18 Thread GitBox
jm7647 opened a new issue #5690: Elasticsearch 5.x Sink connector incompatible
URL: https://github.com/apache/pulsar/issues/5690
 
 
   **Describe the bug**
   Works with ES 7.x version
   Fails with ES 5.x version
   
   Didn't try other versions.
   
   **To Reproduce**
   Steps to reproduce the behavior:
   1. Configure and run ES Sink
   2. See error
   
   
{"error":{"root_cause":[{"type":"invalid_type_name_exception","reason":"Document
 mapping type name can't start with '_', found: 
[_doc]"}],"type":"invalid_type_name_exception","reason":"Document mapping type 
name can't start with '_', found: [_doc]"},"status":400}
   at 
org.elasticsearch.client.RestClient$SyncResponseListener.get(RestClient.java:705)
 ~[?:?]
   at 
org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[?:?]
   at 
org.elasticsearch.client.RestClient.performRequest(RestClient.java:198) ~[?:?]
   at 
org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:522)
 ~[?:?]
   at 
org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:508)
 ~[?:?]
   at 
org.elasticsearch.client.RestHighLevelClient.index(RestHighLevelClient.java:348)
 ~[?:?]
   at 
org.apache.pulsar.io.elasticsearch.ElasticSearchSink.write(ElasticSearchSink.java:91)
 ~[?:?]
   at 
org.apache.pulsar.functions.instance.JavaInstanceRunnable.sendOutputMessage(JavaInstanceRunnable.java:435)
 ~[org.apache.pulsar-pulsar-functions-instance-2.4.1.jar:?]
   at 
org.apache.pulsar.functions.instance.JavaInstanceRunnable.processResult(JavaInstanceRunnable.java:418)
 ~[org.apache.pulsar-pulsar-functions-instance-2.4.1.jar:?]
   at 
org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:272)
 [org.apache.pulsar-pulsar-functions-instance-2.4.1.jar:?]
   at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
   Caused by: org.elasticsearch.client.ResponseException: method 
[POST], host [http://135.91.35.218:9200], URI [/eventslist/_doc?timeout=1m], 
status line [HTTP/1.1 400 Bad Request]
   
{"error":{"root_cause":[{"type":"invalid_type_name_exception","reason":"Document
 mapping type name can't start with '_', found: 
[_doc]"}],"type":"invalid_type_name_exception","reason":"Document mapping type 
name can't start with '_', found: [_doc]"},"status":400}
   
   
   **Expected behavior**
   
   **Screenshots**
   
   **Desktop (please complete the following information):**
- OS: Ubuntu 16
   
   **Additional context**
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar-client-go] branch master updated (55b9a6f -> d91a2a2)

2019-11-18 Thread mmerli
This is an automated email from the ASF dual-hosted git repository.

mmerli pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar-client-go.git.


from 55b9a6f  Add multi topic consumer. (#100)
 add d91a2a2  Add client function to list topics in a namespace. (#101)

No new revisions were added by this update.

Summary of changes:
 pulsar/{impl_client.go => client_impl.go}  | 45 +++---
 .../{impl_client_test.go => client_impl_test.go}   | 96 +-
 pulsar/impl_partition_producer.go  |  9 +-
 pulsar/internal/commands.go|  2 +
 pulsar/producer_test.go|  5 +-
 pulsar/test_helper.go  | 58 +++--
 6 files changed, 186 insertions(+), 29 deletions(-)
 rename pulsar/{impl_client.go => client_impl.go} (73%)
 rename pulsar/{impl_client_test.go => client_impl_test.go} (69%)



[GitHub] [pulsar-client-go] merlimat merged pull request #102: Updated zstd go library to avoid cgo dependency for compression

2019-11-18 Thread GitBox
merlimat merged pull request #102: Updated zstd go library to avoid cgo 
dependency for compression
URL: https://github.com/apache/pulsar-client-go/pull/102
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar-client-go] branch master updated: Updated zstd go library to avoid cgo dependency for compression (#102)

2019-11-18 Thread mmerli
This is an automated email from the ASF dual-hosted git repository.

mmerli pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar-client-go.git


The following commit(s) were added to refs/heads/master by this push:
 new a0d96c8  Updated zstd go library to avoid cgo dependency for 
compression (#102)
a0d96c8 is described below

commit a0d96c89ad5dc2091f5e28c4386f73ebddf99a4a
Author: Matteo Merli 
AuthorDate: Mon Nov 18 14:26:20 2019 -0800

Updated zstd go library to avoid cgo dependency for compression (#102)
---
 go.mod |  6 +---
 go.sum | 15 ++
 pkg/compression/zstd.go| 45 +
 pkg/compression/zstd_native.go | 64 --
 4 files changed, 30 insertions(+), 100 deletions(-)

diff --git a/go.mod b/go.mod
index dddb428..339748e 100644
--- a/go.mod
+++ b/go.mod
@@ -3,16 +3,12 @@ module github.com/apache/pulsar-client-go
 go 1.12
 
 require (
-   github.com/DataDog/zstd v1.4.0 // indirect
github.com/beefsack/go-rate v0.0.0-20180408011153-efa7637bb9b6
github.com/bmizerany/perks v0.0.0-20141205001514-d9a9656a3a4b
-   github.com/cespare/xxhash v1.1.0 // indirect
-   github.com/deckarep/golang-set v1.7.1
github.com/golang/protobuf v1.3.1
github.com/google/go-cmp v0.3.0 // indirect
github.com/inconshreveable/mousetrap v1.0.0 // indirect
-   github.com/klauspost/compress v1.6.2
-   github.com/klauspost/cpuid v1.2.1 // indirect
+   github.com/klauspost/compress v1.9.2
github.com/pierrec/lz4 v2.0.5+incompatible
github.com/pkg/errors v0.8.1
github.com/sirupsen/logrus v1.4.1
diff --git a/go.sum b/go.sum
index a1ccf2f..c3fdcf6 100644
--- a/go.sum
+++ b/go.sum
@@ -1,28 +1,18 @@
-github.com/DataDog/zstd v1.4.0 h1:vhoV+DUHnRZdKW1i5UMjAk2G4JY8wN4ayRfYDNdEhwo=
-github.com/DataDog/zstd v1.4.0/go.mod 
h1:1jcaCB/ufaK+sKp1NBhlGmpz41jOoPQ35bpF36t7BBo=
-github.com/OneOfOne/xxhash v1.2.2 
h1:KMrpdQIwFcEqXDklaen+P1axHaj9BSKzvpUUfnHldSE=
-github.com/OneOfOne/xxhash v1.2.2/go.mod 
h1:HSdplMjZKSmBqAxg5vPj2TmRDmfkzw+cTzAElWljhcU=
 github.com/beefsack/go-rate v0.0.0-20180408011153-efa7637bb9b6 
h1:KXlsf+qt/X5ttPGEjR0tPH1xaWWoKBEg9Q1THAj2h3I=
 github.com/beefsack/go-rate v0.0.0-20180408011153-efa7637bb9b6/go.mod 
h1:6YNgTHLutezwnBvyneBbwvB8C82y3dcoOj5EQJIdGXA=
 github.com/bmizerany/perks v0.0.0-20141205001514-d9a9656a3a4b 
h1:AP/Y7sqYicnjGDfD5VcY4CIfh1hRXBUavxrvELjTiOE=
 github.com/bmizerany/perks v0.0.0-20141205001514-d9a9656a3a4b/go.mod 
h1:ac9efd0D1fsDb3EJvhqgXRbFx7bs2wqZ10HQPeU8U/Q=
-github.com/cespare/xxhash v1.1.0 
h1:a6HrQnmkObjyL+Gs60czilIUGqrzKutQD6XZog3p+ko=
-github.com/cespare/xxhash v1.1.0/go.mod 
h1:XrSqR1VqqWfGrhpAt58auRo0WTKS1nRRg3ghfAqPWnc=
 github.com/davecgh/go-spew v1.1.0/go.mod 
h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38=
 github.com/davecgh/go-spew v1.1.1 
h1:vj9j/u1bqnvCEfJOwUhtlOARqs3+rkHYY13jYWTU97c=
 github.com/davecgh/go-spew v1.1.1/go.mod 
h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38=
-github.com/deckarep/golang-set v1.7.1 
h1:SCQV0S6gTtp6itiFrTqI+pfmJ4LN85S1YzhDf9rTHJQ=
-github.com/deckarep/golang-set v1.7.1/go.mod 
h1:93vsz/8Wt4joVM7c2AVqh+YRMiUSc14yDtF28KmMOgQ=
 github.com/golang/protobuf v1.3.1 
h1:YF8+flBXS5eO826T4nzqPrxfhQThhXl0YzfuUPu4SBg=
 github.com/golang/protobuf v1.3.1/go.mod 
h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U=
 github.com/google/go-cmp v0.3.0 h1:crn/baboCvb5fXaQ0IJ1SGTsTVrWpDsCWC8EGETZijY=
 github.com/google/go-cmp v0.3.0/go.mod 
h1:8QqcDgzrUqlUb/G2PQTWiueGozuR1884gddMywk6iLU=
 github.com/inconshreveable/mousetrap v1.0.0 
h1:Z8tu5sraLXCXIcARxBp/8cbvlwVa7Z1NHg9XEKhtSvM=
 github.com/inconshreveable/mousetrap v1.0.0/go.mod 
h1:PxqpIevigyE2G7u3NXJIT2ANytuPF1OarO4DADm73n8=
-github.com/klauspost/compress v1.6.2 
h1:D9kM6nOc1x+yA/DW/k81uG1xdmwqCMQ/A266P1edQEw=
-github.com/klauspost/compress v1.6.2/go.mod 
h1:RyIbtBH6LamlWaDj8nUwkbUhJ87Yi3uG0guNDohfE1A=
-github.com/klauspost/cpuid v1.2.1 
h1:vJi+O/nMdFt0vqm8NZBI6wzALWdA2X+egi0ogNyrC/w=
-github.com/klauspost/cpuid v1.2.1/go.mod 
h1:Pj4uuM528wm8OyEC2QMXAi2YiTZ96dNQPGgoMS4s3ek=
+github.com/klauspost/compress v1.9.2 
h1:LfVyl+ZlLlLDeQ/d2AqfGIIH4qEDu0Ed2S5GyhCWIWY=
+github.com/klauspost/compress v1.9.2/go.mod 
h1:RyIbtBH6LamlWaDj8nUwkbUhJ87Yi3uG0guNDohfE1A=
 github.com/konsorten/go-windows-terminal-sequences v1.0.1 
h1:mweAR1A6xJ3oS2pRaGiHgQ4OO8tzTaLawm8vnODuwDk=
 github.com/konsorten/go-windows-terminal-sequences v1.0.1/go.mod 
h1:T0+1ngSBFLxvqU3pZ+m/2kptfBszLMUkC4ZK/EgS/cQ=
 github.com/pierrec/lz4 v2.0.5+incompatible 
h1:2xWsjqPFWcplujydGg4WmhC/6fZqK42wMM8aXeqhl0I=
@@ -33,7 +23,6 @@ github.com/pmezard/go-difflib v1.0.0 
h1:4DBwDE0NGyQoBHbLQYPwSUPoCMWR5BEzIk/f1lZb
 github.com/pmezard/go-difflib v1.0.0/go.mod 
h1:iKH77koFhYxTK1pcRnkKkqfTogsbg7gZNVY4sRDYZ/4=
 github.com/sirupsen/logrus v1.4.1 
h1:GL2rEmy6nsikmW0r8opw9JIRScdMF5hA8cOYLH7In1k=
 github.com/sirupsen/logrus v1.4.1/go.mod 
h1:ni0Sbl

[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.

2019-11-18 Thread GitBox
codelipenghui commented on issue #5572: Fix create consumer on partitioned 
topic while disable topic auto creation.
URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555277674
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] huangdx0726 opened a new pull request #5691: [Issues 5681] fix example code of java client

2019-11-18 Thread GitBox
huangdx0726 opened a new pull request #5691: [Issues 5681] fix example code of 
java client
URL: https://github.com/apache/pulsar/pull/5691
 
 
   [Issues 5681] fix example code of java client
   
   Fixes #5681 
   
   ### Motivation
   
   The example code  of java client can't work.
   ```
   Producer producer = 
PulsarUtils.getClient().newProducer(Schema.STRING)
   .topic("my-topic")
   .enableBatch(false)
   .create();
   // 3 messages with "key-1", 3 messages with "key-2", 2 messages with "key-3" 
and 2 messages with "key-4"
   producer.newMessage().key("key-1").value("message-1-1").send();
   producer.newMessage().key("key-1").value("message-1-2").send();
   producer.newMessage().key("key-1").value("message-1-3").send();
   producer.newMessage().key("key-2").value("message-2-1").send();
   producer.newMessage().key("key-2").value("message-2-2").send();
   producer.newMessage().key("key-2").value("message-2-3").send();
   producer.newMessage().key("key-3").value("message-3-1").send();
   producer.newMessage().key("key-3").value("message-3-2").send();
   producer.newMessage().key("key-4").value("message-4-1").send();
   producer.newMessage().key("key-4").value("message-4-2").send();
   ```
   
   ### Modifications
   
   change the enableBatch method to enableBatching.
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] tuteng closed issue #5474: Support CDC Connector for MongoDB

2019-11-18 Thread GitBox
tuteng closed issue #5474: Support CDC Connector for MongoDB
URL: https://github.com/apache/pulsar/issues/5474
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] tuteng merged pull request #5590: [Issue 5474][pulsar-io-debezium] Support CDC Connector for MongoDB

2019-11-18 Thread GitBox
tuteng merged pull request #5590: [Issue 5474][pulsar-io-debezium] Support CDC 
Connector for MongoDB
URL: https://github.com/apache/pulsar/pull/5590
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (69cd6eb -> 8d1f793)

2019-11-18 Thread guangning
This is an automated email from the ASF dual-hosted git repository.

guangning pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from 69cd6eb  fix typo error (#5663)
 add 8d1f793  [Issue 5474][pulsar-io-debezium] Support CDC Connector for 
MongoDB (#5590)

No new revisions were added by this update.

Summary of changes:
 distribution/io/src/assemble/io.xml|  1 +
 .../{data-generator => debezium/mongodb}/pom.xml   | 20 ++---
 .../debezium/mongodb/DebeziumMongoDbSource.java}   | 12 +--
 .../resources/META-INF/services/pulsar-io.yaml |  6 +-
 .../resources/debezium-mongodb-source-config.yaml} | 25 +++
 pulsar-io/debezium/pom.xml |  1 +
 ...ontainer.java => DebeziumMongoDbContainer.java} | 31 
 .../integration/functions/PulsarFunctionsTest.java | 62 
 .../io/DebeziumMongoDbSourceTester.java| 85 ++
 .../integration/io/DebeziumMySqlSourceTester.java  | 18 -
 .../io/DebeziumPostgreSqlSourceTester.java | 18 -
 .../pulsar/tests/integration/io/SourceTester.java  | 31 
 12 files changed, 221 insertions(+), 89 deletions(-)
 copy pulsar-io/{data-generator => debezium/mongodb}/pom.xml (76%)
 copy 
pulsar-io/debezium/{mysql/src/main/java/org/apache/pulsar/io/debezium/mysql/DebeziumMysqlSource.java
 => 
mongodb/src/main/java/org/apache/pulsar/io/debezium/mongodb/DebeziumMongoDbSource.java}
 (85%)
 copy pulsar-io/{aerospike => 
debezium/mongodb}/src/main/resources/META-INF/services/pulsar-io.yaml (85%)
 copy 
pulsar-io/debezium/{postgres/src/main/resources/debezium-postgres-source-config.yaml
 => mongodb/src/main/resources/debezium-mongodb-source-config.yaml} (65%)
 copy 
tests/integration/src/test/java/org/apache/pulsar/tests/integration/containers/{DebeziumMySQLContainer.java
 => DebeziumMongoDbContainer.java} (63%)
 create mode 100644 
tests/integration/src/test/java/org/apache/pulsar/tests/integration/io/DebeziumMongoDbSourceTester.java



[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.

2019-11-18 Thread GitBox
codelipenghui commented on issue #5572: Fix create consumer on partitioned 
topic while disable topic auto creation.
URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555295316
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] tuteng commented on issue #5474: Support CDC Connector for MongoDB

2019-11-18 Thread GitBox
tuteng commented on issue #5474: Support CDC Connector for MongoDB
URL: https://github.com/apache/pulsar/issues/5474#issuecomment-555295267
 
 
   Mongodb's connector is ready for use 
https://github.com/apache/pulsar/pull/5590.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] jiazhai commented on issue #5677: [Issue 5676][C++ client] Expose redelivery count

2019-11-18 Thread GitBox
jiazhai commented on issue #5677: [Issue 5676][C++ client] Expose redelivery 
count
URL: https://github.com/apache/pulsar/pull/5677#issuecomment-555296062
 
 
   retest this please


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] tuteng opened a new issue #5692: [Doc]Add document for mongodb connector

2019-11-18 Thread GitBox
tuteng opened a new issue #5692: [Doc]Add document for mongodb connector
URL: https://github.com/apache/pulsar/issues/5692
 
 
   After adding MongoDB connector, we need to add a document to tell users how 
to use MongoDB connectors. Like this: 
http://pulsar.apache.org/docs/en/io-cdc-debezium/


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar-manager] branch master updated: Remove streamnative from the project (#213)

2019-11-18 Thread sijie
This is an automated email from the ASF dual-hosted git repository.

sijie pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git


The following commit(s) were added to refs/heads/master by this push:
 new 30db686  Remove streamnative from the project (#213)
30db686 is described below

commit 30db68604ea6e1d86fbc1f1b43b7cff0db02c254
Author: tuteng 
AuthorDate: Tue Nov 19 10:21:00 2019 +0800

Remove streamnative from the project (#213)
---
 CONTRIBUTING.md |  6 +++---
 README.md   | 18 ++
 docker/Dockerfile   |  6 +++---
 docs/developer-guide.md | 10 +-
 front-end/README.md |  4 ++--
 front-end/package.json  |  4 ++--
 src/README.md   |  4 ++--
 7 files changed, 23 insertions(+), 29 deletions(-)

diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
index eb1e4ff..0d70bb3 100644
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@@ -17,7 +17,7 @@ Node 10.15 | https://nodejs.org/en/
 
 ### Fork pulsar-manager repository
 
-Fork the [pulsar-manager](https://github.com/streamnative/pulsar-manager) 
repository to your GitHub repository.
+Fork the [pulsar-manager](https://github.com/apache/pulsar-manager) repository 
to your GitHub repository.
 
 ### Install pulsar-manager dependency 
 
@@ -62,14 +62,14 @@ Follow the instructions 
[here](https://howtodoinjava.com/automation/lombok-eclip
 1. Add a remote repository.

 ```bash
-$ git remote add streamnative 
g...@github.com:streamnative/pulsar-manager.git
+$ git remote add apache g...@github.com:apache/pulsar-manager.git
 ```
 
 2. Sync you local repository with the remote repository.
 
 ```bash
 $ git checkout master
-$ git pull streamnative master
+$ git pull apache master
 ```
 
 3. Create your PR and commit code changes.
diff --git a/README.md b/README.md
index 019f28d..c028a65 100644
--- a/README.md
+++ b/README.md
@@ -1,7 +1,5 @@
 # Apache Pulsar manager
 
-[![FOSSA 
Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fpulsar-manager.svg?type=shield)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2Fpulsar-manager?ref=badge_shield)
-
 Apache Pulsar manager is a web-based GUI management tool for managing and 
monitoring Pulsar.
 
 ## Feature
@@ -67,7 +65,7 @@ The pulsar-manager can monitor topics and subscriptions.
 
 
 ## Prerequisites
-* Java 8 or later
+* Java JDK 1.8
 * Node 10.15.3 or later
 * Npm 6.4.1 or later
 * Pulsar 2.4.0 or later
@@ -101,7 +99,7 @@ The pulsar-manager can monitor topics and subscriptions.
 * `PASSWORD`: the password of MySQL
 
 ```
-docker pull streamnative/pulsar-manager
+docker pull apache/pulsar-manager
 docker run -it -p 9527:9527 -e REDIRECT_HOST=front-end-ip -e 
REDIRECT_PORT=front-end-port -e DRIVER_CLASS_NAME=com.mysql.jdbc.Driver -e 
URL='jdbc-url' -e USERNAME=root -e PASSWORD=pulsar pulsar-manager /bin/sh
 ```
 
@@ -116,7 +114,7 @@ The pulsar-manager can monitor topics and subscriptions.
 (1) Download the source code.
 
 ```
-git clone https://github.com/streamnative/pulsar-manager
+git clone https://github.com/apache/pulsar-manager
 ```
 
 (2) Build and start the backend.
@@ -150,7 +148,7 @@ Pulsar Manager bundles JDBC Drivers for 
[HerdDB](https://github.com/diennea/herd
 The default confguration starts and embedded in-memory only HerdDB database.
 
 HerdDB can be used in production, you just have to use the  correct JDBC URL.
-Follow the instructions in 
[application.properties](https://github.com/streamnative/pulsar-manager/blob/master/src/main/resources/application.properties)
 to switch the connection to a standalone HerdDB service or cluster.
+Follow the instructions in 
[application.properties](https://github.com/apache/pulsar-manager/blob/master/src/main/resources/application.properties)
 to switch the connection to a standalone HerdDB service or cluster.
 
 The JDBC URL will look like this:
 jdbc:herddb:server:localhost:7000
@@ -164,14 +162,10 @@ In order to start and setup an HerdDB database follow the 
instructions on the [H
 
 ## Back end
 
-For more information about the back end, see 
[pulsar-manager-backend](https://github.com/streamnative/pulsar-manager/blob/master/src/README.md).
+For more information about the back end, see 
[pulsar-manager-backend](https://github.com/apache/pulsar-manager/blob/master/src/README.md).
 
 
 ## Front end
 
-For more information about the front end, see 
[pulsar-manager-frontend](https://github.com/streamnative/pulsar-manager/blob/master/front-end/README.md).
-
-
+For more information about the front end, see 
[pulsar-manager-frontend](https://github.com/apache/pulsar-manager/blob/master/front-end/README.md).
 
-## License
-[![FOSSA 
Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fstreamnative%2Fpulsar-manager.svg?type=large)](https://app.fossa.io/projects/git%2Bgithub.com%2Fstreamnative%2F

[GitHub] [pulsar] sijie commented on issue #5691: [Issues 5681] fix example code of java client

2019-11-18 Thread GitBox
sijie commented on issue #5691: [Issues 5681] fix example code of java client
URL: https://github.com/apache/pulsar/pull/5691#issuecomment-555303234
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar-manager] branch master updated: Update readme for start backend service (#211)

2019-11-18 Thread sijie
This is an automated email from the ASF dual-hosted git repository.

sijie pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git


The following commit(s) were added to refs/heads/master by this push:
 new c3fd41f  Update readme for start backend service (#211)
c3fd41f is described below

commit c3fd41fa06a1decfcfc56196e86aafa412bc93f9
Author: tuteng 
AuthorDate: Tue Nov 19 10:35:31 2019 +0800

Update readme for start backend service (#211)

* Update readme for start backend service
---
 README.md   | 14 --
 docker/Dockerfile   |  4 +++-
 docker/supervisord.conf |  2 +-
 src/README.md   |  4 ++--
 4 files changed, 14 insertions(+), 10 deletions(-)

diff --git a/README.md b/README.md
index c028a65..b8033f0 100644
--- a/README.md
+++ b/README.md
@@ -90,17 +90,17 @@ The pulsar-manager can monitor topics and subscriptions.
 
 * `REDIRECT_PORT`: the port of the front-end server.
 
-* `DRIVER_CLASS_NAME`: the driver class name of MySQL.
+* `DRIVER_CLASS_NAME`: the driver class name of PostgreSQL.
 
-* `URL`: the url of MySQL jdbc, example: 
jdbc:mysql://localhost:3306/pulsar_manager?useSSL=false
+* `URL`: the url of PostgreSQL jdbc, example: 
jdbc:postgresql://127.0.0.1:5432/pulsar_manager
 
-* `USERNAME`: the username of MySQL
+* `USERNAME`: the username of PostgreSQL
 
-* `PASSWORD`: the password of MySQL
+* `PASSWORD`: the password of PostgreSQL
 
 ```
 docker pull apache/pulsar-manager
-docker run -it -p 9527:9527 -e REDIRECT_HOST=front-end-ip -e 
REDIRECT_PORT=front-end-port -e DRIVER_CLASS_NAME=com.mysql.jdbc.Driver -e 
URL='jdbc-url' -e USERNAME=root -e PASSWORD=pulsar pulsar-manager /bin/sh
+docker run -it -p 9527:9527 -e REDIRECT_HOST=front-end-ip -e 
REDIRECT_PORT=front-end-port -e DRIVER_CLASS_NAME=org.postgresql.Driver -e 
URL='jdbc-url' -e USERNAME=root -e PASSWORD=pulsar pulsar-manager /bin/sh
 ```
 
 This is an example:
@@ -121,7 +121,9 @@ The pulsar-manager can monitor topics and subscriptions.
 ```
 cd pulsar-manager
 ./gradlew build -x test
-java -jar ./build/libs/pulsar-manager.jar
+cd build/distributions
+unzip pulsar-manager.zip or tar -zxvf pulsar-manager.tar
+./pulsar-manager/bin/pulsar-manager
 ```
 
 (3) Build and start the front end.
diff --git a/docker/Dockerfile b/docker/Dockerfile
index 223dd62..d5138f6 100644
--- a/docker/Dockerfile
+++ b/docker/Dockerfile
@@ -43,7 +43,9 @@ RUN mkdir -p /run/nginx
 
 WORKDIR /pulsar-manager
 
-COPY build/libs/*.jar pulsar-manager.jar
+COPY build/distributions/pulsar-manager.tar .
+
+RUN tar -zxvf pulsar-manager.tar
 
 COPY docker/supervisord.conf /etc/
 
diff --git a/docker/supervisord.conf b/docker/supervisord.conf
index bd93427..0c990f2 100644
--- a/docker/supervisord.conf
+++ b/docker/supervisord.conf
@@ -28,5 +28,5 @@ minfds=1024
 minprocs=200
 
 [program:pulsar-manager-backend]
-command = /usr/bin/java -jar /pulsar-manager/pulsar-manager.jar  
--redirect.host=%(ENV_REDIRECT_HOST)s --redirect.port=%(ENV_REDIRECT_PORT)s 
--spring.datasource.driver-class-name=%(ENV_DRIVER_CLASS_NAME)s 
--spring.datasource.url=%(ENV_URL)s 
--spring.datasource.username=%(ENV_USERNAME)s 
--spring.datasource.password=%(ENV_PASSWORD)s 
--spring.datasource.initialization-mode=never
+command = /pulsar-manager/pulsar-manager/bin/pulsar-manager  
--redirect.host=%(ENV_REDIRECT_HOST)s --redirect.port=%(ENV_REDIRECT_PORT)s 
--spring.datasource.driver-class-name=%(ENV_DRIVER_CLASS_NAME)s 
--spring.datasource.url=%(ENV_URL)s 
--spring.datasource.username=%(ENV_USERNAME)s 
--spring.datasource.password=%(ENV_PASSWORD)s 
--spring.datasource.initialization-mode=never
 user = root 
diff --git a/src/README.md b/src/README.md
index 542a62e..34bb30a 100644
--- a/src/README.md
+++ b/src/README.md
@@ -21,7 +21,7 @@ Pulsar manager backend is a supplement and improvement to 
Pulsar broker.
 ### How to set parameters when starting back-end services
 
 ```
-java -jar ./build/libs/pulsar-manager.jar --redirect.host=http://localhost 
--redirect.port=9527 insert.stats.interval=60
+./build/distributions/pulsar-manager/bin/pulsar-manager 
--redirect.host=http://localhost --redirect.port=9527 
insert.stats.interval=60
 ```
 
 ### Use custom databases
@@ -60,7 +60,7 @@ For more information, see [Apache 
Pulsar](http://pulsar.apache.org/docs/en/secur
 * Method 1: Use command-line tool
 
 ```
-java -jar ./build/libs/pulsar-manager.jar --redirect.host=http://localhost 
--redirect.port=9527 insert.stats.interval=60 --backend.jwt.token=token 
--jwt.broker.token.mode=PRIVATE 
--jwt.broker.private.key=file:///path/broker-private.key 
--jwt.broker.public.key=file:///path/broker-public.key
+./build/distributions/pulsar-manager/bin/pulsar-manager 
--redirect.host=http://localhost --redirect.port=9

[GitHub] [pulsar] sijie commented on issue #5674: Parametrize grpc and metrics ports so that they can be configured

2019-11-18 Thread GitBox
sijie commented on issue #5674: Parametrize grpc and metrics ports so that they 
can be configured
URL: https://github.com/apache/pulsar/pull/5674#issuecomment-555306008
 
 
   run integration tests
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5659: Fix prometheus access control not enough in kubernetes

2019-11-18 Thread GitBox
sijie commented on issue #5659: Fix prometheus access control not enough in 
kubernetes
URL: https://github.com/apache/pulsar/pull/5659#issuecomment-555306381
 
 
   retest this please


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5639: Fix ProxyLookupThrottlingTest

2019-11-18 Thread GitBox
sijie commented on issue #5639: Fix ProxyLookupThrottlingTest
URL: https://github.com/apache/pulsar/pull/5639#issuecomment-555306670
 
 
   run cpp tests
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui opened a new issue #5693: [documentation] Clarify the messages(data) be invisible

2019-11-18 Thread GitBox
codelipenghui opened a new issue #5693: [documentation] Clarify the 
messages(data) be invisible
URL: https://github.com/apache/pulsar/issues/5693
 
 
   **Is your feature request related to a problem? Please describe.**
   If all subscriptions mark delete at a position, the messages before that 
position will be delete. Always, users understand the mechanism like send a 
message to the topic, and a new consumer A create a new subscription SUB-A with 
the earliest position and acknowledge the message, then a new consumer B also 
create a new subscription SUB-B with the earliest position, since consumer A 
already acknowledge the message, and at that time topic only have SUB-A 
subscription, so consumer B should not receive that message.
   
   But, actually the consumer B also can receive that message, because broker 
will not delete the current active ledger in the topic, data will be invisible 
to the user until the ledger rollover happens.
   
   So, here add an issue to track the documentation of how messages be 
invisible works.
   
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] tuteng commented on issue #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile

2019-11-18 Thread GitBox
tuteng commented on issue #5689: [Issue 5688][dashboard] Fix postgres version 
in dockerfile
URL: https://github.com/apache/pulsar/pull/5689#issuecomment-555308259
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui commented on issue #5691: [Issues 5681] fix example code of java client

2019-11-18 Thread GitBox
codelipenghui commented on issue #5691: [Issues 5681] fix example code of java 
client
URL: https://github.com/apache/pulsar/pull/5691#issuecomment-555312365
 
 
   run  Integration Tests 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui commented on issue #5691: [Issues 5681] fix example code of java client

2019-11-18 Thread GitBox
codelipenghui commented on issue #5691: [Issues 5681] fix example code of java 
client
URL: https://github.com/apache/pulsar/pull/5691#issuecomment-555312447
 
 
   run Integration Tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui commented on issue #5679: [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1

2019-11-18 Thread GitBox
codelipenghui commented on issue #5679: [Issue 5346]bin/pulsar standalone 
--zookeeper-port 2183 does not work with version 2.4.1
URL: https://github.com/apache/pulsar/pull/5679#issuecomment-555312870
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] zymap commented on issue #5615: Fix hangs when type invalid args at command-line

2019-11-18 Thread GitBox
zymap commented on issue #5615:  Fix hangs when type invalid args at 
command-line
URL: https://github.com/apache/pulsar/pull/5615#issuecomment-555313787
 
 
   @sijie It will hang when we using command-line tools. The process hangs 
because there has a RuntimeException thrown and we are not handling. 
   
   I found we exit the `PulsarAdminTool` by the `System.exit`. When we parse an 
unknown command it will throw a RuntimeException. We need a boolean value to 
check should we exit. When it threw an Exception, there is no value to return 
so it can not exit as usual.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.

2019-11-18 Thread GitBox
codelipenghui commented on issue #5572: Fix create consumer on partitioned 
topic while disable topic auto creation.
URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555319019
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (8d1f793 -> 75c7229)

2019-11-18 Thread zhaijia
This is an automated email from the ASF dual-hosted git repository.

zhaijia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from 8d1f793  [Issue 5474][pulsar-io-debezium] Support CDC Connector for 
MongoDB (#5590)
 add 75c7229  Add epoch for connection handler to handle create producer 
timeout. (#5571)

No new revisions were added by this update.

Summary of changes:
 .../pulsar/broker/service/AbstractTopic.java   |  67 ++--
 .../pulsar/broker/service/BacklogQuotaManager.java |   5 +-
 .../org/apache/pulsar/broker/service/Producer.java |  29 --
 .../apache/pulsar/broker/service/ServerCnx.java|  12 ++-
 .../org/apache/pulsar/broker/service/Topic.java|   3 +-
 .../service/nonpersistent/NonPersistentTopic.java  |  52 --
 .../broker/service/persistent/PersistentTopic.java |  63 +---
 .../stats/prometheus/NamespaceStatsAggregator.java |   2 +-
 .../pulsar/broker/service/PersistentTopicTest.java |  62 +--
 .../pulsar/client/api/ProducerCreationTest.java|  95 +
 .../client/impl/MessagePublishThrottlingTest.java  |   4 +-
 .../pulsar/client/impl/ConnectionHandler.java  |  18 +++-
 .../apache/pulsar/client/impl/ProducerImpl.java|   7 +-
 .../apache/pulsar/common/api/proto/PulsarApi.java  | 114 +
 .../apache/pulsar/common/protocol/Commands.java|   7 +-
 pulsar-common/src/main/proto/PulsarApi.proto   |   7 ++
 16 files changed, 435 insertions(+), 112 deletions(-)
 create mode 100644 
pulsar-broker/src/test/java/org/apache/pulsar/client/api/ProducerCreationTest.java



[GitHub] [pulsar] jiazhai merged pull request #5571: Add epoch for connection handler to handle create producer timeout.

2019-11-18 Thread GitBox
jiazhai merged pull request #5571: Add epoch for connection handler to handle 
create producer timeout.
URL: https://github.com/apache/pulsar/pull/5571
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] jiazhai closed issue #5535: failed to add producer to topic after connection closed

2019-11-18 Thread GitBox
jiazhai closed issue #5535: failed to add producer to topic after connection 
closed
URL: https://github.com/apache/pulsar/issues/5535
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie closed issue #5346: bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1

2019-11-18 Thread GitBox
sijie closed issue #5346: bin/pulsar standalone --zookeeper-port 2183 does not 
work with version 2.4.1
URL: https://github.com/apache/pulsar/issues/5346
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (75c7229 -> 568df47)

2019-11-18 Thread sijie
This is an automated email from the ASF dual-hosted git repository.

sijie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from 75c7229  Add epoch for connection handler to handle create producer 
timeout. (#5571)
 add 568df47  [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does 
not work with version 2.4.1 (#5679)

No new revisions were added by this update.

Summary of changes:
 .../src/main/java/org/apache/pulsar/PulsarStandaloneStarter.java  | 4 +---
 1 file changed, 1 insertion(+), 3 deletions(-)



[GitHub] [pulsar] sijie commented on issue #5628: Fix: Netty threads may still linger after client close

2019-11-18 Thread GitBox
sijie commented on issue #5628: Fix: Netty threads may still linger after 
client close
URL: https://github.com/apache/pulsar/pull/5628#issuecomment-555331978
 
 
   run java8 tests
   run integration tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie merged pull request #5679: [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does not work with version 2.4.1

2019-11-18 Thread GitBox
sijie merged pull request #5679: [Issue 5346]bin/pulsar standalone 
--zookeeper-port 2183 does not work with version 2.4.1
URL: https://github.com/apache/pulsar/pull/5679
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5670: [Doc] Re-organize built-in connector guide

2019-11-18 Thread GitBox
sijie commented on issue #5670: [Doc] Re-organize built-in connector guide
URL: https://github.com/apache/pulsar/pull/5670#issuecomment-555332686
 
 
   run cpp tests
   run integration tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] pradeep-mishra commented on issue #5610: Fluentd connector for Apache Pulsar

2019-11-18 Thread GitBox
pradeep-mishra commented on issue #5610: Fluentd connector for Apache Pulsar
URL: https://github.com/apache/pulsar/issues/5610#issuecomment-555332888
 
 
   @zwzch  thanks, i ll look into it. :)


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5671: [Doc] Add HBase sink connector guide

2019-11-18 Thread GitBox
sijie commented on issue #5671: [Doc] Add HBase sink connector guide
URL: https://github.com/apache/pulsar/pull/5671#issuecomment-555333028
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5647: [docs] Update content of Pulsar SQL overview

2019-11-18 Thread GitBox
sijie commented on issue #5647: [docs] Update content of Pulsar SQL overview
URL: https://github.com/apache/pulsar/pull/5647#issuecomment-55526
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar-manager] 01/01: Merge branch 'master' into branch-0.1.0

2019-11-18 Thread guangning
This is an automated email from the ASF dual-hosted git repository.

guangning pushed a commit to branch branch-0.1.0
in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git

commit 962f93ddc49437487de1697f8e4650ee2634d41c
Merge: 2643a78 c3fd41f
Author: guangning 
AuthorDate: Tue Nov 19 12:57:19 2019 +0800

Merge branch 'master' into branch-0.1.0

 CONTRIBUTING.md |  6 +++---
 README.md   | 32 ++--
 docker/Dockerfile   | 10 ++
 docker/supervisord.conf |  2 +-
 docs/developer-guide.md | 10 +-
 front-end/README.md |  4 ++--
 front-end/package.json  |  4 ++--
 src/README.md   |  8 
 8 files changed, 37 insertions(+), 39 deletions(-)




[pulsar-manager] branch branch-0.1.0 updated (2643a78 -> 962f93d)

2019-11-18 Thread guangning
This is an automated email from the ASF dual-hosted git repository.

guangning pushed a change to branch branch-0.1.0
in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git.


from 2643a78  Merge branch 'master' into branch-0.1.0
 add 30db686  Remove streamnative from the project (#213)
 add c3fd41f  Update readme for start backend service (#211)
 new 962f93d  Merge branch 'master' into branch-0.1.0

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 CONTRIBUTING.md |  6 +++---
 README.md   | 32 ++--
 docker/Dockerfile   | 10 ++
 docker/supervisord.conf |  2 +-
 docs/developer-guide.md | 10 +-
 front-end/README.md |  4 ++--
 front-end/package.json  |  4 ++--
 src/README.md   |  8 
 8 files changed, 37 insertions(+), 39 deletions(-)



[GitHub] [pulsar] sijie commented on issue #5639: Fix ProxyLookupThrottlingTest

2019-11-18 Thread GitBox
sijie commented on issue #5639: Fix ProxyLookupThrottlingTest
URL: https://github.com/apache/pulsar/pull/5639#issuecomment-555333469
 
 
   run cpp tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar-manager] annotated tag v0.1.0-candidate-4 updated (962f93d -> 0d80979)

2019-11-18 Thread guangning
This is an automated email from the ASF dual-hosted git repository.

guangning pushed a change to annotated tag v0.1.0-candidate-4
in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git.


*** WARNING: tag v0.1.0-candidate-4 was modified! ***

from 962f93d  (commit)
  to 0d80979  (tag)
 tagging 962f93ddc49437487de1697f8e4650ee2634d41c (commit)
 replaces v0.1.0-candidate-3
  by guangning
  on Tue Nov 19 12:58:38 2019 +0800

- Log -
Release 0.1.0-candidate-4
-BEGIN PGP SIGNATURE-

iQFJBAABCAAzFiEEfLgyKwIZSFWNsgIYV3wHyoZ66RAFAl3Tdn4VHGd1YW5nbmlu
Z0BhcGFjaGUub3JnAAoJEFd8B8qGeukQvk0H/0N9XbbB5bMTTmixSJxQetCV9GCh
80M4hq4/L7y2v64031u5PlTWO1dVgVqeAeYzqNb85LXFBi1SDpd4CKz5+S2EksKf
pYfhNqI5+1u38ybER5Mn3QCD6AfAwb9IT4y7BwRcx7M7fLsLbo9uT2cZ2HC0Mp2L
4F2Q+a/fCtoxE1f+aR5z2BtXY82jgpzvcKDyO7O3ikrs+UFxlU8tOUs8c6MmrMKB
UtPtvXcaa5adWxmMtaWrS+DukD4ozJmTF++ykqQM5s+9JkEzGAkjVxL6nGPP9mLF
6lqAHPNxu5JVSujOZD8F0gICvCZMdOwIObYzUAy201qEVqG8vd2Vruzn32Q=
=nP4O
-END PGP SIGNATURE-
---


No new revisions were added by this update.

Summary of changes:



[GitHub] [pulsar] sijie commented on issue #5648: [docs] Update sql getting started

2019-11-18 Thread GitBox
sijie commented on issue #5648: [docs] Update sql getting started
URL: https://github.com/apache/pulsar/pull/5648#issuecomment-555333431
 
 
   run java8 tests
   run integration tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on a change in pull request #5632: [Issue 5614] Deprecate brokerServicePurgeInactiveFrequencyInSeconds

2019-11-18 Thread GitBox
sijie commented on a change in pull request #5632: [Issue 5614] Deprecate 
brokerServicePurgeInactiveFrequencyInSeconds
URL: https://github.com/apache/pulsar/pull/5632#discussion_r345544337
 
 

 ##
 File path: 
pulsar-broker-common/src/main/java/org/apache/pulsar/broker/ServiceConfiguration.java
 ##
 @@ -253,7 +253,7 @@
 category = CATEGORY_POLICIES,
 doc = "How often to check for inactive topics"
 )
-private long brokerDeleteInactiveTopicsFrequencySeconds = 60;
+private int brokerDeleteInactiveTopicsFrequencySeconds = 60;
 
 Review comment:
   Any particular reason that you need to change this type?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on a change in pull request #5632: [Issue 5614] Deprecate brokerServicePurgeInactiveFrequencyInSeconds

2019-11-18 Thread GitBox
sijie commented on a change in pull request #5632: [Issue 5614] Deprecate 
brokerServicePurgeInactiveFrequencyInSeconds
URL: https://github.com/apache/pulsar/pull/5632#discussion_r345544457
 
 

 ##
 File path: 
pulsar-broker-common/src/main/java/org/apache/pulsar/broker/ServiceConfiguration.java
 ##
 @@ -1200,6 +1200,7 @@
 doc = "How often broker checks for inactive topics to be deleted 
(topics with no subscriptions and no one connected)"
 )
 private int brokerServicePurgeInactiveFrequencyInSeconds = 60;
+@Deprecated
 
 Review comment:
   I don't think you add the `@Deprecated` annotation in the right place. You 
need add this annotation at line 1202.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5635: [Issue 5612] Use Reactivestreams client for Mongo Sink

2019-11-18 Thread GitBox
sijie commented on issue #5635: [Issue 5612] Use Reactivestreams client for 
Mongo Sink
URL: https://github.com/apache/pulsar/pull/5635#issuecomment-555333906
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5627: [Issue 5626][pulsar-function-go] Fix a memory leak of pulsar-function-go library regarding time.NewTimer()

2019-11-18 Thread GitBox
sijie commented on issue #5627: [Issue 5626][pulsar-function-go] Fix a memory 
leak of pulsar-function-go library regarding time.NewTimer()
URL: https://github.com/apache/pulsar/pull/5627#issuecomment-555334124
 
 
   run integration tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5624: [Issue 4601,5215][pulsar-io-jdbc]Support postgresql,sqlserver,mariadb,clickhouse jdbc source sink

2019-11-18 Thread GitBox
sijie commented on issue #5624: [Issue 4601,5215][pulsar-io-jdbc]Support   
postgresql,sqlserver,mariadb,clickhouse jdbc source sink
URL: https://github.com/apache/pulsar/pull/5624#issuecomment-555334329
 
 
   @huangdx0726 I don't think it is a good idea to put all drivers together. 1) 
it will make the NAR package very large; 2) it becomes very difficult to manage 
the dependencies.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5609: [Doc] Remove duplicate pages

2019-11-18 Thread GitBox
sijie commented on issue #5609: [Doc] Remove duplicate pages
URL: https://github.com/apache/pulsar/pull/5609#issuecomment-555334765
 
 
   @tuteng @Jennifer88huang : since you are fixing the links between different 
versions of documentation, can you please take a look at this pull request?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar-manager.wiki] branch master updated: Updated Release process (markdown)

2019-11-18 Thread guangning
This is an automated email from the ASF dual-hosted git repository.

guangning pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar-manager.wiki.git


The following commit(s) were added to refs/heads/master by this push:
 new 3fa9f68  Updated Release process (markdown)
3fa9f68 is described below

commit 3fa9f6896768b297f44cf0f7f89b01d42b811e7d
Author: tuteng 
AuthorDate: Tue Nov 19 13:04:23 2019 +0800

Updated Release process (markdown)
---
 Release-process.md | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/Release-process.md b/Release-process.md
index 5a4ab4e..048f0ac 100644
--- a/Release-process.md
+++ b/Release-process.md
@@ -89,8 +89,8 @@ The src and bin artifacts need to be signed and uploaded to 
the dist SVN reposit
 ```
 gpg -b --armor apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz
 gpg -b --armor apache-pulsar-manager-0.X.0-candidate-1-src.tar.gz
-shasum -a 512 apache-pulsar-manager-0.X.0-candidate-2-bin.tar.gz > 
apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz.sha512
-shasum -a 512 apache-pulsar-manager-0.X.0-candidate-2-src.tar.gz > 
apache-pulsar-manager-0.X.0-candidate-2-src.tar.gz.sha512
+shasum -a 512 apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz > 
apache-pulsar-manager-0.X.0-candidate-1-bin.tar.gz.sha512
+shasum -a 512 apache-pulsar-manager-0.X.0-candidate-1-src.tar.gz > 
apache-pulsar-manager-0.X.0-candidate-1-src.tar.gz.sha512
 svn co https://dist.apache.org/repos/dist/dev/pulsar/pulsar-manager 
pulsar-manager
 cd pulsar-manager
 



[GitHub] [pulsar] sijie commented on issue #5358: PIP-45: Switch ManagedLedger to use MetadataStore interface

2019-11-18 Thread GitBox
sijie commented on issue #5358: PIP-45: Switch ManagedLedger to use 
MetadataStore interface
URL: https://github.com/apache/pulsar/pull/5358#issuecomment-555335442
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie commented on issue #5342: Use simple GC settings when running integration tests

2019-11-18 Thread GitBox
sijie commented on issue #5342: Use simple GC settings when running integration 
tests
URL: https://github.com/apache/pulsar/pull/5342#issuecomment-555335484
 
 
   run integration tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie merged pull request #5023: `hasMessageAvailable` should return false when Reader read from latest messages

2019-11-18 Thread GitBox
sijie merged pull request #5023: `hasMessageAvailable` should return false when 
Reader read from latest messages
URL: https://github.com/apache/pulsar/pull/5023
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie closed issue #4912: Java client Reader readNext and hasMessageAvailable not working when attempting to find last message in topic

2019-11-18 Thread GitBox
sijie closed issue #4912: Java client Reader readNext and hasMessageAvailable 
not working when attempting to find last message in topic
URL: https://github.com/apache/pulsar/issues/4912
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (568df47 -> bfcfdf6)

2019-11-18 Thread sijie
This is an automated email from the ASF dual-hosted git repository.

sijie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from 568df47  [Issue 5346]bin/pulsar standalone --zookeeper-port 2183 does 
not work with version 2.4.1 (#5679)
 add bfcfdf6  `hasMessageAvailable` should return false when Reader read 
from latest messages (#5023)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/pulsar/client/impl/ReaderTest.java  | 32 ++
 .../apache/pulsar/client/impl/ConsumerImpl.java|  7 +
 2 files changed, 39 insertions(+)



[GitHub] [pulsar] sijie merged pull request #5615: Fix hangs when type invalid args at command-line

2019-11-18 Thread GitBox
sijie merged pull request #5615:  Fix hangs when type invalid args at 
command-line
URL: https://github.com/apache/pulsar/pull/5615
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] sijie closed issue #5533: Missing CLI error handling in pulsar-admin

2019-11-18 Thread GitBox
sijie closed issue #5533: Missing CLI error handling in pulsar-admin
URL: https://github.com/apache/pulsar/issues/5533
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (bfcfdf6 -> d16e79a)

2019-11-18 Thread sijie
This is an automated email from the ASF dual-hosted git repository.

sijie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from bfcfdf6  `hasMessageAvailable` should return false when Reader read 
from latest messages (#5023)
 add d16e79a   Fix hangs when type invalid args at command-line (#5615)

No new revisions were added by this update.

Summary of changes:
 .../src/main/java/org/apache/pulsar/admin/cli/CmdBase.java  | 13 +++--
 1 file changed, 11 insertions(+), 2 deletions(-)



[GitHub] [pulsar] sijie merged pull request #5675: fix bkenv has no effect bug when start bookie using bin/pulsar-daemon

2019-11-18 Thread GitBox
sijie merged pull request #5675: fix bkenv has no effect bug when start bookie 
using bin/pulsar-daemon
URL: https://github.com/apache/pulsar/pull/5675
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (d16e79a -> 16affa0)

2019-11-18 Thread sijie
This is an automated email from the ASF dual-hosted git repository.

sijie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from d16e79a   Fix hangs when type invalid args at command-line (#5615)
 add 16affa0  fix bkenv has no effect bug when start bookie using 
bin/pulsar-daemon (#5675)

No new revisions were added by this update.

Summary of changes:
 bin/pulsar | 6 ++
 bin/pulsar-daemon  | 6 ++
 bin/pulsar-perf| 6 ++
 conf/pulsar_env.sh | 4 
 src/pulsar-io-gen  | 6 ++
 5 files changed, 24 insertions(+), 4 deletions(-)



[GitHub] [pulsar] tuteng commented on issue #5609: [Doc] Remove duplicate pages

2019-11-18 Thread GitBox
tuteng commented on issue #5609: [Doc] Remove duplicate pages
URL: https://github.com/apache/pulsar/pull/5609#issuecomment-555336917
 
 
   > @tuteng @Jennifer88huang : since you are fixing the links between 
different versions of documentation, can you please take a look at this pull 
request?
   
   I will try my best to fix this problem this afternoon and then create a pr.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] wolfstudy commented on issue #4741: Remove failed stale producer from the connection

2019-11-18 Thread GitBox
wolfstudy commented on issue #4741: Remove failed stale producer from the 
connection
URL: https://github.com/apache/pulsar/pull/4741#issuecomment-555337967
 
 
   Change the Milestone to 2.4.2, because of conflict.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] wolfstudy commented on issue #4799: Test cleanup and simplification

2019-11-18 Thread GitBox
wolfstudy commented on issue #4799: Test cleanup and simplification
URL: https://github.com/apache/pulsar/pull/4799#issuecomment-555337827
 
 
   Change the Milestone to 2.4.2, because of conflict.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] wolfstudy commented on issue #4751: Get schema info with topic partition

2019-11-18 Thread GitBox
wolfstudy commented on issue #4751: Get schema info with topic partition
URL: https://github.com/apache/pulsar/pull/4751#issuecomment-555340868
 
 
   Change the Milestone to 2.4.2, because of conflict.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] wolfstudy commented on issue #4877: Add schema admin api get schema info with schema version

2019-11-18 Thread GitBox
wolfstudy commented on issue #4877: Add schema admin api  get schema info with 
schema version
URL: https://github.com/apache/pulsar/pull/4877#issuecomment-555341776
 
 
   Change the Milestone to 2.4.2, because of conflict.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


svn commit: r36820 - in /dev/pulsar/pulsar-manager: pulsar-manager-0.1.0-candidate-2/ pulsar-manager-0.1.0-candidate-3/ pulsar-manager-0.1.0-candidate-4/

2019-11-18 Thread guangning
Author: guangning
Date: Tue Nov 19 05:53:05 2019
New Revision: 36820

Log:
Staging artifacts and signature for Pulsar Manager release 0.1.0

Added:
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/

dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz
   (with props)

dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc

dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512

dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz
   (with props)

dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc

dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.sha512
Removed:
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-2/
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-3/

Added: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz
==
Binary file - no diff available.

Propchange: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz
--
svn:mime-type = application/octet-stream

Added: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc
==
--- 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc
 (added)
+++ 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.asc
 Tue Nov 19 05:53:05 2019
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQEzBAABCAAdFiEEfLgyKwIZSFWNsgIYV3wHyoZ66RAFAl3Td9EACgkQV3wHyoZ6
+6RBGYwgAww1LeifQzwZp8EiZkjouDZmlN7BJQeNt1Thum0kp96JMVG61DDxv8B+p
+2aw1vVidcCLETq1+B6im6VICrXjlPyOwRVKit4r109+OQcVYa0z49lnBfeUK10Nm
+aNRK6ny1vhLOHe54d/N65ar6tvQpdwqQfA/K/+zcR/OwJSRCcSolmaqqOnW4pmaC
+3ymCBM8vbl+sTUd7E5q9xBGJqhPdbuJzVjjybLoKVZatuba5BYbsX1uDMKiRXSTt
+QbjwCpMsvXvd7wIJXEEVP/pWPdXBUqG2X7LUnNOnDYdkwZ64lTxbFpn/b4THG6aB
+aGJKhxOhWaj64nZuL6gDs3FsXppVoQ==
+=P4u/
+-END PGP SIGNATURE-

Added: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512
==
--- 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512
 (added)
+++ 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz.sha512
 Tue Nov 19 05:53:05 2019
@@ -0,0 +1 @@
+bc25543b1693efc9eb1e037a1ae8cb68a1fe30edf69b179cf415a27dcc61fc4398928ea1a52053bcaa7baf51e0365a2bd3d609b712de4e4ebe8ae105602ac3ef
  apache-pulsar-manager-0.1.0-candidate-4-bin.tar.gz

Added: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz
==
Binary file - no diff available.

Propchange: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz
--
svn:mime-type = application/octet-stream

Added: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc
==
--- 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc
 (added)
+++ 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.asc
 Tue Nov 19 05:53:05 2019
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQEzBAABCAAdFiEEfLgyKwIZSFWNsgIYV3wHyoZ66RAFAl3Td9oACgkQV3wHyoZ6
+6RDFeAgA7wq4PVJrtWgO7kkVVYZ+ScOAZKXGUqQfk7+zxjBRji41ATIaXFcuj5Z8
+6AhWcNFc23uNiSzMqIqKXpTIcNyd9YR2R65NGwbK+SasbFYtfBCQPY0hpvQWyfme
+Guh7S2dQtQGL5hsWaq55T3DADCZjwedST8ZGTwgSbQ7klWdiPjY9qhyiz0RZpDQQ
+hK3ouqi1ozKxRr/RwHPLe4APSFVne99kbF8cB8rh/csQXC36udAjBgVgmdRzLiZm
+qZVLjausH/xiQD5yQxiFGLcnXv5vlB2E764uepFq70fSq8hlcWymfhDBzz46PtwN
+vHXrqPYyaO0ZvBPTtLyUHiIpL6mT4w==
+=ofaN
+-END PGP SIGNATURE-

Added: 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-manager-0.1.0-candidate-4-src.tar.gz.sha512
==
--- 
dev/pulsar/pulsar-manager/pulsar-manager-0.1.0-candidate-4/apache-pulsar-ma

[GitHub] [pulsar] lspgn opened a new issue #5695: Go: Segfault on messageId serialize after getting it from producer

2019-11-18 Thread GitBox
lspgn opened a new issue #5695: Go: Segfault on messageId serialize after 
getting it from producer
URL: https://github.com/apache/pulsar/issues/5695
 
 
   **Describe the bug**
   Looks like the following Go code (also happens with async):
   ```
   id, err := producer.SendAndGetMsgID(context.Background(), msg)
   if err != nil { log.Fatal(err) }
   
   fmt.Printf("the %s successfully published with id %v\n", 
string(msg.Payload), id.Serialize())
   ```
   causes the following:
   ```
   fatal error: unexpected signal during runtime execution
   [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x49a2965]
   
   runtime stack:
   runtime.throw(0x44a9483, 0x2a)
   /usr/local/Cellar/go/1.13.3/libexec/src/runtime/panic.go:774 +0x72
   runtime.sigpanic()
   /usr/local/Cellar/go/1.13.3/libexec/src/runtime/signal_unix.go:378 +0x47c
   
   goroutine 8 [syscall]:
   runtime.cgocall(0x43c0490, 0xccfc28, 0x0)
   /usr/local/Cellar/go/1.13.3/libexec/src/runtime/cgocall.go:128 +0x5b 
fp=0xccfbf8 sp=0xccfbc0 pc=0x400494b
   
github.com/apache/pulsar/pulsar-client-go/pulsar._Cfunc_pulsar_message_id_serialize(0x700b7f0,
 0xc00018a010, 0x0)
   _cgo_gotypes.go:1265 +0x4e fp=0xccfc28 sp=0xccfbf8 pc=0x43a2eae
   
github.com/apache/pulsar/pulsar-client-go/pulsar.(*messageID).Serialize.func1(0xc100a8,
 0xc00018a010, 0x4528cc0)
   
/Users/me/go/pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20191115070645-69cd6eb660af/pulsar/c_message.go:187
 +0x68 fp=0xccfc68 sp=0xccfc28 pc=0x43b2378
   
github.com/apache/pulsar/pulsar-client-go/pulsar.(*messageID).Serialize(0xc100a8,
 0x0, 0x0, 0x0)
   
/Users/me/go/pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20191115070645-69cd6eb660af/pulsar/c_message.go:187
 +0x63 fp=0xccfce8 sp=0xccfc68 pc=0x43a9ff3
   main.produceData(0x45352a0, 0xc13420, 0x449b5fb, 0xa)
   /Users/me/project/test/main.go:146 +0x40c fp=0xccffc0 
sp=0xccfce8 pc=0x43be50c
   runtime.goexit()
   /usr/local/Cellar/go/1.13.3/libexec/src/runtime/asm_amd64.s:1357 +0x1 
fp=0xccffc8 sp=0xccffc0 pc=0x405caa1
   created by main.main
   /Users/me/project/test/main.go:177 +0x269
   ```
   Note: `id` is not null, it's a `*pulsar.messageId` pointer.
   
   **Desktop:**
   Mac OS 10.14.6
   github.com/apache/pulsar/pulsar-client-go v0.0.0-20191115070645-69cd6eb660af
   
   Thank you :) 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] merlimat closed issue #5688: [Pulsar dashboard] dashboard docker image installs incorrect version of postgres

2019-11-18 Thread GitBox
merlimat closed issue #5688: [Pulsar dashboard] dashboard docker image installs 
incorrect version of postgres
URL: https://github.com/apache/pulsar/issues/5688
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] merlimat merged pull request #5689: [Issue 5688][dashboard] Fix postgres version in dockerfile

2019-11-18 Thread GitBox
merlimat merged pull request #5689: [Issue 5688][dashboard] Fix postgres 
version in dockerfile
URL: https://github.com/apache/pulsar/pull/5689
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (16affa0 -> 5d6b78d)

2019-11-18 Thread mmerli
This is an automated email from the ASF dual-hosted git repository.

mmerli pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from 16affa0  fix bkenv has no effect bug when start bookie using 
bin/pulsar-daemon (#5675)
 add 5d6b78d  pin debian release (#5689)

No new revisions were added by this update.

Summary of changes:
 dashboard/Dockerfile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)



[GitHub] [pulsar] merlimat commented on issue #5677: [Issue 5676][C++ client] Expose redelivery count

2019-11-18 Thread GitBox
merlimat commented on issue #5677: [Issue 5676][C++ client] Expose redelivery 
count
URL: https://github.com/apache/pulsar/pull/5677#issuecomment-555351801
 
 
   run java8 tests
   run cpp tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] utf7 opened a new pull request #5696: [pulsar-io] improve hbase sink performance

2019-11-18 Thread GitBox
utf7 opened a new pull request #5696: [pulsar-io] improve hbase sink performance
URL: https://github.com/apache/pulsar/pull/5696
 
 
   Motivation
   multi columns add to single put can  improve the performace
   this can improve hbase put performance
   in our test env, it can be better 2.x-3.x
   
   Modifications
   hbase sink : change one column with one put to one put with many columns  


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] codelipenghui commented on issue #5572: Fix create consumer on partitioned topic while disable topic auto creation.

2019-11-18 Thread GitBox
codelipenghui commented on issue #5572: Fix create consumer on partitioned 
topic while disable topic auto creation.
URL: https://github.com/apache/pulsar/pull/5572#issuecomment-555359026
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] Jennifer88huang closed issue #5681: Documentation java client example error

2019-11-18 Thread GitBox
Jennifer88huang closed issue #5681: Documentation java client example error
URL: https://github.com/apache/pulsar/issues/5681
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] Jennifer88huang merged pull request #5691: [Issues 5681] fix example code of java client

2019-11-18 Thread GitBox
Jennifer88huang merged pull request #5691: [Issues 5681] fix example code of 
java client
URL: https://github.com/apache/pulsar/pull/5691
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (5d6b78d -> dd9e669)

2019-11-18 Thread hjf
This is an automated email from the ASF dual-hosted git repository.

hjf pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from 5d6b78d  pin debian release (#5689)
 add dd9e669  fix example code of java client (#5691)

No new revisions were added by this update.

Summary of changes:
 site2/docs/client-libraries-java.md | 2 +-
 site2/website/versioned_docs/version-2.4.0/client-libraries-java.md | 2 +-
 site2/website/versioned_docs/version-2.4.1/client-libraries-java.md | 2 +-
 3 files changed, 3 insertions(+), 3 deletions(-)



[GitHub] [pulsar] jiazhai merged pull request #4621: [PIP-38] Support batch receive in java client.

2019-11-18 Thread GitBox
jiazhai merged pull request #4621: [PIP-38] Support batch receive in java 
client.
URL: https://github.com/apache/pulsar/pull/4621
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[pulsar] branch master updated (dd9e669 -> 56517d5)

2019-11-18 Thread zhaijia
This is an automated email from the ASF dual-hosted git repository.

zhaijia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git.


from dd9e669  fix example code of java client (#5691)
 add 56517d5  [PIP-38] Support batch receive in java client. (#4621)

No new revisions were added by this update.

Summary of changes:
 distribution/server/licenses/LICENSE-jcip.txt  |   7 +
 distribution/server/src/assemble/LICENSE.bin.txt   |   4 +
 distribution/server/src/assemble/NOTICE.bin.txt|   3 +
 pom.xml|   8 +-
 .../client/api/ConsumerBatchReceiveTest.java   | 296 +
 .../pulsar/client/api/BatchReceivePolicy.java  | 145 ++
 .../org/apache/pulsar/client/api/Consumer.java |  75 ++
 .../apache/pulsar/client/api/ConsumerBuilder.java  |  15 ++
 .../apache/pulsar/client/api/ConsumerStats.java|  10 +
 .../api/{package-info.java => Messages.java}   |  13 +-
 pulsar-client/pom.xml  |   5 +
 .../apache/pulsar/client/impl/ConsumerBase.java| 267 +++
 .../pulsar/client/impl/ConsumerBuilderImpl.java|   9 +
 .../apache/pulsar/client/impl/ConsumerImpl.java|  78 +-
 .../pulsar/client/impl/ConsumerStatsDisabled.java  |  15 ++
 .../pulsar/client/impl/ConsumerStatsRecorder.java  |   2 +
 .../client/impl/ConsumerStatsRecorderImpl.java |  32 ++-
 .../apache/pulsar/client/impl/MessagesImpl.java|  80 ++
 .../client/impl/MultiTopicsConsumerImpl.java   |  76 +-
 .../impl/conf/ConsumerConfigurationData.java   |   5 +-
 .../client/impl/ConsumerBuilderImplTest.java   |  14 +
 .../pulsar/client/impl/ConsumerImplTest.java   |   2 +
 .../pulsar/PulsarConsumerSourceTests.java  |  26 ++
 pulsar-sql/presto-distribution/LICENSE |   4 +
 site2/docs/client-libraries-java.md|  40 +++
 src/check-binary-license   |   2 +-
 26 files changed, 1161 insertions(+), 72 deletions(-)
 create mode 100644 distribution/server/licenses/LICENSE-jcip.txt
 create mode 100644 
pulsar-broker/src/test/java/org/apache/pulsar/client/api/ConsumerBatchReceiveTest.java
 create mode 100644 
pulsar-client-api/src/main/java/org/apache/pulsar/client/api/BatchReceivePolicy.java
 copy 
pulsar-client-api/src/main/java/org/apache/pulsar/client/api/{package-info.java 
=> Messages.java} (80%)
 create mode 100644 
pulsar-client/src/main/java/org/apache/pulsar/client/impl/MessagesImpl.java



[GitHub] [pulsar] Jennifer88huang commented on a change in pull request #5609: [Doc] Remove duplicate pages

2019-11-18 Thread GitBox
Jennifer88huang commented on a change in pull request #5609: [Doc] Remove 
duplicate pages
URL: https://github.com/apache/pulsar/pull/5609#discussion_r347764901
 
 

 ##
 File path: site2/docs/deploy-bare-metal.md
 ##
 @@ -447,7 +447,7 @@ bin/pulsar-admin functions create \
   --name exclamation
 ```
 
-Check if the function runs as expected by 
[triggering](functions-deploying.md#triggering-pulsar-functions) the function.
+Check if the function runs as expected by 
[triggering](functions-deploy.md#triggering-pulsar-functions) the function.
 
 Review comment:
   ```suggestion
   Check if the function runs as expected by 
[triggering](functions-deploy.md#trigger-pulsar-functions) the function.
   ```


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [pulsar] Jennifer88huang commented on issue #5647: [docs] Update content of Pulsar SQL overview

2019-11-18 Thread GitBox
Jennifer88huang commented on issue #5647: [docs] Update content of Pulsar SQL 
overview
URL: https://github.com/apache/pulsar/pull/5647#issuecomment-555372795
 
 
   run java8 tests


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


  1   2   >