[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r222908656 ## File path: conf/broker.con

[GitHub] MarkAddison commented on issue #2642: Duplicate classes caught by maven-enforcer-plugin

2018-10-05 Thread GitBox
MarkAddison commented on issue #2642: Duplicate classes caught by maven-enforcer-plugin URL: https://github.com/apache/pulsar/issues/2642#issuecomment-427270535 Thank you for your reply and explanation. As stated above we do have a workaround, which is not completely satisfactory, but will

[pulsar] branch master updated: local function-worker use localhost broker service url (#2722)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new af58956 local function-worker use localhost brok

[GitHub] sijie closed pull request #2722: local function-worker use localhost broker service url

2018-10-05 Thread GitBox
sijie closed pull request #2722: local function-worker use localhost broker service url URL: https://github.com/apache/pulsar/pull/2722 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] sijie closed pull request #2717: [schema] use AUTO_PRODUCE schema when possible

2018-10-05 Thread GitBox
sijie closed pull request #2717: [schema] use AUTO_PRODUCE schema when possible URL: https://github.com/apache/pulsar/pull/2717 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign

[GitHub] sijie commented on issue #2717: [schema] use AUTO_PRODUCE schema when possible

2018-10-05 Thread GitBox
sijie commented on issue #2717: [schema] use AUTO_PRODUCE schema when possible URL: https://github.com/apache/pulsar/pull/2717#issuecomment-427276854 closing this one in favor of #2730 This is an automated message from the Ap

[GitHub] sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728#issuecomment-427277122 run cpp tests run integration tests This is an automated message from the Apac

[GitHub] sijie closed pull request #2724: [functions][stats] don't generate function stats at worker service if runtime is k8s

2018-10-05 Thread GitBox
sijie closed pull request #2724: [functions][stats] don't generate function stats at worker service if runtime is k8s URL: https://github.com/apache/pulsar/pull/2724 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sa

[pulsar] branch master updated: [functions][stats] don't generate function stats at worker service if runtime is k8s (#2724)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new ab02f4f [functions][stats] don't generate funct

[GitHub] sijie commented on issue #2721: [functions][conf] Update functions_worker yml with all the possible settings

2018-10-05 Thread GitBox
sijie commented on issue #2721: [functions][conf] Update functions_worker yml with all the possible settings URL: https://github.com/apache/pulsar/pull/2721#issuecomment-427290606 run java8 tests This is an automated message

[GitHub] sijie opened a new pull request #2732: [integration tests] add a smoketest for pulsar standalone

2018-10-05 Thread GitBox
sijie opened a new pull request #2732: [integration tests] add a smoketest for pulsar standalone URL: https://github.com/apache/pulsar/pull/2732 *Motivation* Ideally we should run all integration tests on both cluster mode and standalone mode. However the apache ci can't really a

[GitHub] sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone

2018-10-05 Thread GitBox
sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone URL: https://github.com/apache/pulsar/pull/2732#issuecomment-427291138 This is for introducing state related tests for #2714 This is a

[pulsar] branch asf-site updated: Updated site at revision ab02f4f

2018-10-05 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 1e6f7cc Updated site at revision ab02f4f 1e

[GitHub] macthestack edited a comment on issue #2697: Offloading fails

2018-10-05 Thread GitBox
macthestack edited a comment on issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697#issuecomment-427086068 Here we go: [stderr](https://storage.googleapis.com/pulsar-topic-offload/stderr/2018/10/04/15%3A00%3A00_15%3A59%3A59_S0.json) [stdout](https://st

[GitHub] ivankelly commented on issue #2697: Offloading fails

2018-10-05 Thread GitBox
ivankelly commented on issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697#issuecomment-427317383 @macthestack ``` # Driver to use to offload old data to long term storage (Possible values: S3) managedLedgerOffloadDriver=aws-s3 ``` For 2.1

[GitHub] ivankelly opened a new pull request #2733: Extra logging for offloaders

2018-10-05 Thread GitBox
ivankelly opened a new pull request #2733: Extra logging for offloaders URL: https://github.com/apache/pulsar/pull/2733 Some extra logging for offloader loading and initialization which would have been useful when debugging #2697. -

[GitHub] ivankelly commented on issue #2688: Polices On Topic

2018-10-05 Thread GitBox
ivankelly commented on issue #2688: Polices On Topic URL: https://github.com/apache/pulsar/issues/2688#issuecomment-427331833 @codelipenghui This change will cause more load on zookeeper. For each topic loaded, we would have to do a read for the policy of that topic when loading the

[GitHub] ivankelly commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
ivankelly commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223007365 ## File path: pulsar-bro

[GitHub] macthestack commented on issue #2697: Offloading fails

2018-10-05 Thread GitBox
macthestack commented on issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697#issuecomment-427375482 Thanks @ivankelly, that did the trick This is an automated message from the Apache Git Service. To

[GitHub] ivankelly commented on issue #2697: Offloading fails

2018-10-05 Thread GitBox
ivankelly commented on issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697#issuecomment-427377399 I'm glad to hear it. Let us know if you have more trouble. This is an automated message from the Apa

[GitHub] ivankelly closed issue #2697: Offloading fails

2018-10-05 Thread GitBox
ivankelly closed issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above

[GitHub] sijie closed pull request #2721: [functions][conf] Update functions_worker yml with all the possible settings

2018-10-05 Thread GitBox
sijie closed pull request #2721: [functions][conf] Update functions_worker yml with all the possible settings URL: https://github.com/apache/pulsar/pull/2721 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of pro

[pulsar] branch master updated: [functions][conf] Update functions_worker yml with all the possible settings (#2721)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 525239b [functions][conf] Update functions_worke

[GitHub] david-streamlio commented on issue #2615: Azure offloader

2018-10-05 Thread GitBox
david-streamlio commented on issue #2615: Azure offloader URL: https://github.com/apache/pulsar/pull/2615#issuecomment-427405837 I am open to suggestions on how to split these up, but these changes are tightly coupled. I could remove the Glacier offloader, but that would be just one class.

[GitHub] sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728#issuecomment-427406609 ping @srkukarni ? This is an automated message from the Apache Git Service. To re

[GitHub] sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728#issuecomment-427406569 run integration tests This is an automated message from the Apache Git Service. T

[GitHub] sijie commented on a change in pull request #2733: Extra logging for offloaders

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2733: Extra logging for offloaders URL: https://github.com/apache/pulsar/pull/2733#discussion_r223050909 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/PulsarService.java ## @@ -689,6 +689,7 @@ public synchro

[GitHub] srkukarni commented on issue #2729: Added ability a download dependencies in Kubernetes

2018-10-05 Thread GitBox
srkukarni commented on issue #2729: Added ability a download dependencies in Kubernetes URL: https://github.com/apache/pulsar/pull/2729#issuecomment-427411294 run cpp tests This is an automated message from the Apache Git Ser

[GitHub] srkukarni closed pull request #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
srkukarni closed pull request #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign p

[pulsar] branch master updated: [function][runtime] NPE at RuntimeSpawner (#2728)

2018-10-05 Thread sanjeevrk
This is an automated email from the ASF dual-hosted git repository. sanjeevrk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new ea503da [function][runtime] NPE at RuntimeSp

[GitHub] merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223068545 ## File path: conf/broker.

[GitHub] merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223069417 ## File path: pulsar-clie

[GitHub] merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223068919 ## File path: pulsar-clie

[GitHub] srkukarni commented on a change in pull request #2729: Added ability a download dependencies in Kubernetes

2018-10-05 Thread GitBox
srkukarni commented on a change in pull request #2729: Added ability a download dependencies in Kubernetes URL: https://github.com/apache/pulsar/pull/2729#discussion_r223074246 ## File path: pulsar-functions/instance/src/main/python/python_instance.py ## @@ -26,7 +26,10 @@

[GitHub] srkukarni closed pull request #2729: Added ability a download dependencies in Kubernetes

2018-10-05 Thread GitBox
srkukarni closed pull request #2729: Added ability a download dependencies in Kubernetes URL: https://github.com/apache/pulsar/pull/2729 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[pulsar] branch master updated: Added ability a download dependencies in Kubernetes (#2729)

2018-10-05 Thread sanjeevrk
This is an automated email from the ASF dual-hosted git repository. sanjeevrk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new da83322 Added ability a download dependencie

[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223093861 ## File path: pulsar-client-

[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223102771 ## File path: pulsar-broker/

[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223102847 ## File path: pulsar-client/

[GitHub] sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone

2018-10-05 Thread GitBox
sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone URL: https://github.com/apache/pulsar/pull/2732#issuecomment-427460647 run integration tests This is an automated message from the Apac

[GitHub] sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#issuecomment-427461762 @ivankelly @merlimat I have addressed your comments. ca

[GitHub] sijie opened a new issue #2734: Add namespace level enforcement on schema validation

2018-10-05 Thread GitBox
sijie opened a new issue #2734: Add namespace level enforcement on schema validation URL: https://github.com/apache/pulsar/issues/2734 in 2.2 we have a broker-level setting on enforcing schema validation. in 2.3, we need to add the enforcement to namespace level and eventually get rid of

[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223116091 ## File path: conf/broker.con

[GitHub] merlimat opened a new pull request #2735: Collect metrics on number of logs lines printed

2018-10-05 Thread GitBox
merlimat opened a new pull request #2735: Collect metrics on number of logs lines printed URL: https://github.com/apache/pulsar/pull/2735 ### Motivation Expose metrics in Prometheus regarding the number of log messages printed by each process. This will add metrics like:

[GitHub] sijie opened a new issue #2736: Add admin command to truncate pulsar topics (partitions)

2018-10-05 Thread GitBox
sijie opened a new issue #2736: Add admin command to truncate pulsar topics (partitions) URL: https://github.com/apache/pulsar/issues/2736 requirement: set infinite retention on a namespace and then manually truncate the topic. - truncate the topic by message id - delete all the

[GitHub] srkukarni opened a new pull request #2737: The log4j should be prefixed by pulsarRootDir

2018-10-05 Thread GitBox
srkukarni opened a new pull request #2737: The log4j should be prefixed by pulsarRootDir URL: https://github.com/apache/pulsar/pull/2737 ### Motivation Explain here the context, and why you're making that change. What is the problem you're trying to solve. ### Modifications

[GitHub] sijie opened a new pull request #2738: [functions][worker] timeout creating producer for worker

2018-10-05 Thread GitBox
sijie opened a new pull request #2738: [functions][worker] timeout creating producer for worker URL: https://github.com/apache/pulsar/pull/2738 *Motivation* Sometime when we run worker service as part of broker, some pods can be hanging on creating producers to assignment topics.

[GitHub] sijie closed pull request #2732: [integration tests] add a smoketest for pulsar standalone

2018-10-05 Thread GitBox
sijie closed pull request #2732: [integration tests] add a smoketest for pulsar standalone URL: https://github.com/apache/pulsar/pull/2732 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this i

[pulsar] branch master updated: [integration tests] add a smoketest for pulsar standalone (#2732)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new d26bea8 [integration tests] add a smoketest for

[GitHub] sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#issuecomment-427515305 run integration tests run java8 tests -

[pulsar] branch master updated: [functions][worker] timeout creating producer for worker (#2738)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new fc0ef90 [functions][worker] timeout creating pro

[GitHub] sijie commented on issue #2735: Collect metrics on number of logs lines printed

2018-10-05 Thread GitBox
sijie commented on issue #2735: Collect metrics on number of logs lines printed URL: https://github.com/apache/pulsar/pull/2735#issuecomment-427525137 run java8 tests This is an automated message from the Apache Git Service. T

[GitHub] sijie closed pull request #2738: [functions][worker] timeout creating producer for worker

2018-10-05 Thread GitBox
sijie closed pull request #2738: [functions][worker] timeout creating producer for worker URL: https://github.com/apache/pulsar/pull/2738 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[GitHub] srkukarni commented on issue #2737: The log4j should be prefixed by pulsarRootDir

2018-10-05 Thread GitBox
srkukarni commented on issue #2737: The log4j should be prefixed by pulsarRootDir URL: https://github.com/apache/pulsar/pull/2737#issuecomment-427526752 run java8 tests This is an automated message from the Apache Git Service

[GitHub] sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#issuecomment-427531197 run cpp tests

[pulsar] branch master updated: The log4j should be prefixed by pulsarRootDir (#2737)

2018-10-05 Thread sanjeevrk
This is an automated email from the ASF dual-hosted git repository. sanjeevrk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 77e2e0b The log4j should be prefixed by puls

[GitHub] srkukarni closed pull request #2737: The log4j should be prefixed by pulsarRootDir

2018-10-05 Thread GitBox
srkukarni closed pull request #2737: The log4j should be prefixed by pulsarRootDir URL: https://github.com/apache/pulsar/pull/2737 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a fore

[pulsar] branch master updated: Collect metrics on number of logs lines printed (#2735)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new c3c7f0d Collect metrics on number of logs lines

[GitHub] sijie closed pull request #2735: Collect metrics on number of logs lines printed

2018-10-05 Thread GitBox
sijie closed pull request #2735: Collect metrics on number of logs lines printed URL: https://github.com/apache/pulsar/pull/2735 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign