[pulsar-site] branch main updated: Update Pulsar featured event for Pulsar Summit Asia 2022 (#216)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/pulsar-site.git The following commit(s) were added to refs/heads/main by this push: new d80347c408e Update Pulsar featured event for Pulsar Summit Asia 2022 (#216) d80347c408e is described below commit d80347c408e04eba137d5df83b728b6c41b06396 Author: Sherlock Xu <65327072+sherlock...@users.noreply.github.com> AuthorDate: Tue Sep 27 01:54:11 2022 +0800 Update Pulsar featured event for Pulsar Summit Asia 2022 (#216) --- site2/website-next/src/pages/events.js | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/site2/website-next/src/pages/events.js b/site2/website-next/src/pages/events.js index b7458f1836d..3ad6bd55766 100644 --- a/site2/website-next/src/pages/events.js +++ b/site2/website-next/src/pages/events.js @@ -51,11 +51,11 @@ export default function Events() { https://pulsar-summit.org/event/san-francisco-2022"; - linkText="Save Your Spot" + link="https://sessionize.com/pulsar-summit-asia-2022/"; + linkText="Submit Your Session" />
[pulsar-site] branch asf-site-next updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site-next in repository https://gitbox.apache.org/repos/asf/pulsar-site.git The following commit(s) were added to refs/heads/asf-site-next by this push: new 49489d9fc44 Publish new charts to https://pulsar.apache.org/charts/ 49489d9fc44 is described below commit 49489d9fc446024dce05055dddb4b655c9bb127a Author: Apache Pulsar Team AuthorDate: Mon Jul 18 15:26:30 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 34 +- 1 file changed, 25 insertions(+), 9 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 692af0d804d..2478a943eb2 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -1,6 +1,22 @@ apiVersion: v1 entries: pulsar: + - apiVersion: v2 +appVersion: 2.9.3 +created: "2022-07-18T15:25:15.57016554Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: edb262adbb973dd46e6bd030eaf72eb6fe3d05b2477cd2a7a0efe4c94c3c47fb +home: https://pulsar.apache.org +icon: https://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.9.4/pulsar-2.9.4.tgz +version: 2.9.4 - apiVersion: v2 appVersion: 2.9.2 created: "2022-05-06T14:04:54.661939012Z" @@ -259,9 +275,9 @@ entries: version: 2.7.0 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:23:17.288984442Z" +created: "2021-02-09T09:00:19.485753008Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a +digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -307,9 +323,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-02-09T09:00:19.485753008Z" +created: "2021-01-30T17:23:17.288984442Z" description: Apache Pulsar Helm chart for Kubernetes -digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a +digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -451,9 +467,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-08-31T05:06:22.671294102Z" +created: "2020-08-21T14:50:51.874906537Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4a8343100a25942faef6e8db64169f19e3568be5d63e95b38c3f684843db2b3e +digest: f0ee3c0165fe9388a11dcc4b325083a1546c8a0fc9080e8ed94e9f43563d1ce7 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -467,9 +483,9 @@ entries: version: 2.6.1-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-08-21T14:50:51.874906537Z" +created: "2020-08-31T05:06:22.671294102Z" description: Apache Pulsar Helm chart for Kubernetes -digest: f0ee3c0165fe9388a11dcc4b325083a1546c8a0fc9080e8ed94e9f43563d1ce7 +digest: 4a8343100a25942faef6e8db64169f19e3568be5d63e95b38c3f684843db2b3e home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -545,4 +561,4 @@ entries: urls: - https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.6.0-1/pulsar-2.6.0-1.tgz version: 2.6.0-1 -generated: "2022-05-06T14:04:54.66226932Z" \ No newline at end of file +generated: "2022-07-18T15:25:15.570554327Z"
[pulsar-helm-chart] tag pulsar-2.9.4 created (now 465d172)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.9.4 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git at 465d172 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 98f6eea19db Publish new charts to https://pulsar.apache.org/charts/ 98f6eea19db is described below commit 98f6eea19db5ed571d576e0a7f6d9122b3cc9ec4 Author: Apache Pulsar Team AuthorDate: Fri May 6 14:05:21 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 42 +- 1 file changed, 29 insertions(+), 13 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 90bbccc5e49..6c049535f04 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -1,6 +1,22 @@ apiVersion: v1 entries: pulsar: + - apiVersion: v2 +appVersion: 2.9.2 +created: "2022-05-06T14:04:54.661939012Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 0b59a5e89792b1937192ee017843241e7659062d26fbf5b6a33dc065188c6af2 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.9.3/pulsar-2.9.3.tgz +version: 2.9.3 - apiVersion: v2 appVersion: 2.9.2 created: "2022-04-11T07:34:32.121046517Z" @@ -243,9 +259,9 @@ entries: version: 2.7.0 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:27:44.643156571Z" +created: "2021-01-30T17:23:17.288984442Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 +digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -259,9 +275,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-08T05:27:15.548211942Z" +created: "2021-01-30T17:27:44.643156571Z" description: Apache Pulsar Helm chart for Kubernetes -digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 +digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -275,9 +291,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-02-09T09:00:19.485753008Z" +created: "2021-01-08T05:27:15.548211942Z" description: Apache Pulsar Helm chart for Kubernetes -digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a +digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -291,9 +307,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:23:17.288984442Z" +created: "2021-02-09T09:00:19.485753008Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a +digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -435,9 +451,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-08-21T14:50:51.874906537Z" +created: "2020-08-31T05:06:22.671294102Z" description: Apache Pulsar Helm chart for Kubernetes -digest: f0ee3c0165fe9388a11dcc4b325083a1546c8a0fc9080e8ed94e9f43563d1ce7 +digest: 4a8343100a25942faef6e8db64169f19e3568be5d63e95b38c3f684843db2b3e home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -451,9 +467,9 @@ entries: version: 2.6.1-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-08-31T05:06:22.671294102Z" +created: "2020-08-21T14:50:51.874906537Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4a8343100a25942faef6e8db64169f19e3568be5d63e95b38c3f684843db2b3e +digest: f0ee3c0165fe9388a11dcc4b325083a1546c8a0fc9080e8ed94e9f43563d1ce7 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -529,4 +545,4 @@ entries: urls: - https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.6.0-1/pulsar-2.6.0-1.tgz version: 2.6.0-1 -generated: "2022-04-11T07:34:32.121433427Z" +generated: "2022-05-06T14:04:54.66226932Z"
[pulsar-helm-chart] tag pulsar-2.9.3 created (now bfb6985)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.9.3 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git at bfb6985 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new d7b6ecb8edb Publish new charts to https://pulsar.apache.org/charts/ d7b6ecb8edb is described below commit d7b6ecb8edb0886030352c0abcb9064b402e77d1 Author: Apache Pulsar Team AuthorDate: Mon Apr 11 07:34:53 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 26 +- 1 file changed, 21 insertions(+), 5 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index a9efadc2a82..90bbccc5e49 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -1,6 +1,22 @@ apiVersion: v1 entries: pulsar: + - apiVersion: v2 +appVersion: 2.9.2 +created: "2022-04-11T07:34:32.121046517Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 9b0a945be15a22d7160aaa9e0e8006d59521baeaddf220ed546124d0679a2f10 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.9.2/pulsar-2.9.2.tgz +version: 2.9.2 - apiVersion: v2 appVersion: 2.7.4 created: "2022-02-23T16:25:06.6737274Z" @@ -419,9 +435,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-08-31T05:06:22.671294102Z" +created: "2020-08-21T14:50:51.874906537Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4a8343100a25942faef6e8db64169f19e3568be5d63e95b38c3f684843db2b3e +digest: f0ee3c0165fe9388a11dcc4b325083a1546c8a0fc9080e8ed94e9f43563d1ce7 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -435,9 +451,9 @@ entries: version: 2.6.1-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-08-21T14:50:51.874906537Z" +created: "2020-08-31T05:06:22.671294102Z" description: Apache Pulsar Helm chart for Kubernetes -digest: f0ee3c0165fe9388a11dcc4b325083a1546c8a0fc9080e8ed94e9f43563d1ce7 +digest: 4a8343100a25942faef6e8db64169f19e3568be5d63e95b38c3f684843db2b3e home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -513,4 +529,4 @@ entries: urls: - https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.6.0-1/pulsar-2.6.0-1.tgz version: 2.6.0-1 -generated: "2022-02-23T16:25:06.674328607Z" +generated: "2022-04-11T07:34:32.121433427Z"
[pulsar-helm-chart] tag pulsar-2.9.2 created (now cee3fcf)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.9.2 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git at cee3fcf (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new da719c1 Publish new charts to https://pulsar.apache.org/charts/ da719c1 is described below commit da719c1ff4ecdf700e9edf65d71ed78f14a40db2 Author: Apache Pulsar Team AuthorDate: Wed Feb 23 16:25:34 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 58 ++- 1 file changed, 37 insertions(+), 21 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index e63548e..a9efadc 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v2 appVersion: 2.7.4 +created: "2022-02-23T16:25:06.6737274Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 362ccff6a8439f20ce4def2b0fa097706af0fdea9ccd5e2d14dfaa5f1d9e599f +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.13/pulsar-2.7.13.tgz +version: 2.7.13 + - apiVersion: v2 +appVersion: 2.7.4 created: "2022-02-17T05:48:38.719970649Z" description: Apache Pulsar Helm chart for Kubernetes digest: 7add302ee84d71a1a11433266f4904f6740f04bec1fad7fe067ba61bc5727fc5 @@ -243,9 +259,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:23:17.288984442Z" +created: "2021-02-09T09:00:19.485753008Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a +digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -259,9 +275,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-02-09T09:00:19.485753008Z" +created: "2021-01-30T17:23:17.288984442Z" description: Apache Pulsar Helm chart for Kubernetes -digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a +digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -307,9 +323,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-09-08T02:06:54.135556929Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -323,9 +339,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -339,9 +355,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-21T18:16:54.544838106Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -355,9 +371,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-13T02:52:12.413925671Z" +created: "2020-11-11T18:49:06.171526352Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 +digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -371,9 +387,9 @@ entries: version: 2.6.1-2 - apiVersi
[pulsar-helm-chart] tag pulsar-2.7.13 created (now 192b3ca)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.13 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 192b3ca (commit) No new revisions were added by this update.
[pulsar-helm-chart] branch master updated: Remove completed init jobs using ttl (#235)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new 192b3ca Remove completed init jobs using ttl (#235) 192b3ca is described below commit 192b3ca2ef80c1e78acd98f64a7f5fa64136ccf8 Author: Chirag Modi <92379152+cmodi-cog...@users.noreply.github.com> AuthorDate: Wed Feb 23 21:54:37 2022 +0530 Remove completed init jobs using ttl (#235) * feat: added ttlSecondsAfterFinished configuration to delete completed jobs * added comments for clarification --- charts/pulsar/Chart.yaml | 2 +- charts/pulsar/templates/bookkeeper-cluster-initialize.yaml | 5 + charts/pulsar/templates/pulsar-cluster-initialize.yaml | 5 + charts/pulsar/values.yaml | 8 4 files changed, 19 insertions(+), 1 deletion(-) diff --git a/charts/pulsar/Chart.yaml b/charts/pulsar/Chart.yaml index c34fa4f..35bfed4 100644 --- a/charts/pulsar/Chart.yaml +++ b/charts/pulsar/Chart.yaml @@ -21,7 +21,7 @@ apiVersion: v2 appVersion: "2.7.4" description: Apache Pulsar Helm chart for Kubernetes name: pulsar -version: 2.7.12 +version: 2.7.13 home: https://pulsar.apache.org sources: - https://github.com/apache/pulsar diff --git a/charts/pulsar/templates/bookkeeper-cluster-initialize.yaml b/charts/pulsar/templates/bookkeeper-cluster-initialize.yaml index 9f9f33a..cbdb52f 100644 --- a/charts/pulsar/templates/bookkeeper-cluster-initialize.yaml +++ b/charts/pulsar/templates/bookkeeper-cluster-initialize.yaml @@ -27,6 +27,11 @@ metadata: {{- include "pulsar.standardLabels" . | nindent 4 }} component: "{{ .Values.bookkeeper.component }}-init" spec: +# This feature was previously behind a feature gate for several Kubernetes versions and will default to true in 1.23 and beyond +# https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/ +{{- if .Values.job.ttl.enabled }} + ttlSecondsAfterFinished: {{ .Values.job.ttl.secondsAfterFinished }} +{{- end }} template: spec: {{- if and .Values.rbac.enabled .Values.rbac.psp }} diff --git a/charts/pulsar/templates/pulsar-cluster-initialize.yaml b/charts/pulsar/templates/pulsar-cluster-initialize.yaml index 8f0c0a0..0b9b77a 100644 --- a/charts/pulsar/templates/pulsar-cluster-initialize.yaml +++ b/charts/pulsar/templates/pulsar-cluster-initialize.yaml @@ -28,6 +28,11 @@ metadata: {{- include "pulsar.standardLabels" . | nindent 4 }} component: {{ .Values.pulsar_metadata.component }} spec: +# This feature was previously behind a feature gate for several Kubernetes versions and will default to true in 1.23 and beyond +# https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/ +{{- if .Values.job.ttl.enabled }} + ttlSecondsAfterFinished: {{ .Values.job.ttl.secondsAfterFinished }} +{{- end }} template: spec: initContainers: diff --git a/charts/pulsar/values.yaml b/charts/pulsar/values.yaml index d862152..180f79b 100644 --- a/charts/pulsar/values.yaml +++ b/charts/pulsar/values.yaml @@ -1139,3 +1139,11 @@ pulsar_manager: admin: user: pulsar password: pulsar + +# These are jobs where job ttl configuration is used +# pulsar-helm-chart/charts/pulsar/templates/pulsar-cluster-initialize.yaml +# pulsar-helm-chart/charts/pulsar/templates/bookkeeper-cluster-initialize.yaml +job: + ttl: +enabled: false +secondsAfterFinished: 3600 \ No newline at end of file
[pulsar-helm-chart] branch master updated: [Build] Revert chart index publishing to new website (#234)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new 3918ee3 [Build] Revert chart index publishing to new website (#234) 3918ee3 is described below commit 3918ee36f017787da4624164b629060f5f9df116 Author: Lari Hotari AuthorDate: Thu Feb 17 22:56:34 2022 +0200 [Build] Revert chart index publishing to new website (#234) - publish to the old website location, apache/pulsar , branch asf-site --- .ci/release.sh | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/.ci/release.sh b/.ci/release.sh index e9b3358..18b524a 100755 --- a/.ci/release.sh +++ b/.ci/release.sh @@ -27,8 +27,8 @@ CHARTS_REPO=${CHARTS_REPO:-"https://pulsar.apache.org/charts/"} OWNER=${OWNER:-apache} REPO=${REPO:-pulsar-helm-chart} PUBLISH_CHARTS=${PUBLISH_CHARTS:-"false"} -PULSAR_SITE_REPO_SLUG=${PULSAR_SITE_REPO_SLUG:-"apache/pulsar-site"} -PULSAR_SITE_BRANCH=${PULSAR_SITE_BRANCH:-"asf-site-next"} +PULSAR_SITE_REPO_SLUG=${PULSAR_SITE_REPO_SLUG:-"apache/pulsar"} +PULSAR_SITE_BRANCH=${PULSAR_SITE_BRANCH:-"asf-site"} # hack/common.sh need this variable to be set PULSAR_CHART_HOME=${CHARTS_HOME}
[pulsar] branch asf-site updated: Update .asf.yaml to try to trigger deployment (#14358)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 958461c Update .asf.yaml to try to trigger deployment (#14358) 958461c is described below commit 958461c6ebc8af031778198015c64a85eed9bec4 Author: Dave Fisher AuthorDate: Thu Feb 17 12:55:15 2022 -0800 Update .asf.yaml to try to trigger deployment (#14358) --- .asf.yaml | 1 + 1 file changed, 1 insertion(+) diff --git a/.asf.yaml b/.asf.yaml index 0735550..170e1e3 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -1,2 +1,3 @@ publish: whoami: asf-site +
[pulsar-site] branch unpublish_from_this_branch created (now 151b233)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch unpublish_from_this_branch in repository https://gitbox.apache.org/repos/asf/pulsar-site.git. at 151b233 Revert "[PIP-87] Update .asf.yaml to publish the pulsar website from this branch" This branch includes the following new commits: new 151b233 Revert "[PIP-87] Update .asf.yaml to publish the pulsar website from this branch" The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[pulsar-site] 01/01: Revert "[PIP-87] Update .asf.yaml to publish the pulsar website from this branch"
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch unpublish_from_this_branch in repository https://gitbox.apache.org/repos/asf/pulsar-site.git commit 151b23304af382a31f9518405338f04c787817a6 Author: Sijie Guo AuthorDate: Thu Feb 17 11:34:08 2022 -0800 Revert "[PIP-87] Update .asf.yaml to publish the pulsar website from this branch" This reverts commit fbeb3f81a11b5b469c430877f8698ee7e3ea21fe. --- .asf.yaml | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/.asf.yaml b/.asf.yaml index 90fdd32..b8fc195 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -1,2 +1,3 @@ -publish: - whoami: asf-site-next +staging: + profile: next + whoami: asf-site-next \ No newline at end of file
[pulsar-site] branch asf-site-next updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site-next in repository https://gitbox.apache.org/repos/asf/pulsar-site.git The following commit(s) were added to refs/heads/asf-site-next by this push: new f8828ae Publish new charts to https://pulsar.apache.org/charts/ f8828ae is described below commit f8828aed378d4e39c98355621a83d40379c11c25 Author: Apache Pulsar Team AuthorDate: Thu Feb 17 05:48:46 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 20 1 file changed, 20 insertions(+) diff --git a/content/charts/index.yaml b/content/charts/index.yaml new file mode 100644 index 000..06f5878 --- /dev/null +++ b/content/charts/index.yaml @@ -0,0 +1,20 @@ +apiVersion: v1 +entries: + pulsar: + - apiVersion: v2 +appVersion: 2.7.4 +created: "2022-02-17T05:48:38.719970649Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 7add302ee84d71a1a11433266f4904f6740f04bec1fad7fe067ba61bc5727fc5 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.12/pulsar-2.7.12.tgz +version: 2.7.12 +generated: "2022-02-17T05:48:38.719985349Z"
[pulsar-helm-chart] tag pulsar-2.7.12 created (now 1c4f745)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.12 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 1c4f745 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 6554bbf Publish new charts to https://pulsar.apache.org/charts/ 6554bbf is described below commit 6554bbfbfc1003d406c13d83a06655a083eb5137 Author: Apache Pulsar Team AuthorDate: Fri Feb 4 08:44:20 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 50 +++ 1 file changed, 33 insertions(+), 17 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 327557ad..a269129 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v2 appVersion: 2.7.4 +created: "2022-02-04T08:41:30.466780686Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: fb2e3c9b0758b191085c77474eeec1cd3792977e9fc6e478feeb7fff759311ad +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.11/pulsar-2.7.11.tgz +version: 2.7.11 + - apiVersion: v2 +appVersion: 2.7.4 created: "2022-01-18T06:48:19.696430799Z" description: Apache Pulsar Helm chart for Kubernetes digest: 9389ab5a1cb2f66cc80bd269480ac70404ef96f36d236ededac9a142cce4a542 @@ -275,9 +291,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-10-15T10:42:47.984904328Z" +created: "2020-09-22T14:48:12.627243579Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf +digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -291,9 +307,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-09-08T02:06:54.135556929Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -307,9 +323,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -323,9 +339,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-21T18:16:54.544838106Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -339,9 +355,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-13T02:52:12.413925671Z" +created: "2020-11-11T18:49:06.171526352Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 +digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -355,9 +371,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-11T18:49:06.171526352Z" +created: "2020-10-15T10:42:47.984904328Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc +digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -371,9 +387,9 @@ entries: version: 2.6.1-2 - apiVersi
[pulsar-helm-chart] tag pulsar-2.7.11 created (now 9613ee0)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.11 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 9613ee0 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 3886f18 Publish new charts to https://pulsar.apache.org/charts/ 3886f18 is described below commit 3886f1810d19642b18383674eaf7d9fbfd1b4225 Author: Apache Pulsar Team AuthorDate: Tue Jan 18 06:51:47 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 50 +++ 1 file changed, 33 insertions(+), 17 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 44413db..327557a 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v2 appVersion: 2.7.4 +created: "2022-01-18T06:48:19.696430799Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 9389ab5a1cb2f66cc80bd269480ac70404ef96f36d236ededac9a142cce4a542 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.10/pulsar-2.7.10.tgz +version: 2.7.10 + - apiVersion: v2 +appVersion: 2.7.4 created: "2022-01-12T10:46:29.013511563Z" description: Apache Pulsar Helm chart for Kubernetes digest: 9f70f6352fb0cdb2568b6f48b8583cb0898d8d0a1f11911297e1aea6fec02b03 @@ -259,9 +275,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-11T18:49:06.171526352Z" +created: "2020-10-15T10:42:47.984904328Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc +digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -275,9 +291,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-10-15T10:42:47.984904328Z" +created: "2020-09-22T14:48:12.627243579Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf +digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -291,9 +307,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-09-08T02:06:54.135556929Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -307,9 +323,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -323,9 +339,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-21T18:16:54.544838106Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -339,9 +355,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-13T02:52:12.413925671Z" +created: "2020-11-11T18:49:06.171526352Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 +digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -355,9 +371,9 @@ entries: version: 2.6.1-2 - apiVersi
[pulsar-helm-chart] tag pulsar-2.7.10 created (now adbc6b7)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.10 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at adbc6b7 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new ccc04ce Publish new charts to https://pulsar.apache.org/charts/ ccc04ce is described below commit ccc04ce4d73d55d94fbb3613d89c99c959c40286 Author: Apache Pulsar Team AuthorDate: Wed Jan 12 10:49:37 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 50 +++ 1 file changed, 33 insertions(+), 17 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index fe50c22..44413db 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -1,6 +1,22 @@ apiVersion: v1 entries: pulsar: + - apiVersion: v2 +appVersion: 2.7.4 +created: "2022-01-12T10:46:29.013511563Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 9f70f6352fb0cdb2568b6f48b8583cb0898d8d0a1f11911297e1aea6fec02b03 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.9/pulsar-2.7.9.tgz +version: 2.7.9 - apiVersion: v1 appVersion: 2.7.4 created: "2022-01-05T14:24:46.841795074Z" @@ -243,9 +259,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-13T02:52:12.413925671Z" +created: "2020-11-11T18:49:06.171526352Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 +digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -259,9 +275,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-11T18:49:06.171526352Z" +created: "2020-10-15T10:42:47.984904328Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc +digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -275,9 +291,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-10-15T10:42:47.984904328Z" +created: "2020-09-22T14:48:12.627243579Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf +digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -291,9 +307,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-09-08T02:06:54.135556929Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -307,9 +323,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -323,9 +339,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-21T18:16:54.544838106Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -339,9 +355,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-08-31T05:06:22.671294102Z" +created: "2020-08-21T1
[pulsar-helm-chart] tag pulsar-2.7.9 created (now 7219a37)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.9 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 7219a37 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new db04e9a Publish new charts to https://pulsar.apache.org/charts/ db04e9a is described below commit db04e9a7db96469bee5ba1db4871386eba3a0b05 Author: Apache Pulsar Team AuthorDate: Wed Jan 5 14:27:38 2022 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 48 +++ 1 file changed, 32 insertions(+), 16 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index bb2f816..fe50c22 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v1 appVersion: 2.7.4 +created: "2022-01-05T14:24:46.841795074Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: edb0667cedf82186b5296b545b7191e94af402eb70f43ecd182de5542c3002ef +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.8/pulsar-2.7.8.tgz +version: 2.7.8 + - apiVersion: v1 +appVersion: 2.7.4 created: "2021-12-30T06:56:15.207823667Z" description: Apache Pulsar Helm chart for Kubernetes digest: 7d30e22661a0be8c5c58052ff1c3248e4fa0b1bd71474954afec7e5d40cc6983 @@ -227,9 +243,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-21T18:16:54.544838106Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -243,9 +259,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-13T02:52:12.413925671Z" +created: "2020-11-11T18:49:06.171526352Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 +digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -259,9 +275,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-11T18:49:06.171526352Z" +created: "2020-10-15T10:42:47.984904328Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc +digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -275,9 +291,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-10-15T10:42:47.984904328Z" +created: "2020-09-22T14:48:12.627243579Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf +digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -291,9 +307,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-09-08T02:06:54.135556929Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -307,9 +323,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -323,9 +339,9 @@ entries: version: 2.6.1-2 - apiVersion: v1
[pulsar-helm-chart] tag pulsar-2.7.8 created (now a919f30)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.8 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at a919f30 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 6ff5ccc Publish new charts to https://pulsar.apache.org/charts/ 6ff5ccc is described below commit 6ff5ccc867c953e10d648cb5340f03082cb2b5e4 Author: Apache Pulsar Team AuthorDate: Thu Dec 30 06:59:29 2021 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 64 +-- 1 file changed, 40 insertions(+), 24 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 38342f6..bb2f816 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -2,6 +2,22 @@ apiVersion: v1 entries: pulsar: - apiVersion: v1 +appVersion: 2.7.4 +created: "2021-12-30T06:56:15.207823667Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 7d30e22661a0be8c5c58052ff1c3248e4fa0b1bd71474954afec7e5d40cc6983 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.7/pulsar-2.7.7.tgz +version: 2.7.7 + - apiVersion: v1 appVersion: 2.7.2 created: "2021-12-10T16:30:28.102561549Z" description: Apache Pulsar Helm chart for Kubernetes @@ -115,9 +131,9 @@ entries: version: 2.7.0 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-02-09T09:00:19.485753008Z" +created: "2021-01-30T17:27:44.643156571Z" description: Apache Pulsar Helm chart for Kubernetes -digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a +digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -131,9 +147,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:27:44.643156571Z" +created: "2021-01-08T05:27:15.548211942Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 +digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -147,9 +163,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-08T05:27:15.548211942Z" +created: "2021-01-30T17:23:17.288984442Z" description: Apache Pulsar Helm chart for Kubernetes -digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 +digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -163,9 +179,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:23:17.288984442Z" +created: "2021-02-09T09:00:19.485753008Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a +digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -211,9 +227,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -227,9 +243,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -243,9 +259,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "202
[pulsar-helm-chart] tag pulsar-2.7.7 created (now 0f6dea8)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.7 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 0f6dea8 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 41e3872 Publish new charts to https://pulsar.apache.org/charts/ 41e3872 is described below commit 41e3872c8374899b86a549cdbd5445b91f627aec Author: Apache Pulsar Team AuthorDate: Fri Dec 10 16:33:15 2021 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 56 ++- 1 file changed, 36 insertions(+), 20 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 8bf450c..38342f6 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v1 appVersion: 2.7.2 +created: "2021-12-10T16:30:28.102561549Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: cb23d75cd65071e07ef96b9f7eb2cec18ccfb055d7a0365ab4d7bd5d4aee6c2a +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.6/pulsar-2.7.6.tgz +version: 2.7.6 + - apiVersion: v1 +appVersion: 2.7.2 created: "2021-11-12T15:56:55.960637651Z" description: Apache Pulsar Helm chart for Kubernetes digest: aa0531316c37601c69f0f13b2fc749f9ce361722fce9b3ef75d0e329ca1e7c05 @@ -99,9 +115,9 @@ entries: version: 2.7.0 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:23:17.288984442Z" +created: "2021-02-09T09:00:19.485753008Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a +digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -115,9 +131,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-02-09T09:00:19.485753008Z" +created: "2021-01-30T17:27:44.643156571Z" description: Apache Pulsar Helm chart for Kubernetes -digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a +digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -131,9 +147,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:27:44.643156571Z" +created: "2021-01-08T05:27:15.548211942Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 +digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -147,9 +163,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-08T05:27:15.548211942Z" +created: "2021-01-30T17:23:17.288984442Z" description: Apache Pulsar Helm chart for Kubernetes -digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 +digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -211,9 +227,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-10-15T10:42:47.984904328Z" +created: "2020-09-22T14:48:12.627243579Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf +digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -227,9 +243,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -243,9 +259,9 @@ entries: version: 2.6.1-2 - apiVersion: v1
[pulsar-helm-chart] tag pulsar-2.7.6 created (now b4b2fa7)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.6 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at b4b2fa7 (commit) No new revisions were added by this update.
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new bfcf4c8 Publish new charts to https://pulsar.apache.org/charts/ bfcf4c8 is described below commit bfcf4c873c3e8ed23bf0ef00043c6e643f1af452 Author: Apache Pulsar Team AuthorDate: Fri Nov 12 16:00:11 2021 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 60 ++- 1 file changed, 38 insertions(+), 22 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 5fa2c5a..8bf450c 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v1 appVersion: 2.7.2 +created: "2021-11-12T15:56:55.960637651Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: aa0531316c37601c69f0f13b2fc749f9ce361722fce9b3ef75d0e329ca1e7c05 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.5/pulsar-2.7.5.tgz +version: 2.7.5 + - apiVersion: v1 +appVersion: 2.7.2 created: "2021-11-09T17:18:50.085604886Z" description: Apache Pulsar Helm chart for Kubernetes digest: 5f743a808c617103ea51466d19b101059c4a07ba33760f535aac5cf4f9c2a34b @@ -83,9 +99,9 @@ entries: version: 2.7.0 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-08T05:27:15.548211942Z" +created: "2021-01-30T17:23:17.288984442Z" description: Apache Pulsar Helm chart for Kubernetes -digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 +digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -99,9 +115,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:23:17.288984442Z" +created: "2021-02-09T09:00:19.485753008Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a +digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -115,9 +131,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-02-09T09:00:19.485753008Z" +created: "2021-01-30T17:27:44.643156571Z" description: Apache Pulsar Helm chart for Kubernetes -digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a +digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -131,9 +147,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:27:44.643156571Z" +created: "2021-01-08T05:27:15.548211942Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 +digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -195,9 +211,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-21T18:16:54.544838106Z" +created: "2020-10-15T10:42:47.984904328Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe +digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -211,9 +227,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-11T18:49:06.171526352Z" +created: "2020-09-22T14:48:12.627243579Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc +digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -227,9 +243,9 @@ entries: version: 2.6.1-2 - apiVersion: v1
[pulsar-helm-chart] tag pulsar-2.7.5 created (now 1956a87)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.5 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 1956a87 (commit) No new revisions were added by this update.
[pulsar-helm-chart] branch master updated: Fixes #173 Support both Role Binding and Cluster Role Binding dependi… (#174)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new 1956a87 Fixes #173 Support both Role Binding and Cluster Role Binding dependi… (#174) 1956a87 is described below commit 1956a870ff7bf1c50bcc60f03ae72322e1d8ea70 Author: Frank Kelly <62910985+frankjke...@users.noreply.github.com> AuthorDate: Fri Nov 12 10:56:35 2021 -0500 Fixes #173 Support both Role Binding and Cluster Role Binding dependi… (#174) * Fixes #173 Support both Role Binding and Cluster Role Binding depending on rbac.limit_to_namespace * Rev version * Get Role/Cluster the right way around --- charts/pulsar/Chart.yaml| 2 +- .../pulsar/templates/broker-cluster-role-binding.yaml | 17 +++-- 2 files changed, 16 insertions(+), 3 deletions(-) diff --git a/charts/pulsar/Chart.yaml b/charts/pulsar/Chart.yaml index 4265d63..e628ddd 100644 --- a/charts/pulsar/Chart.yaml +++ b/charts/pulsar/Chart.yaml @@ -21,7 +21,7 @@ apiVersion: v1 appVersion: "2.7.2" description: Apache Pulsar Helm chart for Kubernetes name: pulsar -version: 2.7.4 +version: 2.7.5 home: https://pulsar.apache.org sources: - https://github.com/apache/pulsar diff --git a/charts/pulsar/templates/broker-cluster-role-binding.yaml b/charts/pulsar/templates/broker-cluster-role-binding.yaml index d76f9c1..706e1ba 100644 --- a/charts/pulsar/templates/broker-cluster-role-binding.yaml +++ b/charts/pulsar/templates/broker-cluster-role-binding.yaml @@ -22,17 +22,24 @@ apiVersion: rbac.authorization.k8s.io/v1 {{- if .Values.rbac.limit_to_namespace }} kind: RoleBinding +metadata: + name: "{{ template "pulsar.fullname" . }}-{{ .Values.broker.component }}-rolebinding" {{- else}} kind: ClusterRoleBinding -{{- end}} metadata: name: "{{ template "pulsar.fullname" . }}-{{ .Values.broker.component }}-clusterrolebinding" +{{- end}} labels: {{- include "pulsar.standardLabels" . | nindent 4 }} roleRef: apiGroup: rbac.authorization.k8s.io +{{- if .Values.rbac.limit_to_namespace }} + kind: Role + name: "{{ template "pulsar.fullname" . }}-{{ .Values.broker.component }}-role" +{{- else}} kind: ClusterRole name: "{{ template "pulsar.fullname" . }}-{{ .Values.broker.component }}-clusterrole" +{{- end}} subjects: - kind: ServiceAccount name: "{{ template "pulsar.fullname" . }}-{{ .Values.broker.component }}-acct" @@ -40,9 +47,15 @@ subjects: --- apiVersion: rbac.authorization.k8s.io/v1 +{{- if .Values.rbac.limit_to_namespace }} +kind: Role +metadata: + name: "{{ template "pulsar.fullname" . }}-{{ .Values.broker.component }}-role" +{{- else}} kind: ClusterRole metadata: name: "{{ template "pulsar.fullname" . }}-{{ .Values.broker.component }}-clusterrole" +{{- end}} labels: {{- include "pulsar.standardLabels" . | nindent 4 }} rules: @@ -67,4 +80,4 @@ rules: - patch --- -{{- end }} \ No newline at end of file +{{- end }}
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new c599bf5 Publish new charts to https://pulsar.apache.org/charts/ c599bf5 is described below commit c599bf552c3ab215772af1753974beeb8fecbf7f Author: Apache Pulsar Team AuthorDate: Tue Nov 9 17:22:03 2021 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 64 +-- 1 file changed, 40 insertions(+), 24 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 04cf2bf..5fa2c5a 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v1 appVersion: 2.7.2 +created: "2021-11-09T17:18:50.085604886Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 5f743a808c617103ea51466d19b101059c4a07ba33760f535aac5cf4f9c2a34b +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.4/pulsar-2.7.4.tgz +version: 2.7.4 + - apiVersion: v1 +appVersion: 2.7.2 created: "2021-09-10T00:56:39.780324095Z" description: Apache Pulsar Helm chart for Kubernetes digest: 52db0bb156d7bf7e89b0a2cd9db7bfa24cb0f33a7bcbe8270d694c0c02dcb476 @@ -67,9 +83,9 @@ entries: version: 2.7.0 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:27:44.643156571Z" +created: "2021-01-08T05:27:15.548211942Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 +digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -83,9 +99,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-08T05:27:15.548211942Z" +created: "2021-01-30T17:23:17.288984442Z" description: Apache Pulsar Helm chart for Kubernetes -digest: bdbb841e75b5ed1fc9e65986def399690270c00c9282e0d616ddfa66faf2c558 +digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -99,9 +115,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-01-30T17:23:17.288984442Z" +created: "2021-02-09T09:00:19.485753008Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 7af51e0b53569fa2fd6a461ff41dcc60df23283195c9e4b7e7dbbf686ff2cb2a +digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -115,9 +131,9 @@ entries: version: 2.7.0-1 - apiVersion: v1 appVersion: 2.7.0 -created: "2021-02-09T09:00:19.485753008Z" +created: "2021-01-30T17:27:44.643156571Z" description: Apache Pulsar Helm chart for Kubernetes -digest: addaf76c03092b9ce8b427702a7131023713b177149cf220ba53e00dcd80d90a +digest: 94d7b360544ffe9a85c8d595cad1d56daeb9aa98873c98242c5e8ace99468c91 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -163,9 +179,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-10-15T10:42:47.984904328Z" +created: "2020-09-08T02:06:54.135556929Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf +digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -179,9 +195,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -195,9 +211,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 app
[pulsar-helm-chart] tag pulsar-2.7.4 created (now 6173081)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.4 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 6173081 (commit) No new revisions were added by this update.
[pulsar-helm-chart] branch master updated: Missing fix for #152. Bookie Service also needs the prefix on the port name (#172)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new 6173081 Missing fix for #152. Bookie Service also needs the prefix on the port name (#172) 6173081 is described below commit 617308147db8dcbcbb72201792756c862790b97e Author: Frank Kelly <62910985+frankjke...@users.noreply.github.com> AuthorDate: Tue Nov 9 12:18:26 2021 -0500 Missing fix for #152. Bookie Service also needs the prefix on the port name (#172) Fixes #158 (This is the second PR - see also https://github.com/apache/pulsar-helm-chart/pull/162) ### Motivation * All non-standard port-names need a proper protocol prefix to support Istio https://istio.io/latest/docs/ops/configuration/traffic-management/protocol-selection/#explicit-protocol-selection ### Modifications Add the prefix value before `bookie` --- charts/pulsar/Chart.yaml| 2 +- charts/pulsar/templates/bookkeeper-service.yaml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/charts/pulsar/Chart.yaml b/charts/pulsar/Chart.yaml index f8bb972..4265d63 100644 --- a/charts/pulsar/Chart.yaml +++ b/charts/pulsar/Chart.yaml @@ -21,7 +21,7 @@ apiVersion: v1 appVersion: "2.7.2" description: Apache Pulsar Helm chart for Kubernetes name: pulsar -version: 2.7.3 +version: 2.7.4 home: https://pulsar.apache.org sources: - https://github.com/apache/pulsar diff --git a/charts/pulsar/templates/bookkeeper-service.yaml b/charts/pulsar/templates/bookkeeper-service.yaml index 3bf9495..c434a4b 100644 --- a/charts/pulsar/templates/bookkeeper-service.yaml +++ b/charts/pulsar/templates/bookkeeper-service.yaml @@ -32,7 +32,7 @@ metadata: {{- end }} spec: ports: - - name: bookie + - name: "{{ .Values.tcpPrefix }}bookie" port: {{ .Values.bookkeeper.ports.bookie }} - name: http port: {{ .Values.bookkeeper.ports.http }}
[pulsar] branch master updated: Fixed NPE in ProxyConnection with no auth data (#12111)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new ea562f8f Fixed NPE in ProxyConnection with no auth data (#12111) ea562f8f is described below commit ea562f8f13fe887a1d0957ca066738aacf8d1265 Author: Matteo Merli AuthorDate: Mon Sep 20 22:04:44 2021 -0700 Fixed NPE in ProxyConnection with no auth data (#12111) ### Motivation In #12057 there was a fix for missing authdata, but `AuthData.of()` is expecting a valid `byte[]` instance, empty if there are no credentials. --- .../src/main/java/org/apache/pulsar/proxy/server/ProxyConnection.java | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/pulsar-proxy/src/main/java/org/apache/pulsar/proxy/server/ProxyConnection.java b/pulsar-proxy/src/main/java/org/apache/pulsar/proxy/server/ProxyConnection.java index 28c6083..dd814cf 100644 --- a/pulsar-proxy/src/main/java/org/apache/pulsar/proxy/server/ProxyConnection.java +++ b/pulsar-proxy/src/main/java/org/apache/pulsar/proxy/server/ProxyConnection.java @@ -92,6 +92,8 @@ public class ProxyConnection extends PulsarHandler implements FutureListener
[pulsar] branch master updated: Fix wrong key-hash selector used for new consumers after all the previous consumers disconnected (#12035)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 3a4755f Fix wrong key-hash selector used for new consumers after all the previous consumers disconnected (#12035) 3a4755f is described below commit 3a4755f50ef46c3d94ce9629478941d5224cb800 Author: lipenghui AuthorDate: Fri Sep 17 14:35:02 2021 +0800 Fix wrong key-hash selector used for new consumers after all the previous consumers disconnected (#12035) We will encounter the issue after all the previous consumers disconnected and the new consumers connect to the topic with different key_shared policy. The root cause is we are using the previous dispatcher after the key_shared policy changed, so the fix is to use a new dispatcher after a new consumer with a different key-shared policy --- ...istentStickyKeyDispatcherMultipleConsumers.java | 43 + .../nonpersistent/NonPersistentSubscription.java | 35 +++ ...istentStickyKeyDispatcherMultipleConsumers.java | 10 ++- .../service/persistent/PersistentSubscription.java | 8 ++- .../client/api/KeySharedSubscriptionTest.java | 71 ++ 5 files changed, 136 insertions(+), 31 deletions(-) diff --git a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/nonpersistent/NonPersistentStickyKeyDispatcherMultipleConsumers.java b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/nonpersistent/NonPersistentStickyKeyDispatcherMultipleConsumers.java index 704fd93..878bac8 100644 --- a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/nonpersistent/NonPersistentStickyKeyDispatcherMultipleConsumers.java +++ b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/nonpersistent/NonPersistentStickyKeyDispatcherMultipleConsumers.java @@ -18,28 +18,67 @@ */ package org.apache.pulsar.broker.service.nonpersistent; +import com.google.common.annotations.VisibleForTesting; import io.netty.util.concurrent.FastThreadLocal; import java.util.ArrayList; import java.util.HashMap; import java.util.List; import java.util.Map; import org.apache.bookkeeper.mledger.Entry; +import org.apache.pulsar.broker.ServiceConfiguration; import org.apache.pulsar.broker.service.BrokerServiceException; +import org.apache.pulsar.broker.service.ConsistentHashingStickyKeyConsumerSelector; import org.apache.pulsar.broker.service.Consumer; import org.apache.pulsar.broker.service.EntryBatchSizes; +import org.apache.pulsar.broker.service.HashRangeAutoSplitStickyKeyConsumerSelector; +import org.apache.pulsar.broker.service.HashRangeExclusiveStickyKeyConsumerSelector; import org.apache.pulsar.broker.service.SendMessageInfo; import org.apache.pulsar.broker.service.StickyKeyConsumerSelector; import org.apache.pulsar.broker.service.Subscription; import org.apache.pulsar.common.api.proto.CommandSubscribe.SubType; +import org.apache.pulsar.common.api.proto.KeySharedMeta; +import org.apache.pulsar.common.api.proto.KeySharedMode; import org.apache.pulsar.common.protocol.Commands; public class NonPersistentStickyKeyDispatcherMultipleConsumers extends NonPersistentDispatcherMultipleConsumers { private final StickyKeyConsumerSelector selector; +private final KeySharedMode keySharedMode; public NonPersistentStickyKeyDispatcherMultipleConsumers(NonPersistentTopic topic, Subscription subscription, + KeySharedMeta ksm) { +super(topic, subscription); +this.keySharedMode = ksm.getKeySharedMode(); +switch (this.keySharedMode) { +case STICKY: +this.selector = new HashRangeExclusiveStickyKeyConsumerSelector(); +break; + +case AUTO_SPLIT: +default: +ServiceConfiguration conf = topic.getBrokerService().getPulsar().getConfiguration(); +if (conf.isSubscriptionKeySharedUseConsistentHashing()) { +this.selector = new ConsistentHashingStickyKeyConsumerSelector( + conf.getSubscriptionKeySharedConsistentHashingReplicaPoints()); +} else { +this.selector = new HashRangeAutoSplitStickyKeyConsumerSelector(); +} +break; +} +} + +@VisibleForTesting +NonPersistentStickyKeyDispatcherMultipleConsumers(NonPersistentTopic topic, Subscription subscription, StickyKeyConsumerSelector selector) { super(topic, subscription); +if (selector instanceof HashRangeExclusiveStickyKeyConsumerSelector) { +keySharedMode = KeySharedMode.STICKY; +} else if (selector instanceof ConsistentHashingStickyKeyConsumerSelector
[pulsar] branch asf-site updated: Publish new charts to https://pulsar.apache.org/charts/
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 82bf2c7 Publish new charts to https://pulsar.apache.org/charts/ 82bf2c7 is described below commit 82bf2c75860a5a5d35000667e34c905ff498db6a Author: Apache Pulsar Team AuthorDate: Fri Sep 10 00:59:22 2021 + Publish new charts to https://pulsar.apache.org/charts/ Signed-off-by: Apache Pulsar Team --- content/charts/index.yaml | 48 +++ 1 file changed, 32 insertions(+), 16 deletions(-) diff --git a/content/charts/index.yaml b/content/charts/index.yaml index 4fd4a8b..04cf2bf 100644 --- a/content/charts/index.yaml +++ b/content/charts/index.yaml @@ -3,6 +3,22 @@ entries: pulsar: - apiVersion: v1 appVersion: 2.7.2 +created: "2021-09-10T00:56:39.780324095Z" +description: Apache Pulsar Helm chart for Kubernetes +digest: 52db0bb156d7bf7e89b0a2cd9db7bfa24cb0f33a7bcbe8270d694c0c02dcb476 +home: https://pulsar.apache.org +icon: http://pulsar.apache.org/img/pulsar.svg +maintainers: +- email: d...@pulsar.apache.org + name: The Apache Pulsar Team +name: pulsar +sources: +- https://github.com/apache/pulsar +urls: +- https://github.com/apache/pulsar-helm-chart/releases/download/pulsar-2.7.3/pulsar-2.7.3.tgz +version: 2.7.3 + - apiVersion: v1 +appVersion: 2.7.2 created: "2021-06-03T08:32:20.657488129Z" description: Apache Pulsar Helm chart for Kubernetes digest: 4b9ef762aa5183bf80b500b5c9110e2fd1441d5512c97131ae78a698324daab4 @@ -147,9 +163,9 @@ entries: version: 2.6.2-1 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-13T02:52:12.413925671Z" +created: "2020-10-15T10:42:47.984904328Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 +digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -163,9 +179,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-10-15T10:42:47.984904328Z" +created: "2020-09-08T02:06:54.135556929Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4b67c2a1dae05e6f164a6ceff923b59927f84ea301cddeaf086a7728f1729eaf +digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -179,9 +195,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-21T18:16:54.544838106Z" +created: "2020-11-13T02:52:12.413925671Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe +digest: 4aa2770403855380fadb8310653731bd459c98e9124064ac03029597a8305b34 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -195,9 +211,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-22T14:48:12.627243579Z" +created: "2020-11-11T18:49:06.171526352Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 +digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -211,9 +227,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-11-11T18:49:06.171526352Z" +created: "2020-09-22T14:48:12.627243579Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 64de61b6c6192c9247401a947bf0f8f79b819798cc5a8556ff0eb30ea61d70fc +digest: 2df7d813ce3a180766a3339d0057aaa51f791f3fe3729277dd0cfe94da351608 home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -227,9 +243,9 @@ entries: version: 2.6.1-2 - apiVersion: v1 appVersion: 2.6.1 -created: "2020-09-08T02:06:54.135556929Z" +created: "2020-09-21T18:16:54.544838106Z" description: Apache Pulsar Helm chart for Kubernetes -digest: 3fe9f49a6c715ef36fad4c5d8ad2786e78f0cf693ac5db319171641b693248ed +digest: 4122ed592729aa33a0cd816223c648d9f36263f5a8f15037cad381d6bcbe7efe home: https://pulsar.apache.org icon: http://pulsar.apache.org/img/pulsar.svg maintainers: @@ -243,9 +259,9 @@ entries: version: 2.6.1-2 - apiVersi
[pulsar-helm-chart] tag pulsar-2.7.3 created (now 5b10f48)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to tag pulsar-2.7.3 in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git. at 5b10f48 (commit) No new revisions were added by this update.
[pulsar] branch master updated: [function] enable protobuf-native schema support for function (#11868)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new d0e5d96 [function] enable protobuf-native schema support for function (#11868) d0e5d96 is described below commit d0e5d96185336f56a7599e97474a6074cf6b76a7 Author: Neng Lu AuthorDate: Wed Sep 1 21:48:02 2021 -0700 [function] enable protobuf-native schema support for function (#11868) Fixes #11721 ### Motivation Enable function proces topic with protobuf_native schema ### Modifications update `TopicSchema` --- .../pulsar/functions/source/TopicSchema.java | 4 ++ .../pulsar/functions/source/TopicSchemaTest.java | 58 ++ 2 files changed, 62 insertions(+) diff --git a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/source/TopicSchema.java b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/source/TopicSchema.java index dcd424e..067a793 100644 --- a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/source/TopicSchema.java +++ b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/source/TopicSchema.java @@ -32,6 +32,7 @@ import org.apache.pulsar.client.api.schema.SchemaDefinition; import org.apache.pulsar.client.impl.PulsarClientImpl; import org.apache.pulsar.client.impl.schema.AvroSchema; import org.apache.pulsar.client.impl.schema.JSONSchema; +import org.apache.pulsar.client.impl.schema.ProtobufNativeSchema; import org.apache.pulsar.client.impl.schema.ProtobufSchema; import org.apache.pulsar.common.functions.ConsumerConfig; import org.apache.pulsar.common.schema.KeyValue; @@ -172,6 +173,9 @@ public class TopicSchema { case PROTOBUF: return ProtobufSchema.ofGenericClass(clazz, new HashMap<>()); +case PROTOBUF_NATIVE: +return ProtobufNativeSchema.ofGenericClass(clazz, new HashMap<>()); + case AUTO_PUBLISH: return (Schema) Schema.AUTO_PRODUCE_BYTES(); diff --git a/pulsar-functions/instance/src/test/java/org/apache/pulsar/functions/source/TopicSchemaTest.java b/pulsar-functions/instance/src/test/java/org/apache/pulsar/functions/source/TopicSchemaTest.java new file mode 100644 index 000..c746093 --- /dev/null +++ b/pulsar-functions/instance/src/test/java/org/apache/pulsar/functions/source/TopicSchemaTest.java @@ -0,0 +1,58 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +package org.apache.pulsar.functions.source; + +import lombok.extern.slf4j.Slf4j; +import org.apache.pulsar.client.api.Schema; +import org.apache.pulsar.client.impl.schema.AvroSchema; +import org.apache.pulsar.client.impl.schema.JSONSchema; +import org.apache.pulsar.client.impl.schema.ProtobufNativeSchema; +import org.apache.pulsar.client.impl.schema.ProtobufSchema; +import org.apache.pulsar.common.schema.SchemaType; +import org.apache.pulsar.functions.proto.Request; +import org.junit.Test; + +import java.util.Optional; + +import static org.testng.Assert.assertEquals; + +@Slf4j +public class TopicSchemaTest { + +@Test +public void testGetSchema() { +TopicSchema topicSchema = new TopicSchema(null); + +String TOPIC = "public/default/test"; +Schema schema = topicSchema.getSchema(TOPIC + "1", DummyClass.class, Optional.of(SchemaType.JSON)); +assertEquals(schema.getClass(), JSONSchema.class); + +schema = topicSchema.getSchema(TOPIC + "2", DummyClass.class, Optional.of(SchemaType.AVRO)); +assertEquals(schema.getClass(), AvroSchema.class); + +// use an arbitrary protobuf class for testing purpose +schema = topicSchema.getSchema(TOPIC + "3", Request.ServiceRequest.class, Optional.of(SchemaType.PROTOBUF)); +assertEquals(schema.getClass(), ProtobufSchema.class); + +schema = topicSchema.getSchema(TOPIC + "4", Request.ServiceRequest.class, Optional.of(SchemaType.PROTOBUF_NATIVE)); +assertEquals(schema.getClass(), ProtobufNativeSchema.class); +} + +private static class DummyClass {} +}
[pulsar] branch master updated (9bfb3db -> f0e20cb)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 9bfb3db [Issue 11814] fix pulsar admin method:getMessageById. (#11852) add f0e20cb [Test] Fix managed cursor metrics test (#11879) No new revisions were added by this update. Summary of changes: .../pulsar/broker/stats/ManagedCursorMetricsTest.java| 16 ++-- 1 file changed, 6 insertions(+), 10 deletions(-)
[pulsar] branch master updated (44becbf -> 9bfb3db)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 44becbf [pulsar-client-tools] fix packages tool parameter desc (#11809) add 9bfb3db [Issue 11814] fix pulsar admin method:getMessageById. (#11852) No new revisions were added by this update. Summary of changes: .../broker/admin/impl/PersistentTopicsBase.java| 7 + .../pulsar/broker/admin/PersistentTopicsTest.java | 31 ++ 2 files changed, 38 insertions(+)
[pulsar] branch master updated: [pulsar-client-tools] fix packages tool parameter desc (#11809)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 44becbf [pulsar-client-tools] fix packages tool parameter desc (#11809) 44becbf is described below commit 44becbf0b15e8c4db8f253603545f04b7fb7e8ba Author: Rui Fu AuthorDate: Thu Sep 2 09:45:48 2021 +0800 [pulsar-client-tools] fix packages tool parameter desc (#11809) ### Motivation fix the parameter's description in packages client tool --- .../src/main/java/org/apache/pulsar/admin/cli/CmdPackages.java | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pulsar-client-tools/src/main/java/org/apache/pulsar/admin/cli/CmdPackages.java b/pulsar-client-tools/src/main/java/org/apache/pulsar/admin/cli/CmdPackages.java index c922dce..0837592 100644 --- a/pulsar-client-tools/src/main/java/org/apache/pulsar/admin/cli/CmdPackages.java +++ b/pulsar-client-tools/src/main/java/org/apache/pulsar/admin/cli/CmdPackages.java @@ -104,7 +104,7 @@ class CmdPackages extends CmdBase { @DynamicParameter(names = {"--properties", "-P"}, description ="external infromations of a package") private Map properties = new HashMap<>(); -@Parameter(names = "--path", description = "descriptions of a package", required = true) +@Parameter(names = "--path", description = "file path of the package", required = true) private String path; @Override
[pulsar] branch master updated (2f4b890 -> d370d00)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2f4b890 [Doc] generate doc set for 2.8.2 (#11870) add d370d00 [Broker] Refine topic level backlog quota policies warning log (#11863) No new revisions were added by this update. Summary of changes: .../java/org/apache/pulsar/broker/service/BacklogQuotaManager.java | 7 +-- 1 file changed, 5 insertions(+), 2 deletions(-)
[pulsar-helm-chart] branch master updated: updates pulsar ca name generation to use suffix making cert swappable (#141)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new f307cc3 updates pulsar ca name generation to use suffix making cert swappable (#141) f307cc3 is described below commit f307cc32af530c369c34a021bb6c96f2d4907fcd Author: Peter Tinti AuthorDate: Wed Aug 25 23:14:03 2021 -0700 updates pulsar ca name generation to use suffix making cert swappable (#141) Updates CA name generation to be configurable allowing the swapping in of a CA. ### Motivation We recently swapped out cert issuers and found that with the current helm chart we were unable to do a hot swap without downtime (via helm) because the CA cert name is not configurable. Being able to change the name of the CA allows us to create a new CA first -> Validate -> then swap over in follow up apply/release. ### Modifications Adds the ability to specify the suffix used to generate the CA name (not the whole name in order to preserve back compatibility regardless of the release name.) --- charts/pulsar/templates/_autorecovery.tpl | 2 +- charts/pulsar/templates/_bookkeeper.tpl | 2 +- charts/pulsar/templates/_broker.tpl | 2 +- charts/pulsar/templates/_toolset.tpl | 2 +- charts/pulsar/templates/proxy-statefulset.yaml| 2 +- charts/pulsar/templates/tls-cert-internal-issuer.yaml | 4 ++-- charts/pulsar/templates/toolset-statefulset.yaml | 2 +- charts/pulsar/templates/zookeeper-statefulset.yaml| 2 +- charts/pulsar/values.yaml | 1 + scripts/pulsar/clean_tls.sh | 9 - scripts/pulsar/upload_tls.sh | 9 - 11 files changed, 26 insertions(+), 11 deletions(-) diff --git a/charts/pulsar/templates/_autorecovery.tpl b/charts/pulsar/templates/_autorecovery.tpl index e1e74d5..8343589 100644 --- a/charts/pulsar/templates/_autorecovery.tpl +++ b/charts/pulsar/templates/_autorecovery.tpl @@ -55,7 +55,7 @@ Define autorecovery tls certs volumes path: tls.key - name: ca secret: -secretName: "{{ .Release.Name }}-ca-tls" +secretName: "{{ .Release.Name }}-{{ .Values.tls.ca_suffix }}" items: - key: ca.crt path: ca.crt diff --git a/charts/pulsar/templates/_bookkeeper.tpl b/charts/pulsar/templates/_bookkeeper.tpl index bd319ff..5b96953 100644 --- a/charts/pulsar/templates/_bookkeeper.tpl +++ b/charts/pulsar/templates/_bookkeeper.tpl @@ -56,7 +56,7 @@ Define bookie tls certs volumes path: tls.key - name: ca secret: -secretName: "{{ .Release.Name }}-ca-tls" +secretName: "{{ .Release.Name }}-{{ .Values.tls.ca_suffix }}" items: - key: ca.crt path: ca.crt diff --git a/charts/pulsar/templates/_broker.tpl b/charts/pulsar/templates/_broker.tpl index 758a0b6..5614e8e 100644 --- a/charts/pulsar/templates/_broker.tpl +++ b/charts/pulsar/templates/_broker.tpl @@ -62,7 +62,7 @@ Define broker tls certs volumes path: tls.key - name: ca secret: -secretName: "{{ .Release.Name }}-ca-tls" +secretName: "{{ .Release.Name }}-{{ .Values.tls.ca_suffix }}" items: - key: ca.crt path: ca.crt diff --git a/charts/pulsar/templates/_toolset.tpl b/charts/pulsar/templates/_toolset.tpl index 5b149b5..c6bf857 100644 --- a/charts/pulsar/templates/_toolset.tpl +++ b/charts/pulsar/templates/_toolset.tpl @@ -55,7 +55,7 @@ Define toolset tls certs volumes path: tls.key - name: ca secret: -secretName: "{{ .Release.Name }}-ca-tls" +secretName: "{{ .Release.Name }}-{{ .Values.tls.ca_suffix }}" items: - key: ca.crt path: ca.crt diff --git a/charts/pulsar/templates/proxy-statefulset.yaml b/charts/pulsar/templates/proxy-statefulset.yaml index 96c24bf..0433d1b 100644 --- a/charts/pulsar/templates/proxy-statefulset.yaml +++ b/charts/pulsar/templates/proxy-statefulset.yaml @@ -260,7 +260,7 @@ spec: {{- if .Values.tls.proxy.enabled }} - name: ca secret: -secretName: "{{ .Release.Name }}-ca-tls" +secretName: "{{ .Release.Name }}-{{ .Values.tls.ca_suffix }}" items: - key: ca.crt path: ca.crt diff --git a/charts/pulsar/templates/tls-cert-internal-issuer.yaml b/charts/pulsar/templates/tls-cert-internal-issuer.yaml index 60ac91a..e9c3a2f 100644 --- a/charts/pulsar/templates/tls-cert-internal-issuer.yaml +++ b/charts/pulsar/templates/tls-cert-internal-issuer.yaml @@ -34,7 +34,7 @@ metadata: name: "{{ template "pulsar.fullname" . }}-ca" namespace: {{ template "pulsar.namespace" . }} spec: - secretName: "{{ .Rel
[pulsar-helm-chart] branch master updated: ZooKeeper HTTP port should be exposed by service so we can use prometheus (#143)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new 65dc686 ZooKeeper HTTP port should be exposed by service so we can use prometheus (#143) 65dc686 is described below commit 65dc68654b33f7e7987f6f9590a319deae245238 Author: Frank Kelly <62910985+frankjke...@users.noreply.github.com> AuthorDate: Thu Aug 26 02:13:47 2021 -0400 ZooKeeper HTTP port should be exposed by service so we can use prometheus (#143) Fixes #142 ### Motivation Expose HTTP Port on ZooKeeper service so we can use Prometheus ### Modifications Bug fix to expose HTTP port on ZooKeeper service --- charts/pulsar/templates/zookeeper-service.yaml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/charts/pulsar/templates/zookeeper-service.yaml b/charts/pulsar/templates/zookeeper-service.yaml index 7ee9890..a71849b 100644 --- a/charts/pulsar/templates/zookeeper-service.yaml +++ b/charts/pulsar/templates/zookeeper-service.yaml @@ -31,6 +31,9 @@ metadata: {{ toYaml .Values.zookeeper.service.annotations | indent 4 }} spec: ports: +# prometheus needs to access /metrics endpoint +- name: http + port: {{ .Values.zookeeper.ports.http }} - name: follower port: {{ .Values.zookeeper.ports.follower }} - name: leader-election
[pulsar-helm-chart] branch master updated: added extraVolumes and extraVolumeMounts (#149)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new c45813f added extraVolumes and extraVolumeMounts (#149) c45813f is described below commit c45813ffe5e280d5cf50fde57b375dc934157e7d Author: Aaron Johnson AuthorDate: Thu Aug 26 01:13:27 2021 -0500 added extraVolumes and extraVolumeMounts (#149) Fixes #147 ### Motivation This gives the helm chart user the ability to specify a secret or other type of volume to be mounted into any of the statefulset pods ### Modifications * Added conditionals to `bookkeeper`, `broker`, `proxy`, `toolset`, and `zookeeper` statefulsets which allow the chart user to specify extraVolumes and extraVolumeMounts for deployed pods. * Added `extraVolumes` and `extraVolumeMounts` parameters to values.yaml --- .../pulsar/templates/bookkeeper-statefulset.yaml | 6 ++ charts/pulsar/templates/broker-statefulset.yaml| 6 ++ charts/pulsar/templates/proxy-statefulset.yaml | 10 +++- charts/pulsar/templates/toolset-statefulset.yaml | 6 ++ charts/pulsar/templates/zookeeper-statefulset.yaml | 6 ++ charts/pulsar/values.yaml | 65 ++ 6 files changed, 97 insertions(+), 2 deletions(-) diff --git a/charts/pulsar/templates/bookkeeper-statefulset.yaml b/charts/pulsar/templates/bookkeeper-statefulset.yaml index e364cd9..f338d4f 100644 --- a/charts/pulsar/templates/bookkeeper-statefulset.yaml +++ b/charts/pulsar/templates/bookkeeper-statefulset.yaml @@ -187,6 +187,9 @@ spec: - name: "{{ template "pulsar.fullname" . }}-{{ .Values.bookkeeper.component }}-{{ .Values.bookkeeper.volumes.ledgers.name }}" mountPath: /pulsar/data/bookkeeper/ledgers {{- end}} +{{- if .Values.bookkeeper.extraVolumeMounts }} +{{ toYaml .Values.bookkeeper.extraVolumeMounts | indent 8 }} +{{- end }} {{- include "pulsar.bookkeeper.certs.volumeMounts" . | nindent 8 }} volumes: {{- if not (and (and .Values.persistence .Values.volumes.persistence) .Values.bookkeeper.volumes.persistence) }} @@ -197,6 +200,9 @@ spec: {{- end }} {{- include "pulsar.bookkeeper.certs.volumes" . | nindent 6 }} {{- include "pulsar.imagePullSecrets" . | nindent 6}} + {{- if .Values.bookkeeper.extraVolumes }} +{{ toYaml .Values.bookkeeper.extraVolumes | indent 6 }} + {{- end }} {{- if and (and .Values.persistence .Values.volumes.persistence) .Values.bookkeeper.volumes.persistence}} volumeClaimTemplates: {{- if .Values.bookkeeper.volumes.useSingleCommonVolume }} diff --git a/charts/pulsar/templates/broker-statefulset.yaml b/charts/pulsar/templates/broker-statefulset.yaml index 7785d06..16db645 100644 --- a/charts/pulsar/templates/broker-statefulset.yaml +++ b/charts/pulsar/templates/broker-statefulset.yaml @@ -235,12 +235,18 @@ spec: readOnly: true {{- end }} {{- end }} + {{- if .Values.broker.extraVolumeMounts }} +{{ toYaml .Values.broker.extraVolumeMounts | indent 10 }} + {{- end }} {{- include "pulsar.broker.certs.volumeMounts" . | nindent 10 }} {{- if and .Values.rbac.enabled .Values.rbac.psp }} securityContext: readOnlyRootFilesystem: false {{- end }} volumes: + {{- if .Values.broker.extraVolumes }} +{{ toYaml .Values.broker.extraVolumes | indent 6 }} + {{- end }} {{- if .Values.auth.authentication.enabled }} {{- if eq .Values.auth.authentication.provider "jwt" }} - name: token-keys diff --git a/charts/pulsar/templates/proxy-statefulset.yaml b/charts/pulsar/templates/proxy-statefulset.yaml index 8b92c4f..96c24bf 100644 --- a/charts/pulsar/templates/proxy-statefulset.yaml +++ b/charts/pulsar/templates/proxy-statefulset.yaml @@ -199,7 +199,7 @@ spec: envFrom: - configMapRef: name: "{{ template "pulsar.fullname" . }}-{{ .Values.proxy.component }}" -{{- if or .Values.auth.authentication.enabled (and .Values.tls.enabled (or .Values.tls.proxy.enabled .Values.tls.broker.enabled)) }} +{{- if or .Values.proxy.extraVolumeMounts .Values.auth.authentication.enabled (and .Values.tls.enabled (or .Values.tls.proxy.enabled .Values.tls.broker.enabled)) }} volumeMounts: {{- if .Values.auth.authentication.enabled }} {{- if eq .Values.auth.authentication.provider "jwt" }} @@ -221,10 +221,16 @@ spec: name: ca readOnly: true {{- end}} + {{- if .Values.proxy.extraVolumeMounts }} +{{ toYaml .Values.proxy.extraVolumeMounts | indent 10 }} + {{- end }} {{- end}} {{- include
[pulsar] branch master updated (8126d98 -> cf7de12)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 8126d98 [Issue 11412] Add shutdownGracefully for ManagedLedgerFactoryImpl (#11517) add cf7de12 [python] Support CryptoKeyReader for Reader API in python clients (#11447) No new revisions were added by this update. Summary of changes: pulsar-client-cpp/python/pulsar/__init__.py | 9 - pulsar-client-cpp/python/pulsar_test.py | 13 + pulsar-client-cpp/python/src/config.cc | 8 3 files changed, 29 insertions(+), 1 deletion(-)
[pulsar] branch master updated (f7957a5 -> 8126d98)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from f7957a5 [Issue 11581][broker] feat:pass the executor to RateLimiter in ResourceGroupPublishLimiter (#11582) add 8126d98 [Issue 11412] Add shutdownGracefully for ManagedLedgerFactoryImpl (#11517) No new revisions were added by this update. Summary of changes: .../bookkeeper/mledger/ManagedLedgerException.java | 11 ++ .../bookkeeper/mledger/ManagedLedgerFactory.java | 9 ++ .../mledger/impl/ManagedLedgerFactoryImpl.java | 111 + .../bookkeeper/mledger/impl/MetaStoreImpl.java | 9 +- .../bookkeeper/mledger/impl/ManagedCursorTest.java | 3 - .../mledger/impl/ManagedLedgerBkTest.java | 7 +- .../impl/ManagedLedgerFactoryShutdownTest.java | 179 + .../bookkeeper/mledger/impl/ManagedLedgerTest.java | 1 - 8 files changed, 319 insertions(+), 11 deletions(-) create mode 100644 managed-ledger/src/test/java/org/apache/bookkeeper/mledger/impl/ManagedLedgerFactoryShutdownTest.java
[pulsar] branch master updated (d10100f -> f7957a5)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from d10100f [Doc] Fix Pulsar c++ client windows build docs (#11705) add f7957a5 [Issue 11581][broker] feat:pass the executor to RateLimiter in ResourceGroupPublishLimiter (#11582) No new revisions were added by this update. Summary of changes: .../resourcegroup/ResourceGroupPublishLimiter.java | 16 1 file changed, 8 insertions(+), 8 deletions(-)
[pulsar] branch master updated: [Doc] Fix Pulsar c++ client windows build docs (#11705)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new d10100f [Doc] Fix Pulsar c++ client windows build docs (#11705) d10100f is described below commit d10100f2fcded846830a884c4c27885e0420d746 Author: ran AuthorDate: Sat Aug 21 08:27:18 2021 +0800 [Doc] Fix Pulsar c++ client windows build docs (#11705) ### Motivation Currently, docs that the Pulsar c++ client windows building-related docs are not complete. ### Modifications Add Pulsar c++ client windows building steps in Apache Pulsar website. Add Pulsar c++ client windows building result check section. --- pulsar-client-cpp/README.md| 20 site2/docs/client-libraries-cpp.md | 31 +++ 2 files changed, 51 insertions(+) diff --git a/pulsar-client-cpp/README.md b/pulsar-client-cpp/README.md index 6316df0..a25db9b 100644 --- a/pulsar-client-cpp/README.md +++ b/pulsar-client-cpp/README.md @@ -235,6 +235,26 @@ ${PULSAR_PATH}/pulsar-client-cpp/cmake -DPROTOC_PATH=C:/protobuf/bin/protoc -DCM #This will generate pulsar-cpp.sln. Open this in Visual Studio and build the desired configurations. ``` + Checks + +# Client libraries are available in the following places. +``` +${PULSAR_PATH}/pulsar-client-cpp/build/lib/Release/pulsar.lib +${PULSAR_PATH}/pulsar-client-cpp/build/lib/Release/pulsar.dll +``` + + Examples + +# Add windows environment paths. +``` +${PULSAR_PATH}/pulsar-client-cpp/build/lib/Release +${PULSAR_PATH}/pulsar-client-cpp/vcpkg_installed +``` + +# Examples are available in. +``` +${PULSAR_PATH}/pulsar-client-cpp/build/examples/Release +``` ## Tests ```shell diff --git a/site2/docs/client-libraries-cpp.md b/site2/docs/client-libraries-cpp.md index b161365..de6fbb5 100644 --- a/site2/docs/client-libraries-cpp.md +++ b/site2/docs/client-libraries-cpp.md @@ -234,6 +234,37 @@ Pulsar releases are available in the [Homebrew](https://brew.sh/) core repositor brew install libpulsar ``` +## Windows (64-bit) + +### Compilation + +1. Clone the Pulsar repository. + +```shell +$ git clone https://github.com/apache/pulsar +``` + +2. Install all necessary dependencies. + +```shell +cd ${PULSAR_HOME}/pulsar-client-cpp +vcpkg install --feature-flags=manifests --triplet x64-windows +``` + +3. Build C++ libraries. + +```shell +cmake -B ./build -A x64 -DBUILD_PYTHON_WRAPPER=OFF -DBUILD_TESTS=OFF -DVCPKG_TRIPLET=x64-windows -DCMAKE_BUILD_TYPE=Release -S . +cmake --build ./build --config Release +``` + +4. Client libraries are available in the following places. + +``` +${PULSAR_HOME}/pulsar-client-cpp/build/lib/Release/pulsar.lib +${PULSAR_HOME}/pulsar-client-cpp/build/lib/Release/pulsar.dll +``` + ## Connection URLs To connect Pulsar using client libraries, you need to specify a Pulsar protocol URL.
[pulsar] branch master updated: Add Pulsar Summit Asia 2021 CFP Blog (#11729)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 36667f8 Add Pulsar Summit Asia 2021 CFP Blog (#11729) 36667f8 is described below commit 36667f855c475a9a503773a46df5122ede5a19f7 Author: Jipei wang <68096627+jipeiw...@users.noreply.github.com> AuthorDate: Sat Aug 21 08:26:19 2021 +0800 Add Pulsar Summit Asia 2021 CFP Blog (#11729) ### Motivation *Pulsar Summit Asia 2021 CFP is open* ### Modifications Add Pulsar Summit Asia 2021 CFP Blog on Pulsar website to call for submissions. --- site2/website/blog/2021-08-18-asia-cfp.md | 47 +++ 1 file changed, 47 insertions(+) diff --git a/site2/website/blog/2021-08-18-asia-cfp.md b/site2/website/blog/2021-08-18-asia-cfp.md new file mode 100644 index 000..cf60648 --- /dev/null +++ b/site2/website/blog/2021-08-18-asia-cfp.md @@ -0,0 +1,47 @@ +--- +author: Dianjin +title: Announcing Pulsar Summit Asia 2021: CFP Is Open! +--- +We’re proud to announce the Pulsar Summit Asia 2021! + +2021 has been a remarkable year for the Apache Pulsar community. [Both the technology and community are growing rapidly this year](https://streamnative.io/en/blog/community/2021-06-14-pulsar-hits-its-400th-contributor-and-passes-kafka-in-monthly-active-contributors), and [Pulsar Virtual Summit North America 2021](https://www.na2021.pulsar-summit.org) was a big success with 33 break-out sessions and more than 550 registrations. + +Last year, [Pulsar Summit Asia](https://pulsar-summit.org/en/event/asia-2020) featured more than 40 interactive sessions by tech leads, open-source developers, software engineers, and software architects from Tencent Group, BIGO, Kingsoft Cloud, Splunk, Yahoo! JAPAN, Nutanix, Dada Group, TIBCO, Huawei Cloud, and more. The conference garnered nearly 1,000 attendees around the globe mostly from Asia, including attendees from top tech, fintech and media companies. + +Cumulatively, the Pulsar Summits drew more than 100 speakers, thousands of attendees, and hundreds of companies from diverse industries. It is a unique opportunity to network and learn about Pulsar project updates, ecosystem developments, best practices, and adoption stories. + +**This year, the Pulsar Summit Asia will be hosted on November 20-21, 2021 by StreamNative. You can join us offline in Beijing for one day of Pulsar Training and one day of keynotes and breakout sessions. All the talks will be streamed live online.** +# CFP Details +Join us and speak at the Pulsar Summit Asia 2021! +We are looking for Pulsar stories that are innovative, informative, or thought-provoking. Here are some suggestions: +- Your Pulsar use case / success story +- A technical deep dive +- Pulsar best practices +- Pulsar ecosystem updates + +To speak at the summit, please [submit an abstract](https://sessionize.com/pulsar-summit-asia-2021/) about your presentation. Remember to keep your proposal short, relevant and engaging. +# First-time Speakers Welcomed! +First time submitting? Don't feel intimidated. We strongly encourage first-time speakers to submit talks for the Pulsar Summit Asia 2021. If your submission is similar to a previous talk in the past Pulsar Summits, please include information on how this version will be different. We hope to see some exciting updates on the topic. + +We welcome submissions from around the globe. Our hybrid conference model has taken time differences into consideration. After your talk is accepted, we will schedule the sessions and send you the presentation options. + +# Speaker Benefits +As a speaker, you will receive: +- The chance to demonstrate your experience and deep knowledge in the rapidly growing event streaming space. +- Your name, title, company, and bio will be featured on the Pulsar Summit Asia 2021 website. +- Your session will be added to the Pulsar Summit YouTube Channel and promoted on Twitter, LinkedIn, and WeChat. +- A professionally produced video of your presentation. +Exclusive Pulsar swag only available to the speakers. + +# Important Dates +- CFP opens: August 18th, 2021 +- CFP closes: September 8th, 2021 +- Speaker notifications: September 22th, 2021 +- Schedule announcement: October 13th, 2021 + +Submissions are open until September 8th. If you want some advice or feedback on your proposal, or have any questions about the summit, please do not hesitate to contact us at organiz...@pulsar-summit.org. We are happy to help! + +# Sponsor Pulsar Summit Asia +Pulsar Summit is a conference for the community and sponsorship is needed. Sponsoring this event provides a great opportunity for your organization to further engage with the Apache Pulsar community. Contact us at organiz...@pulsar-summit.org to learn more. + +Help us make Pulsar Summit Asia 2021 a
[pulsar-helm-chart] branch master updated: Add Support for imagePullSecrets (#140)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-helm-chart.git The following commit(s) were added to refs/heads/master by this push: new 19d6ce6 Add Support for imagePullSecrets (#140) 19d6ce6 is described below commit 19d6ce648845c7a23507146dc6d86074f72134df Author: Thomas O'Neill AuthorDate: Fri Aug 20 20:22:50 2021 -0400 Add Support for imagePullSecrets (#140) Fixes #125 ### Motivation The default images in the values.yaml are in docker hub. This PR allows us to provide image pull secrets for the containers which will allow us to get around Docker Hub's rate limiting if the nodes are not logged into Docker Hub. ### Modifications Added a new template to generate `imagePullSecrets`, and included them in the deployments and statefulsets. This will only add them if they are specified under `images.imagePullSecrets` ### Verifying this change - [] Make sure that the change passes the CI checks. --- charts/pulsar/templates/_helpers.tpl | 12 charts/pulsar/templates/autorecovery-statefulset.yaml | 1 + charts/pulsar/templates/bookkeeper-statefulset.yaml| 1 + charts/pulsar/templates/broker-statefulset.yaml| 1 + charts/pulsar/templates/grafana-deployment.yaml| 1 + charts/pulsar/templates/prometheus-deployment.yaml | 1 + charts/pulsar/templates/proxy-statefulset.yaml | 1 + charts/pulsar/templates/pulsar-manager-deployment.yaml | 1 + charts/pulsar/templates/toolset-statefulset.yaml | 1 + 9 files changed, 20 insertions(+) diff --git a/charts/pulsar/templates/_helpers.tpl b/charts/pulsar/templates/_helpers.tpl index ebc0409..0ad71f9 100644 --- a/charts/pulsar/templates/_helpers.tpl +++ b/charts/pulsar/templates/_helpers.tpl @@ -84,3 +84,15 @@ Create the match labels. app: {{ template "pulsar.name" . }} release: {{ .Release.Name }} {{- end }} + +{{/* +Create ImagePullSecrets +*/}} +{{- define "pulsar.imagePullSecrets" -}} +{{- if .Values.images.imagePullSecrets -}} +imagePullSecrets: +{{- range .Values.images.imagePullSecrets }} +- name: {{ . }} +{{- end }} +{{- end -}} +{{- end }} diff --git a/charts/pulsar/templates/autorecovery-statefulset.yaml b/charts/pulsar/templates/autorecovery-statefulset.yaml index 0d942b0..3f90a05 100644 --- a/charts/pulsar/templates/autorecovery-statefulset.yaml +++ b/charts/pulsar/templates/autorecovery-statefulset.yaml @@ -150,5 +150,6 @@ spec: {{- include "pulsar.autorecovery.certs.volumeMounts" . | nindent 8 }} volumes: {{- include "pulsar.autorecovery.certs.volumes" . | nindent 6 }} + {{- include "pulsar.imagePullSecrets" . | nindent 6}} {{- end }} diff --git a/charts/pulsar/templates/bookkeeper-statefulset.yaml b/charts/pulsar/templates/bookkeeper-statefulset.yaml index e05f9f1..e364cd9 100644 --- a/charts/pulsar/templates/bookkeeper-statefulset.yaml +++ b/charts/pulsar/templates/bookkeeper-statefulset.yaml @@ -196,6 +196,7 @@ spec: emptyDir: {} {{- end }} {{- include "pulsar.bookkeeper.certs.volumes" . | nindent 6 }} + {{- include "pulsar.imagePullSecrets" . | nindent 6}} {{- if and (and .Values.persistence .Values.volumes.persistence) .Values.bookkeeper.volumes.persistence}} volumeClaimTemplates: {{- if .Values.bookkeeper.volumes.useSingleCommonVolume }} diff --git a/charts/pulsar/templates/broker-statefulset.yaml b/charts/pulsar/templates/broker-statefulset.yaml index c85e747..7785d06 100644 --- a/charts/pulsar/templates/broker-statefulset.yaml +++ b/charts/pulsar/templates/broker-statefulset.yaml @@ -268,4 +268,5 @@ spec: {{- end}} {{- end}} {{- include "pulsar.broker.certs.volumes" . | nindent 6 }} + {{- include "pulsar.imagePullSecrets" . | nindent 6}} {{- end }} diff --git a/charts/pulsar/templates/grafana-deployment.yaml b/charts/pulsar/templates/grafana-deployment.yaml index d2c4e49..86787d9 100644 --- a/charts/pulsar/templates/grafana-deployment.yaml +++ b/charts/pulsar/templates/grafana-deployment.yaml @@ -87,4 +87,5 @@ spec: secretKeyRef: name: "{{ template "pulsar.fullname" . }}-{{ .Values.grafana.component }}-secret" key: GRAFANA_ADMIN_PASSWORD +{{- include "pulsar.imagePullSecrets" . | nindent 6}} {{- end }} diff --git a/charts/pulsar/templates/prometheus-deployment.yaml b/charts/pulsar/templates/prometheus-deployment.yaml index abd8bc4..f294b2a 100644 --- a/charts/pulsar/templates/prometheus-deployment.yaml +++ b/charts/pulsar/templates/prometheus-deployment.yaml @@ -93,4 +93,5 @@ spec: persistentVolumeClaim: claimName: "{{ template "pulsar.fullname" . }}-{{ .Va
[pulsar] branch master updated (1d1f633 -> 43ded59)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 1d1f633 [docs] [ISSUE 11380] Update code example and description (#11653) add 43ded59 Fix race condition in concurrent schema deletion (#11606) No new revisions were added by this update. Summary of changes: .../pulsar/broker/service/AbstractTopic.java | 3 +- .../service/schema/BookkeeperSchemaStorage.java| 52 ++ .../broker/service/PersistentTopicE2ETest.java | 27 +++ 3 files changed, 73 insertions(+), 9 deletions(-)
[pulsar] branch master updated (de86f4f -> 1d1f633)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from de86f4f [pulsar-admin] allow create functions with package URL (#11666) add 1d1f633 [docs] [ISSUE 11380] Update code example and description (#11653) No new revisions were added by this update. Summary of changes: site2/docs/admin-api-namespaces.md | 90 site2/docs/cookbooks-retention-expiry.md | 57 2 files changed, 69 insertions(+), 78 deletions(-)
[pulsar] branch master updated (fbfbd0e -> de86f4f)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from fbfbd0e Fix typos in concepts-transactions.md (#11676) add de86f4f [pulsar-admin] allow create functions with package URL (#11666) No new revisions were added by this update. Summary of changes: .../management/core/common/PackageType.java| 0 .../apache/pulsar/admin/cli/CmdFunctionsTest.java | 93 +- .../org/apache/pulsar/common/functions/Utils.java | 10 ++- .../functions/worker/rest/api/FunctionsImpl.java | 8 +- .../functions/worker/rest/api/SinksImpl.java | 8 +- .../functions/worker/rest/api/SourcesImpl.java | 8 +- .../tests/integration/cli/PackagesCliTest.java | 12 +-- 7 files changed, 111 insertions(+), 28 deletions(-) rename {pulsar-package-management/core => pulsar-client-admin-api}/src/main/java/org/apache/pulsar/packages/management/core/common/PackageType.java (100%)
[pulsar] branch master updated: [Issue 8502] Upgrade Debezium to a newer version (#11204)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 283ae57 [Issue 8502] Upgrade Debezium to a newer version (#11204) 283ae57 is described below commit 283ae572a001830cf02275097fdde92f6d4a648b Author: Andrey Yegorov <8622884+dl...@users.noreply.github.com> AuthorDate: Fri Aug 13 16:34:20 2021 -0700 [Issue 8502] Upgrade Debezium to a newer version (#11204) Fixes #8502 ### Motivation Upgrade Debezium to a newer version ### Modifications Upgraded Deebzium to v.1.5.4 (latest built with Java 8, v.1.6.x built with Java 11) Upgraded kafka-client to 2.7 (version debezium tested with) Scala-lib to 2.13.6 (for kafka-client) Dealt with API changes, tests etc. PR is on top of https://github.com/apache/pulsar/pull/11154 to have Debezium integration tests on CI. --- pom.xml| 8 +++--- pulsar-io/debezium/core/pom.xml| 7 + .../pulsar/io/debezium/PulsarDatabaseHistory.java | 5 .../io/debezium/PulsarDatabaseHistoryTest.java | 12 .../kafka/connect/PulsarKafkaSinkTaskContext.java | 33 -- .../io/kafka/connect/PulsarOffsetBackingStore.java | 10 +-- .../connect/PulsarOffsetBackingStoreTest.java | 22 ++- .../tests/integration/io/sources/SourceTester.java | 4 +++ 8 files changed, 42 insertions(+), 59 deletions(-) diff --git a/pom.xml b/pom.xml index c332149..1f11163 100644 --- a/pom.xml +++ b/pom.xml @@ -139,7 +139,7 @@ flexible messaging model and an intuitive client API. 2.2.0 3.6.0 4.4.8 -2.3.0 +2.7.0 5.1.1 1.11.774 1.10.2 @@ -153,9 +153,9 @@ flexible messaging model and an intuitive client API. 3.3.0 7.9.1 332 -2.11 -2.11.12 -1.0.0.Final +2.13 +2.13.6 +1.5.4.Final 0.11.1 0.18.0 2.3.0 diff --git a/pulsar-io/debezium/core/pom.xml b/pulsar-io/debezium/core/pom.xml index 4bd97ed..0b92898 100644 --- a/pulsar-io/debezium/core/pom.xml +++ b/pulsar-io/debezium/core/pom.xml @@ -90,6 +90,13 @@ test-jar + + io.debezium + debezium-connector-mysql + ${debezium.version} + test + + diff --git a/pulsar-io/debezium/core/src/main/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistory.java b/pulsar-io/debezium/core/src/main/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistory.java index c3d95a7..9e9a7f1 100644 --- a/pulsar-io/debezium/core/src/main/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistory.java +++ b/pulsar-io/debezium/core/src/main/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistory.java @@ -251,6 +251,11 @@ public final class PulsarDatabaseHistory extends AbstractDatabaseHistory { } @Override +public boolean storageExists() { +return true; +} + +@Override public String toString() { if (topicName != null) { return "Pulsar topic (" + topicName + ") at " + serviceUrl; diff --git a/pulsar-io/debezium/core/src/test/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistoryTest.java b/pulsar-io/debezium/core/src/test/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistoryTest.java index 6a21812..ba3bc6a 100644 --- a/pulsar-io/debezium/core/src/test/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistoryTest.java +++ b/pulsar-io/debezium/core/src/test/java/org/apache/pulsar/io/debezium/PulsarDatabaseHistoryTest.java @@ -23,9 +23,9 @@ import static org.testng.Assert.assertFalse; import static org.testng.Assert.assertTrue; import io.debezium.config.Configuration; +import io.debezium.connector.mysql.antlr.MySqlAntlrDdlParser; import io.debezium.relational.Tables; -import io.debezium.relational.ddl.DdlParserSql2003; -import io.debezium.relational.ddl.LegacyDdlParser; +import io.debezium.relational.ddl.DdlParser; import io.debezium.relational.history.DatabaseHistory; import io.debezium.relational.history.DatabaseHistoryListener; import io.debezium.text.ParsingException; @@ -86,8 +86,8 @@ public class PulsarDatabaseHistoryTest extends ProducerConsumerBase { // Calling it another time to ensure we can work with the DB history topic already existing history.initializeStorage(); -LegacyDdlParser recoveryParser = new DdlParserSql2003(); -LegacyDdlParser ddlParser = new DdlParserSql2003(); +DdlParser recoveryParser = new MySqlAntlrDdlParser(); +DdlParser ddlParser = new MySqlAntlrDdlParser(); ddlParser.setCurrentSchema("db1"); // recover does this, so we need to as well Tables tables1 = new Tables(); Tables tables2 = new Tables(); @@ -102,9 +102,9 @@ public class PulsarDatabaseHisto
[pulsar] branch master updated: [tools] Pulsar Client: add ability to produce KV messages (#11303)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 17ab040 [tools] Pulsar Client: add ability to produce KV messages (#11303) 17ab040 is described below commit 17ab040bbd71161df3860613ddcd253b3af24f59 Author: Enrico Olivelli AuthorDate: Sat Aug 14 01:24:45 2021 +0200 [tools] Pulsar Client: add ability to produce KV messages (#11303) ### Motivation Currently (Pulsar 2.8.0) it is not easy to produce messages with KeyValue encoding, because command line tools do not provide such support. With this change the user will be able to set the schema while using `pulsar-client produce` We are adding three parameters: * "--key-schema" : this is the schema for the Key (default :"string") * "--value-schema": this is the schema for the Value (default: "bytes") * "--key-value-encoding-type": this is the type of encoding with values: none,separated,inline with key-value-encoding-type=node (default behaviour) we are not using KV encoding The command is 100% compatible with previous versions ### Modifications Add support for the properties listed above. We are using "Schema.AUTO_PRODUCE_BYTES" in order to deal with the Schema registry. The user will pass the raw value as message and we are passing it without modifications to Pulsar. Example command to send a KV message with JSON key and value: `bin/pulsar-client produce --key-value-encoding-type separated -k '{"a":"b"}' -m '{"a":"b"}' --key-schema 'json:{"type": "record","namespace": "com.example","name": "FullName", "fields": [{ "name": "a", "type": "string" }]} ' --value-schema 'json:{"type": "record","namespace": "com.example","name": "FullName", "fields": [{ "name": "a", "type": "string" }]} ' test` for AVRO and JSON the schema is written inline after the prefix "avro:" and "json:" ### Verifying this change This change added unit tests --- .../org/apache/pulsar/client/cli/CmdProduce.java | 106 +++-- .../apache/pulsar/client/cli/TestCmdProduce.java | 37 ++- 2 files changed, 133 insertions(+), 10 deletions(-) diff --git a/pulsar-client-tools/src/main/java/org/apache/pulsar/client/cli/CmdProduce.java b/pulsar-client-tools/src/main/java/org/apache/pulsar/client/cli/CmdProduce.java index 326e221..52d0b25 100644 --- a/pulsar-client-tools/src/main/java/org/apache/pulsar/client/cli/CmdProduce.java +++ b/pulsar-client-tools/src/main/java/org/apache/pulsar/client/cli/CmdProduce.java @@ -30,6 +30,7 @@ import com.google.common.util.concurrent.RateLimiter; import com.google.gson.JsonParseException; import java.net.URI; +import java.nio.charset.StandardCharsets; import java.nio.file.Files; import java.nio.file.Paths; import java.util.ArrayList; @@ -38,12 +39,12 @@ import java.util.Base64; import java.util.Collections; import java.util.HashMap; import java.util.List; +import java.util.Locale; import java.util.Map; import java.util.concurrent.CompletableFuture; import java.util.concurrent.CountDownLatch; import java.util.concurrent.TimeUnit; -import org.apache.commons.lang3.StringUtils; import org.apache.pulsar.client.api.Authentication; import org.apache.pulsar.client.api.AuthenticationDataProvider; import org.apache.pulsar.client.api.ClientBuilder; @@ -51,8 +52,13 @@ import org.apache.pulsar.client.api.Producer; import org.apache.pulsar.client.api.ProducerBuilder; import org.apache.pulsar.client.api.PulsarClient; import org.apache.pulsar.client.api.PulsarClientException; +import org.apache.pulsar.client.api.Schema; import org.apache.pulsar.client.api.TypedMessageBuilder; +import org.apache.pulsar.client.impl.schema.SchemaInfoImpl; import org.apache.pulsar.common.naming.TopicName; +import org.apache.pulsar.common.schema.KeyValue; +import org.apache.pulsar.common.schema.KeyValueEncodingType; +import org.apache.pulsar.common.schema.SchemaType; import org.apache.pulsar.common.util.ObjectMapperFactory; import org.apache.pulsar.websocket.data.ProducerMessage; import org.eclipse.jetty.util.ssl.SslContextFactory; @@ -76,6 +82,9 @@ public class CmdProduce { private static final Logger LOG = LoggerFactory.getLogger(PulsarClientTool.class); private static final int MAX_MESSAGES = 1000; +static final String KEY_VALUE_ENCODING_TYPE_NOT_SET = ""; +private static final String KEY_VALUE_EN
[pulsar] branch master updated: remove pulsar-standalone image (#11657)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 05827ae remove pulsar-standalone image (#11657) 05827ae is described below commit 05827aeb4b0aa4a1b09a7a122f00a65012bf53a1 Author: Rui Fu AuthorDate: Fri Aug 13 13:26:42 2021 +0800 remove pulsar-standalone image (#11657) ### Motivation Currently, the pulsar-dashboard has been removed in https://github.com/apache/pulsar/pull/11284, as the pulsar-standalone image is required pulsar-dashboard and provide dashboard service in one container, which leads to building failure in pulsar-standalone image. in https://github.com/apache/pulsar/pull/11623, as @merlimat suggests, this PR removes the pulsar-standalone image from master. I did a quick search in the codebase to find if there is any doc related to pulsar-standalone image but seems no doc related to pulsar-standalone image anymore. so this PR will not include any doc changes. ### Modifications - remove pulsar-standalone image --- docker/build.sh | 1 - docker/pom.xml | 1 - docker/publish.sh | 4 -- docker/pulsar-standalone/Dockerfile | 94 - docker/pulsar-standalone/pom.xml| 100 5 files changed, 200 deletions(-) diff --git a/docker/build.sh b/docker/build.sh index c642d40..d8ab4be 100755 --- a/docker/build.sh +++ b/docker/build.sh @@ -21,5 +21,4 @@ ROOT_DIR=$(git rev-parse --show-toplevel) cd $ROOT_DIR/docker -mvn -f ../dashboard/pom.xml package -Pdocker,-main mvn package -Pdocker,-main diff --git a/docker/pom.xml b/docker/pom.xml index 573c188..1d106d7 100644 --- a/docker/pom.xml +++ b/docker/pom.xml @@ -60,7 +60,6 @@ pulsar grafana pulsar-all -pulsar-standalone diff --git a/docker/publish.sh b/docker/publish.sh index c064286..1df2dd7 100755 --- a/docker/publish.sh +++ b/docker/publish.sh @@ -65,21 +65,17 @@ set -e docker tag pulsar:latest ${docker_registry_org}/pulsar:latest docker tag pulsar-all:latest ${docker_registry_org}/pulsar-all:latest docker tag pulsar-grafana:latest ${docker_registry_org}/pulsar-grafana:latest -docker tag pulsar-standalone:latest ${docker_registry_org}/pulsar-standalone:latest docker tag pulsar:latest ${docker_registry_org}/pulsar:$MVN_VERSION docker tag pulsar-all:latest ${docker_registry_org}/pulsar-all:$MVN_VERSION docker tag pulsar-grafana:latest ${docker_registry_org}/pulsar-grafana:$MVN_VERSION -docker tag pulsar-standalone:latest ${docker_registry_org}/pulsar-standalone:$MVN_VERSION # Push all images and tags docker push ${docker_registry_org}/pulsar:latest docker push ${docker_registry_org}/pulsar-all:latest docker push ${docker_registry_org}/pulsar-grafana:latest -docker push ${docker_registry_org}/pulsar-standalone:latest docker push ${docker_registry_org}/pulsar:$MVN_VERSION docker push ${docker_registry_org}/pulsar-all:$MVN_VERSION docker push ${docker_registry_org}/pulsar-grafana:$MVN_VERSION -docker push ${docker_registry_org}/pulsar-standalone:$MVN_VERSION echo "Finished pushing images to ${docker_registry_org}" diff --git a/docker/pulsar-standalone/Dockerfile b/docker/pulsar-standalone/Dockerfile deleted file mode 100644 index cabbb7d..000 --- a/docker/pulsar-standalone/Dockerfile +++ /dev/null @@ -1,94 +0,0 @@ -# -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, -# software distributed under the License is distributed on an -# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -# KIND, either express or implied. See the License for the -# specific language governing permissions and limitations -# under the License. -# - -# Using files from pulsar-all docker image for pulsar -FROM apachepulsar/pulsar-all:latest as pulsar - -# Using files from pulsar-dashboard for the dashboard -FROM apachepulsar/pulsar-dashboard:latest as dashboard - -# Restart from -FROM ubuntu:20.04 - -ARG DEBIAN_FRONTEND=noninteractive - -# Note that the libpq-dev package is needed here in order to install -# the required python psycopg2 package (for postgresql) later -RUN apt-get update \ -&& apt-get -y install openjdk-11-jdk-headless python3 python3-dev python3-pip postgresql
[pulsar] branch master updated (b80b0be -> 5d136a1)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from b80b0be [Issue 11473] [Python] Fix fields that are ignoring the required key argument (#11508) add 5d136a1 Fixing Debezium integration tests (#11154) No new revisions were added by this update. Summary of changes: ...tibility.yaml => ci-integration-pulsar-io.yaml} | 9 +-- build/run_integration_group.sh | 7 +- .../tests/integration/io/sources/SourceTester.java | 18 + .../debezium/DebeziumPostgreSqlSourceTester.java | 56 ++-- .../debezium/PulsarDebeziumSourcesTest.java| 19 +++--- .../debezium/PulsarIODebeziumSourceRunner.java | 78 -- 6 files changed, 129 insertions(+), 58 deletions(-) copy .github/workflows/{ci-integration-backwards-compatibility.yaml => ci-integration-pulsar-io.yaml} (94%)
[pulsar] branch master updated (5e2c446 -> b80b0be)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 5e2c446 Typo Fix: Capitalization (#11519) add b80b0be [Issue 11473] [Python] Fix fields that are ignoring the required key argument (#11508) No new revisions were added by this update. Summary of changes: .../python/pulsar/schema/definition.py | 9 ++-- pulsar-client-cpp/python/schema_test.py| 26 +- 2 files changed, 32 insertions(+), 3 deletions(-)
[pulsar] branch master updated (1f76d0d -> 5e2c446)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 1f76d0d [websocket] Query parameter "negativeAckRedeliveryDelay" should be effective even if DLQ is disabled (#11495) add 5e2c446 Typo Fix: Capitalization (#11519) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-cgo.md | 2 +- site2/docs/reference-configuration.md | 2 +- .../versioned_docs/version-2.1.0-incubating/client-libraries-go.md | 2 +- .../versioned_docs/version-2.1.0-incubating/reference-configuration.md | 2 +- .../versioned_docs/version-2.1.1-incubating/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.2.0/client-libraries-go.md | 2 +- site2/website/versioned_docs/version-2.2.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.2.1/client-libraries-go.md | 2 +- site2/website/versioned_docs/version-2.2.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.3.0/client-libraries-go.md | 2 +- site2/website/versioned_docs/version-2.3.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.3.1/client-libraries-go.md | 2 +- site2/website/versioned_docs/version-2.3.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.3.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.4.0/client-libraries-go.md | 2 +- site2/website/versioned_docs/version-2.4.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.4.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.4.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.5.0/client-libraries-go.md | 2 +- site2/website/versioned_docs/version-2.5.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.5.1/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.5.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.5.2/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.5.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.0/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.6.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.1/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.6.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.2/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.6.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.3/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.6.3/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.4/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.6.4/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.7.0/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.7.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.7.1/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.7.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.7.2/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.7.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.7.3/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.7.3/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.8.0/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.8.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.8.1/client-libraries-cgo.md | 2 +- site2/website/versioned_docs/version-2.8.1/reference-configuration.md | 2 +- 46 files changed, 46 insertions(+), 46 deletions(-)
[pulsar] branch master updated: [websocket] Query parameter "negativeAckRedeliveryDelay" should be effective even if DLQ is disabled (#11495)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 1f76d0d [websocket] Query parameter "negativeAckRedeliveryDelay" should be effective even if DLQ is disabled (#11495) 1f76d0d is described below commit 1f76d0de94eda94b91648f6235acde6ebd02d43a Author: Masahiro Sakamoto AuthorDate: Wed Aug 4 14:10:38 2021 +0900 [websocket] Query parameter "negativeAckRedeliveryDelay" should be effective even if DLQ is disabled (#11495) ### Motivation On the consumer endpoint of WebSocket API, we can specify the delay time before a message which is negatively acknowledged is redelivered using the query parameter `negativeAckRedeliveryDelay`. However, this parameter is currently ignored when DLQ is disabled. I think this is an implementation mistake. Users should be able to specify `negativeAckRedeliveryDelay` even if DLQ is disabled. https://github.com/apache/pulsar/blob/ee202d06548e3c73d70ad52374658ee3507ca809/pulsar-websocket/src/main/java/org/apache/pulsar/websocket/ConsumerHandler.java#L389-L403 Related PR: https://github.com/apache/pulsar/pull/8249 ### Modifications Fixed `ConsumerHandler` of WebSocket to use the `negativeAckRedeliveryDelay` value specified by the client even if DLQ is disabled. In addition, fixed an inappropriate test code (`ProxyPublishConsumeTest#nackMessageTest()`). --- .../websocket/proxy/ProxyPublishConsumeTest.java | 77 ++ .../websocket/proxy/SimpleProducerSocket.java | 10 ++- .../apache/pulsar/websocket/ConsumerHandler.java | 8 ++- site2/docs/client-libraries-websocket.md | 2 +- 4 files changed, 79 insertions(+), 18 deletions(-) diff --git a/pulsar-broker/src/test/java/org/apache/pulsar/websocket/proxy/ProxyPublishConsumeTest.java b/pulsar-broker/src/test/java/org/apache/pulsar/websocket/proxy/ProxyPublishConsumeTest.java index 2019a9e..941e410 100644 --- a/pulsar-broker/src/test/java/org/apache/pulsar/websocket/proxy/ProxyPublishConsumeTest.java +++ b/pulsar-broker/src/test/java/org/apache/pulsar/websocket/proxy/ProxyPublishConsumeTest.java @@ -38,6 +38,7 @@ import java.util.List; import java.util.Map; import java.util.Map.Entry; import java.util.Optional; +import java.util.UUID; import java.util.concurrent.ExecutorService; import java.util.concurrent.Future; import java.util.concurrent.TimeUnit; @@ -769,11 +770,11 @@ public class ProxyPublishConsumeTest extends ProducerConsumerBase { } } -@Test(timeOut = 1) +@Test(timeOut = 2) public void nackMessageTest() throws Exception { final String subscription = "my-sub"; -final String dlqTopic = "my-property/my-ns/my-topic10"; -final String consumerTopic = "my-property/my-ns/my-topic9"; +final String dlqTopic = "my-property/my-ns/nack-msg-dlq-" + UUID.randomUUID(); +final String consumerTopic = "my-property/my-ns/nack-msg-" + UUID.randomUUID(); final String dlqUri = "ws://localhost:" + proxyServer.getListenPortHTTP().get() + "/ws/v2/consumer/persistent/" + @@ -784,7 +785,7 @@ public class ProxyPublishConsumeTest extends ProducerConsumerBase { "/ws/v2/consumer/persistent/" + consumerTopic + "/" + subscription + "?deadLetterTopic=" + dlqTopic + - "&maxRedeliverCount=0&subscriptionType=Shared&ackTimeoutMillis=1000&negativeAckRedeliveryDelay=1000"; + "&maxRedeliverCount=1&subscriptionType=Shared&negativeAckRedeliveryDelay=1000"; final String producerUri = "ws://localhost:" + proxyServer.getListenPortHTTP().get() + "/ws/v2/producer/persistent/" + consumerTopic; @@ -794,7 +795,7 @@ public class ProxyPublishConsumeTest extends ProducerConsumerBase { WebSocketClient consumeClient2 = new WebSocketClient(); SimpleConsumerSocket consumeSocket2 = new SimpleConsumerSocket(); WebSocketClient produceClient = new WebSocketClient(); -SimpleProducerSocket produceSocket = new SimpleProducerSocket(); +SimpleProducerSocket produceSocket = new SimpleProducerSocket(0); consumeSocket1.setMessageHandler((id, data) -> { JsonObject nack = new JsonObject(); @@ -824,18 +825,70 @@ public class ProxyPublishConsumeTest extends ProducerConsumerBase { produceSocket.sendMessage(1); -Thread.sleep(500); +// Main topic +Awaitility.await().atMost(5, TimeUnit.SECONDS) +.untilAsserted(() -> assertEquals(consumeSocket1.getReceivedMessagesCount(), 2)); -
[pulsar] branch master updated: fix required params to set-retention (#11319)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 292f9e0 fix required params to set-retention (#11319) 292f9e0 is described below commit 292f9e0fcd2aeab04082d245b49de1fad172643c Author: é”幻之翼 AuthorDate: Wed Aug 4 13:08:14 2021 +0800 fix required params to set-retention (#11319) Missing keyword namespaces,Result in failure to execute --- site2/docs/admin-api-namespaces.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/site2/docs/admin-api-namespaces.md b/site2/docs/admin-api-namespaces.md index 3e0e9a5..8a2faeb 100644 --- a/site2/docs/admin-api-namespaces.md +++ b/site2/docs/admin-api-namespaces.md @@ -582,7 +582,7 @@ Each namespace contains multiple topics and the retention size (storage size) of ``` -$ pulsar-admin set-retention --size 100 --time 10 test-tenant/ns1 +$ pulsar-admin namespaces set-retention --size 100 --time 10 test-tenant/ns1 ``` ```
[pulsar] branch master updated (ded806f -> 27ecd41)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from ded806f [Broker] Fix set-publish-rate when using preciseTopicPublishRateLimiterEnable=true (#10384) add 27ecd41 Make getTopicPoliciesAsyncWithRetry as a default method (#11518) No new revisions were added by this update. Summary of changes: .../apache/pulsar/broker/admin/AdminResource.java | 45 ++ .../SystemTopicBasedTopicPoliciesService.java | 7 ++-- .../broker/service/TopicPoliciesService.java | 36 + .../SystemTopicBasedTopicPoliciesServiceTest.java | 40 ++- 4 files changed, 75 insertions(+), 53 deletions(-)
[pulsar] branch master updated: [Broker] Fix set-publish-rate when using preciseTopicPublishRateLimiterEnable=true (#10384)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new ded806f [Broker] Fix set-publish-rate when using preciseTopicPublishRateLimiterEnable=true (#10384) ded806f is described below commit ded806fd52f6e2f182fa02052cbd82c2a6755098 Author: Lari Hotari AuthorDate: Tue Aug 3 19:14:26 2021 +0300 [Broker] Fix set-publish-rate when using preciseTopicPublishRateLimiterEnable=true (#10384) ### Motivation When using `preciseTopicPublishRateLimiterEnable=true` (introduced by #7078) setting for rate limiting, there are various issues: - updating the limits doesn't set either boundary when changing the limits from a bounded limit to unbounded. - each topic will create a scheduler thread for each limiter instance - each topic will never release the scheduler thread when the topic gets unloaded / closed - updating the limits didn't close the scheduler thread related to the replaced limiter instance ### Modifications - Fix updating of the limits by cleaning up the previous limiter instances before creating new limiter instances - Use `brokerService.pulsar().getExecutor()` as the scheduler for the rate limiter instances - Add resource cleanup hooks for topic closing (unload) ### Open issue The existing code has a difference in passing the `rateLimitFunction`: https://github.com/apache/pulsar/blob/69a173a82c89893f54dbe5b6f422249f66ea5418/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java#L80-L86 It's passed to the `topicPublishRateLimiterOnMessage`, but not to `topicPublishRateLimiterOnByte` . It is unclear whether this is intentional. The `rateLimitFunction` is `() -> this.enableCnxAutoRead()` https://github.com/apache/pulsar/blob/69a173a82c89893f54dbe5b6f422249f66ea5418/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractTopic.java#L913 (This also raises a question whether rate limiting works consistently when multiple topics share the same connection.) --- .../pulsar/broker/service/AbstractTopic.java | 2 +- .../broker/service/PrecisPublishLimiter.java | 113 +++-- .../pulsar/broker/service/PublishRateLimiter.java | 2 +- .../broker/service/PublishRateLimiterDisable.java | 4 + .../broker/service/PublishRateLimiterImpl.java | 5 + .../service/nonpersistent/NonPersistentTopic.java | 7 ++ .../broker/service/persistent/PersistentTopic.java | 7 ++ .../service/persistent/SubscribeRateLimiter.java | 2 +- .../broker/service/PrecisPublishLimiterTest.java | 57 +++ .../org/apache/pulsar/common/util/RateLimiter.java | 29 +- .../instance/stats/FunctionStatsManager.java | 14 +-- .../functions/instance/stats/SinkStatsManager.java | 4 +- .../instance/stats/SourceStatsManager.java | 4 +- 13 files changed, 201 insertions(+), 49 deletions(-) diff --git a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractTopic.java b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractTopic.java index bb66308..d388d51 100644 --- a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractTopic.java +++ b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/AbstractTopic.java @@ -929,7 +929,7 @@ public abstract class AbstractTopic implements Topic { // create new rateLimiter if rate-limiter is disabled if (preciseTopicPublishRateLimitingEnable) { this.topicPublishRateLimiter = new PrecisPublishLimiter(publishRate, -() -> this.enableCnxAutoRead()); +() -> this.enableCnxAutoRead(), brokerService.pulsar().getExecutor()); } else { this.topicPublishRateLimiter = new PublishRateLimiterImpl(publishRate); } diff --git a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java index 60fbcf0..e61597e 100644 --- a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java +++ b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java @@ -18,7 +18,7 @@ */ package org.apache.pulsar.broker.service; -import java.util.concurrent.TimeUnit; +import java.util.concurrent.ScheduledExecutorService; import org.apache.pulsar.common.policies.data.Policies; import org.apache.pulsar.common.policies.data.PublishRate; import org.apache.pulsar.common.util.RateLimitFunction; @@ -27,30 +27,37 @@ import org.apache.pulsar.common.util.RateLimiter; public class PrecisPublishLimiter imple
[pulsar] branch master updated (720214c -> 7f2ca8f)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 720214c [Go Functions] Upgrade go client version to 0.6.0 (#11477) add 7f2ca8f [Issue #11351] Parallel Precise Publish Rate Limiting Fix (#11372) No new revisions were added by this update. Summary of changes: .../pulsar/broker/service/PrecisPublishLimiter.java | 16 +--- .../java/org/apache/pulsar/common/util/RateLimiter.java | 6 +++--- 2 files changed, 16 insertions(+), 6 deletions(-)
[pulsar] branch master updated (41c202d -> 719c40d)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 41c202d [website][pulsar]: auto generate docs for pulsar subcommand: initialize-namespace (#11359) add 719c40d [website][pulsar]: auto generate docs for pulsar subcommand: version (#11363) No new revisions were added by this update. Summary of changes: .../org/apache/pulsar/PulsarVersionStarter.java| 31 ++ ...downTest.java => PulsarVersionStarterTest.java} | 6 ++--- 2 files changed, 34 insertions(+), 3 deletions(-) copy pulsar-broker/src/test/java/org/apache/pulsar/{PulsarClusterMetadataTeardownTest.java => PulsarVersionStarterTest.java} (90%)
[pulsar] branch master updated (afe4792 -> 41c202d)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from afe4792 [Issue 11440]. Add complete metadata for admin.topics().examineMessages (#11443) add 41c202d [website][pulsar]: auto generate docs for pulsar subcommand: initialize-namespace (#11359) No new revisions were added by this update. Summary of changes: .../main/java/org/apache/pulsar/PulsarInitialNamespaceSetup.java | 9 + ...ataTeardownTest.java => PulsarInitialNamespaceSetupTest.java} | 6 +++--- 2 files changed, 12 insertions(+), 3 deletions(-) copy pulsar-broker/src/test/java/org/apache/pulsar/{PulsarClusterMetadataTeardownTest.java => PulsarInitialNamespaceSetupTest.java} (90%)
[pulsar] branch master updated: [Issue 11440]. Add complete metadata for admin.topics().examineMessages (#11443)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new afe4792 [Issue 11440]. Add complete metadata for admin.topics().examineMessages (#11443) afe4792 is described below commit afe47926b904033c304256d96ade5e6214c51bbd Author: Jason918 AuthorDate: Thu Jul 29 11:41:07 2021 +0800 [Issue 11440]. Add complete metadata for admin.topics().examineMessages (#11443) Fixes #11440 ### Motivation see issue 11440 ### Modifications Add all the other non-empty meta data fields in http response headers in `org.apache.pulsar.broker.admin.impl.PersistentTopicsBase#generateResponseWithEntry`. For fields with byte[] type, base64 is used for serialization and deserialization. --- .../broker/admin/impl/PersistentTopicsBase.java| 73 .../pulsar/broker/admin/PersistentTopicsTest.java | 45 +++- .../pulsar/client/admin/internal/TopicsImpl.java | 125 - site2/docs/admin-api-topics.md | 24 4 files changed, 265 insertions(+), 2 deletions(-) diff --git a/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java b/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java index 8aa92e0..e372ba8 100644 --- a/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java +++ b/pulsar-broker/src/main/java/org/apache/pulsar/broker/admin/impl/PersistentTopicsBase.java @@ -29,6 +29,7 @@ import com.google.common.collect.Sets; import io.netty.buffer.ByteBuf; import java.io.IOException; import java.util.ArrayList; +import java.util.Base64; import java.util.HashMap; import java.util.List; import java.util.Map; @@ -94,6 +95,7 @@ import org.apache.pulsar.common.allocator.PulsarByteBufAllocator; import org.apache.pulsar.common.api.proto.BrokerEntryMetadata; import org.apache.pulsar.common.api.proto.CommandSubscribe.InitialPosition; import org.apache.pulsar.common.api.proto.CommandSubscribe.SubType; +import org.apache.pulsar.common.api.proto.EncryptionKeys; import org.apache.pulsar.common.api.proto.KeyValue; import org.apache.pulsar.common.api.proto.MessageMetadata; import org.apache.pulsar.common.compression.CompressionCodec; @@ -2571,6 +2573,77 @@ public class PersistentTopicsBase extends AdminResource { } responseBuilder.header("X-Pulsar-Is-Encrypted", metadata.getEncryptionKeysCount() > 0); +if (metadata.hasProducerName()) { +responseBuilder.header("X-Pulsar-producer-name", metadata.getProducerName()); +} +if (metadata.hasSequenceId()) { +responseBuilder.header("X-Pulsar-sequence-id", metadata.getSequenceId()); +} +if (metadata.hasReplicatedFrom()) { +responseBuilder.header("X-Pulsar-replicated-from", metadata.getReplicatedFrom()); +} +for (String replicatedTo : metadata.getReplicateTosList()) { +responseBuilder.header("X-Pulsar-replicated-to", replicatedTo); +} +if (metadata.hasPartitionKey()) { +responseBuilder.header("X-Pulsar-partition-key", metadata.getPartitionKey()); +} +if (metadata.hasCompression()) { +responseBuilder.header("X-Pulsar-compression", metadata.getCompression()); +} +if (metadata.hasUncompressedSize()) { +responseBuilder.header("X-Pulsar-uncompressed-size", metadata.getUncompressedSize()); +} +if (metadata.hasEncryptionAlgo()) { +responseBuilder.header("X-Pulsar-encryption-algo", metadata.getEncryptionAlgo()); +} +for (EncryptionKeys encryptionKeys : metadata.getEncryptionKeysList()) { +responseBuilder.header("X-Pulsar-Base64-encryption-keys", + Base64.getEncoder().encodeToString(encryptionKeys.toByteArray())); +} +if (metadata.hasEncryptionParam()) { +responseBuilder.header("X-Pulsar-Base64-encryption-param", + Base64.getEncoder().encodeToString(metadata.getEncryptionParam())); +} +if (metadata.hasSchemaVersion()) { +responseBuilder.header("X-Pulsar-Base64-schema-version", + Base64.getEncoder().encodeToString(metadata.getSchemaVersion())); +} +if (metadata.hasPartitionKeyB64Encoded()) { +responseBuilder.header("X-Pulsar-partition-key-b64-encoded", metadata.isPartitionKeyB64Encoded()); +} +if (metadata.hasOrderingKey()) { +responseBuilder.header("X-Pulsar-Base64-ordering-key", + Base64.getEncoder(
[pulsar] branch master updated (cc6c62f -> 2cefbcc)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from cc6c62f Remove unsupport command description in doc (#11479) add 2cefbcc [pulsar-io] fix source stats exposing empty exceptions list (#11478) No new revisions were added by this update. Summary of changes: .../apache/pulsar/functions/instance/stats/SourceStatsManager.java| 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[pulsar] branch master updated (0ed823d -> cc6c62f)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 0ed823d [website][pulsar]: auto generate docs for pulsar subcommand: delete-cluster-metadata (#11328) add cc6c62f Remove unsupport command description in doc (#11479) No new revisions were added by this update. Summary of changes: site2/docs/deploy-bare-metal.md| 10 ++ .../website/versioned_docs/version-2.8.0/deploy-bare-metal.md | 10 ++ .../website/versioned_docs/version-2.8.1/deploy-bare-metal.md | 10 ++ 3 files changed, 6 insertions(+), 24 deletions(-)
[pulsar] branch master updated (00ad07d -> d3c44ba)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 00ad07d [issue #13351] Solving precise rate limiting does not takes effect (#11446) add d3c44ba [stats] Do not expose meaningless stats for publisher (#11454) No new revisions were added by this update. Summary of changes: .../pulsar/broker/stats/ConsumerStatsTest.java | 13 ++--- .../policies/data/stats/PublisherStatsImpl.java| 11 .../common/policies/data/stats/TopicStatsImpl.java | 2 ++ .../common/policies/data/PublisherStatsTest.java | 32 +- site2/docs/getting-started-docker.md | 18 5 files changed, 53 insertions(+), 23 deletions(-)
[pulsar] branch master updated: [issue #13351] Solving precise rate limiting does not takes effect (#11446)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 00ad07d [issue #13351] Solving precise rate limiting does not takes effect (#11446) 00ad07d is described below commit 00ad07d7fdad5dadc378235a2f5e7edd354d8ff7 Author: Daniel Sinai <51213812+danielsi...@users.noreply.github.com> AuthorDate: Wed Jul 28 10:32:03 2021 +0300 [issue #13351] Solving precise rate limiting does not takes effect (#11446) ![image](https://user-images.githubusercontent.com/51213812/126812923-91bb827c-246d-451d-8f25-343bb2c1dca0.png) befoe this PR precise publish rate limiting wasn't taking effect at all ### Modifications In order to solve the current problems, there are 2 modifications 1. Using IsDispatchRateLimiting in precise publish rate limiter as well (in order to starve the producer) 2. Checking if there are available permits before resetting the read from the connection again ### Verifying this change Already covered by current tests. --- .../broker/service/PrecisPublishLimiter.java | 4 +- .../broker/service/PublishRateLimiterDisable.java | 2 +- .../broker/service/PublishRateLimiterTest.java | 65 +++--- .../org/apache/pulsar/common/util/RateLimiter.java | 29 +++--- 4 files changed, 83 insertions(+), 17 deletions(-) diff --git a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java index 4db6bf2..e981518 100644 --- a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java +++ b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PrecisPublishLimiter.java @@ -79,10 +79,10 @@ public class PrecisPublishLimiter implements PublishRateLimiter { this.publishMaxByteRate = Math.max(maxPublishRate.publishThrottlingRateInByte, 0); if (this.publishMaxMessageRate > 0) { topicPublishRateLimiterOnMessage = -new RateLimiter(publishMaxMessageRate, 1, TimeUnit.SECONDS, rateLimitFunction); +new RateLimiter(publishMaxMessageRate, 1, TimeUnit.SECONDS, rateLimitFunction, true); } if (this.publishMaxByteRate > 0) { -topicPublishRateLimiterOnByte = new RateLimiter(publishMaxByteRate, 1, TimeUnit.SECONDS); +topicPublishRateLimiterOnByte = new RateLimiter(publishMaxByteRate, 1, TimeUnit.SECONDS, true); } } else { this.publishMaxMessageRate = 0; diff --git a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PublishRateLimiterDisable.java b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PublishRateLimiterDisable.java index 0ff3866..c72f6ba 100644 --- a/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PublishRateLimiterDisable.java +++ b/pulsar-broker/src/main/java/org/apache/pulsar/broker/service/PublishRateLimiterDisable.java @@ -59,7 +59,7 @@ public class PublishRateLimiterDisable implements PublishRateLimiter { @Override public boolean tryAcquire(int numbers, long bytes) { // No-op -return false; +return true; } } diff --git a/pulsar-broker/src/test/java/org/apache/pulsar/broker/service/PublishRateLimiterTest.java b/pulsar-broker/src/test/java/org/apache/pulsar/broker/service/PublishRateLimiterTest.java index b820c60..9131d51 100644 --- a/pulsar-broker/src/test/java/org/apache/pulsar/broker/service/PublishRateLimiterTest.java +++ b/pulsar-broker/src/test/java/org/apache/pulsar/broker/service/PublishRateLimiterTest.java @@ -20,10 +20,19 @@ package org.apache.pulsar.broker.service; import org.apache.pulsar.common.policies.data.Policies; import org.apache.pulsar.common.policies.data.PublishRate; +import org.apache.pulsar.common.stats.Rate; +import org.apache.pulsar.common.util.RateLimitFunction; +import org.apache.pulsar.common.util.RateLimiter; +import org.apache.pulsar.utils.StatsOutputStream; import org.testng.annotations.BeforeMethod; import org.testng.annotations.Test; +import java.lang.reflect.Constructor; +import java.lang.reflect.Field; +import java.lang.reflect.Method; import java.util.HashMap; +import java.util.concurrent.ScheduledExecutorService; +import java.util.concurrent.ScheduledFuture; import static org.testng.Assert.assertFalse; import static org.testng.Assert.assertTrue; @@ -38,13 +47,12 @@ public class PublishRateLimiterTest { private PrecisPublishLimiter precisPublishLimiter; private PublishRateLimiterImpl publishRateLimiter; - @BeforeMethod public void setup() throws Exception { policies.publishMaxMessageR
[pulsar] branch master updated: add instance and fqn into log message properties (#11399)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new b6d02e4 add instance and fqn into log message properties (#11399) b6d02e4 is described below commit b6d02e46b753bc2b321a5da8feca0ab7695c3a56 Author: Neng Lu AuthorDate: Mon Jul 26 15:33:54 2021 -0700 add instance and fqn into log message properties (#11399) ### Motivation Enrich the published log message with `instanceId` and `fqn` set in properties. ### Modifications add `instanceId` and `fqn` into log message properties --- .../org/apache/pulsar/functions/instance/JavaInstanceRunnable.java | 3 ++- .../main/java/org/apache/pulsar/functions/instance/LogAppender.java | 6 +- 2 files changed, 7 insertions(+), 2 deletions(-) diff --git a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java index e36dd26..3d79c2b 100644 --- a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java +++ b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/JavaInstanceRunnable.java @@ -574,7 +574,8 @@ public class JavaInstanceRunnable implements AutoCloseable, Runnable { // to prevent "SSE4.2 CRC32C provider initialized" appearing in log topic new Crc32cIntChecksum(); logAppender = new LogAppender(client, instanceConfig.getFunctionDetails().getLogTopic(), - FunctionCommon.getFullyQualifiedName(instanceConfig.getFunctionDetails())); + FunctionCommon.getFullyQualifiedName(instanceConfig.getFunctionDetails()), +instanceConfig.getInstanceName()); logAppender.start(); setupLogTopicAppender(LoggerContext.getContext()); } diff --git a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/LogAppender.java b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/LogAppender.java index e0a4c95..20354d4 100644 --- a/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/LogAppender.java +++ b/pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/LogAppender.java @@ -38,14 +38,16 @@ public class LogAppender implements Appender { private PulsarClient pulsarClient; private String logTopic; private String fqn; +private String instance; private State state; private ErrorHandler errorHandler; private Producer producer; -public LogAppender(PulsarClient pulsarClient, String logTopic, String fqn) { +public LogAppender(PulsarClient pulsarClient, String logTopic, String fqn, String instance) { this.pulsarClient = pulsarClient; this.logTopic = logTopic; this.fqn = fqn; +this.instance = instance; } @Override @@ -53,6 +55,8 @@ public class LogAppender implements Appender { producer.newMessage() .value(logEvent.getMessage().getFormattedMessage().getBytes(StandardCharsets.UTF_8)) .property("loglevel", logEvent.getLevel().name()) +.property("instance", instance) +.property("fqn", fqn) .sendAsync(); }
[pulsar] branch master updated (a60c189 -> 2511133)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from a60c189 [Issue 11339] Pulsar Admin List Subscription lists only subscriptions created for Partition-0 when partition specific subscriptions are created (#11355) add 2511133 [Elasticsearch-sink] support multi Elasticsearch hosts (#10973) No new revisions were added by this update. Summary of changes: .../pulsar/io/elasticsearch/ElasticSearchSink.java | 32 ++ .../io/elasticsearch/ElasticSearchSinkTests.java | 17 2 files changed, 38 insertions(+), 11 deletions(-)
[pulsar] branch master updated (8b1d937 -> a60c189)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 8b1d937 swap getTopicReference(topic).isPresent() with serviceUnit.includes(topicName) to reduce calling getTopicReference (#11405) add a60c189 [Issue 11339] Pulsar Admin List Subscription lists only subscriptions created for Partition-0 when partition specific subscriptions are created (#11355) No new revisions were added by this update. Summary of changes: .../broker/admin/impl/PersistentTopicsBase.java| 87 +++--- .../pulsar/broker/admin/PersistentTopicsTest.java | 22 +- 2 files changed, 82 insertions(+), 27 deletions(-)
[pulsar] branch master updated (5819242 -> 8b1d937)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 5819242 Reduce the probability of cache inconsistencies (#11423) add 8b1d937 swap getTopicReference(topic).isPresent() with serviceUnit.includes(topicName) to reduce calling getTopicReference (#11405) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/pulsar/broker/service/BrokerService.java | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[pulsar] branch master updated (cba4ea9 -> 5819242)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from cba4ea9 Update Minikube link (#11439) add 5819242 Reduce the probability of cache inconsistencies (#11423) No new revisions were added by this update. Summary of changes: .../functions/worker/FunctionMetaDataManager.java | 33 --- .../worker/FunctionMetaDataManagerTest.java| 49 +- 2 files changed, 74 insertions(+), 8 deletions(-)
[pulsar] branch master updated (b3892ee -> cba4ea9)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from b3892ee make KafkaSourceRecord ack() async to avoid deadlock (#11435) add cba4ea9 Update Minikube link (#11439) No new revisions were added by this update. Summary of changes: site2/docs/getting-started-helm.md | 2 +- .../versioned_docs/version-2.1.0-incubating/deploy-kubernetes.md| 2 +- site2/website/versioned_docs/version-2.5.0/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.6.0/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.6.1/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.6.2/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.6.3/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.6.4/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.7.0/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.7.1/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.7.2/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.7.3/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.8.0/getting-started-helm.md | 2 +- site2/website/versioned_docs/version-2.8.1/getting-started-helm.md | 2 +- 14 files changed, 14 insertions(+), 14 deletions(-)
[pulsar] branch master updated: make KafkaSourceRecord ack() async to avoid deadlock (#11435)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new b3892ee make KafkaSourceRecord ack() async to avoid deadlock (#11435) b3892ee is described below commit b3892ee96945b93190d9d2b20e70cbec7382fcde Author: Neng Lu AuthorDate: Fri Jul 23 13:13:36 2021 -0700 make KafkaSourceRecord ack() async to avoid deadlock (#11435) ### Motivation The `ack()` method of the `AbstractKafkaSourceRecord` should be non-blocking. Otherwise there'll be deadlock for pulsar-client-io thread and the main `public/default/debezium-mongodb-source-0` thread. And further blocks the whole debezium connector to work correctly. ### Modifications 1. remove the blocking `future.get()` call from `ack()` 2. move the commit logic into callbacks --- .../kafka/connect/AbstractKafkaConnectSource.java | 43 +++--- .../io/kafka/connect/PulsarOffsetBackingStore.java | 8 ++-- 2 files changed, 24 insertions(+), 27 deletions(-) diff --git a/pulsar-io/kafka-connect-adaptor/src/main/java/org/apache/pulsar/io/kafka/connect/AbstractKafkaConnectSource.java b/pulsar-io/kafka-connect-adaptor/src/main/java/org/apache/pulsar/io/kafka/connect/AbstractKafkaConnectSource.java index 987f6f6..3901c5f 100644 --- a/pulsar-io/kafka-connect-adaptor/src/main/java/org/apache/pulsar/io/kafka/connect/AbstractKafkaConnectSource.java +++ b/pulsar-io/kafka-connect-adaptor/src/main/java/org/apache/pulsar/io/kafka/connect/AbstractKafkaConnectSource.java @@ -163,9 +163,15 @@ public abstract class AbstractKafkaConnectSource implements Source { } else { // there is no records any more, then waiting for the batch to complete writing // to sink and the offsets are committed as well, then do next round read. -flushFuture.get(); -flushFuture = null; -currentBatch = null; +try { +flushFuture.get(); +} catch (ExecutionException ex) { +// log the error, continue execution +log.error("execution exception while get flushFuture", ex); +} finally { +flushFuture = null; +currentBatch = null; +} } } } @@ -181,7 +187,7 @@ public abstract class AbstractKafkaConnectSource implements Source { private static Map PROPERTIES = Collections.emptyMap(); private static Optional RECORD_SEQUENCE = Optional.empty(); -private static long FLUSH_TIMEOUT_MS = 2000; +private static long FLUSH_TIMEOUT_MS = 6; public abstract class AbstractKafkaSourceRecord implements Record { @Getter @@ -234,9 +240,17 @@ public abstract class AbstractKafkaConnectSource implements Source { offsetWriter.cancelFlush(); flushFuture.completeExceptionally(new Exception("No Offsets Added Error")); } else { -log.trace("Finished flushing offsets to storage"); -currentBatch = null; -flushFuture.complete(null); +try { +sourceTask.commit(); + +log.info("Finished flushing offsets to storage"); +currentBatch = null; +flushFuture.complete(null); +} catch (InterruptedException exception) { +log.warn("Flush of {} offsets interrupted, cancelling", this); +offsetWriter.cancelFlush(); +flushFuture.completeExceptionally(new Exception("Failed to commit offsets")); +} } } @@ -261,21 +275,6 @@ public abstract class AbstractKafkaConnectSource implements Source { flushFuture.completeExceptionally(new Exception("No Offsets Added Error")); return; } - -// Wait until the offsets are flushed -try { -doFlush.get(FLUSH_TIMEOUT_MS, TimeUnit.MILLISECONDS); -sourceTask.commit(); -} catch (InterruptedException e) { -log.warn("Flush of {} offsets interrupted, cancelling", this); -offsetWriter.cancelFlush(); -} catch (ExecutionException e) { -log.error("Flush of {} offsets threw an unexpected exception: ", this, e); -offsetWriter.cancelFlush(); -} catch (TimeoutException e) { -log.error("Timed out waiting to flush {} offsets to storage", this); -offsetWriter.cancelFlush
[pulsar] branch master updated (1fb5b47 -> 4f1bc77)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 1fb5b47 make java code sample match the actual API (#11398) add 4f1bc77 Flaky-test: NamespacesTest.testSubscribeRate (#11394) No new revisions were added by this update. Summary of changes: .../test/java/org/apache/pulsar/broker/admin/NamespacesTest.java| 6 -- 1 file changed, 4 insertions(+), 2 deletions(-)
[pulsar] branch master updated (dbf3138 -> 1fb5b47)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from dbf3138 [Issue 11340] Fix concurrency issues in NarUnpacker (#11343) add 1fb5b47 make java code sample match the actual API (#11398) No new revisions were added by this update. Summary of changes: site2/docs/security-oauth2.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
[pulsar] branch master updated (01a78ae -> dbf3138)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 01a78ae Fix flaky-test testBlockByPublishRateLimiting (#11424) add dbf3138 [Issue 11340] Fix concurrency issues in NarUnpacker (#11343) No new revisions were added by this update. Summary of changes: .../org/apache/pulsar/common/nar/NarUnpacker.java | 80 ++- .../apache/pulsar/common/nar/NarUnpackerTest.java | 160 + 2 files changed, 207 insertions(+), 33 deletions(-) create mode 100644 pulsar-common/src/test/java/org/apache/pulsar/common/nar/NarUnpackerTest.java
[pulsar] branch master updated (a78b029 -> 9a66cbf)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from a78b029 [Issue 11007] add a version of AUTO_PRODUCE_BYTES that doesn't validate the message in `encode` (#11238) add 9a66cbf fix flaky test testUpdateDynamicLocalConfiguration (#5) No new revisions were added by this update. Summary of changes: .../test/java/org/apache/pulsar/broker/admin/AdminApiTest.java| 8 1 file changed, 4 insertions(+), 4 deletions(-)
[pulsar] branch master updated (4d3fdae -> a78b029)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 4d3fdae Avoid infinite waiting for consumer close (#11347) add a78b029 [Issue 11007] add a version of AUTO_PRODUCE_BYTES that doesn't validate the message in `encode` (#11238) No new revisions were added by this update. Summary of changes: .../client/api/SimpleProducerConsumerTest.java | 46 ++ .../apache/pulsar/client/api/SimpleSchemaTest.java | 180 + .../java/org/apache/pulsar/schema/SchemaTest.java | 11 ++ .../java/org/apache/pulsar/client/api/Schema.java | 12 ++ .../client/internal/DefaultImplementation.java | 7 + .../client/impl/schema/NativeAvroBytesSchema.java | 101 6 files changed, 357 insertions(+) create mode 100644 pulsar-client/src/main/java/org/apache/pulsar/client/impl/schema/NativeAvroBytesSchema.java
[pulsar] branch master updated (b72635d -> 4d3fdae)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from b72635d [pulsar-doc] Document pulsar-kafka adapter encryption support (#11317) add 4d3fdae Avoid infinite waiting for consumer close (#11347) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/pulsar/client/impl/ConsumerImpl.java | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
[pulsar] branch master updated (2b0073b -> b72635d)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2b0073b feat: auto generate docs for pulsar subcommand proxy (#11361) add b72635d [pulsar-doc] Document pulsar-kafka adapter encryption support (#11317) No new revisions were added by this update. Summary of changes: site2/docs/adaptors-kafka.md | 2 ++ 1 file changed, 2 insertions(+)
[pulsar] branch master updated (87e2758 -> 2b0073b)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 87e2758 Generate documentation of ServiceDiscovery automatically (#11369) add 2b0073b feat: auto generate docs for pulsar subcommand proxy (#11361) No new revisions were added by this update. Summary of changes: .../org/apache/pulsar/proxy/server/ProxyServiceStarter.java | 11 +++ 1 file changed, 11 insertions(+)
[pulsar] branch master updated (af213c2 -> 87e2758)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from af213c2 [Tests] Reduce integration test memory usage in CI (#11414) add 87e2758 Generate documentation of ServiceDiscovery automatically (#11369) No new revisions were added by this update. Summary of changes: .../pulsar/broker/BaseGenerateDocumentation.java | 48 +++-- .../pulsar/utils/CmdGenerateDocumentation.java | 82 + .../discovery/service/server/ServiceConfig.java| 196 + .../service/util/CmdGenerateDocumentation.java | 45 + .../apache/pulsar/discovery/service}/CmdTest.java | 18 +- 5 files changed, 245 insertions(+), 144 deletions(-) copy pulsar-broker/src/main/java/org/apache/pulsar/utils/CmdGenerateDocumentation.java => pulsar-broker-common/src/main/java/org/apache/pulsar/broker/BaseGenerateDocumentation.java (71%) create mode 100644 pulsar-discovery-service/src/main/java/org/apache/pulsar/discovery/service/util/CmdGenerateDocumentation.java copy {pulsar-broker/src/test/java/org/apache/pulsar/utils => pulsar-discovery-service/src/test/java/org/apache/pulsar/discovery/service}/CmdTest.java (82%)
[pulsar] branch master updated: [Tests] Reduce integration test memory usage in CI (#11414)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new af213c2 [Tests] Reduce integration test memory usage in CI (#11414) af213c2 is described below commit af213c23954f465d289e7cc0bf8e6da010f05a46 Author: Lari Hotari AuthorDate: Thu Jul 22 03:37:10 2021 +0300 [Tests] Reduce integration test memory usage in CI (#11414) ### Motivation There are several integration test jobs failing where the docker container run by Testcontainers gets terminated with error code 137 (maps to out of memory error). The failing jobs are: CI - Integration - Sql - https://github.com/apache/pulsar/actions/workflows/ci-integration-sql.yaml (most fail) CI - Integration - Process - https://github.com/apache/pulsar/actions/workflows/ci-integration-process.yaml (some succeed) CI - Integration - Messaging - https://github.com/apache/pulsar/actions/workflows/ci-integration-messaging.yaml (some succeed) CI - Integration - Function & IO - https://github.com/apache/pulsar/actions/workflows/ci-integration-function.yaml (some succeed) This started happening yesterday for most PR builds. For example: https://github.com/apache/pulsar/runs/3111868662?check_suite_focus=true#step:14:1024 ``` Error: Tests run: 22, Failures: 1, Errors: 0, Skipped: 21, Time elapsed: 292.035 s <<< FAILURE! - in TestSuite Error: testPythonWordCountFunction(org.apache.pulsar.tests.integration.functions.PulsarStateTest) Time elapsed: 43.416 s <<< FAILURE! org.apache.pulsar.tests.integration.docker.ContainerExecException: /pulsar/bin/pulsar-admin functions querystate --tenant public --namespace default --name test-wordcount-py-fn-tfhycxsf --key message-1 failed on 705ecb067214d1cc42cd16358df6fa6d7a8cacc6c5ddd0cdde84a73b3e2e1f76 with error code 137 at org.apache.pulsar.tests.integration.utils.DockerUtils$2.onComplete(DockerUtils.java:248) at org.testcontainers.shaded.com.github.dockerjava.core.exec.AbstrAsyncDockerCmdExec$1.onComplete(AbstrAsyncDockerCmdExec.java:51) at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$executeAndStream$1(DefaultInvocationBuilder.java:276) at java.base/java.lang.Thread.run(Thread.java:829) ``` It seems that GitHub Actions Runner VM has increased memory consumption after[ the most recent updates](https://github.com/actions/virtual-environments/blob/releases/ubuntu20/20210718/images/linux/Ubuntu2004-README.md). ### Modifications - Reduce Presto maximum heap size in integration tests - Reduce standalone container memory usage - Stop some system services to save RAM - Redcue memory usage of the integration tests surefire JVM --- .github/actions/tune-runner-vm/action.yml | 25 +- .github/workflows/ci-cpp.yaml | 4 +-- .../ci-integration-backwards-compatibility.yaml| 5 ++-- .github/workflows/ci-integration-cli.yaml | 3 +-- .github/workflows/ci-integration-function.yaml | 5 ++-- .github/workflows/ci-integration-messaging.yaml| 5 ++-- .github/workflows/ci-integration-process.yaml | 10 +--- .github/workflows/ci-integration-schema.yaml | 5 ++-- .github/workflows/ci-integration-sql.yaml | 13 +++--- .github/workflows/ci-integration-standalone.yaml | 5 ++-- .github/workflows/ci-integration-thread.yaml | 5 ++-- .../ci-integration-tiered-filesystem.yaml | 5 ++-- .../workflows/ci-integration-tiered-jcloud.yaml| 5 ++-- .github/workflows/ci-integration-transaction.yaml | 5 ++-- .github/workflows/ci-pulsar-website-build.yaml | 5 ++-- .github/workflows/ci-shade-test.yaml | 3 +-- .../docker-images/latest-version-image/Dockerfile | 2 ++ .../latest-version-image/conf/presto/jvm.config| 30 ++ tests/integration/pom.xml | 2 +- .../integration/containers/ChaosContainer.java | 6 + .../integration/containers/PulsarContainer.java| 1 + .../containers/StandaloneContainer.java| 1 + 22 files changed, 104 insertions(+), 46 deletions(-) diff --git a/.github/actions/tune-runner-vm/action.yml b/.github/actions/tune-runner-vm/action.yml index ec5599a..30cf183 100644 --- a/.github/actions/tune-runner-vm/action.yml +++ b/.github/actions/tune-runner-vm/action.yml @@ -32,6 +32,10 @@ runs: # consumption is high. # Set vm.swappiness=1 to avoid swapping and allow high RAM usage echo 1 | sudo tee /proc/sys/vm/swappiness +# Set swappiness to 1 for all cgroups and sub-groups +for swappiness_file in /sys/fs/cgroup/memory/*/memory.swappiness
[pulsar] branch master updated: [python functions] fix tls_validate_hostname is not supported in python functions runtime (#11087)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new a14f1c5 [python functions] fix tls_validate_hostname is not supported in python functions runtime (#11087) a14f1c5 is described below commit a14f1c5940fe656348b6d7d326596358f43dcbc9 Author: Rui Fu AuthorDate: Tue Jul 20 11:13:39 2021 +0800 [python functions] fix tls_validate_hostname is not supported in python functions runtime (#11087) ### Motivation Pulsar's python client support define TLS parameters, like `tls_validate_hostname`, but in python functions runtime, it is not been set properly. ### Modifications - get `hostname_verification_enabled` from python instance arguments - pass `hostname_verification_enabled` to pulsar client ### Verifying this change - [x] Make sure that the change passes the CI checks. --- pulsar-functions/instance/src/main/python/python_instance_main.py | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/pulsar-functions/instance/src/main/python/python_instance_main.py b/pulsar-functions/instance/src/main/python/python_instance_main.py index 322d728..6270134 100644 --- a/pulsar-functions/instance/src/main/python/python_instance_main.py +++ b/pulsar-functions/instance/src/main/python/python_instance_main.py @@ -150,6 +150,7 @@ def main(): use_tls = False tls_allow_insecure_connection = False tls_trust_cert_path = None + hostname_verification_enabled = False if args.client_auth_plugin and args.client_auth_params: authentication = pulsar.Authentication(args.client_auth_plugin, args.client_auth_params) if args.use_tls == "true": @@ -158,10 +159,13 @@ def main(): tls_allow_insecure_connection = True if args.tls_trust_cert_path: tls_trust_cert_path = args.tls_trust_cert_path + if args.hostname_verification_enabled == "true": +hostname_verification_enabled = True pulsar_client = pulsar.Client(args.pulsar_serviceurl, authentication=authentication, operation_timeout_seconds=30, io_threads=1, message_listener_threads=1, concurrent_lookup_requests=5, log_conf_file_path=None, use_tls=use_tls, tls_trust_certs_file_path=tls_trust_cert_path, - tls_allow_insecure_connection=tls_allow_insecure_connection) + tls_allow_insecure_connection=tls_allow_insecure_connection, + tls_validate_hostname=hostname_verification_enabled) state_storage_serviceurl = None if args.state_storage_serviceurl is not None:
[pulsar] branch master updated: Pulsar IO: allow Sinks to use native AVRO and JSON (#11322)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new f35766f Pulsar IO: allow Sinks to use native AVRO and JSON (#11322) f35766f is described below commit f35766f99fcc56493be9d12533f4b2a31c3c5884 Author: Enrico Olivelli AuthorDate: Tue Jul 20 05:11:26 2021 +0200 Pulsar IO: allow Sinks to use native AVRO and JSON (#11322) The Sink should be able to manage the result of GenericRecord.getNativeObject(). In order to do this Apache AVRO must be loaded from the same classloader that is loading Apache Pulsar Runtime. The same problem applies in the case of a JsonNode returned by getNativeObject(); *Modifications* - Add AVRO to the list of classes (like slf4j) to be loaded from the Pulsar runtime (this in turn imports Commons Compress and Jackson Databind). - Enhance the existing integration tests, that tested about the Schema definition, but it didn't actually try to "use" the `org.apache.avro.GenericRecord` object as well as the `Jackson JsonNode` object --- pulsar-functions/runtime-all/pom.xml | 14 ++ .../pulsar/functions/instance/JavaInstanceDepsTest.java | 9 - .../tests/integration/io/TestGenericObjectSink.java | 16 +++- .../integration/io/PulsarGenericObjectSinkTest.java | 1 + 4 files changed, 38 insertions(+), 2 deletions(-) diff --git a/pulsar-functions/runtime-all/pom.xml b/pulsar-functions/runtime-all/pom.xml index d3eaccf..9dacaa3 100644 --- a/pulsar-functions/runtime-all/pom.xml +++ b/pulsar-functions/runtime-all/pom.xml @@ -41,6 +41,7 @@ 5. log4j-slf4j-impl 6. log4j-api 7. log4j-core +8. AVRO --> pulsar-functions-runtime-all @@ -65,6 +66,19 @@ ${project.version} + + + org.apache.avro + avro + ${avro.version} + + + + com.fasterxml.jackson.core + jackson-databind + ${jackson.databind.version} + + diff --git a/pulsar-functions/runtime-all/src/test/java/org/apache/pulsar/functions/instance/JavaInstanceDepsTest.java b/pulsar-functions/runtime-all/src/test/java/org/apache/pulsar/functions/instance/JavaInstanceDepsTest.java index 3bdd23f..859be4e 100644 --- a/pulsar-functions/runtime-all/src/test/java/org/apache/pulsar/functions/instance/JavaInstanceDepsTest.java +++ b/pulsar-functions/runtime-all/src/test/java/org/apache/pulsar/functions/instance/JavaInstanceDepsTest.java @@ -44,6 +44,9 @@ import java.util.zip.ZipInputStream; * 5. log4j-slf4j-impl * 6. log4j-api * 7. log4j-core + * 8. Apache AVRO + * 9. Jackson Mapper and Databind (dependency of AVRO) + * 10. Apache Commons Compress (dependency of AVRO) */ public class JavaInstanceDepsTest { @@ -60,11 +63,15 @@ public class JavaInstanceDepsTest { if (e == null) break; String name = e.getName(); -if (name.endsWith(".class") && !name.startsWith("META-INF")) { +if (name.endsWith(".class") && !name.startsWith("META-INF") && !name.equals("module-info.class")) { // The only classes in the java-instance.jar should be org.apache.pulsar, slf4j, and log4j classes +// (see the full list above) // filter out those classes to see if there are any other classes that should not be allowed if (!name.startsWith("org/apache/pulsar") && !name.startsWith("org/slf4j") +&& !name.startsWith("org/apache/avro") +&& !name.startsWith("com/fasterxml/jackson") +&& !name.startsWith("org/apache/commons/compress") && !name.startsWith("org/apache/logging/slf4j") && !name.startsWith("org/apache/logging/log4j")) { notAllowedClasses.add(name); diff --git a/tests/docker-images/java-test-functions/src/main/java/org/apache/pulsar/tests/integration/io/TestGenericObjectSink.java b/tests/docker-images/java-test-functions/src/main/java/org/apache/pulsar/tests/integration/io/TestGenericObjectSink.java index d131e5b..fa8a3fe 100644 --- a/tests/docker-images/java-test-functions/src/main/java/org/apache/pulsar/tests/integration/io/TestGenericObjectSink.java +++ b/tests/docker-images/java-test-functions/src/main/java/org/apache/pulsar/tests/integration/io/TestGenericObjectSink.java @@ -18,7 +18,9 @@ */ package org.apache.pulsar.tests.integration.io; +import com.fasterxml.jackson.databind.JsonNode
[pulsar] branch master updated (3adc475 -> 7cce8e3)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 3adc475 [Security] Bump Netty version to 4.1.66.Final (#11344) add 7cce8e3 fix: use same regex code at ZTSClient (#11323) No new revisions were added by this update. Summary of changes: pulsar-client-cpp/lib/auth/athenz/ZTSClient.cc | 22 ++ pulsar-client-cpp/tests/ZTSClientTest.cc | 12 2 files changed, 18 insertions(+), 16 deletions(-)
[pulsar] branch master updated (8a4147e -> 3adc475)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 8a4147e Close the replicator and replication client when delete cluster. (#11342) add 3adc475 [Security] Bump Netty version to 4.1.66.Final (#11344) No new revisions were added by this update. Summary of changes: buildtools/pom.xml | 2 +- distribution/server/src/assemble/LICENSE.bin.txt | 36 pom.xml | 4 +-- pulsar-sql/presto-distribution/LICENSE | 32 ++--- 4 files changed, 37 insertions(+), 37 deletions(-)
[pulsar] branch master updated (eb4d8aa -> 8a4147e)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from eb4d8aa Support new topic format for broker admin healthcheck endpoint. (#11268) add 8a4147e Close the replicator and replication client when delete cluster. (#11342) No new revisions were added by this update. Summary of changes: .../org/apache/pulsar/broker/PulsarService.java| 13 ++ .../pulsar/broker/service/BrokerService.java | 26 +++ .../pulsar/broker/service/ReplicatorTest.java | 50 ++ 3 files changed, 89 insertions(+)
[pulsar] branch master updated (fc8ce64 -> 791c0ac)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from fc8ce64 [python-client] Fixed crash when using Python logger (#10981) add 791c0ac [function] fix update user config (#10731) No new revisions were added by this update. Summary of changes: .../worker/PulsarFunctionPublishTest.java | 57 +- .../org/apache/pulsar/admin/cli/CmdFunctions.java | 6 +-- 2 files changed, 48 insertions(+), 15 deletions(-)
[pulsar] branch master updated (47b3495 -> fc8ce64)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 47b3495 fix add listenerName for geo-replicator (#10779) add fc8ce64 [python-client] Fixed crash when using Python logger (#10981) No new revisions were added by this update. Summary of changes: pulsar-client-cpp/python/src/config.cc | 65 +- 1 file changed, 32 insertions(+), 33 deletions(-)
[pulsar] branch master updated (96b91f8 -> 47b3495)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 96b91f8 [ Issue 11032 ] Fixed flaky test ZKSessionTest.. #11032 (#11062) add 47b3495 fix add listenerName for geo-replicator (#10779) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/pulsar/admin/cli/CmdClusters.java | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[pulsar] branch master updated (70e9c48 -> 96b91f8)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 70e9c48 use testng to replace junit (#11033) add 96b91f8 [ Issue 11032 ] Fixed flaky test ZKSessionTest.. #11032 (#11062) No new revisions were added by this update. Summary of changes: .../org/apache/pulsar/metadata/ZKSessionTest.java | 29 ++ 1 file changed, 8 insertions(+), 21 deletions(-)
[pulsar] branch master updated (6384f94 -> 70e9c48)
This is an automated email from the ASF dual-hosted git repository. sijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 6384f94 add parameter to control publish message check policy frequency (#11141) add 70e9c48 use testng to replace junit (#11033) No new revisions were added by this update. Summary of changes: .../flume/node/TestEnvVarResolverProperties.java | 8 ++--- .../io/kafka/connect/KafkaConnectSinkTest.java | 40 +++--- 2 files changed, 24 insertions(+), 24 deletions(-)