[pulsar] branch master updated: Update PMC list (#12011)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 9b7c327 Update PMC list (#12011)
9b7c327 is described below
commit 9b7c3275c904ac1e6a8ef67487a10a0506bb2c58
Author: aarondonwilliams
AuthorDate: Sun Sep 12 20:37:12 2021 -0700
Update PMC list (#12011)
New members have joined, but the list was not updated.
---
site2/website/data/team.js | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/site2/website/data/team.js b/site2/website/data/team.js
index 9019518..2253e7c 100644
--- a/site2/website/data/team.js
+++ b/site2/website/data/team.js
@@ -48,7 +48,7 @@ module.exports = {
{
name: 'Enrico Olivelli',
apacheId: 'eolivelli',
- roles: 'Committer'
+ roles: 'Committer, PMC'
},
{
name: 'Fangbin Sun',
@@ -69,7 +69,7 @@ module.exports = {
name: 'Hang Chen',
apacheId: 'chenhang',
org: 'BIGO Technology',
- roles: 'Committer'
+ roles: 'Committer, PMC'
},
{
name: 'Hiroyuki Sakai',
@@ -128,7 +128,7 @@ module.exports = {
name: 'Lin Lin',
apacheId: 'linlin',
org: 'Tencent',
- roles: 'Committer'
+ roles: 'Committer, PMC'
},
{
name: 'Ludwig Pummer',
[pulsar] branch master updated (0748ecb -> e36233e)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 0748ecb [C++] Fixing use-after-free and constructor bugs in UnAckedMessageTrackerEnabled (#11630) add e36233e [docs] Remove broken links (#11658) No new revisions were added by this update. Summary of changes: site2/docs/adaptors-spark.md| 2 +- site2/docs/deploy-monitoring.md | 2 +- site2/docs/io-connectors.md | 2 +- site2/website/versioned_docs/version-2.7.0/deploy-monitoring.md | 2 +- site2/website/versioned_docs/version-2.7.1/deploy-monitoring.md | 2 +- site2/website/versioned_docs/version-2.7.2/deploy-monitoring.md | 2 +- site2/website/versioned_docs/version-2.7.3/deploy-monitoring.md | 2 +- site2/website/versioned_docs/version-2.8.0/adaptors-spark.md| 2 +- site2/website/versioned_docs/version-2.8.0/deploy-monitoring.md | 2 +- site2/website/versioned_docs/version-2.8.0/io-connectors.md | 2 +- site2/website/versioned_docs/version-2.8.1/adaptors-spark.md| 2 +- site2/website/versioned_docs/version-2.8.1/deploy-monitoring.md | 2 +- site2/website/versioned_docs/version-2.8.1/io-connectors.md | 2 +- 13 files changed, 13 insertions(+), 13 deletions(-)
[pulsar] branch master updated: [docs] Update deploy-bare-metal-multi-cluster.md (#11466)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new efb973d [docs] Update deploy-bare-metal-multi-cluster.md (#11466) efb973d is described below commit efb973dbe09eb3f4639eb4a10dd675627e0a8378 Author: fengtao1998 <37149842+fengtao1...@users.noreply.github.com> AuthorDate: Wed Aug 11 13:35:52 2021 +0800 [docs] Update deploy-bare-metal-multi-cluster.md (#11466) * Update deploy-bare-metal-multi-cluster.md * Update deploy-bare-metal-multi-cluster.md * Update deploy-bare-metal-multi-cluster.md * Update deploy-bare-metal-multi-cluster.md * Update deploy-bare-metal-multi-cluster.md * Update deploy-bare-metal-multi-cluster.md * Update deploy-bare-metal-multi-cluster.md * Update site2/docs/deploy-bare-metal-multi-cluster.md Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> * Update deploy-bare-metal-multi-cluster.md * Update deploy-bare-metal-multi-cluster.md Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> --- site2/docs/deploy-bare-metal-multi-cluster.md | 74 --- 1 file changed, 32 insertions(+), 42 deletions(-) diff --git a/site2/docs/deploy-bare-metal-multi-cluster.md b/site2/docs/deploy-bare-metal-multi-cluster.md index 62b735b..374fe34 100644 --- a/site2/docs/deploy-bare-metal-multi-cluster.md +++ b/site2/docs/deploy-bare-metal-multi-cluster.md @@ -4,35 +4,28 @@ title: Deploying a multi-cluster on bare metal sidebar_label: Bare metal multi-cluster --- -> ### Tips +> **Tips** > -> 1. Single-cluster Pulsar installations should be sufficient for all but the most ambitious use cases. If you are interested in experimenting with -> Pulsar or using it in a startup or on a single team, you had better opt for a single cluster. For instructions on deploying a single cluster, -> see the guide [here](deploy-bare-metal.md). +> 1. You can use single-cluster Pulsar installation in most use cases, such as experimenting with Pulsar or using Pulsar in a startup or in a single team. If you need to run a multi-cluster Pulsar instance, see the [guide](deploy-bare-metal-multi-cluster.md). > -> 2. If you want to use all builtin [Pulsar IO](io-overview.md) connectors in your Pulsar deployment, you need to download `apache-pulsar-io-connectors` -> package and install `apache-pulsar-io-connectors` under `connectors` directory in the pulsar directory on every broker node or on every function-worker node if you -> run a separate cluster of function workers for [Pulsar Functions](functions-overview.md). +> 2. If you want to use all built-in [Pulsar IO](io-overview.md) connectors, you need to download `apache-pulsar-io-connectors`package and install `apache-pulsar-io-connectors` under `connectors` directory in the pulsar directory on every broker node or on every function-worker node if you have run a separate cluster of function workers for [Pulsar Functions](functions-overview.md). > -> 3. If you want to use [Tiered Storage](concepts-tiered-storage.md) feature in your Pulsar deployment, you need to download `apache-pulsar-offloaders` -> package and install `apache-pulsar-offloaders` under `offloaders` directory in the pulsar directory on every broker node. For more details of how to configure -> this feature, you can refer to the [Tiered storage cookbook](cookbooks-tiered-storage.md). +>3. If you want to use [Tiered Storage](concepts-tiered-storage.md) feature in your Pulsar deployment, you need to download `apache-pulsar-offloaders`package and install `apache-pulsar-offloaders` under `offloaders` directory in the Pulsar directory on every broker node. For more details of how to configure this feature, you can refer to the [Tiered storage cookbook](cookbooks-tiered-storage.md). -A Pulsar *instance* consists of multiple Pulsar clusters working in unison. You can distribute clusters across data centers or geographical regions and replicate the clusters amongst themselves using [geo-replication](administration-geo.md). Deploying a multi-cluster Pulsar instance involves the following basic steps: +A Pulsar instance consists of multiple Pulsar clusters working in unison. You can distribute clusters across data centers or geographical regions and replicate the clusters amongst themselves using [geo-replication](administration-geo.md).Deploying a multi-cluster Pulsar instance consists of the following steps: -* Deploying two separate [ZooKeeper](#deploy-zookeeper) quorums: a [local](#deploy-local-zookeeper) quorum for each cluster in the instance and a [configuration store](#configuration-store) quorum for instance-wide task
[pulsar] branch master updated: [docs]Update deploy-bare-metal.md (#11452)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new cdcb86b [docs]Update deploy-bare-metal.md (#11452) cdcb86b is described below commit cdcb86b22c646e79945d83551c496195adb18785 Author: fengtao1998 <37149842+fengtao1...@users.noreply.github.com> AuthorDate: Tue Aug 10 09:28:53 2021 +0800 [docs]Update deploy-bare-metal.md (#11452) * Update deploy-bare-metal.md * Update deploy-bare-metal.md * Create deploy-bare-metal.md * Update deploy-bare-metal.md * Update deploy-bare-metal.md * Update site2/docs/deploy-bare-metal.md Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> * Update site2/docs/deploy-bare-metal.md Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> * Update deploy-bare-metal.md * Update site2/docs/deploy-bare-metal.md Co-authored-by: sijia-w <53718687+siji...@users.noreply.github.com> * Update site2/docs/deploy-bare-metal.md Co-authored-by: sijia-w <53718687+siji...@users.noreply.github.com> * Update deploy-bare-metal.md pulsar->Pulsar * Update site2/docs/deploy-bare-metal.md Co-authored-by: sijia-w <53718687+siji...@users.noreply.github.com> * Update site2/docs/deploy-bare-metal.md Co-authored-by: sijia-w <53718687+siji...@users.noreply.github.com> * Update site2/docs/deploy-bare-metal.md Co-authored-by: sijia-w <53718687+siji...@users.noreply.github.com> * Create deploy-bare-metal.md * Update site2/docs/deploy-bare-metal.md * Update site2/docs/deploy-bare-metal.md Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> Co-authored-by: sijia-w <53718687+siji...@users.noreply.github.com> --- site2/docs/deploy-bare-metal.md | 68 ++--- 1 file changed, 29 insertions(+), 39 deletions(-) diff --git a/site2/docs/deploy-bare-metal.md b/site2/docs/deploy-bare-metal.md index 3410dcd..0012e91 100644 --- a/site2/docs/deploy-bare-metal.md +++ b/site2/docs/deploy-bare-metal.md @@ -5,35 +5,30 @@ sidebar_label: Bare metal --- -> ### Tips +> **Tips** > -> 1. Single-cluster Pulsar installations should be sufficient for all but the most ambitious use cases. If you are interested in experimenting with -> Pulsar or using Pulsar in a startup or on a single team, it is simplest to opt for a single cluster. If you do need to run a multi-cluster Pulsar instance, -> see the guide [here](deploy-bare-metal-multi-cluster.md). +> 1. You can use single-cluster Pulsar installation in most use cases, such as experimenting with Pulsar or using Pulsar in a startup or in a single team. If you need to run a multi-cluster Pulsar instance, see the [guide](deploy-bare-metal-multi-cluster.md). > -> 2. If you want to use all builtin [Pulsar IO](io-overview.md) connectors in your Pulsar deployment, you need to download `apache-pulsar-io-connectors` -> package and install `apache-pulsar-io-connectors` under `connectors` directory in the pulsar directory on every broker node or on every function-worker node if you -> have run a separate cluster of function workers for [Pulsar Functions](functions-overview.md). +> 2. If you want to use all built-in [Pulsar IO](io-overview.md) connectors, you need to download `apache-pulsar-io-connectors`package and install `apache-pulsar-io-connectors` under `connectors` directory in the pulsar directory on every broker node or on every function-worker node if you have run a separate cluster of function workers for [Pulsar Functions](functions-overview.md). > -> 3. If you want to use [Tiered Storage](concepts-tiered-storage.md) feature in your Pulsar deployment, you need to download `apache-pulsar-offloaders` -> package and install `apache-pulsar-offloaders` under `offloaders` directory in the pulsar directory on every broker node. For more details of how to configure -> this feature, you can refer to the [Tiered storage cookbook](cookbooks-tiered-storage.md). +> 3. If you want to use [Tiered Storage](concepts-tiered-storage.md) feature in your Pulsar deployment, you need to download `apache-pulsar-offloaders`package and install `apache-pulsar-offloaders` under `offloaders` directory in the Pulsar directory on every broker node. For more details of how to configure this feature, you can refer to the [Tiered storage cookbook](cookbooks-tiered-storage.md). -Deploying a Pulsar cluster involves doing the following (in order): +Deploying a Pulsar cluster consists of the following steps: -* Deploy
[pulsar] branch master updated: [Docs]Update docs for Client libraries Python (#10984)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 9311f7f [Docs]Update docs for Client libraries Python (#10984) 9311f7f is described below commit 9311f7fa1e852169ac3c2d51090053834a3fc8be Author: fengtao1998 <37149842+fengtao1...@users.noreply.github.com> AuthorDate: Mon Aug 9 15:24:34 2021 +0800 [Docs]Update docs for Client libraries Python (#10984) * Update client-libraries-python.md * Update site2/docs/client-libraries-python.md Co-authored-by: Anonymitaet <50226895+anonymit...@users.noreply.github.com> * Update client-libraries-python.md * Update client-libraries-python.md * Update site2/docs/client-libraries-python.md Co-authored-by: Anonymitaet <50226895+anonymit...@users.noreply.github.com> Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> --- site2/docs/client-libraries-python.md | 10 +- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/site2/docs/client-libraries-python.md b/site2/docs/client-libraries-python.md index 24808b6..49c75b4 100644 --- a/site2/docs/client-libraries-python.md +++ b/site2/docs/client-libraries-python.md @@ -4,7 +4,7 @@ title: Pulsar Python client sidebar_label: Python --- -Pulsar Python client library is a wrapper over the existing [C++ client library](client-libraries-cpp.md) and exposes all of the [same features](/api/cpp). You can find the code in the [`python` subdirectory](https://github.com/apache/pulsar/tree/master/pulsar-client-cpp/python) of the C++ client code. +Pulsar Python client library is a wrapper over the existing [C++ client library](client-libraries-cpp.md) and exposes all of the [same features](/api/cpp). You can find the code in the [Python directory](https://github.com/apache/pulsar/tree/master/pulsar-client-cpp/python) of the C++ client code. All the methods in producer, consumer, and reader of a Python client are thread-safe. @@ -12,7 +12,7 @@ All the methods in producer, consumer, and reader of a Python client are thread- ## Install -You can install the [`pulsar-client`](https://pypi.python.org/pypi/pulsar-client) library either via [PyPi](https://pypi.python.org/pypi), using [pip](#installation-using-pip), or by building the library from source. +You can install the [`pulsar-client`](https://pypi.python.org/pypi/pulsar-client) library either via [PyPi](https://pypi.python.org/pypi), using [pip](#installation-using-pip), or by building the library from [source](https://github.com/apache/pulsar/tree/master/pulsar-client-cpp). ### Install using pip @@ -62,7 +62,7 @@ The complete Python API reference is available at [api/python](/api/python). ## Examples -You can find a variety of Python code examples for the `pulsar-client` library. +You can find a variety of Python code examples for the [pulsar-client](/pulsar-client-cpp/python) library. ### Producer example @@ -151,7 +151,7 @@ while True: In addition to subscribing a consumer to a single Pulsar topic, you can also subscribe to multiple topics simultaneously. To use multi-topic subscriptions, you can supply a regular expression (regex) or a `List` of topics. If you select topics via regex, all topics must be within the same Pulsar namespace. -The following is an example. +The following is an example: ```python import re @@ -405,5 +405,5 @@ This section provides step-by-step instructions on how to use the end-to-end enc This is from the consumer side. ``` -Received msg 'b'encryption message'' id = '(0,0,-1,-1)' +Received msg 'encryption message' id = '(0,0,-1,-1)' ```
[pulsar] branch master updated (a50fe87 -> 674537c)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from a50fe87 [Transaction] Fix delete sub then delete pending ack. (#11023) add 674537c [Docs]Update Kubernetes (Helm) (#11406) No new revisions were added by this update. Summary of changes: site2/docs/helm-deploy.md | 2 +- site2/docs/helm-install.md | 3 --- site2/docs/helm-overview.md | 12 ++-- site2/docs/helm-prepare.md | 12 4 files changed, 7 insertions(+), 22 deletions(-)
[pulsar] branch master updated: [docs]Update getting-started-docker.md (#11218)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 620ee49 [docs]Update getting-started-docker.md (#11218)
620ee49 is described below
commit 620ee49c61447c35b616478e745732f86876d53f
Author: fengtao1998 <37149842+fengtao1...@users.noreply.github.com>
AuthorDate: Wed Jul 7 14:04:30 2021 +0800
[docs]Update getting-started-docker.md (#11218)
* Update getting-started-docker.md
* Update getting-started-docker.md
---
site2/docs/getting-started-docker.md | 160 +++
1 file changed, 107 insertions(+), 53 deletions(-)
diff --git a/site2/docs/getting-started-docker.md
b/site2/docs/getting-started-docker.md
index 56cff28..675fff8 100644
--- a/site2/docs/getting-started-docker.md
+++ b/site2/docs/getting-started-docker.md
@@ -15,13 +15,7 @@ and follow the instructions for your OS.
* For MacOS, Linux, and Windows:
```shell
- $ docker run -it \
--p 6650:6650 \
--p 8080:8080 \
---mount source=pulsardata,target=/pulsar/data \
---mount source=pulsarconf,target=/pulsar/conf \
-apachepulsar/pulsar:{{pulsar:version}} \
-bin/pulsar standalone
+ $ docker run -it -p 6650:6650 -p 8080:8080 --mount
source=pulsardata,target=/pulsar/data --mount
source=pulsarconf,target=/pulsar/conf apachepulsar/pulsar:{{pulsar:version}}
bin/pulsar standalone
```
A few things to note about this command:
@@ -32,8 +26,9 @@ time the container is restarted. For details on the volumes
you can use `docker
If you start Pulsar successfully, you will see `INFO`-level log messages like
this:
```
-2017-08-09 22:34:04,030 - INFO - [main:WebService@213] - Web Service started
at http://127.0.0.1:8080
-2017-08-09 22:34:04,038 - INFO - [main:PulsarService@335] - messaging service
is ready, bootstrap service on port=8080, broker url=pulsar://127.0.0.1:6650,
cluster=standalone,
configs=org.apache.pulsar.broker.ServiceConfiguration@4db60246
+08:18:30.970 [main] INFO org.apache.pulsar.broker.web.WebService - HTTP
Service started at http://0.0.0.0:8080
+...
+07:53:37.322 [main] INFO org.apache.pulsar.broker.PulsarService - messaging
service is ready, bootstrap service port = 8080, broker url=
pulsar://localhost:6650, cluster=standalone,
configs=org.apache.pulsar.broker.ServiceConfiguration@98b63c1
...
```
@@ -52,7 +47,7 @@ use one of these root URLs to interact with your cluster:
* `pulsar://localhost:6650`
* `http://localhost:8080`
-The following example will guide you get started with Pulsar quickly by using
the [Python](client-libraries-python.md)
+The following example will guide you get started with Pulsar quickly by using
the [Python client API](client-libraries-python.md)
client API.
Install the Pulsar Python client library directly from
[PyPI](https://pypi.org/project/pulsar-client/):
@@ -111,50 +106,109 @@ The output is something like this:
```json
{
- "averageMsgSize": 0.0,
- "msgRateIn": 0.0,
- "msgRateOut": 0.0,
- "msgThroughputIn": 0.0,
- "msgThroughputOut": 0.0,
- "publishers": [
-{
- "address": "/172.17.0.1:35048",
- "averageMsgSize": 0.0,
- "clientVersion": "1.19.0-incubating",
- "connectedSince": "2017-08-09 20:59:34.621+",
- "msgRateIn": 0.0,
- "msgThroughputIn": 0.0,
- "producerId": 0,
- "producerName": "standalone-0-1"
-}
- ],
- "replication": {},
- "storageSize": 16,
- "subscriptions": {
-"my-sub": {
- "blockedSubscriptionOnUnackedMsgs": false,
- "consumers": [
+"count": 0,
+"msgRateIn": 0.0,
+"msgThroughputIn": 0.0,
+"msgRateOut": 1.8332950480217471,
+"msgThroughputOut": 91.33142602871978,
+"bytesInCounter": 7097,
+"msgInCounter": 143,
+"bytesOutCounter": 6607,
+"msgOutCounter": 133,
+"averageMsgSize": 0.0,
+"msgChunkPublished": false,
+"storageSize": 7097,
+"backlogSize": 0,
+"offloadedStorageSize": 0,
+"publishers": [
{
- "address": "/172.17.0.1:35064",
- "availablePermits": 996,
- "blockedConsumerOnUnackedMsgs": false,
- "clientVersion": "1.19.0-incubating",
- "connectedSince": "2017-08-09 21:05:39.222+",
- "consumerName": "166111",
- "msgRateOut": 0.0,
- "msgRateRedeliver": 0.0,
- &q
[pulsar] branch master updated (93e145b -> cc38567)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 93e145b Fix init WebSocketService with ClusterData (#11234) add cc38567 Update getting-started-standalone.md (#11236) No new revisions were added by this update. Summary of changes: site2/docs/getting-started-standalone.md | 10 +- 1 file changed, 5 insertions(+), 5 deletions(-)
[pulsar-translation] branch master updated: Update schedule_zh-CN.md (#42)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 1713978 Update schedule_zh-CN.md (#42) 1713978 is described below commit 171397883ad8d5f531ff61b24457bca21f63031e Author: xxwinnie AuthorDate: Mon Jun 21 10:08:10 2021 +0800 Update schedule_zh-CN.md (#42) --- schedule_zh-CN.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 1aa83b4..a369813 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -108,14 +108,14 @@ io-cli | SylviaBABY | sijia-w | Approved io-connectors | SylviaBABY | sijia-w | Approved io-debezium-source | SylviaBABY | | Translated io-debug | SylviaBABY | | Translated -io-develop | sijia-w | sijia-w | Approved +io-develop | sijia-w & xxwinnie | sijia-w | Approved io-elasticsearch-sink | Kevin Ma | | Translated io-elasticsearch | | | Empty io-file-source | SylviaBABY | | Translated io-file | Bu Xing | | In Progress io-flume-sink | SylviaBABY | | Translated io-flume-source | SylviaBABY | | Translated -io-hbase-sink | | | To Do +io-hbase-sink | xxwinnie | | To Do io-hbase | Bu Xing | | Deprecated io-hdfs | Bu Xing | | Deprecated io-hdfs2-sink | SylviaBABY | | Translated
[pulsar-translation] branch master updated: Finished translation to helm-upgrade (#43)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new efa6b44 Finished translation to helm-upgrade (#43) efa6b44 is described below commit efa6b44d65405ab0600186ed43bd3634bb483c6f Author: hapihu AuthorDate: Mon Jun 21 10:07:39 2021 +0800 Finished translation to helm-upgrade (#43) Co-authored-by: 吴贵虎 --- schedule_zh-CN.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 86feb29..1aa83b4 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -95,7 +95,7 @@ helm-install | | | To Do helm-overview | | | To Do helm-prepare | | | To Do helm-tools | | | To Do -helm-upgrade | | | To Do +helm-upgrade | hapihu | | Translated io-aerospike-sink | SylviaBABY | | Translated io-aerospike | | | To Do io-canal-source | sijia-w | | Translated
[pulsar-translation] branch master updated: io managing.md Translated (#44)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new d85e2c4 io managing.md Translated (#44) d85e2c4 is described below commit d85e2c438fe9e795abe8451b324a481797c2b75c Author: mrcangye AuthorDate: Sun Jun 20 21:07:04 2021 -0500 io managing.md Translated (#44) * add io-managing.md task * Update schedule_zh-CN.md --- schedule_zh-CN.md | 1 + 1 file changed, 1 insertion(+) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index bd752c8..86feb29 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -130,6 +130,7 @@ io-kafka | KarenGirl | | Deprecated io-kinesis-sink | SylviaBABY | sijia-w | Approved io-kinesis-source | SylviaBABY | | Translated io-kinesis | | | To Do +io-managing | mrcangye | | Translated io-mongo-sink | SylviaBABY | | Translated io-mongo | | | To Do io-netty-source | SylviaBABY | | Translated
[pulsar-translation] branch master updated: Update schedule_zh-CN.md (#47)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 8715a67 Update schedule_zh-CN.md (#47) 8715a67 is described below commit 8715a67ee3447d1c693229d8b3a9316157e6c894 Author: 陈敏 <37955350+bjtuchen...@users.noreply.github.com> AuthorDate: Mon Jun 21 10:05:10 2021 +0800 Update schedule_zh-CN.md (#47) --- schedule_zh-CN.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 7886d55..bd752c8 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -30,7 +30,7 @@ administration-stats | Jiechuan Chen| sijia-w | Approved administration-upgrade | July-liu | sijia-w | Approved administration-zk-bk | futeng | | Translated admin-load-distribution | bilahepan(Tianci Gao) | | Deprecated -client-libraries-cgo | | | To Do +client-libraries-cgo | bjtuchenmin | | Translated client-libraries-cpp | Lewinma | | Translated client-libraries-donet | | | To Do client-libraries-dotnet | | | To Do
[pulsar-translation] branch master updated: translate reference-terminology.md (#38)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 5ad048a translate reference-terminology.md (#38) 5ad048a is described below commit 5ad048a9034a2700799c5993c920e15b5d3122f5 Author: Lobo Xu <32694291+lob...@users.noreply.github.com> AuthorDate: Mon Jun 21 10:04:40 2021 +0800 translate reference-terminology.md (#38) Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> --- schedule_zh-CN.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 3fc9a35..7886d55 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -153,7 +153,7 @@ reference-configuration | Jiechuan Chen | | Translated reference-connector-admin | Jiechuan Chen | | Translated reference-metrics | Jiechuan Chen | | Translated reference-pulsar-admin | Jiechuan Chen | | Translated -reference-terminology | Jia Zhai | Jia Zhai & sijia-w | Approved +reference-terminology | Jia Zhai & Lobo Xu | Jia Zhai | Approved schema-evolution-compatibility | SylviaBABY | sijia-w | Approved schema-get-started | SylviaBABY | sijia-w | Approved schema-manage | SylviaBABY | sijia-w | Approved
[pulsar-translation] branch master updated: Update schedule_zh-CN.md (#46)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new f8f2648 Update schedule_zh-CN.md (#46) f8f2648 is described below commit f8f26480a0554ba38c6e824b0eaf4c6e67d1ce03 Author: 陈敏 <37955350+bjtuchen...@users.noreply.github.com> AuthorDate: Mon Jun 21 10:03:10 2021 +0800 Update schedule_zh-CN.md (#46) --- schedule_zh-CN.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index d9b66ee..3fc9a35 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -90,7 +90,7 @@ getting-started-docker | SylviaBABY | sijia-w | Approved getting-started-helm | Jiechuan Chen | | Translated getting-started-pulsar | | sijia-w | Approved getting-started-standalone (Correspond 'Run Pulsar locally') | | sijia-w | Approved -helm-deploy | | | To Do +helm-deploy | cr7258 & bjtuchenmin | | In Progress helm-install | | | To Do helm-overview | | | To Do helm-prepare | | | To Do
[pulsar-translation] branch master updated: Finished translation to tiered-storage-overview (#41)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 4154143 Finished translation to tiered-storage-overview (#41) 4154143 is described below commit 4154143474fbc31ed57b88117217fd024d228067 Author: Eric Shen AuthorDate: Thu Jun 10 09:00:31 2021 +0800 Finished translation to tiered-storage-overview (#41) * delete duplicate items Signed-off-by: Eric Shen * book translation Signed-off-by: Eric Shen * finish translation to tiered-storage-overview Signed-off-by: Eric Shen --- schedule_zh-CN.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index b1f6175..d9b66ee 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -173,12 +173,11 @@ sql-deployment-configurations | SylviaBABY | | Translated sql-getting-started | SylviaBABY | | Translated sql-overview | SylviaBABY | | Translated sql-rest-api | SylviaBABY | | Translated -tiered-storage-overview | zzy | | To Do +tiered-storage-overview | ericsyh | | Translated tiered-storage-aws | | | To Do tiered-storage-azure | | | To Do tiered-storage-filesystem | | | To Do tiered-storage-gcs | | | To Do -tiered-storage-overview | | | To Do transaction-api | | | To Do transaction-guarantee | | | To Do window-functions-context | | | To Do
[pulsar-translation] branch master updated: Update schedule_zh-CN.md (#39)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 503e21c Update schedule_zh-CN.md (#39) 503e21c is described below commit 503e21c2e1eb09bf8ae1b6cf270d0e4ffe9ba24e Author: bem3 AuthorDate: Wed Mar 31 16:01:43 2021 +0800 Update schedule_zh-CN.md (#39) Co-authored-by: zzy Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> --- schedule_zh-CN.md | 1 + 1 file changed, 1 insertion(+) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 41ee66b..b1f6175 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -173,6 +173,7 @@ sql-deployment-configurations | SylviaBABY | | Translated sql-getting-started | SylviaBABY | | Translated sql-overview | SylviaBABY | | Translated sql-rest-api | SylviaBABY | | Translated +tiered-storage-overview | zzy | | To Do tiered-storage-aws | | | To Do tiered-storage-azure | | | To Do tiered-storage-filesystem | | | To Do
[pulsar-translation] branch master updated: Update schedule (#40)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 3a449ca Update schedule (#40) 3a449ca is described below commit 3a449ca5ece392bb0b6e2a1ebd30849b5d213f2d Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Wed Mar 31 10:00:02 2021 +0200 Update schedule (#40) * update schedule * update --- schedule_zh-CN.md | 23 ++- 1 file changed, 18 insertions(+), 5 deletions(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 5044daf..41ee66b 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -6,10 +6,10 @@ Topic | Translator | Reviewer | Status :-|:---|:-|:-- -adaptors-kafka | Jia Zhai & Susan97 & Jennifer & Shipei Huang & Forbidden | | Translated +adaptors-kafka | Jia Zhai & Susan97 & Jennifer & Shipei Huang & Forbidden | sijia-w | Approved adaptors-spark | Jia Zhai & Ruihuan Wang & Jennifer | Jia Zhai | Approved adaptors-storm | Ruihuan Wang & Jennifer | | Translated -admin-api-brokers | liyiming2002 | | Translated +admin-api-brokers | liyiming2002 | sijia-w | Approved admin-api-clusters | liyiming2002 | sijia-w | Approved admin-api-functions | Jiechuan Chen | sijia-w | Approved admin-api-namespaces | Xiangyu Sun & kuangye098 | sijia-w | Approved @@ -24,14 +24,16 @@ admin-api-tenants | liyiming2002 | sijia-w | Approved administration-dashboard | Jiechuan Chen | sijia-w | Approved administration-geo | xuefei wei | | Translated administration-load-balance | Wuwenliang & futeng| | Translated -administration-proxy | bilahepan(Tianci Gao) & bilahepan | Jennifer Huang | Translated +administration-proxy | bilahepan(Tianci Gao) & bilahepan | Jennifer Huang & sijia-w | Approved administration-pulsar-manager | Jiechuan Chen | sijia-w | Approved administration-stats | Jiechuan Chen| sijia-w | Approved -administration-upgrade | July-liu | | Translated +administration-upgrade | July-liu | sijia-w | Approved administration-zk-bk | futeng | | Translated admin-load-distribution | bilahepan(Tianci Gao) | | Deprecated client-libraries-cgo | | | To Do client-libraries-cpp | Lewinma | | Translated +client-libraries-donet | | | To Do +client-libraries-dotnet | | | To Do client-libraries-go | z2665 | | Translated client-libraries-java | WJL & coxapp | | Translated client-libraries-node | Jiechuan Chen | sijia-w | Approved @@ -42,7 +44,9 @@ concepts-authentication | liyiming2002 & futeng| sijia-w | Approved concepts-clients | Zongyang & futeng| | Translated concepts-messaging | liyiming 2002 & futeng | | Translated concepts-multi-tenancy | futeng & liyiming2002 | sijia-w | Approved +concepts-multiple-advertised-listeners | lobo xu| sijia-w | Approved concepts-overview | futeng & wen.spider & Jiechuan Chen| sijia-w | Approved +concepts-proxy-sni-routing | | | To Do concepts-replication | coxapp | sijia-w | Approved concepts-schema-registry | liyiming2002 | sijia-w | Approved concepts-tiered-storage | liyiming2002 & futeng & wen.spider| | Translated @@ -143,12 +147,13 @@ io-tcp | Bu Xing | | Deprecated io-twitter-source | SylviaBABY | | Translated io-twitter | | | Deprecated io-use | SylviaBABY | | Translated +performance-pulsar-perf | | | To Do reference-cli-tools | Jiechuan Chen | | Translated reference-configuration | Jiechuan Chen | | Translated reference-connector-admin | Jiechuan Chen | | Translated reference-metrics | Jiechuan Chen | | Translated reference-pulsar-admin | Jiechuan Chen | | Translated -reference-terminology | Jia Zhai | Jia Zhai | Approved +reference-terminology | Jia Zhai | Jia Zhai & sijia-w | Approved schema-evolution-compatibility | SylviaBABY | sijia-w | Approved schema-get-started | SylviaBABY | sijia-w | Approved schema-manage | SylviaBABY | sijia-w | Approved @@ -168,3 +173,11 @@ sql-deployment-configurations | SylviaBABY | | Translated sql-getting-started | SylviaBABY | | Translated sql-overview | SylviaBABY | | Translated sql-rest-api | SylviaBABY | | Translated +tiered-storage-aws | | | To Do +tiered-storage-azure | | | To Do +tiered-storage-filesystem | | | To Do +tiered-storage-gcs | | | To Do +tiered-storage-overview | | | To Do +transaction-api | | | To Do +transaction-guarantee | | | To Do +window-functions-context | | | To Do
[pulsar] branch master updated (ea44087 -> 9559114)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from ea44087 Pass envirnoment variables to the docker container when building whee… (#10043) add 9559114 [doc] Add setter for reader subscription name (#10027) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-java.md | 3 +++ 1 file changed, 3 insertions(+)
[pulsar] branch master updated (4d878d7 -> 27d6625)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 4d878d7 [Transaction] Transaction buffer clear abort transactions (#9974) add 27d6625 [docs] add Key_shared subscription type (#10024) No new revisions were added by this update. Summary of changes: site2/docs/developing-binary-protocol.md | 2 +- site2/docs/reference-terminology.md | 4 ++-- .../versioned_docs/version-2.4.0/developing-binary-protocol.md| 2 +- .../versioned_docs/version-2.5.1/developing-binary-protocol.md| 2 +- .../versioned_docs/version-2.5.2/developing-binary-protocol.md| 2 +- .../versioned_docs/version-2.6.0/developing-binary-protocol.md| 2 +- site2/website/versioned_docs/version-2.6.0/reference-terminology.md | 4 ++-- .../versioned_docs/version-2.6.1/developing-binary-protocol.md| 2 +- site2/website/versioned_docs/version-2.6.1/reference-terminology.md | 4 ++-- .../versioned_docs/version-2.6.2/developing-binary-protocol.md| 2 +- site2/website/versioned_docs/version-2.6.2/reference-terminology.md | 4 ++-- .../versioned_docs/version-2.6.3/developing-binary-protocol.md| 2 +- site2/website/versioned_docs/version-2.6.3/reference-terminology.md | 4 ++-- .../versioned_docs/version-2.7.0/developing-binary-protocol.md| 2 +- site2/website/versioned_docs/version-2.7.0/reference-terminology.md | 4 ++-- .../versioned_docs/version-2.7.1/developing-binary-protocol.md| 2 +- site2/website/versioned_docs/version-2.7.1/reference-terminology.md | 4 ++-- 17 files changed, 24 insertions(+), 24 deletions(-)
[pulsar] branch master updated (9afc59f -> 6704f12)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 9afc59f Upgrade Lombok version (#1) add 6704f12 [docs] Fix installation instructions in c# documentation (#9913) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-dotnet.md | 87 ++ .../version-2.6.0/client-libraries-dotnet.md | 87 ++ .../version-2.6.1/client-libraries-dotnet.md | 87 ++ .../version-2.6.2/client-libraries-dotnet.md | 87 ++ .../version-2.6.3/client-libraries-dotnet.md | 87 ++ .../version-2.7.0/client-libraries-dotnet.md | 87 ++ .../version-2.7.1/client-libraries-dotnet.md | 87 ++ 7 files changed, 147 insertions(+), 462 deletions(-)
[pulsar] branch master updated: fix command issue (#9972)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new e58379b fix command issue (#9972)
e58379b is described below
commit e58379b9567a99822a4cbcba80357aa180eb9076
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Mon Mar 22 09:25:51 2021 +0800
fix command issue (#9972)
---
site2/docs/admin-api-packages.md | 12 ++--
1 file changed, 6 insertions(+), 6 deletions(-)
diff --git a/site2/docs/admin-api-packages.md b/site2/docs/admin-api-packages.md
index 06b6849..2dc2bfd 100644
--- a/site2/docs/admin-api-packages.md
+++ b/site2/docs/admin-api-packages.md
@@ -74,7 +74,7 @@ bin/pulsar-admin packages upload
functions://public/default/example@v0.1 --path
-{@inject: endpoint| POST
|admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/?version=[[pulsar:version_number]]}
+{@inject:
endpoint|POST|/admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/?version=[[pulsar:version_number]]}
Upload a package to the package management service synchronously.
@@ -99,7 +99,7 @@ bin/pulsar-admin packages download
functions://public/default/example@v0.1 --pat
-{@inject: endpoint| GET
|admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/?version=[[pulsar:version_number]]}
+{@inject:
endpoint|GET|/admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/?version=[[pulsar:version_number]]}
Download a package to the package management service synchronously.
@@ -124,7 +124,7 @@ bin/pulsar-admin packages list --type function
public/default
-{@inject: endpoint| GET
|admin/v3/packages/:type/:tenant/:namespace/:packageName/?version=[[pulsar:version_number]]}
+{@inject:
endpoint|GET|/admin/v3/packages/:type/:tenant/:namespace/:packageName/?version=[[pulsar:version_number]]}
List all versions of a package synchronously.
@@ -174,7 +174,7 @@ bin/pulsar-admin packages get-metadata
function://public/default/test@v1
-{@inject: endpoint| GET
|admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/metadata/?version=[[pulsar:version_number]]}
+{@inject:
endpoint|GET|/admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/metadata/?version=[[pulsar:version_number]]}
Get the metadata of a package synchronously.
@@ -198,7 +198,7 @@ bin/pulsar-admin packages update-metadata
function://public/default/example@v0.1
-{@inject: endpoint| PUT
|admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/metadata/?version=[[pulsar:version_number]]}
+{@inject:
endpoint|PUT|/admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/metadata/?version=[[pulsar:version_number]]}
Update a package metadata information synchronously.
@@ -225,7 +225,7 @@ bin/pulsar-admin packages delete
functions://public/default/example@v0.1
-{@inject: endpoint| DELETE
|admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/?version=[[pulsar:version_number]]}
+{@inject:
endpoint|DELETE|/admin/v3/packages/:type/:tenant/:namespace/:packageName/:version/?version=[[pulsar:version_number]]}
Delete a specified package synchronously.
[pulsar] branch master updated (7d3317e -> ac1a03c)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 7d3317e [CI] Fix Transaction flaky test. (#9934) add ac1a03c Support DLQ in key_shared sub mode (#9951) No new revisions were added by this update. Summary of changes: site2/docs/concepts-messaging.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[pulsar] branch master updated (c4aaf41 -> dedd882)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from c4aaf41 Add TestNG groups to pulsar-broker (#9712) add dedd882 [Documentation] Fix reference configuration table formatting (#9941) No new revisions were added by this update. Summary of changes: site2/docs/reference-configuration.md | 34 ++ .../version-2.6.0/reference-configuration.md | 14 - .../version-2.6.1/reference-configuration.md | 12 .../version-2.6.2/reference-configuration.md | 12 .../version-2.6.3/reference-configuration.md | 18 ++-- .../version-2.7.0/reference-configuration.md | 32 ++-- .../version-2.7.1/reference-configuration.md | 32 ++-- 7 files changed, 74 insertions(+), 80 deletions(-)
[pulsar] branch master updated (1b21d5256 -> d05b04c)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 1b21d5256 Reduce size of integration tests image by including only selected con… (#9807) add d05b04c [Doc] Add doc on how to configure max subscriptions per topic at the topic level (#9748) No new revisions were added by this update. Summary of changes: site2/docs/reference-pulsar-admin.md | 29 +- .../version-2.7.1/reference-pulsar-admin.md| 26 +++ 2 files changed, 54 insertions(+), 1 deletion(-)
[pulsar] branch master updated (a5e795c -> 795e889)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from a5e795c [pulsar-broker] Added support to force deleting tenant (#9677) add 795e889 [Doc] Add doc on how to configure max subscriptions per topic at the namespace level (#9747) No new revisions were added by this update. Summary of changes: site2/docs/reference-pulsar-admin.md | 91 + .../version-2.7.1/reference-pulsar-admin.md| 94 ++ 2 files changed, 117 insertions(+), 68 deletions(-)
[pulsar] branch master updated (1419d28 -> d8cbf13)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 1419d28 [CI][C++] Force CMake to find Python2 (#9690) add d8cbf13 restore format (#9531) No new revisions were added by this update. Summary of changes: .../version-2.1.0-incubating/security-tls-authentication.md | 4 ++-- .../versioned_docs/version-2.2.1/security-tls-authentication.md | 4 ++-- .../website/versioned_docs/version-2.2.1/security-token-admin.md | 8 .../website/versioned_docs/version-2.3.1/security-token-admin.md | 8 site2/website/versioned_docs/version-2.4.0/security-jwt.md| 4 ++-- .../versioned_docs/version-2.4.0/security-tls-authentication.md | 4 ++-- .../website/versioned_docs/version-2.4.0/security-token-admin.md | 8 .../versioned_docs/version-2.4.1/security-tls-authentication.md | 4 ++-- .../versioned_docs/version-2.4.2/security-tls-authentication.md | 4 ++-- .../versioned_docs/version-2.5.0/security-tls-authentication.md | 4 ++-- .../website/versioned_docs/version-2.5.0/security-token-admin.md | 4 ++-- site2/website/versioned_docs/version-2.5.1/security-jwt.md| 8 .../versioned_docs/version-2.5.1/security-tls-authentication.md | 4 ++-- site2/website/versioned_docs/version-2.5.2/security-jwt.md| 8 .../versioned_docs/version-2.5.2/security-tls-authentication.md | 4 ++-- site2/website/versioned_docs/version-2.6.0/security-jwt.md| 8 .../versioned_docs/version-2.6.0/security-tls-authentication.md | 4 ++-- .../website/versioned_docs/version-2.6.0/security-tls-keystore.md | 2 +- .../website/versioned_docs/version-2.6.0/security-token-admin.md | 4 ++-- site2/website/versioned_docs/version-2.6.1/security-jwt.md| 8 .../versioned_docs/version-2.6.1/security-tls-authentication.md | 4 ++-- .../website/versioned_docs/version-2.6.1/security-tls-keystore.md | 2 +- .../website/versioned_docs/version-2.6.1/security-token-admin.md | 4 ++-- site2/website/versioned_docs/version-2.6.2/security-jwt.md| 8 .../versioned_docs/version-2.6.2/security-tls-authentication.md | 4 ++-- .../website/versioned_docs/version-2.6.2/security-tls-keystore.md | 2 +- .../website/versioned_docs/version-2.6.2/security-token-admin.md | 4 ++-- site2/website/versioned_docs/version-2.7.0/security-jwt.md| 8 .../versioned_docs/version-2.7.0/security-tls-authentication.md | 4 ++-- .../website/versioned_docs/version-2.7.0/security-tls-keystore.md | 2 +- .../website/versioned_docs/version-2.7.0/security-token-admin.md | 4 ++-- 31 files changed, 76 insertions(+), 76 deletions(-)
[pulsar] branch master updated (71bc841 -> d5edbd9)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 71bc841 Disallow parsing of token with none signature in authenticateToken (#9172) add d5edbd9 [DOCS] Fix the batch delay default value in versioned docs (#9528) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-cgo.md | 12 ++-- site2/docs/client-libraries-go.md| 4 ++-- .../version-2.1.0-incubating/client-libraries-go.md | 10 +- .../versioned_docs/version-2.2.0/client-libraries-go.md | 10 +- .../versioned_docs/version-2.2.1/client-libraries-go.md | 10 +- .../versioned_docs/version-2.3.0/client-libraries-go.md | 10 +- .../versioned_docs/version-2.3.1/client-libraries-go.md | 10 +- .../versioned_docs/version-2.4.0/client-libraries-go.md | 10 +- .../versioned_docs/version-2.5.0/client-libraries-go.md | 12 ++-- .../versioned_docs/version-2.5.1/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.5.1/client-libraries-go.md | 4 ++-- .../versioned_docs/version-2.5.2/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.5.2/client-libraries-go.md | 4 ++-- .../versioned_docs/version-2.6.0/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.6.0/client-libraries-go.md | 4 ++-- .../versioned_docs/version-2.6.1/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.6.1/client-libraries-go.md | 4 ++-- .../versioned_docs/version-2.6.2/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.6.2/client-libraries-go.md | 4 ++-- .../versioned_docs/version-2.6.3/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.6.3/client-libraries-go.md | 4 ++-- .../versioned_docs/version-2.7.0/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.7.0/client-libraries-go.md | 4 ++-- .../versioned_docs/version-2.7.1/client-libraries-cgo.md | 12 ++-- .../versioned_docs/version-2.7.1/client-libraries-go.md | 4 ++-- 25 files changed, 108 insertions(+), 108 deletions(-)
[pulsar] branch master updated (0143850 -> c5589f6)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 0143850 Compression must be applied during deferred schema preparation and enableBatching is enabled (#9396) add c5589f6 [Issue 9418][docs] Add how to define Pulsar resources names when using K8S runtime (#9439) No new revisions were added by this update. Summary of changes: site2/docs/admin-api-overview.md | 42 1 file changed, 21 insertions(+), 21 deletions(-)
[pulsar] branch master updated (2be583e -> b729131)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2be583e [Doc] Add notes for S3 offloading configuration (#9366) add b729131 [docs] add Key_shared subscription type (#9392) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-java.md | 2 +- site2/docs/client-libraries-node.md | 2 +- site2/docs/client-libraries-websocket.md | 2 +- site2/website/versioned_docs/version-2.5.0/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.5.0/client-libraries-node.md | 2 +- site2/website/versioned_docs/version-2.5.1/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.5.1/client-libraries-node.md | 2 +- site2/website/versioned_docs/version-2.5.2/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.5.2/client-libraries-node.md | 2 +- site2/website/versioned_docs/version-2.6.0/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.6.0/client-libraries-node.md | 2 +- .../versioned_docs/version-2.6.0/client-libraries-websocket.md| 2 +- site2/website/versioned_docs/version-2.6.1/client-libraries-java.md | 4 ++-- site2/website/versioned_docs/version-2.6.1/client-libraries-node.md | 2 +- .../versioned_docs/version-2.6.1/client-libraries-websocket.md| 2 +- site2/website/versioned_docs/version-2.6.2/client-libraries-java.md | 4 ++-- site2/website/versioned_docs/version-2.6.2/client-libraries-node.md | 2 +- .../versioned_docs/version-2.6.2/client-libraries-websocket.md| 2 +- site2/website/versioned_docs/version-2.6.3/client-libraries-java.md | 4 ++-- site2/website/versioned_docs/version-2.6.3/client-libraries-node.md | 2 +- .../versioned_docs/version-2.6.3/client-libraries-websocket.md| 2 +- site2/website/versioned_docs/version-2.7.0/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.7.0/client-libraries-node.md | 2 +- .../versioned_docs/version-2.7.0/client-libraries-websocket.md| 2 +- site2/website/versioned_docs/version-2.7.1/client-libraries-java.md | 2 +- site2/website/versioned_docs/version-2.7.1/client-libraries-node.md | 2 +- .../versioned_docs/version-2.7.1/client-libraries-websocket.md| 2 +- 27 files changed, 30 insertions(+), 30 deletions(-)
[pulsar] branch master updated (47df15c -> 21ebbf5)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 47df15c Update release time for Pulsar 2.6.3 (#9391) add 21ebbf5 [docs] fix metrics type error (#9386) No new revisions were added by this update. Summary of changes: site2/docs/reference-metrics.md | 8 site2/website/versioned_docs/version-2.4.0/reference-metrics.md | 8 site2/website/versioned_docs/version-2.4.1/reference-metrics.md | 8 site2/website/versioned_docs/version-2.4.2/reference-metrics.md | 8 site2/website/versioned_docs/version-2.5.0/reference-metrics.md | 8 site2/website/versioned_docs/version-2.5.1/reference-metrics.md | 8 site2/website/versioned_docs/version-2.5.2/reference-metrics.md | 8 site2/website/versioned_docs/version-2.6.0/reference-metrics.md | 8 site2/website/versioned_docs/version-2.6.1/reference-metrics.md | 8 site2/website/versioned_docs/version-2.6.2/reference-metrics.md | 8 site2/website/versioned_docs/version-2.6.3/reference-metrics.md | 8 site2/website/versioned_docs/version-2.7.0/reference-metrics.md | 8 site2/website/versioned_docs/version-2.7.1/reference-metrics.md | 8 13 files changed, 52 insertions(+), 52 deletions(-)
[pulsar] branch master updated (25484d7 -> 88c9e09)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 25484d7 Fix Flaky-test: MessagePublishBufferThrottleTest (#9376) add 88c9e09 [docs]Add topic-level policy config (#9108) No new revisions were added by this update. Summary of changes: site2/docs/reference-pulsar-admin.md | 39 +- .../version-2.7.0/reference-pulsar-admin.md| 37 .../version-2.7.1/reference-pulsar-admin.md| 37 3 files changed, 112 insertions(+), 1 deletion(-)
[pulsar] branch master updated: fix format issue (#9158)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 8ceaf43 fix format issue (#9158) 8ceaf43 is described below commit 8ceaf4313cd8120e367dad4befc8b8fc66cc5ff0 Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> AuthorDate: Wed Jan 13 11:44:12 2021 +0800 fix format issue (#9158) --- site2/docs/reference-configuration.md | 2 +- site2/docs/tiered-storage-gcs.md| 2 +- .../versioned_docs/version-2.1.0-incubating/reference-configuration.md | 2 +- .../versioned_docs/version-2.1.1-incubating/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.2.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.2.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.3.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.3.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.3.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.4.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.4.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.4.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.5.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.5.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.5.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.2/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.6.3/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.7.0/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.7.0/tiered-storage-gcs.md| 2 +- site2/website/versioned_docs/version-2.7.1/reference-configuration.md | 2 +- site2/website/versioned_docs/version-2.7.1/tiered-storage-gcs.md| 2 +- 23 files changed, 23 insertions(+), 23 deletions(-) diff --git a/site2/docs/reference-configuration.md b/site2/docs/reference-configuration.md index 6bebcc6..ed06774 100644 --- a/site2/docs/reference-configuration.md +++ b/site2/docs/reference-configuration.md @@ -272,7 +272,7 @@ subscriptionExpirationTimeMinutes | How long to delete inactive subscriptions fr |managedLedgerCacheEvictionTimeThresholdMillis| All entries that have stayed in cache for more than the configured time, will be evicted | 1000 | |managedLedgerCursorBackloggedThreshold| Configure the threshold (in number of entries) from where a cursor should be considered 'backlogged' and thus should be set as inactive. | 1000| |managedLedgerDefaultMarkDeleteRateLimit| Rate limit the amount of writes per second generated by consumer acking the messages |1.0| -|managedLedgerMaxEntriesPerLedger| Max number of entries to append to a ledger before triggering a rollover. A ledger rollover is triggered on these conditions: Either the max rollover time has been reachedor max entries have been written to the ledged and at least min-time has passed|5| +|managedLedgerMaxEntriesPerLedger| The max number of entries to append to a ledger before triggering a rollover. A ledger rollover is triggered on these conditions: Either the max rollover time has been reachedor the max entries have been written to the ledger and at least min-time has passed|5| |managedLedgerMinLedgerRolloverTimeMinutes| Minimum time between ledger rollover for a topic |10| |managedLedgerMaxLedgerRolloverTimeMinutes| Maximum time before forcing a ledger rollover for a topic |240| |managedLedgerCursorMaxEntriesPerLedger| Max number of entries to append to a cursor ledger |5| diff --git a/site2/docs/tiered-storage-gcs.md b/site2/docs/tiered-storage-gcs.md index b6fec1a..d87ae14 100644 --- a/site2/docs/tiered-storage-gcs.md +++ b/site2/docs/tiered-storage-gcs.md @@ -91,7 +91,7 @@ You can configure GCS offloader driver in the configuration file `broker.conf` o `gcsManagedLedgerOffloadReadBufferSizeInBytes`|Size of block read|1 MB `gcsManagedLedgerOffloadMaxBlockSizeInBytes`|Size of block write|64 MB `managedLedgerMinLedgerRolloverTimeMinutes`|Minimum time between ledger rollover for a topic.|2 -`managedLedgerMaxEntriesPerLedger`|Max number of entries to append to a ledger before triggering a rollover.|5000 +`managedLedgerMaxEntriesPerLedger`|The max number of entries to append to a ledger before triggering a rollover.|5000 Bucket (required) diff --git a/site2/website/versioned_docs/version-2.1.0-incu
[pulsar] branch master updated: [docs]add parameter for helm init cluster (#9070)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 459ba1f [docs]add parameter for helm init cluster (#9070) 459ba1f is described below commit 459ba1ffd12d1aa20cbaea680cf396550314fd3c Author: wangyufan AuthorDate: Wed Dec 30 17:03:02 2020 +0800 [docs]add parameter for helm init cluster (#9070) * [docs]add parameter for helm init cluster * [docs]refer * [docs]fix * [docs]fix --- site2/docs/getting-started-helm.md | 5 + site2/website/versioned_docs/version-2.6.1/getting-started-helm.md | 5 + site2/website/versioned_docs/version-2.6.2/getting-started-helm.md | 5 + site2/website/versioned_docs/version-2.6.3/getting-started-helm.md | 5 + site2/website/versioned_docs/version-2.7.0/getting-started-helm.md | 5 + site2/website/versioned_docs/version-2.7.1/getting-started-helm.md | 5 + 6 files changed, 30 insertions(+) diff --git a/site2/docs/getting-started-helm.md b/site2/docs/getting-started-helm.md index 79d9c32..888f368 100644 --- a/site2/docs/getting-started-helm.md +++ b/site2/docs/getting-started-helm.md @@ -80,9 +80,14 @@ We use [Minikube](https://kubernetes.io/docs/getting-started-guides/minikube/) i 3. Use the Pulsar Helm chart to install a Pulsar cluster to Kubernetes. + > **NOTE** + > You need to specify `--set initialize=true` when installing Pulsar the first time. This command installs and starts Apache Pulsar. + ```bash helm install \ --values examples/values-minikube.yaml \ +--set initialize=true \ +--namespace pulsar \ pulsar-mini apache/pulsar ``` diff --git a/site2/website/versioned_docs/version-2.6.1/getting-started-helm.md b/site2/website/versioned_docs/version-2.6.1/getting-started-helm.md index a7e50ce..b2dbf12 100644 --- a/site2/website/versioned_docs/version-2.6.1/getting-started-helm.md +++ b/site2/website/versioned_docs/version-2.6.1/getting-started-helm.md @@ -81,9 +81,14 @@ We use [Minikube](https://kubernetes.io/docs/getting-started-guides/minikube/) i 3. Use the Pulsar Helm chart to install a Pulsar cluster to Kubernetes. + > **NOTE** + > You need to specify `--set initialize=true` when installing Pulsar the first time. This command installs and starts Apache Pulsar. + ```bash helm install \ --values examples/values-minikube.yaml \ +--set initialize=true \ +--namespace pulsar \ pulsar-mini apache/pulsar ``` diff --git a/site2/website/versioned_docs/version-2.6.2/getting-started-helm.md b/site2/website/versioned_docs/version-2.6.2/getting-started-helm.md index 6dcb7f0..3602653 100644 --- a/site2/website/versioned_docs/version-2.6.2/getting-started-helm.md +++ b/site2/website/versioned_docs/version-2.6.2/getting-started-helm.md @@ -81,9 +81,14 @@ We use [Minikube](https://kubernetes.io/docs/getting-started-guides/minikube/) i 3. Use the Pulsar Helm chart to install a Pulsar cluster to Kubernetes. + > **NOTE** + > You need to specify `--set initialize=true` when installing Pulsar the first time. This command installs and starts Apache Pulsar. + ```bash helm install \ --values examples/values-minikube.yaml \ +--set initialize=true \ +--namespace pulsar \ pulsar-mini apache/pulsar ``` diff --git a/site2/website/versioned_docs/version-2.6.3/getting-started-helm.md b/site2/website/versioned_docs/version-2.6.3/getting-started-helm.md index cb0e0a1..c4cbdd7 100644 --- a/site2/website/versioned_docs/version-2.6.3/getting-started-helm.md +++ b/site2/website/versioned_docs/version-2.6.3/getting-started-helm.md @@ -81,9 +81,14 @@ We use [Minikube](https://kubernetes.io/docs/getting-started-guides/minikube/) i 3. Use the Pulsar Helm chart to install a Pulsar cluster to Kubernetes. + > **NOTE** + > You need to specify `--set initialize=true` when installing Pulsar the first time. This command installs and starts Apache Pulsar. + ```bash helm install \ --values examples/values-minikube.yaml \ +--set initialize=true \ +--namespace pulsar \ pulsar-mini apache/pulsar ``` diff --git a/site2/website/versioned_docs/version-2.7.0/getting-started-helm.md b/site2/website/versioned_docs/version-2.7.0/getting-started-helm.md index 1c932b8..2b859c0 100644 --- a/site2/website/versioned_docs/version-2.7.0/getting-started-helm.md +++ b/site2/website/versioned_docs/version-2.7.0/getting-started-helm.md @@ -81,9 +81,14 @@ We use [Minikube](https://kubernetes.io/docs/getting-started-guides/minikube/) i 3. Use the Pulsar Helm chart to install a Pulsar cluster to Kubernetes. + > **NOTE** + > You need to specify `--set in
[pulsar] branch master updated (1dcd6c3 -> b09c0d7)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 1dcd6c3 [DOCS] Refine the description of jwt (#9053) add b09c0d7 update 271 version (#9073) No new revisions were added by this update. Summary of changes: .../version-2.7.1/administration-pulsar-manager.md | 14 +++--- 1 file changed, 7 insertions(+), 7 deletions(-)
[pulsar] branch master updated (331ca7c -> 1dcd6c3)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 331ca7c Remove external CIs (#9069) add 1dcd6c3 [DOCS] Refine the description of jwt (#9053) No new revisions were added by this update. Summary of changes: site2/docs/administration-pulsar-manager.md| 14 +++--- .../version-2.5.0/administration-pulsar-manager.md | 14 +++--- .../version-2.6.0/administration-pulsar-manager.md | 14 +++--- .../version-2.6.1/administration-pulsar-manager.md | 14 +++--- .../version-2.6.2/administration-pulsar-manager.md | 14 +++--- .../version-2.7.0/administration-pulsar-manager.md | 14 +++--- 6 files changed, 42 insertions(+), 42 deletions(-)
[pulsar] branch master updated: update client concepts (#9050)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 1c7ca15 update client concepts (#9050) 1c7ca15 is described below commit 1c7ca159d402dcf1a9865410f4872a5741630609 Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Mon Dec 28 01:37:57 2020 +0100 update client concepts (#9050) --- site2/docs/concepts-clients.md | 27 ++ .../version-2.7.0/concepts-clients.md | 27 ++ 2 files changed, 24 insertions(+), 30 deletions(-) diff --git a/site2/docs/concepts-clients.md b/site2/docs/concepts-clients.md index cb59e3f..668891f 100644 --- a/site2/docs/concepts-clients.md +++ b/site2/docs/concepts-clients.md @@ -4,26 +4,26 @@ title: Pulsar Clients sidebar_label: Clients --- -Pulsar exposes a client API with language bindings for [Java](client-libraries-java.md), [Go](client-libraries-go.md), [Python](client-libraries-python.md) and [C++](client-libraries-cpp.md). The client API optimizes and encapsulates Pulsar's client-broker communication protocol and exposes a simple and intuitive API for use by applications. +Pulsar exposes a client API with language bindings for [Java](client-libraries-java.md), [Go](client-libraries-go.md), [Python](client-libraries-python.md) and [C++](client-libraries-cpp.md). The client API optimizes and encapsulates Pulsar's client-broker communication protocol and exposes a simple and intuitive API for use by applications. Under the hood, the current official Pulsar client libraries support transparent reconnection and/or connection failover to brokers, queuing of messages until acknowledged by the broker, and heuristics such as connection retries with backoff. -> Custom client libraries -> If you'd like to create your own client library, we recommend consulting the documentation on Pulsar's custom [binary protocol](developing-binary-protocol.md) +> **Custom client libraries** +> If you'd like to create your own client library, we recommend consulting the documentation on Pulsar's custom [binary protocol](developing-binary-protocol.md). ## Client setup phase -When an application wants to create a producer/consumer, the Pulsar client library will initiate a setup phase that is composed of two steps: +Before an application creates a producer/consumer, the Pulsar client library needs to initiate a setup phase including two steps: -1. The client will attempt to determine the owner of the topic by sending an HTTP lookup request to the broker. The request could reach one of the active brokers which, by looking at the (cached) zookeeper metadata will know who is serving the topic or, in case nobody is serving it, will try to assign it to the least loaded broker. -1. Once the client library has the broker address, it will create a TCP connection (or reuse an existing connection from the pool) and authenticate it. Within this connection, client and broker exchange binary commands from a custom protocol. At this point the client will send a command to create producer/consumer to the broker, which will comply after having validated the authorization policy. +1. The client attempts to determine the owner of the topic by sending an HTTP lookup request to the broker. The request could reach one of the active brokers which, by looking at the (cached) zookeeper metadata knows who is serving the topic or, in case nobody is serving it, tries to assign it to the least loaded broker. +1. Once the client library has the broker address, it creates a TCP connection (or reuse an existing connection from the pool) and authenticates it. Within this connection, client and broker exchange binary commands from a custom protocol. At this point the client sends a command to create producer/consumer to the broker, which will comply after having validated the authorization policy. -Whenever the TCP connection breaks, the client will immediately re-initiate this setup phase and will keep trying with exponential backoff to re-establish the producer or consumer until the operation succeeds. +Whenever the TCP connection breaks, the client immediately re-initiates this setup phase and keeps trying with exponential backoff to re-establish the producer or consumer until the operation succeeds. ## Reader interface -In Pulsar, the "standard" [consumer interface](concepts-messaging.md#consumers) involves using consumers to listen on [topics](reference-terminology.md#topic), process incoming messages, and finally acknowledge those messages when they've been processed. Whenever a new subscription is created, it is initially positioned at the end of the topic (by default), and consumers associated with that subscription will begin rea
[pulsar] branch master updated: update 271 (#9065)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 5f3fac0 update 271 (#9065) 5f3fac0 is described below commit 5f3fac06fd534fe227c3bad8eb0804342b354347 Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Mon Dec 28 01:36:50 2020 +0100 update 271 (#9065) --- .../version-2.7.1/concepts-clients.md | 27 ++ 1 file changed, 12 insertions(+), 15 deletions(-) diff --git a/site2/website/versioned_docs/version-2.7.1/concepts-clients.md b/site2/website/versioned_docs/version-2.7.1/concepts-clients.md index eec4355..3df7abb 100644 --- a/site2/website/versioned_docs/version-2.7.1/concepts-clients.md +++ b/site2/website/versioned_docs/version-2.7.1/concepts-clients.md @@ -5,26 +5,26 @@ sidebar_label: Clients original_id: concepts-clients --- -Pulsar exposes a client API with language bindings for [Java](client-libraries-java.md), [Go](client-libraries-go.md), [Python](client-libraries-python.md) and [C++](client-libraries-cpp.md). The client API optimizes and encapsulates Pulsar's client-broker communication protocol and exposes a simple and intuitive API for use by applications. +Pulsar exposes a client API with language bindings for [Java](client-libraries-java.md), [Go](client-libraries-go.md), [Python](client-libraries-python.md) and [C++](client-libraries-cpp.md). The client API optimizes and encapsulates Pulsar's client-broker communication protocol and exposes a simple and intuitive API for use by applications. Under the hood, the current official Pulsar client libraries support transparent reconnection and/or connection failover to brokers, queuing of messages until acknowledged by the broker, and heuristics such as connection retries with backoff. -> Custom client libraries -> If you'd like to create your own client library, we recommend consulting the documentation on Pulsar's custom [binary protocol](developing-binary-protocol.md) +> **Custom client libraries** +> If you'd like to create your own client library, we recommend consulting the documentation on Pulsar's custom [binary protocol](developing-binary-protocol.md). ## Client setup phase -When an application wants to create a producer/consumer, the Pulsar client library will initiate a setup phase that is composed of two steps: +Before an application creates a producer/consumer, the Pulsar client library needs to initiate a setup phase including two steps: -1. The client will attempt to determine the owner of the topic by sending an HTTP lookup request to the broker. The request could reach one of the active brokers which, by looking at the (cached) zookeeper metadata will know who is serving the topic or, in case nobody is serving it, will try to assign it to the least loaded broker. -1. Once the client library has the broker address, it will create a TCP connection (or reuse an existing connection from the pool) and authenticate it. Within this connection, client and broker exchange binary commands from a custom protocol. At this point the client will send a command to create producer/consumer to the broker, which will comply after having validated the authorization policy. +1. The client attempts to determine the owner of the topic by sending an HTTP lookup request to the broker. The request could reach one of the active brokers which, by looking at the (cached) zookeeper metadata knows who is serving the topic or, in case nobody is serving it, tries to assign it to the least loaded broker. +1. Once the client library has the broker address, it creates a TCP connection (or reuse an existing connection from the pool) and authenticates it. Within this connection, client and broker exchange binary commands from a custom protocol. At this point the client sends a command to create producer/consumer to the broker, which will comply after having validated the authorization policy. -Whenever the TCP connection breaks, the client will immediately re-initiate this setup phase and will keep trying with exponential backoff to re-establish the producer or consumer until the operation succeeds. +Whenever the TCP connection breaks, the client immediately re-initiates this setup phase and keeps trying with exponential backoff to re-establish the producer or consumer until the operation succeeds. ## Reader interface -In Pulsar, the "standard" [consumer interface](concepts-messaging.md#consumers) involves using consumers to listen on [topics](reference-terminology.md#topic), process incoming messages, and finally acknowledge those messages when they've been processed. Whenever a new subscription is created, it is initially positioned at the end of the topic (by default), and consumers associated with
[pulsar] branch master updated: update 263 and 271 (#9062)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 924e584 update 263 and 271 (#9062) 924e584 is described below commit 924e58475c94de4f909d423c677b2cdf31bb56f7 Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Fri Dec 25 10:54:38 2020 +0100 update 263 and 271 (#9062) --- site2/website/versioned_docs/version-2.6.3/adaptors-spark.md | 7 +-- site2/website/versioned_docs/version-2.6.3/adaptors-storm.md | 6 ++ site2/website/versioned_docs/version-2.7.1/adaptors-spark.md | 6 +- site2/website/versioned_docs/version-2.7.1/adaptors-storm.md | 6 ++ 4 files changed, 6 insertions(+), 19 deletions(-) diff --git a/site2/website/versioned_docs/version-2.6.3/adaptors-spark.md b/site2/website/versioned_docs/version-2.6.3/adaptors-spark.md index 02e5c83..5db24e1 100644 --- a/site2/website/versioned_docs/version-2.6.3/adaptors-spark.md +++ b/site2/website/versioned_docs/version-2.6.3/adaptors-spark.md @@ -69,9 +69,4 @@ Pass an instance of `SparkStreamingPulsarReceiver` to the `receiverStream` metho JavaReceiverInputDStream lineDStream = jsc.receiverStream(pulsarReceiver); ``` - -## Example - -You can find a complete example [here](https://github.com/apache/pulsar/tree/master/examples/spark/src/main/java/org/apache/spark/streaming/receiver/example/SparkStreamingPulsarReceiverExample.java). -In this example, the number of messages which contain the string "Pulsar" in received messages is counted. - +For a complete example, click [here](https://github.com/apache/pulsar-adapters/blob/master/examples/spark/src/main/java/org/apache/spark/streaming/receiver/example/SparkStreamingPulsarReceiverExample.java). In this example, the number of messages that contain the string "Pulsar" in received messages is counted. diff --git a/site2/website/versioned_docs/version-2.6.3/adaptors-storm.md b/site2/website/versioned_docs/version-2.6.3/adaptors-storm.md index 431aa29..b6ac9cd 100644 --- a/site2/website/versioned_docs/version-2.6.3/adaptors-storm.md +++ b/site2/website/versioned_docs/version-2.6.3/adaptors-storm.md @@ -53,6 +53,8 @@ spoutConf.setMessageToValuesMapper(messageToValuesMapper); PulsarSpout spout = new PulsarSpout(spoutConf); ``` +For a complete example, click [here](https://github.com/apache/pulsar-adapters/blob/master/pulsar-storm/src/test/java/org/apache/pulsar/storm/PulsarSpoutTest.java). + ## Pulsar Bolt The Pulsar bolt allows data in a Storm topology to be published on a topic. It publishes messages based on the Storm tuple received and the `TupleToMessageMapper` provided by the client. @@ -85,7 +87,3 @@ boltConf.setTupleToMessageMapper(tupleToMessageMapper); // Create a Pulsar Bolt PulsarBolt bolt = new PulsarBolt(boltConf); ``` - -## Example - -You can find a complete example [here](https://github.com/apache/pulsar/tree/master/pulsar-storm/src/test/java/org/apache/pulsar/storm/example/StormExample.java). diff --git a/site2/website/versioned_docs/version-2.7.1/adaptors-spark.md b/site2/website/versioned_docs/version-2.7.1/adaptors-spark.md index e8ec85c..1dbb756 100644 --- a/site2/website/versioned_docs/version-2.7.1/adaptors-spark.md +++ b/site2/website/versioned_docs/version-2.7.1/adaptors-spark.md @@ -69,9 +69,5 @@ Pass an instance of `SparkStreamingPulsarReceiver` to the `receiverStream` metho JavaReceiverInputDStream lineDStream = jsc.receiverStream(pulsarReceiver); ``` - -## Example - -You can find a complete example [here](https://github.com/apache/pulsar/tree/master/examples/spark/src/main/java/org/apache/spark/streaming/receiver/example/SparkStreamingPulsarReceiverExample.java). -In this example, the number of messages which contain the string "Pulsar" in received messages is counted. +For a complete example, click [here](https://github.com/apache/pulsar-adapters/blob/master/examples/spark/src/main/java/org/apache/spark/streaming/receiver/example/SparkStreamingPulsarReceiverExample.java). In this example, the number of messages that contain the string "Pulsar" in received messages is counted. diff --git a/site2/website/versioned_docs/version-2.7.1/adaptors-storm.md b/site2/website/versioned_docs/version-2.7.1/adaptors-storm.md index 931b79a..c5b0f78 100644 --- a/site2/website/versioned_docs/version-2.7.1/adaptors-storm.md +++ b/site2/website/versioned_docs/version-2.7.1/adaptors-storm.md @@ -53,6 +53,8 @@ spoutConf.setMessageToValuesMapper(messageToValuesMapper); PulsarSpout spout = new PulsarSpout(spoutConf); ``` +For a complete example, click [here](https://github.com/apache/pulsar-adapters/blob/master/pulsar-storm/src/test/java/org/apache/pulsar/storm/PulsarSpoutTest.java). + ## Pulsar Bolt The Pulsar bolt allows data in a Storm topology to be published on a to
[pulsar] branch master updated (21206e7 -> f5c344e)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 21206e7 Update team info (#9059) add f5c344e [ISSUE] DOCS-8994 fix the links of examples (#9054) No new revisions were added by this update. Summary of changes: site2/docs/adaptors-spark.md | 6 +- site2/docs/adaptors-storm.md | 5 ++--- site2/website/versioned_docs/version-2.6.0/adaptors-spark.md | 6 +- site2/website/versioned_docs/version-2.6.0/adaptors-storm.md | 5 ++--- site2/website/versioned_docs/version-2.6.1/adaptors-spark.md | 7 +-- site2/website/versioned_docs/version-2.6.1/adaptors-storm.md | 5 ++--- site2/website/versioned_docs/version-2.6.2/adaptors-spark.md | 5 + site2/website/versioned_docs/version-2.6.2/adaptors-storm.md | 5 ++--- site2/website/versioned_docs/version-2.7.0/adaptors-spark.md | 7 +-- site2/website/versioned_docs/version-2.7.0/adaptors-storm.md | 5 ++--- 10 files changed, 15 insertions(+), 41 deletions(-)
[pulsar] branch master updated: [ISSUE 8477][docs] Duplicate info of using C++ in Pulsar (#8919)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 11b9359 [ISSUE 8477][docs] Duplicate info of using C++ in Pulsar
(#8919)
11b9359 is described below
commit 11b935930e8f041991a4d51baee20203fb28810b
Author: sijia-w <53718687+siji...@users.noreply.github.com>
AuthorDate: Thu Dec 24 11:07:58 2020 +0100
[ISSUE 8477][docs] Duplicate info of using C++ in Pulsar (#8919)
* fix 8477 doc issue
* update
* Update client-libraries-cpp.md
* update sidebars
---
site2/docs/client-libraries-cpp.md | 158 ++---
site2/docs/developing-cpp.md | 100 ---
site2/website/sidebars.json| 3 +-
3 files changed, 130 insertions(+), 131 deletions(-)
diff --git a/site2/docs/client-libraries-cpp.md
b/site2/docs/client-libraries-cpp.md
index c2c209a..c495f19 100644
--- a/site2/docs/client-libraries-cpp.md
+++ b/site2/docs/client-libraries-cpp.md
@@ -14,40 +14,100 @@ Pulsar C++ client is supported on **Linux** and **MacOS**
platforms.
[Doxygen](http://www.doxygen.nl/)-generated API docs for the C++ client are
available [here](/api/cpp).
+## System requirements
+
+You need to install the following components before using the C++ client:
+
+* [CMake](https://cmake.org/)
+* [Boost](http://www.boost.org/)
+* [Protocol Buffers](https://developers.google.com/protocol-buffers/) 2.6
+* [libcurl](https://curl.haxx.se/libcurl/)
+* [Google Test](https://github.com/google/googletest)
+
## Linux
+### Compilation
+
+1. Clone the Pulsar repository.
+
+```shell
+$ git clone https://github.com/apache/pulsar
+```
+
+2. Install all necessary dependencies.
+
+```shell
+$ apt-get install cmake libssl-dev libcurl4-openssl-dev liblog4cxx-dev \
+ libprotobuf-dev protobuf-compiler libboost-all-dev google-mock libgtest-dev
libjsoncpp-dev
+```
+
+3. Compile and install [Google Test](https://github.com/google/googletest).
+
+```shell
+# libgtest-dev version is 1.18.0 or above
+$ cd /usr/src/googletest
+$ sudo cmake .
+$ sudo make
+$ sudo cp ./googlemock/libgmock.a ./googlemock/gtest/libgtest.a /usr/lib/
+
+# less than 1.18.0
+$ cd /usr/src/gtest
+$ sudo cmake .
+$ sudo make
+$ sudo cp libgtest.a /usr/lib
+
+$ cd /usr/src/gmock
+$ sudo cmake .
+$ sudo make
+$ sudo cp libgmock.a /usr/lib
+```
+
+4. Compile the Pulsar client library for C++ inside the Pulsar repository.
+
+```shell
+$ cd pulsar-client-cpp
+$ cmake .
+$ make
+```
+
+After you install the components successfully, the files `libpulsar.so` and
`libpulsar.a` are in the `lib` folder of the repository. The tools
`perfProducer` and `perfConsumer` are in the `perf` directory.
+
+### Install Dependencies
+
> Since 2.1.0 release, Pulsar ships pre-built RPM and Debian packages. You can
> download and install those packages directly.
-Four kind of libraries `libpulsar.so` / `libpulsarnossl.so` / `libpulsar.a` /
`libpulsarwithdeps.a` are included in your `/usr/lib` after rpm/deb download
and install.
-By default, they are build under code path `${PULSAR_HOME}/pulsar-client-cpp`,
using command
- `cmake . -DBUILD_TESTS=OFF -DLINK_STATIC=ON && make pulsarShared
pulsarSharedNossl pulsarStatic pulsarStaticWithDeps -j 3`
-These libraries rely on some other libraries, if you want to get detailed
version of dependencies libraries, please reference
[these](https://github.com/apache/pulsar/blob/master/pulsar-client-cpp/pkg/rpm/Dockerfile)
[files](https://github.com/apache/pulsar/blob/master/pulsar-client-cpp/pkg/deb/Dockerfile).
+After you download and install RPM or DEB, the `libpulsar.so`,
`libpulsarnossl.so`, `libpulsar.a`, and `libpulsarwithdeps.a` libraries are in
your `/usr/lib` directory.
+
+By default, they are built in code path `${PULSAR_HOME}/pulsar-client-cpp`.
You can build with the command below.
+
+ `cmake . -DBUILD_TESTS=OFF -DLINK_STATIC=ON && make pulsarShared
pulsarSharedNossl pulsarStatic pulsarStaticWithDeps -j 3`.
+
+These libraries rely on some other libraries. If you want to get detailed
version of dependencies, see
[RPM](https://github.com/apache/pulsar/blob/master/pulsar-client-cpp/pkg/rpm/Dockerfile)
or
[DEB](https://github.com/apache/pulsar/blob/master/pulsar-client-cpp/pkg/deb/Dockerfile)
files.
+
+1. `libpulsar.so` is a shared library, containing statically linked `boost`
and `openssl`. It also dynamically links all other necessary libraries. You can
use this Pulsar library with the command below.
-1. `libpulsar.so` is the Shared library, it contains statically linked `boost`
and `openssl`, and will also dynamically link all other needed libraries.
-The command the when use this pulsar library is like this:
```bash
g++ --std=c++11 PulsarTest.cpp -o test /usr/lib/libpulsar.so
-I/usr/local/ssl/include
[pulsar] branch master updated (3604c67 -> 4da7a1b)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 3604c67 make namespaces policy update take effect on time (#8976) add 4da7a1b [website]Fixed generate sidebar and full documentation (#9025) No new revisions were added by this update. Summary of changes: site2/website/docusaurus-version.js | 66 ++--- site2/website/package.json | 2 +- 2 files changed, 34 insertions(+), 34 deletions(-) mode change 100644 => 100755 site2/website/docusaurus-version.js
[pulsar] branch master updated: [ISSUE 8909]Fix Giggso logo link error (#8937)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new a9e1ac3 [ISSUE 8909]Fix Giggso logo link error (#8937)
a9e1ac3 is described below
commit a9e1ac3c2e33716508a6fa30e2484db31798bd89
Author: Weijie Guo
AuthorDate: Mon Dec 14 09:18:01 2020 +0800
[ISSUE 8909]Fix Giggso logo link error (#8937)
* fix icon
* fix broker link
---
site2/docs/tiered-storage-gcs.md | 2 +-
site2/website/data/users.js | 3 ++-
2 files changed, 3 insertions(+), 2 deletions(-)
diff --git a/site2/docs/tiered-storage-gcs.md b/site2/docs/tiered-storage-gcs.md
index bed4dc0..b6fec1a 100644
--- a/site2/docs/tiered-storage-gcs.md
+++ b/site2/docs/tiered-storage-gcs.md
@@ -223,7 +223,7 @@ For individual topics, you can trigger GCS offloader
manually using one of the f
> Tip
>
-> For more information about the `pulsar-admin topics offload options`
command, including flags, descriptions, default values, and shorthands, see
[here]((reference-pulsar-admin.md#offload).
+> For more information about the `pulsar-admin topics offload options`
command, including flags, descriptions, default values, and shorthands, see
[here](reference-pulsar-admin.md#offload).
- This example checks the GCS offloader status using pulsar-admin with the
command `pulsar-admin topics offload-status options`.
diff --git a/site2/website/data/users.js b/site2/website/data/users.js
index 3f3a809..2d68915 100644
--- a/site2/website/data/users.js
+++ b/site2/website/data/users.js
@@ -13,7 +13,8 @@ module.exports = [
{
name: 'Giggso',
url: 'https://giggso.com/',
-logo:
'https://pbs.twimg.com/profile_banners/4179602009/1470596851/600x200'
+logo: 'https://www.giggso.com/wp-content/uploads/2019/11/logo-2.png',
+logo_white: true
},
{
name: 'STICorp',
[pulsar] branch master updated (dc2596f -> 456f265)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from dc2596f [website] Update the format issue (#8773) add 456f265 [docs] Update Websocket content (#8762) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-websocket.md | 6 +++--- site2/docs/getting-started-clients.md| 2 +- site2/website/sidebars.json | 1 + 3 files changed, 5 insertions(+), 4 deletions(-)
[pulsar] 01/01: [website] Update the format issue
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch Jennifer88huang-patch-1
in repository https://gitbox.apache.org/repos/asf/pulsar.git
commit 4574ac720c8209e08a4cef1af19acf0ef2a637ab
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Wed Dec 2 10:36:16 2020 +0800
[website] Update the format issue
---
site2/website/data/connectors.js | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/site2/website/data/connectors.js b/site2/website/data/connectors.js
index 9933d53..4182f2c 100644
--- a/site2/website/data/connectors.js
+++ b/site2/website/data/connectors.js
@@ -136,7 +136,7 @@ module.exports = [
longName: 'NSQ source',
type: 'Source',
link: 'https://nsq.io/',
-}
+},
{
name: 'rabbitmq',
longName: 'RabbitMQ source and sink',
[pulsar] branch Jennifer88huang-patch-1 created (now 4574ac7)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch Jennifer88huang-patch-1 in repository https://gitbox.apache.org/repos/asf/pulsar.git. at 4574ac7 [website] Update the format issue This branch includes the following new commits: new 4574ac7 [website] Update the format issue The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[pulsar] branch master updated: [docs] Fix incorrect command (#8758)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 91e2f83 [docs] Fix incorrect command (#8758) 91e2f83 is described below commit 91e2f832178d9ffd5d78161145d895910296c2d9 Author: Zixuan Liu AuthorDate: Tue Dec 1 17:15:29 2020 +0800 [docs] Fix incorrect command (#8758) --- site2/docs/deploy-docker.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/site2/docs/deploy-docker.md b/site2/docs/deploy-docker.md index 3d29035..1b663b3 100644 --- a/site2/docs/deploy-docker.md +++ b/site2/docs/deploy-docker.md @@ -18,7 +18,7 @@ To run Pulsar on Docker, you need to create a container for each Pulsar componen You can pull a Pulsar image from [Docker Hub](https://hub.docker.com/r/apachepulsar/pulsar-all/tags) with the following command. ``` -docker run -it apachepulsar/pulsar-all:latest +docker pull apachepulsar/pulsar-all:latest ``` ### Create three containers
[pulsar] branch master updated: [docs] Add transactions in the sidebar (#8692)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new bf0db51 [docs] Add transactions in the sidebar (#8692)
bf0db51 is described below
commit bf0db51fdc3b65453e789aaaf05e629f98788ee1
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Wed Nov 25 22:29:31 2020 +0800
[docs] Add transactions in the sidebar (#8692)
* add transaction in the sidebar
* keep transactions consitent in the docs
* update
* update
---
site2/docs/concepts-transactions.md | 4 ++--
site2/docs/transaction-api.md | 6 +++---
site2/docs/transaction-guarantee.md | 6 +++---
site2/website/sidebars.json | 9 ++---
4 files changed, 14 insertions(+), 11 deletions(-)
diff --git a/site2/docs/concepts-transactions.md
b/site2/docs/concepts-transactions.md
index c525ddc..592122a 100644
--- a/site2/docs/concepts-transactions.md
+++ b/site2/docs/concepts-transactions.md
@@ -1,7 +1,7 @@
---
-id: transaction
+id: transactions
title: Transactions
-sidebar_label: Transaction Concepts
+sidebar_label: Overview
---
Transactional semantics enable event streaming applications to consume,
process, and produce messages in one atomic operation. In Pulsar, a producer or
consumer can work with messages across multiple topics and partitions and
ensure those messages are processed as a single unit.
diff --git a/site2/docs/transaction-api.md b/site2/docs/transaction-api.md
index 9d20191..70ade5e 100644
--- a/site2/docs/transaction-api.md
+++ b/site2/docs/transaction-api.md
@@ -1,7 +1,7 @@
---
-id: transaction-api
-title: Transaction API(Developer Preview)
-sidebar_label: Transaction API
+id: transactions-api
+title: Transactions API (Developer Preview)
+sidebar_label: Transactions API
---
All messages in a transaction is available only to consumers after the
transaction is committed. If a transaction is aborted, all the writes and
acknowledgments in this transaction rollback.
diff --git a/site2/docs/transaction-guarantee.md
b/site2/docs/transaction-guarantee.md
index 1c28b4f..73c7c68 100644
--- a/site2/docs/transaction-guarantee.md
+++ b/site2/docs/transaction-guarantee.md
@@ -1,7 +1,7 @@
---
-id: transaction-guarantee
-title: Transaction Guarantee
-sidebar_label: Transaction Guarantee
+id: transactions-guarantee
+title: Transactions Guarantee
+sidebar_label: Transactions Guarantee
---
Pulsar transactions support the following guarantee.
diff --git a/site2/website/sidebars.json b/site2/website/sidebars.json
index e273d7c..d096801 100644
--- a/site2/website/sidebars.json
+++ b/site2/website/sidebars.json
@@ -1,11 +1,9 @@
{
"docs": {
"Get started": [
- "pulsar-2.0",
"standalone",
"standalone-docker",
- "kubernetes-helm",
- "client-libraries"
+ "kubernetes-helm"
],
"Concepts and Architecture": [
"concepts-overview",
@@ -57,6 +55,11 @@
"tiered-storage-gcs",
"tiered-storage-filesystem"
],
+ "Transactions": [
+"transactions",
+"transactions-guarantee",
+"transactions-api"
+ ],
"Kubernetes (Helm)": [
"helm-overview",
"helm-prepare",
[pulsar] branch master updated: [docs] Merge persistent and partitioned topics content in one file (#8462)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 570d60f [docs] Merge persistent and partitioned topics content in one
file (#8462)
570d60f is described below
commit 570d60f26fe905e485ec2c3ff74cfde8963b7cdb
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Sun Nov 8 11:08:22 2020 +0800
[docs] Merge persistent and partitioned topics content in one file (#8462)
* merge persistent and partitioned topics
* add a note to clarify the usage of schema
* refine name file and id
* update sidebar
---
site2/docs/admin-api-partitioned-topics.md | 426 +
...pi-persistent-topics.md => admin-api-topics.md} | 426 -
site2/website/sidebars.json| 2 +-
3 files changed, 427 insertions(+), 427 deletions(-)
diff --git a/site2/docs/admin-api-partitioned-topics.md
b/site2/docs/admin-api-partitioned-topics.md
index 8a02b46..ef01f6f 100644
--- a/site2/docs/admin-api-partitioned-topics.md
+++ b/site2/docs/admin-api-partitioned-topics.md
@@ -1,427 +1,5 @@
---
id: admin-api-partitioned-topics
title: Managing partitioned topics
-sidebar_label: Topics1
-
-## Manage partitioned topics
-You can use Pulsar [admin API](admin-api-overview.md) to create, update,
delete and check status of partitioned topics.
-
-### Create
-
-Partitioned topics must be explicitly created. When creating a new partitioned
topic, you need to provide a name and the number of partitions for the topic.
-
-By default, 60 seconds after creation, topics are considered inactive and
deleted automatically to avoid generating trash data. To disable this feature,
set `brokerDeleteInactiveTopicsEnabled` to `false`. To change the frequency of
checking inactive topics, set `brokerDeleteInactiveTopicsFrequencySeconds` to a
specific value.
-
-For more information about the two parameters, see
[here](reference-configuration.md#broker).
-
-You can create partitioned topics in the following ways.
-
-
-When you create partitioned topics with the
[`create-partitioned-topic`](reference-pulsar-admin.md#create-partitioned-topic)
-command, you need to specify the topic name as an argument and the number of
partitions using the `-p` or `--partitions` flag.
-
-```shell
-$ bin/pulsar-admin topics create-partitioned-topic \
- persistent://my-tenant/my-namespace/my-topic \
- --partitions 4
-```
-
-> **Note**
-> If a non-partitioned topic with the suffix '-partition-' followed by a
numeric value like 'xyz-topic-partition-10', you can not create a partitioned
topic with name 'xyz-topic', because the partitions of the partitioned topic
could override the existing non-partitioned topic. To create such partitioned
topic, you have to delete that non-partitioned topic first.
-
-
-{@inject:
endpoint|PUT|/admin/v2/topics/:tenant/:namespace/:topic/partitions|operation/createPartitionedTopic}
-
-
-```java
-String topicName = "persistent://my-tenant/my-namespace/my-topic";
-int numPartitions = 4;
-admin.topics().createPartitionedTopic(topicName, numPartitions);
-```
-
-
-
-### Create missed partitions
-
-When topic auto-creation is disabled, and you have a partitioned topic without
any partitions, you can use the
[`create-missed-partitions`](reference-pulsar-admin.md#create-missed-partitions)
command to create partitions for the topic.
-
-
-
-You can create missed partitions with the
[`create-missed-partitions`](reference-pulsar-admin.md#create-missed-partitions)
command and specify the topic name as an argument.
-
-```shell
-$ bin/pulsar-admin topics create-missed-partitions \
- persistent://my-tenant/my-namespace/my-topic \
-```
-
-
-{@inject:
endpoint|POST|/admin/v2/topics/:tenant/:namespace/:topic|operation/createMissedPartitions}
-
-
-```java
-String topicName = "persistent://my-tenant/my-namespace/my-topic";
-admin.topics().createMissedPartitions(topicName);
-```
-
-
-
-### Get metadata
-
-Partitioned topics are associated with metadata, you can view it as a JSON
object. The following metadata field is available.
-
-Field | Description
-:-|:---
-`partitions` | The number of partitions into which the topic is divided.
-
-
-
-You can check the number of partitions in a partitioned topic with the
[`get-partitioned-topic-metadata`](reference-pulsar-admin.md#get-partitioned-topic-metadata)
subcommand.
-
-```shell
-$ pulsar-admin topics get-partitioned-topic-metadata \
- persistent://my-tenant/my-namespace/my-topic
-{
- "partitions": 4
-}
-```
-
-
-{@inject:
endpoint|GET|/admin/v2/topics/:tenant/:namespace/:topic/partitions|operation/getPartitionedMetadata}
-
-
-```java
-String topicName = "persistent://my-tenant/my-namespace/my-topic"
[pulsar] branch master updated (3142456 -> a145858)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 3142456 [C++] Allow to configure KeyShared with out of order delivery (#7842) add a145858 [docs] Re-org topics in Admin API section (#8375) No new revisions were added by this update. Summary of changes: site2/docs/admin-api-non-persistent-topics.md | 260 +--- site2/docs/admin-api-persistent-topics.md | 549 +- site2/website/sidebars.json | 3 - 3 files changed, 269 insertions(+), 543 deletions(-)
[pulsar] branch master updated (2d1b86f -> 75a26a8)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2d1b86f [Issue 7372][docs] Add detailed info for retention policy (#8397) add 75a26a8 [docs] Prepare partitioned and non-partioned topic resources (#8388) No new revisions were added by this update. Summary of changes: site2/docs/admin-api-non-partitioned-topics.md | 158 + site2/docs/admin-api-partitioned-topics.md | 469 ++--- 2 files changed, 262 insertions(+), 365 deletions(-)
[pulsar] branch master updated (2aa3093 -> 2d1b86f)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2aa3093 Fix typo in docs (#8438) add 2d1b86f [Issue 7372][docs] Add detailed info for retention policy (#8397) No new revisions were added by this update. Summary of changes: site2/docs/cookbooks-retention-expiry.md | 56 +--- site2/docs/reference-configuration.md | 2 +- .../version-2.6.1/cookbooks-retention-expiry.md| 74 -- 3 files changed, 88 insertions(+), 44 deletions(-)
[pulsar] branch master updated (fe5cea3 -> 2aa3093)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from fe5cea3 Fix returned status code for get function state when state does not exist (#8437) add 2aa3093 Fix typo in docs (#8438) No new revisions were added by this update. Summary of changes: site2/docs/concepts-messaging.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[pulsar] branch master updated (7285380 -> 06c9f57)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 7285380 [Issue 7742][functions] Allow kubernetes runtime to customize function instance class path (#7844) add 06c9f57 update helm deploy (#8404) No new revisions were added by this update. Summary of changes: site2/website/versioned_docs/version-2.6.1/helm-deploy.md | 3 +-- site2/website/versioned_docs/version-2.6.2/helm-deploy.md | 1 - 2 files changed, 1 insertion(+), 3 deletions(-)
[pulsar] branch master updated: [Issue 8345][Documentation] Improve retention policy documentation (#8356)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new a9633b5 [Issue 8345][Documentation] Improve retention policy
documentation (#8356)
a9633b5 is described below
commit a9633b5b95ebe37c333c8eac59634a123ae2f2e3
Author: Lari Hotari
AuthorDate: Mon Oct 26 03:01:18 2020 +0200
[Issue 8345][Documentation] Improve retention policy documentation (#8356)
* Clarify javadoc documentation of ManagedLedger retention time and
retention size
- explain the settings in other words to clarify the meaning
* Clarify retention policy documentation
Fixes #8345
- the retention policy is based on both size and time
- documentation was misleading and not accurate
- setting either limit to 0 disables retention policy
- add this also to the documentation explicitly
* Fix checkstyle violation
---
.../bookkeeper/mledger/ManagedLedgerConfig.java| 23 +++---
.../common/policies/data/RetentionPolicies.java| 6
site2/docs/cookbooks-retention-expiry.md | 35 +-
site2/docs/reference-terminology.md| 2 +-
4 files changed, 47 insertions(+), 19 deletions(-)
diff --git
a/managed-ledger/src/main/java/org/apache/bookkeeper/mledger/ManagedLedgerConfig.java
b/managed-ledger/src/main/java/org/apache/bookkeeper/mledger/ManagedLedgerConfig.java
index 7a6dcbf..23dff99 100644
---
a/managed-ledger/src/main/java/org/apache/bookkeeper/mledger/ManagedLedgerConfig.java
+++
b/managed-ledger/src/main/java/org/apache/bookkeeper/mledger/ManagedLedgerConfig.java
@@ -378,15 +378,16 @@ public class ManagedLedgerConfig {
}
/**
- * Set the retention time for the ManagedLedger
+ * Set the retention time for the ManagedLedger.
*
- * Retention time will prevent data from being deleted for at least the
specified amount of time, even if no cursors
- * are created, or if all the cursors have marked the data for deletion.
+ * Retention time and retention size ({@link #setRetentionSizeInMB(long)})
are together used to retain the
+ * ledger data when when there are no cursors or when all the cursors have
marked the data for deletion.
+ * Data will be deleted in this case when both retention time and
retention size settings don't prevent deleting
+ * the data marked for deletion.
*
- * A retention time of 0 (the default), will to have no time based
retention.
+ * A retention time of 0 (default) will make data to be deleted
immediately.
*
- * Specifying a negative retention time will make the data to be retained
indefinitely, based on the
- * {@link #setRetentionSizeInMB(long)} value.
+ * A retention time of -1 , means to have an unlimited retention time.
*
* @param retentionTime
*duration for which messages should be retained
@@ -409,12 +410,14 @@ public class ManagedLedgerConfig {
/**
* The retention size is used to set a maximum retention size quota on the
ManagedLedger.
*
- * This setting works in conjuction with {@link
#setRetentionSizeInMB(long)} and places a max size for retention,
- * after which the data is deleted.
+ * Retention size and retention time ({@link #setRetentionTime(int,
TimeUnit)}) are together used to retain the
+ * ledger data when when there are no cursors or when all the cursors have
marked the data for deletion.
+ * Data will be deleted in this case when both retention time and
retention size settings don't prevent deleting
+ * the data marked for deletion.
*
- * A retention size of 0, will make data to be deleted immediately.
+ * A retention size of 0 (default) will make data to be deleted
immediately.
*
- * A retention size of -1, means to have an unlimited retention size.
+ * A retention size of -1 , means to have an unlimited retention size.
*
* @param retentionSizeInMB
*quota for message retention
diff --git
a/pulsar-common/src/main/java/org/apache/pulsar/common/policies/data/RetentionPolicies.java
b/pulsar-common/src/main/java/org/apache/pulsar/common/policies/data/RetentionPolicies.java
index c4b8688..4049708 100644
---
a/pulsar-common/src/main/java/org/apache/pulsar/common/policies/data/RetentionPolicies.java
+++
b/pulsar-common/src/main/java/org/apache/pulsar/common/policies/data/RetentionPolicies.java
@@ -20,6 +20,12 @@ package org.apache.pulsar.common.policies.data;
/**
* Definition of the retention policy.
+ *
+ * When you set a retention policy you must set **both** a *size limit* and
a *time limit*.
+ * In the case where you don't want to limit by either time or set, the value
must be set to `-1`.
+ * Retention policy will be effectively disabled
[pulsar] branch master updated (8ddd6ba -> 9951ddc)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 8ddd6ba Close ZK connections at end of metadata setup (#8228) add 9951ddc Support limit max subscriptions per topic (#8289) No new revisions were added by this update. Summary of changes: conf/broker.conf | 5 ++ conf/standalone.conf | 5 ++ deployment/terraform-ansible/templates/broker.conf | 5 ++ .../apache/pulsar/broker/ServiceConfiguration.java | 8 ++ .../broker/service/persistent/PersistentTopic.java | 35 ++--- .../apache/pulsar/broker/admin/AdminApiTest2.java | 88 ++ 6 files changed, 137 insertions(+), 9 deletions(-)
[pulsar] branch master updated: [docs] Add how to SerDe for Java function (#8278)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 96804b7 [docs] Add how to SerDe for Java function (#8278)
96804b7 is described below
commit 96804b7c7749fe70619a906efd64a2d021b5532f
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Mon Oct 19 12:14:24 2020 +0800
[docs] Add how to SerDe for Java function (#8278)
* add info for schema in Java function
* fix typos
* address comments
---
site2/docs/functions-develop.md | 20 +---
1 file changed, 9 insertions(+), 11 deletions(-)
diff --git a/site2/docs/functions-develop.md b/site2/docs/functions-develop.md
index 2191507..4b6a206 100644
--- a/site2/docs/functions-develop.md
+++ b/site2/docs/functions-develop.md
@@ -4,7 +4,7 @@ title: Develop Pulsar Functions
sidebar_label: "How-to: Develop"
---
-This tutorial walks you through how to develop Pulsar Functions.
+You learn how to develop Pulsar Functions with different APIs for Java, Python
and Go.
## Available APIs
In Java and Python, you have two options to write Pulsar Functions. In Go, you
can use Pulsar Functions SDK for Go.
@@ -104,22 +104,14 @@ For complete code, see
[here](https://github.com/apache/pulsar/blob/master/pulsa
## Schema registry
-Pulsar has a built in schema registry and comes bundled with a variety of
popular schema types(avro, json and protobuf). Pulsar Functions can leverage
existing schema information from input topics and derive the input type. The
schema registry applies for output topic as well.
+Pulsar has a built-in schema registry and is bundled with popular schema
types, such as Avro, JSON and Protobuf. Pulsar Functions can leverage the
existing schema information from input topics and derive the input type. The
schema registry applies for output topic as well.
## SerDe
SerDe stands for **Ser**ialization and **De**serialization. Pulsar Functions
uses SerDe when publishing data to and consuming data from Pulsar topics. How
SerDe works by default depends on the language you use for a particular
function.
-When you write Pulsar Functions in Java, the following basic Java types are
built in and supported by default:
-
-* `String`
-* `Double`
-* `Integer`
-* `Float`
-* `Long`
-* `Short`
-* `Byte`
+When you write Pulsar Functions in Java, the following basic Java types are
built in and supported by default: `String`, `Double`, `Integer`, `Float`,
`Long`, `Short`, and `Byte`.
To customize Java types, you need to implement the following interface.
@@ -129,6 +121,12 @@ public interface SerDe {
byte[] serialize(T input);
}
```
+SerDe works in the following ways in Java Functions.
+- If the input and output topics have schema, Pulsar Functions use schema for
SerDe.
+- If the input or output topics do not exist, Pulsar Functions adopt the
following rules to determine SerDe:
+ - If the schema type is specified, Pulsar Functions use the specified schema
type.
+ - If SerDe is specified, Pulsar Functions use the specified SerDe, and the
schema type for input and output topics is `Byte`.
+ - If neither the schema type nor SerDe is specified, Pulsar Functions use
the built-in SerDe. For non-primitive schema type, the built-in SerDe
serializes and deserializes objects in the `JSON` format.
In Python, the default SerDe is identity, meaning that the type is serialized
as whatever type the producer function returns.
[pulsar] branch master updated (3a298f3 -> 757cd5a)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 3a298f3 Use ThreadPoolExecutor instead of EventLoop (#8208) add 757cd5a update CFP dates (#8255) No new revisions were added by this update. Summary of changes: site2/website/blog/2020-09-01-pulsar-summit-asia-2020-cfp.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
[pulsar] branch master updated: add newland logo (#8113)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 07dc484 add newland logo (#8113)
07dc484 is described below
commit 07dc484e509c418ce3c685a7450da5517793365c
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Wed Sep 23 17:43:10 2020 +0800
add newland logo (#8113)
---
site2/website/data/users.js | 5 +
1 file changed, 5 insertions(+)
diff --git a/site2/website/data/users.js b/site2/website/data/users.js
index d2d5ff6..3f3a809 100644
--- a/site2/website/data/users.js
+++ b/site2/website/data/users.js
@@ -249,6 +249,11 @@ module.exports = [
logo:
'https://media-exp1.licdn.com/dms/image/C4D0BAQEoQxITTypd9g/company-logo_200_200/0?e=1608768000=beta=AbpUaraLUWyqUQcBiF3qYel_T0k-5W1JSEUw5qAqGj8',
},
{
+name: 'Newland',
+url: 'http://www.nlsoft.com.cn/',
+logo: 'http://www.nlsoft.com.cn/images/common/logo.png',
+},
+{
name: 'Appen',
url: 'https://www.appen.com.cn/',
logo:
'https://resources.appen.com/wp-content/uploads/2020/03/no-tagline.svg',
[pulsar] branch master updated: Use the CN website asper Appen (#8112)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 0ccd608 Use the CN website asper Appen (#8112)
0ccd608 is described below
commit 0ccd60861f769e1cd4e7df9aa7b2ab80de4cf9c6
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Wed Sep 23 16:39:12 2020 +0800
Use the CN website asper Appen (#8112)
---
site2/website/data/users.js | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/site2/website/data/users.js b/site2/website/data/users.js
index df4a6ea..d2d5ff6 100644
--- a/site2/website/data/users.js
+++ b/site2/website/data/users.js
@@ -250,7 +250,7 @@ module.exports = [
},
{
name: 'Appen',
-url: 'https://appen.com/',
+url: 'https://www.appen.com.cn/',
logo:
'https://resources.appen.com/wp-content/uploads/2020/03/no-tagline.svg',
}
].sort((a, b) => (a.name > b.name) ? 1 : -1);
[pulsar] branch master updated (bf96619 -> 3853b3a)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from bf96619 Cancel retry if the error is autheticate failed (#8058) add 3853b3a [Issue 5399][docs] Update KubernetesSecretsTokenAuthProvider docs (#7806) No new revisions were added by this update. Summary of changes: site2/docs/functions-runtime.md | 130 ++-- 1 file changed, 58 insertions(+), 72 deletions(-)
[pulsar] branch master updated (c1b85f8 -> 072c6be)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from c1b85f8 Allow to configure basic rate limiting for HTTP requests (#8031) add 072c6be [Docs] Cleanup broker documentation (#8053) No new revisions were added by this update. Summary of changes: site2/docs/admin-api-namespaces.md | 47 ++-- site2/docs/concepts-architecture-overview.md | 5 ++- site2/docs/concepts-authentication.md| 2 +- 3 files changed, 29 insertions(+), 25 deletions(-)
[pulsar] branch master updated (ff6876c -> a304332)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from ff6876c [cpp-client] Fix for not respecting custom LoggerFactory client config (#7932) add a304332 [docs] Update Functions package content (#8005) No new revisions were added by this update. Summary of changes: site2/docs/functions-package.md | 334 +++- 1 file changed, 120 insertions(+), 214 deletions(-)
[pulsar] branch master updated (8933d8d -> 7154185)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 8933d8d Fix dispatchRate is overwritten (#8004) add 7154185 Fix comment: pulsar.Client.create_producer() (#7972) No new revisions were added by this update. Summary of changes: pulsar-client-cpp/python/pulsar/__init__.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[pulsar] branch master updated: [DOCS] Small improvements and clarifications around AuthN / AuthZ (#7976)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 18a54c4 [DOCS] Small improvements and clarifications around AuthN / AuthZ (#7976) 18a54c4 is described below commit 18a54c4105399d40e4e46147c720d0fcd88c42d0 Author: Frank J Kelly AuthorDate: Mon Sep 7 21:56:47 2020 -0400 [DOCS] Small improvements and clarifications around AuthN / AuthZ (#7976) * Small documentation improvements and clarifications around AuthN / AuthZ * PR feedback and added some clarifications --- site2/docs/security-authorization.md | 9 + site2/docs/security-extending.md | 16 +--- 2 files changed, 14 insertions(+), 11 deletions(-) diff --git a/site2/docs/security-authorization.md b/site2/docs/security-authorization.md index 60d4f1a..e4c3b2f 100644 --- a/site2/docs/security-authorization.md +++ b/site2/docs/security-authorization.md @@ -24,17 +24,18 @@ superUserRoles=my-super-user-1,my-super-user-2 > A full list of parameters is available in the `conf/broker.conf` file. > You can also find the default values for those parameters in [Broker > Configuration](reference-configuration.md#broker). -Typically, you can not only use superuser roles for administrators and clients but also for broker-to-broker authorization. When you use [geo-replication](concepts-replication.md), every broker needs to be able to publish to all the other topics of clusters. +Typically, you use superuser roles for administrators, clients as well as broker-to-broker authorization. When you use [geo-replication](concepts-replication.md), every broker needs to be able to publish to all the other topics of clusters. -You can also enable the authorization for the proxy in the proxy configuration file (`conf/proxy.conf`). Once you enable the authorization on the proxy, the proxy does an additional authorization check before forwarding the request to a broker. The broker still checks the authorization of the request when the broker receives the forwarded request. +You can also enable the authorization for the proxy in the proxy configuration file (`conf/proxy.conf`). Once you enable the authorization on the proxy, the proxy does an additional authorization check before forwarding the request to a broker. +If you enable authorization on the broker, the broker checks the authorization of the request when the broker receives the forwarded request. ### Proxy Roles By default, the broker treats the connection between a proxy and the broker as a normal user connection. The broker authenticates the user as the role configured in `proxy.conf`(see ["Enable TLS Authentication on Proxies"](security-tls-authentication.md#enable-tls-authentication-on-proxies)). However, when the user connects to the cluster through a proxy, the user rarely requires the authentication. The user expects to be able to interact with the cluster as the role for which they have [...] -Pulsar uses *Proxy roles* to enable the authentication. Proxy roles are specified in the broker configuration file, [`conf/broker.conf`](reference-configuration.md#broker). If a client that is authenticated with a broker is one of its ```proxyRoles```, all requests from that client must also carry information about the role of the client that is authenticated with the proxy. This information is called the *original principle*. If the *original principle* misses, the client is not able to [...] +Pulsar uses *Proxy roles* to enable the authentication. Proxy roles are specified in the broker configuration file, [`conf/broker.conf`](reference-configuration.md#broker). If a client that is authenticated with a broker is one of its ```proxyRoles```, all requests from that client must also carry information about the role of the client that is authenticated with the proxy. This information is called the *original principal*. If the *original principal* is absent, the client is not able [...] -You must authorize the *proxy role* and the *original principle* to access a resource. Thus that resource can be accessible via the proxy. Administrators can take two approaches to authorize the *proxy role* and the *original principle*. +You must authorize both the *proxy role* and the *original principal* to access a resource to ensure that the resource is accessible via the proxy. Administrators can take two approaches to authorize the *proxy role* and the *original principal*. The more secure approach is to grant access to the proxy roles each time you grant access to a resource. For example, if you have a proxy role named `proxy1`, when the superuser creats a tenant, you should specify `proxy1` as one of the admin roles. When a role is granted permissions to produce or consume from a namespace, if that clie
[pulsar] branch master updated (c9026ca -> 0ca52f3)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from c9026ca update aws (#7961) add 0ca52f3 update node client document (#7966) No new revisions were added by this update. Summary of changes: site2/docs/client-libraries-node.md | 27 +++ 1 file changed, 27 insertions(+)
[pulsar] branch master updated: update aws (#7961)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new c9026ca update aws (#7961) c9026ca is described below commit c9026ca908b43c9d66708ca9627585ff173fea06 Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Thu Sep 3 10:46:26 2020 +0200 update aws (#7961) --- site2/docs/reference-configuration.md | 1 - 1 file changed, 1 deletion(-) diff --git a/site2/docs/reference-configuration.md b/site2/docs/reference-configuration.md index d37bc2d..2d6b49f 100644 --- a/site2/docs/reference-configuration.md +++ b/site2/docs/reference-configuration.md @@ -339,7 +339,6 @@ subscriptionExpirationTimeMinutes | How long to delete inactive subscriptions fr |maxMessagePublishBufferSizeInMB|The maximum memory size for broker handling messages sent from producers. If the processing message size exceeds this value, broker stops reading data from the connection. The processing messages means messages are sent to broker but broker have not sent response to the client. Usually the message are waiting to be written to bookies. It's shared across all the topics running in the same broker. The value `-1` disables the memory limitation. By default, i [...] |messagePublishBufferCheckIntervalInMillis|Interval between checks to see if message publish buffer size exceeds the maximum. Use `0` or negative number to disable the max publish buffer limiting.|100| |retentionCheckIntervalInSeconds|Check between intervals to see if consumed ledgers need to be trimmed. Use 0 or negative number to disable the check.|120| - | maxMessageSize | Set the maximum size of a message. | 5242880 | | preciseTopicPublishRateLimiterEnable | Enable precise topic publish rate limiting. | false |
[pulsar] branch master updated: [blog] Add Pulsar Summit Asia 2020 CFP blog (#7886)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 2248a2e [blog] Add Pulsar Summit Asia 2020 CFP blog (#7886) 2248a2e is described below commit 2248a2ef31300f8c360762dbcc0a77594034d35d Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> AuthorDate: Wed Sep 2 15:18:18 2020 +0800 [blog] Add Pulsar Summit Asia 2020 CFP blog (#7886) * Add Pulsar Summit CFP blog * update * Update 2020-08-25-pulsar-summit-asia-2020-cfp.md --- .../blog/2020-08-25-pulsar-summit-asia-2020-cfp.md | 51 ++ 1 file changed, 51 insertions(+) diff --git a/site2/website/blog/2020-08-25-pulsar-summit-asia-2020-cfp.md b/site2/website/blog/2020-08-25-pulsar-summit-asia-2020-cfp.md new file mode 100644 index 000..7955545 --- /dev/null +++ b/site2/website/blog/2020-08-25-pulsar-summit-asia-2020-cfp.md @@ -0,0 +1,51 @@ +--- +author: Jennifer Huang +authorURL: https://twitter.com/Jennife06125739 +title: Pulsar Summit Asia 2020 CFP is now open + +--- + +The Pulsar Summit is an annual conference dedicated to the Apache Pulsar community. The summit brings together an international audience of CTOs/CIOs, developers, data architects, data scientists, Apache Pulsar committers/contributors, and the messaging and streaming community. Together, they share experiences, ideas, and insights on Pulsar and its growing community, and receive hands-on training sessions led by Pulsar experts. + +After a very successful Pulsar Summit Virtual Conference in June, we have decided to present our Pulsar Summit Asia 2020 in the same way on November 28-29, 2020. The two-day conference will be free to attend! Are you interested in presenting? Suggested topics include Pulsar use cases, operations, technology deep dive, and ecosystem. CFP and registration are now open! + +## Speak at Pulsar Summit +The opportunity to speak at the second global Pulsar Summit is a great chance to participate in the rapidly growing Apache Pulsar community. Join us for the opportunity to be on stage with top Pulsar thought-leaders, including Apache Pulsar PMC members Sijie Guo and Jia Zhai from [StreamNative](https://streamnative.io/), Penghui Li from Zhaopin.com, Nozomi Kurihara from [Yahoo Japan Corporation](https://about.yahoo.co.jp/), and other community leaders such as Dezhi Liu from [Tencent](htt [...] + +If you have questions about submitting a proposal, or want some feedback or advice in general, please do not hesitate to reach out to [organiz...@pulsar-summit.org](mailto:organiz...@pulsar-summit.org). We are happy to help out! Details are available on the [CFP website](https://pulsar-summit.org/en/event/asia-2020/cfp). + +## Dates to remember +- CFP opens: September 1, 2020 +- CFP closes: October 14, 2020 - 23:59 (CST: China Standard Time/UTC+8 time zone) +- CFP notification: October 21, 2020 +- Schedule announcement: October 28, 2020 + +## Speaker benefits +When your speaking proposal is approved, you will enjoy the following benefits: + +- The opportunity to expand your network and raise your profile in the Apache Pulsar community. +- The chance to demonstrate your experience and deep knowledge in the rapidly growing event streaming space. +- Your name, title, company, and bio will be featured on the Pulsar Summit Asia 2020 website. +- Your session will be added to the Pulsar Summit YouTube Channel and promoted on Twitter and LinkedIn. +- A professionally produced video of your presentation. + +## Speaker requirements +In addition to your talk, we ask that you actively participate in promoting the event via your personal and company channels. These include posting on your Twitter, LinkedIn, WeChat, Weibo, blog and other channels. We would also like to work directly with your marketing team on co-marketing opportunities. These include, but are not limited to, posting to your company’s Twitter, LinkedIn, WeChat and other developer communities and sending a dedicated Pulsar Summit email to your company’s [...] + +## Registration +If you are interested in attending Pulsar Summit Asia 2020, please sign in Hopin and [checkout our event](https://hopin.to/events/pulsar-summit-asia-2020). Your ideas are very important to us, and we will prepare the content accordingly. + +After you checkout the event in Hopin, you will be notified with the event update at the first time when announcing. + +## Sponsor Pulsar Summit +Pulsar Summit is a community run conference and your support is needed. Sponsoring this event will provide a great opportunity for your organization to further engage with the Apache Pulsar community. [Contact us](mailto:partn...@pulsar-summit.org) to learn more. + +Help us make #PulsarSummit 2020 a big success by spreading the word and submittin
[pulsar] branch master updated: Update index.js (#7921)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 4dbbb33 Update index.js (#7921)
4dbbb33 is described below
commit 4dbbb33e12ac0ce814153cf3cf2ebf60aac13258
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Sat Aug 29 18:28:41 2020 +0800
Update index.js (#7921)
---
site2/website/pages/en/index.js | 18 +-
1 file changed, 9 insertions(+), 9 deletions(-)
diff --git a/site2/website/pages/en/index.js b/site2/website/pages/en/index.js
index 210e588..d4bc3a8 100755
--- a/site2/website/pages/en/index.js
+++ b/site2/website/pages/en/index.js
@@ -108,43 +108,43 @@ const features_lang = language => {
return {
row1: [
{
-content: 'Easily deploy lightweight compute logic using
developer-friendly APIs without needing to run your own stream processing
engine',
+content: 'Easy to deploy, lightweight compute process,
developer-friendly APIs, no need to run your own stream processing engine.',
title: `[Pulsar Functions](${docUrl('functions-overview', language)})`,
},
{
-content: 'Pulsar has run in production at Yahoo scale for over 3
years, with millions of messages per second across millions of topics',
+content: 'Run in production at Yahoo! scale for over 5 years, with
millions of messages per second across millions of topics.',
title: `[Proven in
production](${docUrl('concepts-architecture-overview', language)})`,
},
{
-content: 'Seamlessly expand capacity to hundreds of nodes',
+content: 'Expand capacity seamlessly to hundreds of nodes.',
title: `[Horizontally
scalable](${docUrl('concepts-architecture-overview', language)})`,
}
],
row2: [
{
-content: 'Designed for low publish latency (< 5ms) at scale with
strong durabilty guarantees',
+content: 'Low publish latency (< 5ms) at scale with strong durability
guarantees.',
title: `[Low latency with
durability](${docUrl('concepts-architecture-overview', language)})`,
},
{
-content: 'Designed for configurable replication between data centers
across multiple geographic regions',
+content: 'Configurable replication between data centers across
multiple geographic regions.',
title: `[Geo-replication](${docUrl('administration-geo', language)})`,
},
{
-content: 'Built from the ground up as a multi-tenant system. Supports
Isolation, Authentication, Authorization and Quotas',
+content: 'Built from the ground up as a multi-tenant system. Supports
isolation, authentication, authorization and quotas.',
title: `[Multi-tenancy](${docUrl('concepts-multi-tenancy',
language)})`,
}
],
row3: [
{
-content: 'Persistent message storage based on Apache BookKeeper.
Provides IO-level isolation between write and read operations',
+content: 'Persistent message storage based on Apache BookKeeper.
IO-level isolation between write and read operations.',
title: `[Persistent
storage](${docUrl('concepts-architecture-overview#persistent-storage',
language)})`,
},
{
-content: 'Flexible messaging models with high-level APIs for Java,
C++, Python and GO',
+content: 'Flexible messaging models with high-level APIs for Java, Go,
Python, C++, Node.js, WebSocket and C#.',
title: `[Client libraries](${docUrl('client-libraries', language)})`,
},
{
-content: 'REST Admin API for provisioning, administration, tools and
monitoring. Deploy on bare metal or Kubernetes.',
+content: 'REST Admin API for provisioning, administration, tools and
monitoring. Can be deployed on bare metal, Kubernetes, Amazon Web
Services(AWS), and DataCenter Operating System(DC/OS).',
title: `[Operability](${docUrl('admin-api-overview', language)})`,
}
]
[pulsar] branch home created (now 70cbbaf)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch home in repository https://gitbox.apache.org/repos/asf/pulsar.git. at 70cbbaf Update siteConfig.js This branch includes the following new commits: new 70cbbaf Update siteConfig.js The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[pulsar] 01/01: Update siteConfig.js
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch home
in repository https://gitbox.apache.org/repos/asf/pulsar.git
commit 70cbbaf06aa667b47e8855ab45db0cdf5c8d38c7
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Fri Aug 28 18:37:36 2020 +0800
Update siteConfig.js
---
site2/website/siteConfig.js | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/site2/website/siteConfig.js b/site2/website/siteConfig.js
index 1a646d5..e9de76e 100644
--- a/site2/website/siteConfig.js
+++ b/site2/website/siteConfig.js
@@ -179,8 +179,8 @@ const siteConfig = {
githubUrl: githubUrl,
projectDescription: `
-Apache Pulsar is an open-source distributed pub-sub messaging system
originally
-created at Yahoo and now part of the Apache Software Foundation
+Apache Pulsar is a cloud-native, distributed messaging and streaming
platform originally
+created at Yahoo! and now a top-level Apache Software Foundation
`,
markdownPlugins: [
[pulsar] branch index created (now 9d51869)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch index in repository https://gitbox.apache.org/repos/asf/pulsar.git. at 9d51869 Update index.js This branch includes the following new commits: new 9d51869 Update index.js The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[pulsar] 01/01: Update index.js
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch index
in repository https://gitbox.apache.org/repos/asf/pulsar.git
commit 9d518693a443a9dc113a4e21aa829b8dbf389012
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Fri Aug 28 18:33:49 2020 +0800
Update index.js
---
site2/website/pages/en/index.js | 18 +-
1 file changed, 9 insertions(+), 9 deletions(-)
diff --git a/site2/website/pages/en/index.js b/site2/website/pages/en/index.js
index 210e588..d4bc3a8 100755
--- a/site2/website/pages/en/index.js
+++ b/site2/website/pages/en/index.js
@@ -108,43 +108,43 @@ const features_lang = language => {
return {
row1: [
{
-content: 'Easily deploy lightweight compute logic using
developer-friendly APIs without needing to run your own stream processing
engine',
+content: 'Easy to deploy, lightweight compute process,
developer-friendly APIs, no need to run your own stream processing engine.',
title: `[Pulsar Functions](${docUrl('functions-overview', language)})`,
},
{
-content: 'Pulsar has run in production at Yahoo scale for over 3
years, with millions of messages per second across millions of topics',
+content: 'Run in production at Yahoo! scale for over 5 years, with
millions of messages per second across millions of topics.',
title: `[Proven in
production](${docUrl('concepts-architecture-overview', language)})`,
},
{
-content: 'Seamlessly expand capacity to hundreds of nodes',
+content: 'Expand capacity seamlessly to hundreds of nodes.',
title: `[Horizontally
scalable](${docUrl('concepts-architecture-overview', language)})`,
}
],
row2: [
{
-content: 'Designed for low publish latency (< 5ms) at scale with
strong durabilty guarantees',
+content: 'Low publish latency (< 5ms) at scale with strong durability
guarantees.',
title: `[Low latency with
durability](${docUrl('concepts-architecture-overview', language)})`,
},
{
-content: 'Designed for configurable replication between data centers
across multiple geographic regions',
+content: 'Configurable replication between data centers across
multiple geographic regions.',
title: `[Geo-replication](${docUrl('administration-geo', language)})`,
},
{
-content: 'Built from the ground up as a multi-tenant system. Supports
Isolation, Authentication, Authorization and Quotas',
+content: 'Built from the ground up as a multi-tenant system. Supports
isolation, authentication, authorization and quotas.',
title: `[Multi-tenancy](${docUrl('concepts-multi-tenancy',
language)})`,
}
],
row3: [
{
-content: 'Persistent message storage based on Apache BookKeeper.
Provides IO-level isolation between write and read operations',
+content: 'Persistent message storage based on Apache BookKeeper.
IO-level isolation between write and read operations.',
title: `[Persistent
storage](${docUrl('concepts-architecture-overview#persistent-storage',
language)})`,
},
{
-content: 'Flexible messaging models with high-level APIs for Java,
C++, Python and GO',
+content: 'Flexible messaging models with high-level APIs for Java, Go,
Python, C++, Node.js, WebSocket and C#.',
title: `[Client libraries](${docUrl('client-libraries', language)})`,
},
{
-content: 'REST Admin API for provisioning, administration, tools and
monitoring. Deploy on bare metal or Kubernetes.',
+content: 'REST Admin API for provisioning, administration, tools and
monitoring. Can be deployed on bare metal, Kubernetes, Amazon Web
Services(AWS), and DataCenter Operating System(DC/OS).',
title: `[Operability](${docUrl('admin-api-overview', language)})`,
}
]
[pulsar] branch master updated (f90750d -> b00f5e7)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from f90750d [blog] Add 300 contributor blog (#7882) add b00f5e7 update start number (#7885) No new revisions were added by this update. Summary of changes: site2/website/blog/2020-08-24-Pulsar-300-contributors.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[pulsar] branch master updated (97f4112 -> f90750d)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 97f4112 [issue 7851][C++] Make clear() thread-safe (#7862) add f90750d [blog] Add 300 contributor blog (#7882) No new revisions were added by this update. Summary of changes: .../blog/2020-08-24-Pulsar-300-contributors.md | 65 ++ 1 file changed, 65 insertions(+) create mode 100644 site2/website/blog/2020-08-24-Pulsar-300-contributors.md
[pulsar-translation] branch master updated: added some docs to translate (#36)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 6930088 added some docs to translate (#36) 6930088 is described below commit 6930088c5be50c627b69a76c5711e0457383499a Author: Jiechuan Chen <654815...@qq.com> AuthorDate: Mon Aug 24 09:19:47 2020 +0800 added some docs to translate (#36) --- schedule_zh-CN.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index e721b06..5044daf 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -154,9 +154,9 @@ schema-get-started | SylviaBABY | sijia-w | Approved schema-manage | SylviaBABY | sijia-w | Approved schema-understand | SylviaBABY | sijia-w | Approved security-athenz | SylviaBABY | | Translated -security-authorization | | | To Do -security-bouncy-castle | | | To Do -security-encryption | | | To Do +security-authorization | Jiechuan Chen | | Translated +security-bouncy-castle | Jiechuan Chen | | Translated +security-encryption | Jiechuan Chen | | Translated security-extending | bilahepan(Tianci Gao) | | In Progress security-jwt | futeng | | Translated security-kerberos | futeng | | Translated
[pulsar-translation] branch master updated: Update schedule_zh-CN.md (#37)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 421ba4d Update schedule_zh-CN.md (#37) 421ba4d is described below commit 421ba4dda64a2b8a65793520120ebbca570d8ea3 Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Mon Aug 24 03:18:38 2020 +0200 Update schedule_zh-CN.md (#37) --- schedule_zh-CN.md | 16 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index f5ac63c..e721b06 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -14,7 +14,7 @@ admin-api-clusters | liyiming2002 | sijia-w | Approved admin-api-functions | Jiechuan Chen | sijia-w | Approved admin-api-namespaces | Xiangyu Sun & kuangye098 | sijia-w | Approved admin-api-non-partitioned-topics | Kevin Ma | | Translated -admin-api-non-persistent-topics | liyiming2002 | | Translated +admin-api-non-persistent-topics | liyiming2002 | sijia-w | Approved admin-api-overview | coxapp | Sijie Guo | Approved admin-api-partitioned-topics | bilahepan(Tianci Gao) | Jennifer Huang | Approved admin-api-permissions | liyiming 2002 | sijia-w | Approved @@ -25,7 +25,7 @@ administration-dashboard | Jiechuan Chen | sijia-w | Approved administration-geo | xuefei wei | | Translated administration-load-balance | Wuwenliang & futeng| | Translated administration-proxy | bilahepan(Tianci Gao) & bilahepan | Jennifer Huang | Translated -administration-pulsar-manager | Jiechuan Chen | | Translated +administration-pulsar-manager | Jiechuan Chen | sijia-w | Approved administration-stats | Jiechuan Chen| sijia-w | Approved administration-upgrade | July-liu | | Translated administration-zk-bk | futeng | | Translated @@ -34,16 +34,16 @@ client-libraries-cgo | | | To Do client-libraries-cpp | Lewinma | | Translated client-libraries-go | z2665 | | Translated client-libraries-java | WJL & coxapp | | Translated -client-libraries-node | Jiechuan Chen | | Translated +client-libraries-node | Jiechuan Chen | sijia-w | Approved client-libraries-python | Bu Xing & Francis Du & liyiming2002 | | Translated -client-libraries-websocket | Francis Du & liyiming2002 | | Translated +client-libraries-websocket | Francis Du & liyiming2002 | sijia-w | Approved concepts-architecture-overview | Jia Zhai & HashZhang & yony228 & li samdy| | Translated concepts-authentication | liyiming2002 & futeng| sijia-w | Approved concepts-clients | Zongyang & futeng| | Translated concepts-messaging | liyiming 2002 & futeng | | Translated concepts-multi-tenancy | futeng & liyiming2002 | sijia-w | Approved concepts-overview | futeng & wen.spider & Jiechuan Chen| sijia-w | Approved -concepts-replication | coxapp | | Translated +concepts-replication | coxapp | sijia-w | Approved concepts-schema-registry | liyiming2002 | sijia-w | Approved concepts-tiered-storage | liyiming2002 & futeng & wen.spider| | Translated concepts-topic-compaction | liyiming2002 | | Translated @@ -106,7 +106,7 @@ io-debezium-source | SylviaBABY | | Translated io-debug | SylviaBABY | | Translated io-develop | sijia-w | sijia-w | Approved io-elasticsearch-sink | Kevin Ma | | Translated -io-elasticsearch | | | To Do +io-elasticsearch | | | Empty io-file-source | SylviaBABY | | Translated io-file | Bu Xing | | In Progress io-flume-sink | SylviaBABY | | Translated @@ -119,11 +119,11 @@ io-hdfs3-sink | SylviaBABY | | Translated io-influxdb-sink | SylviaBABY | | Translated io-influxdb | | | To Do io-jdbc-sink | SylviaBABY | | Translated -io-jdbc | | | To Do +io-jdbc | | | Empty io-kafka-sink | SylviaBABY | | Translated io-kafka-source | SylviaBABY | | Translated io-kafka | KarenGirl | | Deprecated -io-kinesis-sink | SylviaBABY | | Translated +io-kinesis-sink | SylviaBABY | sijia-w | Approved io-kinesis-source | SylviaBABY | | Translated io-kinesis | | | To Do io-mongo-sink | SylviaBABY | | Translated
[pulsar] branch master updated: [Issue 5157][docs] Update source and sink --processing-guarantees description (#7767)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new bd8d2ba [Issue 5157][docs] Update source and sink --processing-guarantees description (#7767) bd8d2ba is described below commit bd8d2bab3b56d550138911b1cc674eb98cbe42e4 Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> AuthorDate: Tue Aug 11 16:56:14 2020 +0800 [Issue 5157][docs] Update source and sink --processing-guarantees description (#7767) * update source create description * update as per advice from sijia --- site2/docs/io-cli.md | 12 ++-- 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/site2/docs/io-cli.md b/site2/docs/io-cli.md index 345b3d9..a1ecc2a 100644 --- a/site2/docs/io-cli.md +++ b/site2/docs/io-cli.md @@ -64,7 +64,7 @@ $ pulsar-admin sources create options |`--name` | The source's name. | `--namespace` | The source's namespace. | ` --parallelism` | The source's parallelism factor, that is, the number of source instances to run. -| `--processing-guarantees` | The processing guarantees (aka delivery semantics) applied to the source.Possible Values: ATLEAST_ONCE, ATMOST_ONCE, EFFECTIVELY_ONCE. +| `--processing-guarantees` | The processing guarantees (also named as delivery semantics) applied to the source. A source connector receives messages from external system and writes messages to a Pulsar topic. The `--processing-guarantees` is used to ensure the processing guarantees for writing messages to the Pulsar topic. The available values are ATLEAST_ONCE, ATMOST_ONCE, EFFECTIVELY_ONCE. | `--ram` | The RAM (in bytes) that needs to be allocated per source instance (applicable only to the process and Docker runtimes). | `-st`, `--schema-type` | The schema type. Either a builtin schema (for example, AVRO and JSON) or custom schema class name to be used to encode messages emitted from source. | `--source-config` | Source config key/values. @@ -95,7 +95,7 @@ $ pulsar-admin sources update options |`--name` | The source's name. | `--namespace` | The source's namespace. | ` --parallelism` | The source's parallelism factor, that is, the number of source instances to run. -| `--processing-guarantees` | The processing guarantees (aka delivery semantics) applied to the source.Possible Values: ATLEAST_ONCE, ATMOST_ONCE, EFFECTIVELY_ONCE. +| `--processing-guarantees` | The processing guarantees (also named as delivery semantics) applied to the source. A source connector receives messages from external system and writes messages to a Pulsar topic. The `--processing-guarantees` is used to ensure the processing guarantees for writing messages to the Pulsar topic. The available values are ATLEAST_ONCE, ATMOST_ONCE, EFFECTIVELY_ONCE. | `--ram` | The RAM (in bytes) that needs to be allocated per source instance (applicable only to the process and Docker runtimes). | `-st`, `--schema-type` | The schema type. Either a builtin schema (for example, AVRO and JSON) or custom schema class name to be used to encode messages emitted from source. | `--source-config` | Source config key/values. @@ -263,7 +263,7 @@ $ pulsar-admin sources localrun options |`--name`|The source’s name.| |`--namespace`|The source’s namespace.| |`--parallelism`|The source’s parallelism factor, that is, the number of source instances to run).| -|`--processing-guarantees`|The processing guarantees (aka delivery semantics) applied to the source. Available values: ATLEAST_ONCE, ATMOST_ONCE, EFFECTIVELY_ONCE. +|`--processing-guarantees` | The processing guarantees (also named as delivery semantics) applied to the source. A source connector receives messages from external system and writes messages to a Pulsar topic. The `--processing-guarantees` is used to ensure the processing guarantees for writing messages to the Pulsar topic. The available values are ATLEAST_ONCE, ATMOST_ONCE, EFFECTIVELY_ONCE. |`--ram`|The RAM (in bytes) that needs to be allocated per source instance (applicable only to the Docker runtime).| | `-st`, `--schema-type` | The schema type. Either a builtin schema (for example, AVRO and JSON) or custom schema class name to be used to encode messages emitted from source. |`--source-config`|Source config key/values. @@ -354,7 +354,7 @@ $ pulsar-admin sinks create options |`--name` | The sink's name. | `--namespace` | The sink's namespace. | ` --parallelism` | The sink's parallelism factor, that is, the number of sink instances to run. -| `--processing-guarantees` | The processing guarantees (aka delivery semantics) applied to the sink.Possible Values: ATLEAST_ONCE, ATMOST_ONCE, EFFECTIVELY_ONCE. +| `--processing-guarantees` | The processing guarantees (also known as delivery semantics) applied to the sink. The `--processing-guarantees` implemen
[pulsar] branch master updated: [Issue 5401][docs] Add deploy-docker doc (#7769)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new c7ead15 [Issue 5401][docs] Add deploy-docker doc (#7769) c7ead15 is described below commit c7ead1589fa1c327a2e03beeb57ba4fe78f026c5 Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Mon Aug 10 13:20:27 2020 +0200 [Issue 5401][docs] Add deploy-docker doc (#7769) * add deploy-docker doc * Update deploy-docker.md * Update site2/docs/deploy-docker.md Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> Co-authored-by: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> --- site2/docs/deploy-docker.md | 51 + site2/website/sidebars.json | 1 + 2 files changed, 52 insertions(+) diff --git a/site2/docs/deploy-docker.md b/site2/docs/deploy-docker.md new file mode 100644 index 000..3d29035 --- /dev/null +++ b/site2/docs/deploy-docker.md @@ -0,0 +1,51 @@ +--- +id: deploy-docker +title: Deploy a cluster on Docker +sidebar_label: Docker +--- + +To deploy a Pulsar cluster on Docker, complete the following steps: +1. Deploy a ZooKeeper cluster (optional) +2. Initialize cluster metadata +3. Deploy a BookKeeper cluster +4. Deploy one or more Pulsar brokers + +## Prepare + +To run Pulsar on Docker, you need to create a container for each Pulsar component: ZooKeeper, BookKeeper and broker. You can pull the images of ZooKeeper and BookKeeper separately on [Docker Hub](https://hub.docker.com/), and pull a [Pulsar image](https://hub.docker.com/r/apachepulsar/pulsar-all/tags) for the broker. You can also pull only one [Pulsar image](https://hub.docker.com/r/apachepulsar/pulsar-all/tags) and create three containers with this image. This tutorial takes the second [...] + +### Pull a Pulsar image +You can pull a Pulsar image from [Docker Hub](https://hub.docker.com/r/apachepulsar/pulsar-all/tags) with the following command. + +``` +docker run -it apachepulsar/pulsar-all:latest +``` + +### Create three containers +Create containers for ZooKeeper, BookKeeper and broker. In this example, they are named as `zookeeper`, `bookkeeper` and `broker` respectively. You can name them as you want with the `--name` flag. By default, the container names are created randomly. + +``` +docker run -it --name bookkeeper apachepulsar/pulsar-all:latest /bin/bash +docker run -it --name zookeeper apachepulsar/pulsar-all:latest /bin/bash +docker run -it --name broker apachepulsar/pulsar-all:latest /bin/bash +``` + +### Create a network +To deploy a Pulsar cluster on Docker, you need to create a `network` and connect the containers of ZooKeeper, BookKeeper and broker to this network. The following command creates the network `pulsar`: + +``` +docker network create pulsar +``` + +### Connect containers to network +Connect the containers of ZooKeeper, BookKeeper and broker to the `pulsar` network with the following commands. + +``` +docker network connect pulsar zookeeper +docker network connect pulsar bookkeeper +docker network connect pulsar broker +``` + +To check whether the containers are successfully connected to the network, enter the `docker network inspect pulsar` command. + +For detailed information about how to deploy ZooKeeper cluster, BookKeeper cluster, brokers, see [deploy a cluster on bare metal](deploy-bare-metal.md). diff --git a/site2/website/sidebars.json b/site2/website/sidebars.json index 50aa36d..a415741 100644 --- a/site2/website/sidebars.json +++ b/site2/website/sidebars.json @@ -70,6 +70,7 @@ "deploy-bare-metal", "deploy-bare-metal-multi-cluster", "deploy-dcos", + "deploy-docker", "deploy-monitoring" ], "Administration": [
[pulsar] branch master updated: Fix functions-worker typos (#7746)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new d3076f2 Fix functions-worker typos (#7746)
d3076f2 is described below
commit d3076f21b088a7062659d144b3f6b3efdacb848b
Author: sijia-w <53718687+siji...@users.noreply.github.com>
AuthorDate: Wed Aug 5 08:33:54 2020 +0200
Fix functions-worker typos (#7746)
* Update functions-worker.md
* Update functions-worker.md
* Update site2/docs/functions-worker.md
Co-authored-by: Jennifer Huang
<47805623+jennifer88hu...@users.noreply.github.com>
---
site2/docs/functions-worker.md | 24 +---
1 file changed, 13 insertions(+), 11 deletions(-)
diff --git a/site2/docs/functions-worker.md b/site2/docs/functions-worker.md
index 35bfd9a..7970782 100644
--- a/site2/docs/functions-worker.md
+++ b/site2/docs/functions-worker.md
@@ -5,7 +5,7 @@ sidebar_label: "Setup: Pulsar Functions Worker"
---
Before using Pulsar Functions, you need to learn how to set up Pulsar
Functions worker and how to [configure Functions
runtime](functions-runtime.md).
-Pulsar `functions-worker` is a logic component to run Pulsar Functions in
cluster mode. Two options are available, and you can select either of the two
options based on your requirements.
+Pulsar `functions-worker` is a logic component to run Pulsar Functions in
cluster mode. Two options are available, and you can select either based on
your requirements.
- [run with brokers](#run-functions-worker-with-brokers)
- [run it separately](#run-functions-worker-separately) in a different broker
@@ -24,16 +24,16 @@ To enable functions-worker running as part of a broker, you
need to set `functio
functionsWorkerEnabled=true
```
-When you set `functionsWorkerEnabled` to `true`, it means that you start
functions-worker as part of a broker. You need to configure the
`conf/functions_worker.yml` file to customize your functions_worker.
+If the `functionsWorkerEnabled` is set to `true`, the functions-worker is
started as part of a broker. You need to configure the
`conf/functions_worker.yml` file to customize your functions_worker.
Before you run Functions-worker with broker, you have to configure
Functions-worker, and then start it with brokers.
### Configure Functions-Worker to run with brokers
-In this mode, since `functions-worker` is running as part of broker, most of
the settings already inherit from your broker configuration (for example,
configurationStore settings, authentication settings, and so on).
+In this mode, most of the settings are already inherited from your broker
configuration (for example, configurationStore settings, authentication
settings, and so on) since `functions-worker` is running as part of the broker.
Pay attention to the following required settings when configuring
functions-worker in this mode.
-- `numFunctionPackageReplicas`: The number of replicas to store function
packages. The default value is `1`, which is good for standalone deployment.
For production deployment, to ensure high availability, set it to be more than
`2` .
+- `numFunctionPackageReplicas`: The number of replicas to store function
packages. The default value is `1`, which is good for standalone deployment.
For production deployment, to ensure high availability, set it to be larger
than `2`.
- `pulsarFunctionsCluster`: Set the value to your Pulsar cluster name (same as
the `clusterName` setting in the broker configuration).
If authentication is enabled on the BookKeeper cluster, configure the
following BookKeeper authentication settings.
@@ -52,7 +52,7 @@ And then you can use the following command to verify if
`functions-worker` is ru
curl :8080/admin/v2/worker/cluster
```
-After entering the command above, a list of active function workers in the
cluster is returned. The output is something similar as follows.
+After entering the command above, a list of active function workers in the
cluster is returned. The output is similar to the following.
```json
[{"workerId":"","workerHostname":"","port":8080}]
@@ -65,7 +65,7 @@ This section illustrates how to run `functions-worker` as a
separate process in
> Note
-In this mode, make sure `functionsWorkerEnabled` is set to `false`, so you
won't start `functions-worker` with brokers by mistake.
+> In this mode, make sure `functionsWorkerEnabled` is set to `false`, so you
won't start `functions-worker` with brokers by mistake.
### Configure Functions-worker to run separately
@@ -73,7 +73,7 @@ To run function-worker separately, you have to configure the
following parameter
Worker parameters
-- `workerId`: The ty
[pulsar] branch master updated: update events (#7671)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 4f143f5 update events (#7671)
4f143f5 is described below
commit 4f143f51f017b832c5376c9682287d448fc13421
Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com>
AuthorDate: Wed Aug 5 11:31:34 2020 +0800
update events (#7671)
---
site2/website/pages/en/events.js | 11 ++-
1 file changed, 10 insertions(+), 1 deletion(-)
diff --git a/site2/website/pages/en/events.js b/site2/website/pages/en/events.js
index d2ec4f6..1f6a43e 100644
--- a/site2/website/pages/en/events.js
+++ b/site2/website/pages/en/events.js
@@ -35,11 +35,20 @@ class Events extends React.Component {
Groups
+ - [Pulsar Summit Asia 2020](https://pulsar-summit.org/)
+
+
+ - [Webinar: How to Operate Pulsar in
Production](https://us02web.zoom.us/webinar/register/WN_xMt6QBJ9TWiyeVdifqKITg/)
+
+
+ - [Weekly TGIP](https://github.com/streamnative/tgip/)
+
+
- [Apache Pulsar Bay Area Meetup
Group](https://www.meetup.com/Apache-Pulsar-Meetup-Group/)
- [Japan Pulsar User
Group](https://japan-pulsar-user-group.connpass.com/)
-
+
[pulsar-translation] branch master updated: phase3 translation (#35)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new d67f756 phase3 translation (#35) d67f756 is described below commit d67f756f1de4c25e599612726010583a2f37f285 Author: Jiechuan Chen <654815...@qq.com> AuthorDate: Tue Aug 4 15:47:33 2020 +0800 phase3 translation (#35) --- schedule_zh-CN.md | 10 +- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 4fcf878..f5ac63c 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -143,11 +143,11 @@ io-tcp | Bu Xing | | Deprecated io-twitter-source | SylviaBABY | | Translated io-twitter | | | Deprecated io-use | SylviaBABY | | Translated -reference-cli-tools | | | To Do -reference-configuration | | | To Do -reference-connector-admin | | | To Do -reference-metrics | | | To Do -reference-pulsar-admin | | | To Do +reference-cli-tools | Jiechuan Chen | | Translated +reference-configuration | Jiechuan Chen | | Translated +reference-connector-admin | Jiechuan Chen | | Translated +reference-metrics | Jiechuan Chen | | Translated +reference-pulsar-admin | Jiechuan Chen | | Translated reference-terminology | Jia Zhai | Jia Zhai | Approved schema-evolution-compatibility | SylviaBABY | sijia-w | Approved schema-get-started | SylviaBABY | sijia-w | Approved
[pulsar-translation] branch master updated: Update translation status for Pulsar-Functions and Pulsar-SQL articles (zh-tw) (#25)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 67994cf Update translation status for Pulsar-Functions and Pulsar-SQL articles (zh-tw) (#25) 67994cf is described below commit 67994cfadb62acae2ec8c796249d72e4e1c3d7f1 Author: ErhWen Kuo AuthorDate: Tue Aug 4 15:42:55 2020 +0800 Update translation status for Pulsar-Functions and Pulsar-SQL articles (zh-tw) (#25) --- schedule_zh-TW.md | 20 1 file changed, 12 insertions(+), 8 deletions(-) diff --git a/schedule_zh-TW.md b/schedule_zh-TW.md index bd366da..3d97b62 100644 --- a/schedule_zh-TW.md +++ b/schedule_zh-TW.md @@ -58,13 +58,13 @@ schema-evolution-compatibility | erhwenkuo | | Translated schema-get-started | erhwenkuo | | Translated schema-manage | erhwenkuo | | Translated schema-understand | erhwenkuo | | Translated -functions-overview | | | -functions-worker | | | -functions-runtime | | | -functions-develop | | | -functions-debug | | | -functions-deploy | | | -functions-cli | | | +functions-overview | erhwenkuo | | Translated +functions-worker | erhwenkuo | | Translated +functions-runtime | erhwenkuo | | Translated +functions-develop | erhwenkuo | | Translated +functions-debug | erhwenkuo | | Translated +functions-deploy | erhwenkuo | | Translated +functions-cli | erhwenkuo | | Translated io-overview | | | io-quickstart (Correspond 'Get started') | | | io-use | | | @@ -98,4 +98,8 @@ io-rabbitmq-sink | | | io-rabbitmq-source | | | io-redis-sink | | | io-solr-sink | | | -io-twitter-source | | | \ No newline at end of file +io-twitter-source | | | +sql-deployment-configurations | erhwenkuo | | Translated +sql-getting-started | erhwenkuo | | Translated +sql-overview | erhwenkuo | | Translated +sql-rest-api | erhwenkuo | | Translated
[pulsar-translation] branch master updated: [docs]added some docs to tran (#32)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 2895c4b [docs]added some docs to tran (#32) 2895c4b is described below commit 2895c4b6bcca6dc1f2ae6e3d99ece19c5e5403e2 Author: Jiechuan Chen <654815...@qq.com> AuthorDate: Tue Aug 4 15:40:05 2020 +0800 [docs]added some docs to tran (#32) * added some docs to tran * name added to the contributor list --- CONTRIBUTORS.md | 1 + schedule_zh-CN.md | 6 +++--- 2 files changed, 4 insertions(+), 3 deletions(-) diff --git a/CONTRIBUTORS.md b/CONTRIBUTORS.md index 6344b5c..c787cae 100644 --- a/CONTRIBUTORS.md +++ b/CONTRIBUTORS.md @@ -5,6 +5,7 @@ - Francis Du (https://github.com/francis-du) - Jennifer Huang (https://github.com/Jennifer88huang) - Jia Zhai (https://github.com/jiazhai) +- Jiechuan Chen (https://github.com/omega-ariston) - Lei Yang (https://github.com/yangleimiao) - Sijie Guo (https://github.com/sijie) - Susan (https://github.com/Ssusan) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 635e30a..4fcf878 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -34,7 +34,7 @@ client-libraries-cgo | | | To Do client-libraries-cpp | Lewinma | | Translated client-libraries-go | z2665 | | Translated client-libraries-java | WJL & coxapp | | Translated -client-libraries-node | | | To Do +client-libraries-node | Jiechuan Chen | | Translated client-libraries-python | Bu Xing & Francis Du & liyiming2002 | | Translated client-libraries-websocket | Francis Du & liyiming2002 | | Translated concepts-architecture-overview | Jia Zhai & HashZhang & yony228 & li samdy| | Translated @@ -48,7 +48,7 @@ concepts-schema-registry | liyiming2002 | sijia-w | Approved concepts-tiered-storage | liyiming2002 & futeng & wen.spider| | Translated concepts-topic-compaction | liyiming2002 | | Translated cookbooks-bookkeepermetadata | sijia-w | | Translated -cookbooks-compaction | | | To Do +cookbooks-compaction | Jiechuan Chen | | Translated cookbooks-deduplication | bilahepan(Tianci Gao) | | In Progress cookbooks-encryption | z2665 | | Translated cookbooks-message-queue | bilahepan(Tianci Gao) & Ying Zhan | Susan97 | Approved @@ -83,7 +83,7 @@ functions-worker | sijia-w | sijia-w | Approved getting-started-clients | SylviaBABY | sijia-w | Approved getting-started-concepts-and-architecture | | | To Do getting-started-docker | SylviaBABY | sijia-w | Approved -getting-started-helm | | | To Do +getting-started-helm | Jiechuan Chen | | Translated getting-started-pulsar | | sijia-w | Approved getting-started-standalone (Correspond 'Run Pulsar locally') | | sijia-w | Approved helm-deploy | | | To Do
[pulsar-translation] branch master updated: Use .asf.yaml for managing repo settings (#26)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new bfc8ca2 Use .asf.yaml for managing repo settings (#26) bfc8ca2 is described below commit bfc8ca25df3656adb33de89006bbf8d5f8850637 Author: Sijie Guo AuthorDate: Tue Aug 4 00:41:01 2020 -0700 Use .asf.yaml for managing repo settings (#26) --- .asf.yaml | 45 + 1 file changed, 45 insertions(+) diff --git a/.asf.yaml b/.asf.yaml new file mode 100644 index 000..ff301d7 --- /dev/null +++ b/.asf.yaml @@ -0,0 +1,45 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# + +github: + description: "Pulsar documentation translation - https://crowdin.com/project/apache-pulsar; + homepage: https://pulsar.apache.org/ + labels: +- pulsar +- pubsub +- messaging +- streaming +- queuing +- event-streaming +- translation +- crowdin + features: +# Enable wiki for documentation +wiki: true +# Enable issues management +issues: true +# Enable projects for project management boards +projects: true + enabled_merge_buttons: +# enable squash button: +squash: true +# disable merge button: +merge: false +# disable rebase button: +rebase: false \ No newline at end of file
[pulsar-translation] branch master updated: [docs]added some docs to tran (#32)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 2895c4b [docs]added some docs to tran (#32) 2895c4b is described below commit 2895c4b6bcca6dc1f2ae6e3d99ece19c5e5403e2 Author: Jiechuan Chen <654815...@qq.com> AuthorDate: Tue Aug 4 15:40:05 2020 +0800 [docs]added some docs to tran (#32) * added some docs to tran * name added to the contributor list --- CONTRIBUTORS.md | 1 + schedule_zh-CN.md | 6 +++--- 2 files changed, 4 insertions(+), 3 deletions(-) diff --git a/CONTRIBUTORS.md b/CONTRIBUTORS.md index 6344b5c..c787cae 100644 --- a/CONTRIBUTORS.md +++ b/CONTRIBUTORS.md @@ -5,6 +5,7 @@ - Francis Du (https://github.com/francis-du) - Jennifer Huang (https://github.com/Jennifer88huang) - Jia Zhai (https://github.com/jiazhai) +- Jiechuan Chen (https://github.com/omega-ariston) - Lei Yang (https://github.com/yangleimiao) - Sijie Guo (https://github.com/sijie) - Susan (https://github.com/Ssusan) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 635e30a..4fcf878 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -34,7 +34,7 @@ client-libraries-cgo | | | To Do client-libraries-cpp | Lewinma | | Translated client-libraries-go | z2665 | | Translated client-libraries-java | WJL & coxapp | | Translated -client-libraries-node | | | To Do +client-libraries-node | Jiechuan Chen | | Translated client-libraries-python | Bu Xing & Francis Du & liyiming2002 | | Translated client-libraries-websocket | Francis Du & liyiming2002 | | Translated concepts-architecture-overview | Jia Zhai & HashZhang & yony228 & li samdy| | Translated @@ -48,7 +48,7 @@ concepts-schema-registry | liyiming2002 | sijia-w | Approved concepts-tiered-storage | liyiming2002 & futeng & wen.spider| | Translated concepts-topic-compaction | liyiming2002 | | Translated cookbooks-bookkeepermetadata | sijia-w | | Translated -cookbooks-compaction | | | To Do +cookbooks-compaction | Jiechuan Chen | | Translated cookbooks-deduplication | bilahepan(Tianci Gao) | | In Progress cookbooks-encryption | z2665 | | Translated cookbooks-message-queue | bilahepan(Tianci Gao) & Ying Zhan | Susan97 | Approved @@ -83,7 +83,7 @@ functions-worker | sijia-w | sijia-w | Approved getting-started-clients | SylviaBABY | sijia-w | Approved getting-started-concepts-and-architecture | | | To Do getting-started-docker | SylviaBABY | sijia-w | Approved -getting-started-helm | | | To Do +getting-started-helm | Jiechuan Chen | | Translated getting-started-pulsar | | sijia-w | Approved getting-started-standalone (Correspond 'Run Pulsar locally') | | sijia-w | Approved helm-deploy | | | To Do
[pulsar] branch master updated: [docs] Fix wrong required properties for HDFS2 sink (#7643)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new bf90e55 [docs] Fix wrong required properties for HDFS2 sink (#7643) bf90e55 is described below commit bf90e55214d04c3f8b34433c119c43a49bb1c1e8 Author: Yunze Xu AuthorDate: Tue Jul 28 17:38:25 2020 +0800 [docs] Fix wrong required properties for HDFS2 sink (#7643) * Fix wrong required properties for HDFS2 sink * Fix description of filenamePrefix --- site2/docs/io-hdfs2-sink.md | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/site2/docs/io-hdfs2-sink.md b/site2/docs/io-hdfs2-sink.md index 9769695..56c4c7b 100644 --- a/site2/docs/io-hdfs2-sink.md +++ b/site2/docs/io-hdfs2-sink.md @@ -21,8 +21,8 @@ The configuration of the HDFS2 sink connector has the following properties. | `compression` | Compression |false |None |The compression code used to compress or de-compress the files on HDFS. Below are the available options:BZIP2DEFLATEGZIPLZ4SNAPPY| | `kerberosUserPrincipal` |String| false| None|The principal account of Kerberos user used for authentication. | | `keytab` | String|false|None| The full pathname of the Kerberos keytab file used for authentication. | -| `filenamePrefix` |String| false |None |The prefix of the files created inside the HDFS directory.**Example** The value of topicA result in files named topicA-. | -| `fileExtension` | String| false | None| The extension added to the files written to HDFS.**Example**'.txt' '.seq' | +| `filenamePrefix` |String| true, if `compression` is set to `None`. | None |The prefix of the files created inside the HDFS directory.**Example** The value of topicA result in files named topicA-. | +| `fileExtension` | String| true | None | The extension added to the files written to HDFS.**Example**'.txt' '.seq' | | `separator` | char|false |None |The character used to separate records in a text file. If no value is provided, the contents from all records are concatenated together in one continuous byte array. | | `syncInterval` | long| false |0| The interval between calls to flush data to HDFS disk in milliseconds. | | `maxPendingRecords` |int| false|Integer.MAX_VALUE | The maximum number of records that hold in memory before acking. Setting this property to 1 makes every record send to disk before the record is acked.Setting this property to a higher value allows buffering records before flushing them to disk. @@ -38,6 +38,7 @@ Before using the HDFS2 sink connector, you need to create a configuration file t "hdfsConfigResources": "core-site.xml", "directory": "/foo/bar", "filenamePrefix": "prefix", +"fileExtension": ".log", "compression": "SNAPPY" } ``` @@ -49,5 +50,6 @@ Before using the HDFS2 sink connector, you need to create a configuration file t hdfsConfigResources: "core-site.xml" directory: "/foo/bar" filenamePrefix: "prefix" +fileExtension: ".log" compression: "SNAPPY" ```
[pulsar-translation] branch master updated: Update schedule_zh-CN.md (#34)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar-translation.git The following commit(s) were added to refs/heads/master by this push: new 3f7f036 Update schedule_zh-CN.md (#34) 3f7f036 is described below commit 3f7f036059ef9a064c63fd9bec14b69ef878bfdd Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Tue Jul 21 15:06:43 2020 +0200 Update schedule_zh-CN.md (#34) --- schedule_zh-CN.md | 12 ++-- 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/schedule_zh-CN.md b/schedule_zh-CN.md index 253f6c4..635e30a 100644 --- a/schedule_zh-CN.md +++ b/schedule_zh-CN.md @@ -10,9 +10,9 @@ adaptors-kafka | Jia Zhai & Susan97 & Jennifer & Shipei Huang & Forbidden | | Tr adaptors-spark | Jia Zhai & Ruihuan Wang & Jennifer | Jia Zhai | Approved adaptors-storm | Ruihuan Wang & Jennifer | | Translated admin-api-brokers | liyiming2002 | | Translated -admin-api-clusters | liyiming2002 | | Translated +admin-api-clusters | liyiming2002 | sijia-w | Approved admin-api-functions | Jiechuan Chen | sijia-w | Approved -admin-api-namespaces | Xiangyu Sun & kuangye098 | | To Do +admin-api-namespaces | Xiangyu Sun & kuangye098 | sijia-w | Approved admin-api-non-partitioned-topics | Kevin Ma | | Translated admin-api-non-persistent-topics | liyiming2002 | | Translated admin-api-overview | coxapp | Sijie Guo | Approved @@ -21,12 +21,12 @@ admin-api-permissions | liyiming 2002 | sijia-w | Approved admin-api-persistent-topics | liyiming2002 | sijia-w | Approved admin-api-schemas | liyiming2002 | sijia-w | Approved admin-api-tenants | liyiming2002 | sijia-w | Approved -administration-dashboard | Jiechuan Chen | | Translated +administration-dashboard | Jiechuan Chen | sijia-w | Approved administration-geo | xuefei wei | | Translated administration-load-balance | Wuwenliang & futeng| | Translated administration-proxy | bilahepan(Tianci Gao) & bilahepan | Jennifer Huang | Translated administration-pulsar-manager | Jiechuan Chen | | Translated -administration-stats | Jiechuan Chen| | Translated +administration-stats | Jiechuan Chen| sijia-w | Approved administration-upgrade | July-liu | | Translated administration-zk-bk | futeng | | Translated admin-load-distribution | bilahepan(Tianci Gao) | | Deprecated @@ -38,10 +38,10 @@ client-libraries-node | | | To Do client-libraries-python | Bu Xing & Francis Du & liyiming2002 | | Translated client-libraries-websocket | Francis Du & liyiming2002 | | Translated concepts-architecture-overview | Jia Zhai & HashZhang & yony228 & li samdy| | Translated -concepts-authentication | liyiming2002 & futeng| | Translated +concepts-authentication | liyiming2002 & futeng| sijia-w | Approved concepts-clients | Zongyang & futeng| | Translated concepts-messaging | liyiming 2002 & futeng | | Translated -concepts-multi-tenancy | futeng & liyiming2002 | | Translated +concepts-multi-tenancy | futeng & liyiming2002 | sijia-w | Approved concepts-overview | futeng & wen.spider & Jiechuan Chen| sijia-w | Approved concepts-replication | coxapp | | Translated concepts-schema-registry | liyiming2002 | sijia-w | Approved
[pulsar] branch master updated: fix the command for starting bookies in the foreground (#7596)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 9475b45 fix the command for starting bookies in the foreground (#7596) 9475b45 is described below commit 9475b450201869b3ddfd8a94aec198bbb2b5015c Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Sun Jul 19 05:55:23 2020 +0200 fix the command for starting bookies in the foreground (#7596) --- site2/docs/deploy-bare-metal.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/site2/docs/deploy-bare-metal.md b/site2/docs/deploy-bare-metal.md index 3c1e4c2..da3682d 100644 --- a/site2/docs/deploy-bare-metal.md +++ b/site2/docs/deploy-bare-metal.md @@ -285,7 +285,7 @@ $ bin/pulsar-daemon start bookie To start the bookie in the foreground: ```bash -$ bin/bookkeeper bookie +$ bin/pulsar bookie ``` You can verify that a bookie works properly by running the `bookiesanity` command on the [BookKeeper shell](reference-cli-tools.md#shell):
[pulsar] branch master updated: update md file (#7597)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 8153424 update md file (#7597) 8153424 is described below commit 8153424e0313c2a5c536d67dc364a43323835b77 Author: sijia-w <53718687+siji...@users.noreply.github.com> AuthorDate: Sun Jul 19 04:12:14 2020 +0200 update md file (#7597) --- .../version-2.1.0-incubating/concepts-architecture-overview.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/site2/website/versioned_docs/version-2.1.0-incubating/concepts-architecture-overview.md b/site2/website/versioned_docs/version-2.1.0-incubating/concepts-architecture-overview.md index 13bd17d..1f065b3 100644 --- a/site2/website/versioned_docs/version-2.1.0-incubating/concepts-architecture-overview.md +++ b/site2/website/versioned_docs/version-2.1.0-incubating/concepts-architecture-overview.md @@ -11,7 +11,7 @@ In a Pulsar cluster: * One or more brokers handles and load balances incoming messages from producers, dispatches messages to consumers, communicates with the Pulsar configuration store to handle various coordination tasks, stores messages in BookKeeper instances (aka bookies), relies on a cluster-specific ZooKeeper cluster for certain tasks, and more. * A BookKeeper cluster consisting of one or more bookies handles [persistent storage](#persistent-storage) of messages. -* A ZooKeeper cluster specific to that cluster handles +* A ZooKeeper cluster specific to that cluster handles coordination tasks between Pulsar clusters. The diagram below provides an illustration of a Pulsar cluster:
[pulsar] branch master updated (2374cd9 -> e180837)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 2374cd9 Improve security setting of Pulsar Functions (#7578) add e180837 fix sidebar v2.5.0 (#7590) No new revisions were added by this update. Summary of changes: site2/website/versioned_sidebars/version-2.5.0-sidebars.json | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-)
[pulsar] branch master updated (3db03be -> 742fc5c)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 3db03be Replace the use of Paths.get(...).getParent() for a zookeeper path in ZooKeeperCache (#7558) add 742fc5c fix website build for sidebars.json error (#7575) No new revisions were added by this update. Summary of changes: site2/website/sidebars.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[pulsar] branch master updated: Add async state manupulation methods in java functions (#7468)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new b197962 Add async state manupulation methods in java functions (#7468)
b197962 is described below
commit b197962d3eb55b8a7c01f61453042236d3d62c7c
Author: HuanliMeng <48120384+huanli-m...@users.noreply.github.com>
AuthorDate: Tue Jul 14 13:48:14 2020 +0800
Add async state manupulation methods in java functions (#7468)
---
site2/docs/functions-develop.md| 68 +++-
.../versioned_docs/version-2.4.0/functions-api.md | 4 +
.../version-2.4.0/functions-state.md | 177 +
.../version-2.4.1/functions-develop.md | 68 +++-
.../version-2.4.2/functions-develop.md | 66 +++-
.../version-2.5.0/functions-develop.md | 68 +++-
.../version-2.5.1/functions-develop.md | 68 +++-
.../version-2.5.2/functions-develop.md | 68 +++-
.../version-2.6.0/functions-develop.md | 68 +++-
9 files changed, 634 insertions(+), 21 deletions(-)
diff --git a/site2/docs/functions-develop.md b/site2/docs/functions-develop.md
index c2bdd16..0f1a447 100644
--- a/site2/docs/functions-develop.md
+++ b/site2/docs/functions-develop.md
@@ -296,10 +296,14 @@ public interface Context {
String getFunctionVersion();
Logger getLogger();
void incrCounter(String key, long amount);
+void incrCounterAsync(String key, long amount);
long getCounter(String key);
+long getCounterAsync(String key);
void putState(String key, ByteBuffer value);
+void putStateAsync(String key, ByteBuffer value);
void deleteState(String key);
ByteBuffer getState(String key);
+ByteBuffer getStateAsync(String key);
Map getUserConfigMap();
Optional getUserConfigValue(String key);
Object getUserConfigValueOrDefault(String key, Object defaultValue);
@@ -789,7 +793,7 @@ Since Pulsar 2.1.0 release, Pulsar integrates with Apache
BookKeeper [table serv
States are key-value pairs, where the key is a string and the value is
arbitrary binary data - counters are stored as 64-bit big-endian binary values.
Keys are scoped to an individual Pulsar Function, and shared between instances
of that function.
-You can access states within Pulsar Functions using the `putState`,
`getState`, `incrCounter`, `getCounter` and `deleteState` calls on the context
object. You can also manage states using the [querystate](#query-state) and
[putstate](#putstate) options to `pulsar-admin functions`.
+You can access states within Pulsar Java Functions using the `putState`,
`putStateAsync`, `getState`, `getStateAsync`, `incrCounter`,
`incrCounterAsync`, `getCounter`, `getCounterAsync` and `deleteState` calls on
the context object. You can access states within Pulsar Python Functions using
the `putState`, `getState`, `incrCounter`, `getCounter` and `deleteState` calls
on the context object. You can also manage states using the
[querystate](#query-state) and [putstate](#putstate) option [...]
> Note
> State storage is not available in Go.
@@ -811,7 +815,22 @@ Currently Pulsar Functions expose the following APIs for
mutating and accessing
void incrCounter(String key, long amount);
```
-Application can use `incrCounter` to change the counter of a given `key` by
the given `amount`.
+The application can use `incrCounter` to change the counter of a given `key`
by the given `amount`.
+
+ incrCounterAsync
+
+```java
+ /**
+ * Increment the builtin distributed counter referred by key
+ * but dont wait for the completion of the increment operation
+ *
+ * @param key The name of the key
+ * @param amount The amount to be incremented
+ */
+CompletableFuture incrCounterAsync(String key, long amount);
+```
+
+The application can use `incrCounterAsync` to asynchronously change the
counter of a given `key` by the given `amount`.
getCounter
@@ -825,11 +844,26 @@ Application can use `incrCounter` to change the counter
of a given `key` by the
long getCounter(String key);
```
-Application can use `getCounter` to retrieve the counter of a given `key`
mutated by `incrCounter`.
+The application can use `getCounter` to retrieve the counter of a given `key`
mutated by `incrCounter`.
Except the `counter` API, Pulsar also exposes a general key/value API for
functions to store
general key/value state.
+ getCounterAsync
+
+```java
+ /**
+ * Retrieve the counter value for the key, but don't wait
+ * for the operation to be completed
+ *
+ * @param key name of the key
+ * @return the amount of the counter value for this key
+ */
+CompletableFuture getCounterAsync(String key);
+```
+
+The application can use `getCounterAsync` to as
[pulsar] branch master updated: Add sidebar for "Pulasr SNI routing with ATS" content (#7471)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new f2b9f49 Add sidebar for "Pulasr SNI routing with ATS" content (#7471) f2b9f49 is described below commit f2b9f49d30337b1fd3ebdb68bd4ac3fdd8bd Author: Jennifer Huang <47805623+jennifer88hu...@users.noreply.github.com> AuthorDate: Sun Jul 12 12:39:42 2020 +0800 Add sidebar for "Pulasr SNI routing with ATS" content (#7471) * update sidebar.json for proxy-sni * update * update * update sidebar.json * update * fix as per comments form Huanli --- site2/docs/concepts-proxy-sni-routing.md | 46 +++- site2/website/sidebars.json | 3 ++- 2 files changed, 24 insertions(+), 25 deletions(-) diff --git a/site2/docs/concepts-proxy-sni-routing.md b/site2/docs/concepts-proxy-sni-routing.md index fc1ae9b..1b8e6ed 100644 --- a/site2/docs/concepts-proxy-sni-routing.md +++ b/site2/docs/concepts-proxy-sni-routing.md @@ -5,29 +5,31 @@ sidebar_label: Proxy support with SNI routing --- ## Pulsar Proxy with SNI routing +A proxy server is an intermediary server that forwards requests from multiple clients to different servers across the Internet. The proxy server acts as a "traffic cop" in both forward and reverse proxy scenarios, and benefits your system such as load balancing, performance, security, auto-scaling, and so on. -A proxy server is an intermediary server that forwards requests from multiple clients to different servers across the Internet. The proxy server acts as a "traffic cop" in both forward and reverse proxy scenarios, and brings various benefits to your system such as load balancing, performance, security, auto-scaling, etc. There are already many proxy servers available in the market which are fast and scalable. More importantly, these proxy servers cover various essential security aspects [...] +The proxy in Pulsar acts as a reverse proxy, and creates a gateway in front of brokers. Proxies such as Apache Traffic Server (ATS), HAProxy, Nginx, and Envoy are not supported in Pulsar. These proxy-servers support **SNI routing**. SNI routing is used to route traffic to a destination without terminating the SSL connection. Layer 4 routing provides greater transparency because the outbound connection is determined by examining the destination address in the client TCP packets. -[PIP-60](https://github.com/apache/pulsar/wiki/PIP-60:-Support-Proxy-server-with-SNI-routing) explains the SNI routing protocol and how Pulsar clients support SNI routing protocol to connect to brokers through the proxy. This document explains how to set up the ATS proxy and the Pulsar client to enable SNI routing and connect Pulsar client to the broker through the ATS proxy. +Pulsar clients support [SNI routing protocol](https://github.com/apache/pulsar/wiki/PIP-60:-Support-Proxy-server-with-SNI-routing), so you can connect to brokers through the proxy. This document walks you through how to set up the ATS proxy, enable SNI routing, and connect Pulsar client to the broker through the ATS proxy. ### ATS-SNI Routing in Pulsar -[ATS supports layer-4 SNI routing](https://docs.trafficserver.apache.org/en/latest/admin-guide/layer-4-routing.en.html) with the requirement that inbound connection must be a TLS connection. The Pulsar client also supports SNI routing protocol on TLS connection and that allows Pulsar to use ATS as a reverse proxy when Pulsar client wants to connect to broker through ATS proxy. Therefore, this section explains how to set up and use ATS as a reverse proxy so pulsar clients can connect to b [...] +To support [layer-4 SNI routing](https://docs.trafficserver.apache.org/en/latest/admin-guide/layer-4-routing.en.html) with ATS, the inbound connection must be a TLS connection. Pulsar client supports SNI routing protocol on TLS connection, so when Pulsar clients connect to broker through ATS proxy, Pulsar uses ATS as a reverse proxy. +Pulsar supports SNI routing for geo-replication, so brokers can connect to brokers in other clusters through the ATS proxy. - ATS Proxy setup for layer-4 SNI routing - -This section explains how to set up ATS proxy to enable layer 4 SNI routing which will be used by Pulsar to use ATS as a reverse proxy. +This section explains how to set up and use ATS as a reverse proxy, so Pulsar clients can connect to brokers through the ATS proxy using the SNI routing protocol on TLS connection. + Set up ATS Proxy for layer-4 SNI routing +To support layer 4 SNI routing, you need to configure the `records.conf` and `ssl_server_name.conf` files.  -To support SNI routing, you need to configure two fi
[pulsar] branch master updated: [pulsar-doc] Add document for Pulasr SNI routing with ATS (#7421)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new ee1b810 [pulsar-doc] Add document for Pulasr SNI routing with ATS (#7421) ee1b810 is described below commit ee1b81030f0b6fe6f67fc6db89b4b55a1ef2f033 Author: Rajan Dhabalia AuthorDate: Tue Jul 7 01:06:51 2020 -0700 [pulsar-doc] Add document for Pulasr SNI routing with ATS (#7421) * [pulsar-doc] Add document for Pulasr SNI routing with ATS * address comments * add image * Update site2/docs/concepts-proxy-sni-routing.md Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com> * Update site2/docs/concepts-proxy-sni-routing.md Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com> * Update site2/docs/concepts-proxy-sni-routing.md Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com> * Update site2/docs/concepts-proxy-sni-routing.md Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com> * Update site2/docs/concepts-proxy-sni-routing.md Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com> Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com> --- site2/docs/assets/pulsar-sni-client.png | Bin 0 -> 232801 bytes site2/docs/assets/pulsar-sni-geo.png | Bin 0 -> 201549 bytes site2/docs/concepts-proxy-sni-routing.md | 122 +++ 3 files changed, 122 insertions(+) diff --git a/site2/docs/assets/pulsar-sni-client.png b/site2/docs/assets/pulsar-sni-client.png new file mode 100644 index 000..c02e046 Binary files /dev/null and b/site2/docs/assets/pulsar-sni-client.png differ diff --git a/site2/docs/assets/pulsar-sni-geo.png b/site2/docs/assets/pulsar-sni-geo.png new file mode 100644 index 000..bff8482 Binary files /dev/null and b/site2/docs/assets/pulsar-sni-geo.png differ diff --git a/site2/docs/concepts-proxy-sni-routing.md b/site2/docs/concepts-proxy-sni-routing.md new file mode 100644 index 000..fc1ae9b --- /dev/null +++ b/site2/docs/concepts-proxy-sni-routing.md @@ -0,0 +1,122 @@ +--- +id: concepts-proxy-sni-routing +title: Proxy support with SNI routing +sidebar_label: Proxy support with SNI routing +--- + +## Pulsar Proxy with SNI routing + +A proxy server is an intermediary server that forwards requests from multiple clients to different servers across the Internet. The proxy server acts as a "traffic cop" in both forward and reverse proxy scenarios, and brings various benefits to your system such as load balancing, performance, security, auto-scaling, etc. There are already many proxy servers available in the market which are fast and scalable. More importantly, these proxy servers cover various essential security aspects [...] + +[PIP-60](https://github.com/apache/pulsar/wiki/PIP-60:-Support-Proxy-server-with-SNI-routing) explains the SNI routing protocol and how Pulsar clients support SNI routing protocol to connect to brokers through the proxy. This document explains how to set up the ATS proxy and the Pulsar client to enable SNI routing and connect Pulsar client to the broker through the ATS proxy. + +### ATS-SNI Routing in Pulsar +[ATS supports layer-4 SNI routing](https://docs.trafficserver.apache.org/en/latest/admin-guide/layer-4-routing.en.html) with the requirement that inbound connection must be a TLS connection. The Pulsar client also supports SNI routing protocol on TLS connection and that allows Pulsar to use ATS as a reverse proxy when Pulsar client wants to connect to broker through ATS proxy. Therefore, this section explains how to set up and use ATS as a reverse proxy so pulsar clients can connect to b [...] + + + ATS Proxy setup for layer-4 SNI routing + +This section explains how to set up ATS proxy to enable layer 4 SNI routing which will be used by Pulsar to use ATS as a reverse proxy. + + + + +To support SNI routing, you need to configure two files: `records.conf` and `ssl_server_name.conf`. + + +- `records.conf`: +The [records.config fil](https://docs.trafficserver.apache.org/en/latest/admin-guide/files/records.config.en.html) (By default, it is located in `/usr/local/etc/trafficserver/`.) is a list of configurable variables used by the Apache Traffic Server and we have to update this file with TLS port (`http.server_ports`) on which proxy can listen and proxy certs (`ssl.client.cert.path` and `ssl.client.cert.filename`) for secure TLS tunneling. We also have to configure a range of server ports ( [...] + +**Example:** + +``` +# PROXY TLS PORT +CONFIG proxy.config.http.server_ports STRING 4443:ssl 4080 +# PROXY CERTS FILE PATH +CONFIG prox
[pulsar] branch master updated: [doc] fix doc after remove bc-shaded (#7454)
This is an automated email from the ASF dual-hosted git repository.
hjf pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new ceecc78 [doc] fix doc after remove bc-shaded (#7454)
ceecc78 is described below
commit ceecc780de5dd8e72c51ecaa4eeb0691d49cf91a
Author: Jia Zhai
AuthorDate: Mon Jul 6 18:42:42 2020 -0500
[doc] fix doc after remove bc-shaded (#7454)
* fix bc doc after remove bc-shaded
* Update site2/docs/security-bouncy-castle.md
Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com>
Co-authored-by: Sijie Guo
Co-authored-by: Yu Liu <50226895+anonymit...@users.noreply.github.com>
---
site2/docs/security-bouncy-castle.md | 8 +++-
.../versioned_docs/version-2.5.1/security-bouncy-castle.md| 7 +++
.../versioned_docs/version-2.5.2/security-bouncy-castle.md| 7 +++
.../versioned_docs/version-2.6.0/security-bouncy-castle.md| 7 +++
.../versioned_docs/version-2.6.1/security-bouncy-castle.md| 7 +++
5 files changed, 15 insertions(+), 21 deletions(-)
diff --git a/site2/docs/security-bouncy-castle.md
b/site2/docs/security-bouncy-castle.md
index e2d2a5d..2d9ef6b 100644
--- a/site2/docs/security-bouncy-castle.md
+++ b/site2/docs/security-bouncy-castle.md
@@ -37,8 +37,7 @@ Pulsar module `bouncy-castle-bc`, which defined by
`bouncy-castle/bc/pom.xml` co
```
-And based on Pulsar module `bouncy-castle-bc`, Pulsar shades a fat jar in
module `bouncy-castle-bc-shaded` that contains needed classes of BouncyCastle
non-FIPS jars.
-By using this `bouncy-castle-bc-shaded` module, user can easily include and
exclude BouncyCastle non-FIPS jars.
+By using this `bouncy-castle-bc` module, you can easily include and exclude
BouncyCastle non-FIPS jars.
### Pulsar Client and Broker dependencies on BC-non-FIPS
@@ -47,7 +46,7 @@ Pulsar Client(`pulsar-client-original`) module include
BouncyCastle non-FIPS jar
```xml
org.apache.pulsar
- bouncy-castle-bc-shaded
+ bouncy-castle-bc
${project.parent.version}
```
@@ -95,7 +94,7 @@ For example:
${project.groupId}
- bouncy-castle-bc-shaded
+ bouncy-castle-bc
@@ -118,4 +117,3 @@ Besides this, module `bouncy-castle-bcfips` builds contain
an output with format
For more example, you can reference module `bcfips-include-test` and
`bcfips-nar-test`.
-
diff --git
a/site2/website/versioned_docs/version-2.5.1/security-bouncy-castle.md
b/site2/website/versioned_docs/version-2.5.1/security-bouncy-castle.md
index 59965b6..b8b8d56 100644
--- a/site2/website/versioned_docs/version-2.5.1/security-bouncy-castle.md
+++ b/site2/website/versioned_docs/version-2.5.1/security-bouncy-castle.md
@@ -38,8 +38,7 @@ Pulsar module `bouncy-castle-bc`, which defined by
`bouncy-castle/bc/pom.xml` co
```
-And based on Pulsar module `bouncy-castle-bc`, Pulsar shades a fat jar in
module `bouncy-castle-bc-shaded` that contains needed classes of BouncyCastle
non-FIPS jars.
-By using this `bouncy-castle-bc-shaded` module, user can easily include and
exclude BouncyCastle non-FIPS jars.
+By using this `bouncy-castle-bc` module, user can easily include and exclude
BouncyCastle non-FIPS jars.
### Pulsar Client and Broker dependencies on BC-non-FIPS
@@ -48,7 +47,7 @@ Pulsar Client(`pulsar-client-original`) module include
BouncyCastle non-FIPS jar
```xml
org.apache.pulsar
- bouncy-castle-bc-shaded
+ bouncy-castle-bc
${project.parent.version}
```
@@ -96,7 +95,7 @@ For example:
${project.groupId}
- bouncy-castle-bc-shaded
+ bouncy-castle-bc
diff --git
a/site2/website/versioned_docs/version-2.5.2/security-bouncy-castle.md
b/site2/website/versioned_docs/version-2.5.2/security-bouncy-castle.md
index 147eefc..aea6d01 100644
--- a/site2/website/versioned_docs/version-2.5.2/security-bouncy-castle.md
+++ b/site2/website/versioned_docs/version-2.5.2/security-bouncy-castle.md
@@ -38,8 +38,7 @@ Pulsar module `bouncy-castle-bc`, which defined by
`bouncy-castle/bc/pom.xml` co
```
-And based on Pulsar module `bouncy-castle-bc`, Pulsar shades a fat jar in
module `bouncy-castle-bc-shaded` that contains needed classes of BouncyCastle
non-FIPS jars.
-By using this `bouncy-castle-bc-shaded` module, user can easily include and
exclude BouncyCastle non-FIPS jars.
+By using this `bouncy-castle-bc` module, user can easily include and exclude
BouncyCastle non-FIPS jars.
### Pulsar Client and Broker dependencies on BC-non-FIPS
@@ -48,7 +47,7 @@ Pulsar Client(`pulsar-client-original`) module include
BouncyCastle non-FIPS jar
```xml
org.apache.pulsar
- bouncy-castle-bc-shaded
+
[pulsar] branch master updated (e99b669 -> 56fe11a)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from e99b669 [Issue: 7379] Improve security setting of Pulsar Functions (#7424) add 56fe11a [docs]Update content on message deduplication (#7429) No new revisions were added by this update. Summary of changes: site2/docs/concepts-clients.md| 2 +- site2/docs/concepts-messaging.md | 153 -- site2/docs/cookbooks-deduplication.md | 10 +-- 3 files changed, 79 insertions(+), 86 deletions(-)
[pulsar] branch master updated (4a8ceb5 -> 717deb8)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 4a8ceb5 simplify code (#7381) add 717deb8 update for pr:Restore clusterDispatchRate policy for compatibility (#7380) No new revisions were added by this update. Summary of changes: site2/docs/admin-api-namespaces.md | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-)
[pulsar] branch master updated (4a8ceb5 -> 717deb8)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 4a8ceb5 simplify code (#7381) add 717deb8 update for pr:Restore clusterDispatchRate policy for compatibility (#7380) No new revisions were added by this update. Summary of changes: site2/docs/admin-api-namespaces.md | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-)
[pulsar] branch master updated (45afb56 -> 5417882)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 45afb56 Fix the regression from #6428 (#7241) add 5417882 [Issue 7032][Doc] Update connector admin CLI for suporting DLQ for sink/source. (#7339) No new revisions were added by this update. Summary of changes: site2/docs/io-cli.md | 3 +++ site2/docs/io-use.md | 4 ++-- site2/website/versioned_docs/version-2.5.0/io-use.md | 4 ++-- site2/website/versioned_docs/version-2.6.0/io-use.md | 7 --- 4 files changed, 11 insertions(+), 7 deletions(-)
[pulsar] branch master updated (45afb56 -> 5417882)
This is an automated email from the ASF dual-hosted git repository. hjf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git. from 45afb56 Fix the regression from #6428 (#7241) add 5417882 [Issue 7032][Doc] Update connector admin CLI for suporting DLQ for sink/source. (#7339) No new revisions were added by this update. Summary of changes: site2/docs/io-cli.md | 3 +++ site2/docs/io-use.md | 4 ++-- site2/website/versioned_docs/version-2.5.0/io-use.md | 4 ++-- site2/website/versioned_docs/version-2.6.0/io-use.md | 7 --- 4 files changed, 11 insertions(+), 7 deletions(-)
