(pulsar-site) branch main updated: [feat] add summit events 2024 display (#786)
This is an automated email from the ASF dual-hosted git repository.
guangning pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git
The following commit(s) were added to refs/heads/main by this push:
new 347d54cd4136 [feat] add summit events 2024 display (#786)
347d54cd4136 is described below
commit 347d54cd4136453dfd559b3c6fd56019b4aa266a
Author: Li Li
AuthorDate: Thu Feb 8 15:12:14 2024 +0800
[feat] add summit events 2024 display (#786)
* [feat] summit events 2024 display
Signed-off-by: lili
* Update date
---
data/events.ts | 271 +---
src/components/pages/EventsPage/Cards/Cards.tsx | 8 +-
2 files changed, 153 insertions(+), 126 deletions(-)
diff --git a/data/events.ts b/data/events.ts
index 084bedc74221..24065e8a1af2 100644
--- a/data/events.ts
+++ b/data/events.ts
@@ -21,129 +21,150 @@ export type Resource = {
};
export const resources: Record = {
-events: [
- {
-title: 'Pulsar Summit Europe 2023',
-description: '',
-link:
'https://streamnative.io/blog/pulsar-virtual-summit-europe-2023-on-demand-videos-available-now',
-displayDate: '23 May 2023',
-startDate: '2023-05-23' // year-month-day
- },
- {
-title: 'Pulsar Summit San Francisco 2022',
-description: '',
-link: 'https://pulsar-summit.org/event/san-francisco-2022',
-displayDate: '18 Aug 2022',
-startDate: '2022-08-18' // year-month-day
- },
- {
-title: 'Pulsar Summit Europe 2021 ',
-description: '',
-link: 'https://pulsar-summit.org/en/event/europe-2021',
-displayDate: '6 Oct 2021',
-startDate: '2021-10-06' // year-month-day
- },
- {
-title: 'Pulsar Summit Asia 2021',
-description: '',
-link: 'https://pulsar-summit.org/en/event/asia-2021',
-displayDate: '20-21 November 2021',
-startDate: '2021-11-20' // year-month-day
- },
- {
-title: 'Pulsar Summit North America 2021',
-description: '',
-link: 'https://pulsar-summit.org/en/event/north-america-2021',
-displayDate: '16-17 June 2021',
-startDate: '2021-06-16' // year-month-day
- },
- {
-title: 'Pulsar Summit Asia 2020',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWjHlRb-dzjwYdETkVlyCJOq',
-displayDate: '28-29 November 2020',
-startDate: '2021-11-28' // year-month-day
- },
- {
-title: 'Pulsar Summit Virtual Conference 2020',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWjVlPfaWlf3VO9W-XWsF_4-',
-displayDate: '17-18 June 2020',
-startDate: '2021-06-17' // year-month-day
- },
- {
-title: 'ApacheCon @Home',
-description: '',
-link:
'https://www.youtube.com/watch?v=iIABx20uvmw&list=PLU2OcwpQkYCy_awEe5xwlxGTk5UieA37m',
-displayDate: '29 June 2020',
-startDate: '2020-06-29' // year-month-day
- },
- {
-title: 'Pulsar Summit Virtual Conference ',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWjVlPfaWlf3VO9W-XWsF_4-',
-displayDate: '9 September 2020',
-startDate: '2020-09-09' // year-month-day
- }
-],
-meetups: [
- {
-title: 'NorCal Apache Pulsar Neighborhood Meetup Group',
-description: '',
-link: 'https://www.meetup.com/nor-cal-apache-pulsar-meetup-group/',
- },
- {
-title: 'Netherlands Apache Pulsar Meetup Group',
-description: '',
-link: 'https://www.meetup.com/netherlands-apache-pulsar-meetup/'
- },
- {
-title: 'SoCal Apache Pulsar Neighborhood Meetup Group',
-description: '',
-link: 'https://www.meetup.com/socal-apache-pulsar-meetup-group/'
- },
- {
-title: 'New York City Apache Pulsar Meetup',
-description: '',
-link: 'https://www.meetup.com/new-york-city-apache-pulsar-meetup/'
- },
- {
-title: 'Beijing Apache Pulsar® Meetup by StreamNative',
-description: '',
-link:
'https://www.meetup.com/beijing-apache-pulsar-meetup-by-streamnative/'
- },
- {
-title: 'SF Bay Area Apache Pulsar Meetup',
-description: '',
-link: 'https://www.meetup.com/SF-Bay-Area-Apache-Pulsar-Meetup/'
- },
- {
-title: 'Japan Pulsar User Group',
-description: '',
-link: 'https://japan-pulsar-user-group.connpass.com/'
- },
-],
-playlists: [
- {
-title: 'Pulsar Summit Europe 2021',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWh7zes7mNeTUCr2iU-2C1jB',
- },
- {
-title: 'Pulsar Summit North America 2021',
-description: ''
Re: [PR] [feat] add summit events 2024 display [pulsar-site]
tuteng merged PR #786: URL: https://github.com/apache/pulsar-site/pull/786 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(pulsar-site) branch summit-events-2024 updated (5f955d222b12 -> 322e3e060e94)
This is an automated email from the ASF dual-hosted git repository. guangning pushed a change to branch summit-events-2024 in repository https://gitbox.apache.org/repos/asf/pulsar-site.git from 5f955d222b12 [feat] summit events 2024 display add 322e3e060e94 Update date No new revisions were added by this update. Summary of changes: data/events.ts | 12 ++-- 1 file changed, 6 insertions(+), 6 deletions(-)
Re: [I] Feature Request: Pulsar to Azure Data Explorer (ADX) Connector [pulsar]
asaharn commented on issue #22040: URL: https://github.com/apache/pulsar/issues/22040#issuecomment-1933449434 Here is the PR that brings in ADX connector #22006 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[I] Feature Request: Pulsar to Azure Data Explorer (ADX) Connector [pulsar]
asaharn opened a new issue, #22040: URL: https://github.com/apache/pulsar/issues/22040 ### Search before asking - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar. ### Motivation Presently, there is no dedicated connector to facilitate seamless data transfer from Apache Pulsar to Azure Data Explorer (ADX). This hinders the ability to efficiently ingest and analyze data in ADX Clusters. ### Solution To address this, we propose the development of a new connector tailored to bridge the gap between Pulsar and Azure Data Explorer ADX. This connector should enable smooth and optimized data transfer, ensuring compatibility, reliability, and efficient ingestion into ADX Clusters. The proposed connector would empower teams to harness the full potential of ADX for analytics and insights, enhancing the decision-making processes. ### Alternatives _No response_ ### Anything else? _No response_ ### Are you willing to submit a PR? - [X] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] Ability for a Consumer to bypass retries and DLQ a terminally failing message [pulsar-client-go]
RobertIndie commented on issue #1167: URL: https://github.com/apache/pulsar-client-go/issues/1167#issuecomment-1933322584 I think we could add an interceptor in the DLQPolicy so that we can let users choose whether each message need to be retried. Does it make sense to you? Before implementing this, we need to follow the PIP process and get approval. Are you willing to lead this discussion? Would you like to start by sending the discussion to the mailing list? FYI, you can find the PIP process guide here: https://github.com/apache/pulsar/blob/master/pip/README.md -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [feature] Max Retry per msg feature added [pulsar-client-go]
RobertIndie commented on PR #939: URL: https://github.com/apache/pulsar-client-go/pull/939#issuecomment-1933318946 > @nodece what is PMC, and why was it not approved? I created an issue today (#1167) which I think this PR would have addressed. The discussion happened here: https://lists.apache.org/thread/b9rfv6t307z439xx3zt2ym4p140qzp06 For the term of PMC, please see: https://pulsar.apache.org/community/#section-governance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [feat] add summit events 2024 display [pulsar-site]
github-actions[bot] commented on PR #786: URL: https://github.com/apache/pulsar-site/pull/786#issuecomment-1933317324 @urfreespace Please select only one documentation label in your PR description. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] [feat] add summit events 2024 display [pulsar-site]
urfreespace opened a new pull request, #786: URL: https://github.com/apache/pulsar-site/pull/786 This PR adds doc for #xyz This PR add summit events 2024 display - [ ] `doc` - [x] `doc-required` - [x] `doc-not-needed` - [ ] `doc-complete` https://github.com/apache/pulsar-site/assets/76024046/c7515f70-48a4-4f14-9bed-350b2ca4f18d";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(pulsar-site) branch summit-events-2024 created (now 5f955d222b12)
This is an automated email from the ASF dual-hosted git repository. urfree pushed a change to branch summit-events-2024 in repository https://gitbox.apache.org/repos/asf/pulsar-site.git at 5f955d222b12 [feat] summit events 2024 display This branch includes the following new commits: new 5f955d222b12 [feat] summit events 2024 display The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(pulsar-site) 01/01: [feat] summit events 2024 display
This is an automated email from the ASF dual-hosted git repository.
urfree pushed a commit to branch summit-events-2024
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git
commit 5f955d222b12cd5da0b55b11d04a2cf9a85bd9a3
Author: lili
AuthorDate: Thu Feb 8 11:42:46 2024 +0800
[feat] summit events 2024 display
Signed-off-by: lili
---
data/events.ts | 271 +---
src/components/pages/EventsPage/Cards/Cards.tsx | 8 +-
2 files changed, 153 insertions(+), 126 deletions(-)
diff --git a/data/events.ts b/data/events.ts
index 084bedc74221..bde3ed69257d 100644
--- a/data/events.ts
+++ b/data/events.ts
@@ -21,129 +21,150 @@ export type Resource = {
};
export const resources: Record = {
-events: [
- {
-title: 'Pulsar Summit Europe 2023',
-description: '',
-link:
'https://streamnative.io/blog/pulsar-virtual-summit-europe-2023-on-demand-videos-available-now',
-displayDate: '23 May 2023',
-startDate: '2023-05-23' // year-month-day
- },
- {
-title: 'Pulsar Summit San Francisco 2022',
-description: '',
-link: 'https://pulsar-summit.org/event/san-francisco-2022',
-displayDate: '18 Aug 2022',
-startDate: '2022-08-18' // year-month-day
- },
- {
-title: 'Pulsar Summit Europe 2021 ',
-description: '',
-link: 'https://pulsar-summit.org/en/event/europe-2021',
-displayDate: '6 Oct 2021',
-startDate: '2021-10-06' // year-month-day
- },
- {
-title: 'Pulsar Summit Asia 2021',
-description: '',
-link: 'https://pulsar-summit.org/en/event/asia-2021',
-displayDate: '20-21 November 2021',
-startDate: '2021-11-20' // year-month-day
- },
- {
-title: 'Pulsar Summit North America 2021',
-description: '',
-link: 'https://pulsar-summit.org/en/event/north-america-2021',
-displayDate: '16-17 June 2021',
-startDate: '2021-06-16' // year-month-day
- },
- {
-title: 'Pulsar Summit Asia 2020',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWjHlRb-dzjwYdETkVlyCJOq',
-displayDate: '28-29 November 2020',
-startDate: '2021-11-28' // year-month-day
- },
- {
-title: 'Pulsar Summit Virtual Conference 2020',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWjVlPfaWlf3VO9W-XWsF_4-',
-displayDate: '17-18 June 2020',
-startDate: '2021-06-17' // year-month-day
- },
- {
-title: 'ApacheCon @Home',
-description: '',
-link:
'https://www.youtube.com/watch?v=iIABx20uvmw&list=PLU2OcwpQkYCy_awEe5xwlxGTk5UieA37m',
-displayDate: '29 June 2020',
-startDate: '2020-06-29' // year-month-day
- },
- {
-title: 'Pulsar Summit Virtual Conference ',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWjVlPfaWlf3VO9W-XWsF_4-',
-displayDate: '9 September 2020',
-startDate: '2020-09-09' // year-month-day
- }
-],
-meetups: [
- {
-title: 'NorCal Apache Pulsar Neighborhood Meetup Group',
-description: '',
-link: 'https://www.meetup.com/nor-cal-apache-pulsar-meetup-group/',
- },
- {
-title: 'Netherlands Apache Pulsar Meetup Group',
-description: '',
-link: 'https://www.meetup.com/netherlands-apache-pulsar-meetup/'
- },
- {
-title: 'SoCal Apache Pulsar Neighborhood Meetup Group',
-description: '',
-link: 'https://www.meetup.com/socal-apache-pulsar-meetup-group/'
- },
- {
-title: 'New York City Apache Pulsar Meetup',
-description: '',
-link: 'https://www.meetup.com/new-york-city-apache-pulsar-meetup/'
- },
- {
-title: 'Beijing Apache Pulsar® Meetup by StreamNative',
-description: '',
-link:
'https://www.meetup.com/beijing-apache-pulsar-meetup-by-streamnative/'
- },
- {
-title: 'SF Bay Area Apache Pulsar Meetup',
-description: '',
-link: 'https://www.meetup.com/SF-Bay-Area-Apache-Pulsar-Meetup/'
- },
- {
-title: 'Japan Pulsar User Group',
-description: '',
-link: 'https://japan-pulsar-user-group.connpass.com/'
- },
-],
-playlists: [
- {
-title: 'Pulsar Summit Europe 2021',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWh7zes7mNeTUCr2iU-2C1jB',
- },
- {
-title: 'Pulsar Summit North America 2021',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PLqRma1oIkcWjyezVodJHcp8GSypvGuc1C'
- },
- {
-title: 'Pulsar Summit Asia 2020',
-description: '',
-link:
'https://www.youtube.com/playlist?list=PL
Re: [PR] [improve][fn] support WASM functions which can support many languages [pulsar]
dragon-zhang commented on PR #21975: URL: https://github.com/apache/pulsar/pull/21975#issuecomment-1933278909 I will start abstracting SPI interfaces as soon as possible after the Chinese New Year. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [client] add ability to list topic names which exist on the server [pulsar-client-go]
RobertIndie commented on issue #1168: URL: https://github.com/apache/pulsar-client-go/issues/1168#issuecomment-1933268305 We could list the topics using the pulsaradmin. Here is the API: https://github.com/apache/pulsar-client-go/blob/f476814a9e1bac484e9589d4fb3f299066f54ddc/pulsaradmin/pkg/admin/topic.go#L43-L44 Is that OK for you? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] [all] support contexts [pulsar-client-go]
merlimat commented on issue #1170: URL: https://github.com/apache/pulsar-client-go/issues/1170#issuecomment-1933232258 @jayshrivastava Yes, you're right, it would be really good to take those contexts (and use them). The main difficulty, as in #1165, is how to do that without breaking compatibility. Or maybe, it would be a good opportunity to break compatibility, and change versioning scheme to 1.0. Would you like to drive a discussion on the d...@pulsar.apache.org mailing list about this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] Update dependencies to latest versions [pulsar-client-cpp]
merlimat commented on PR #401: URL: https://github.com/apache/pulsar-client-cpp/pull/401#issuecomment-1933065097 > The download link of protobuf 25.1 is different from old versions. I actually rolled back the protobuf update, it's too complex. They are now requiring another dependency to be installed https://abseil.io/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(pulsar-client-cpp) branch merlimat-patch-2 updated (377e2c1 -> 118d7c9)
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a change to branch merlimat-patch-2 in repository https://gitbox.apache.org/repos/asf/pulsar-client-cpp.git from 377e2c1 Fixed new protobuf paths add 81d3c70 Revert "Fixed new protobuf paths" add 118d7c9 Rolled back to previous Protobuf version No new revisions were added by this update. Summary of changes: dependencies.yaml | 2 +- pkg/apk/Dockerfile | 6 +++--- pkg/deb/Dockerfile | 6 +++--- pkg/mac/build-static-library.sh | 4 ++-- pkg/rpm/Dockerfile | 6 +++--- 5 files changed, 12 insertions(+), 12 deletions(-)
(pulsar) branch master updated: [feat] PIP-335: Add support Oxia as a metadata store (#22007)
This is an automated email from the ASF dual-hosted git repository.
mmerli pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new a83e9ed7032 [feat] PIP-335: Add support Oxia as a metadata store
(#22007)
a83e9ed7032 is described below
commit a83e9ed70323b80319545326716340ce76d690eb
Author: Matteo Merli
AuthorDate: Wed Feb 7 14:10:33 2024 -0800
[feat] PIP-335: Add support Oxia as a metadata store (#22007)
---
distribution/server/src/assemble/LICENSE.bin.txt | 2 +
pom.xml| 13 +
pulsar-broker/pom.xml | 6 +
pulsar-metadata/pom.xml| 12 +
.../metadata/impl/MetadataStoreFactoryImpl.java| 3 +
.../metadata/impl/oxia/OxiaMetadataStore.java | 283 +
.../impl/oxia/OxiaMetadataStoreProvider.java | 75 ++
.../pulsar/metadata/impl/oxia/package-info.java| 19 ++
.../pulsar/metadata/BaseMetadataStoreTest.java | 18 ++
.../apache/pulsar/metadata/MetadataBenchmark.java | 2 +-
.../apache/pulsar/metadata/MetadataStoreTest.java | 30 ++-
11 files changed, 450 insertions(+), 13 deletions(-)
diff --git a/distribution/server/src/assemble/LICENSE.bin.txt
b/distribution/server/src/assemble/LICENSE.bin.txt
index 0bf0fee823c..e3941c54a74 100644
--- a/distribution/server/src/assemble/LICENSE.bin.txt
+++ b/distribution/server/src/assemble/LICENSE.bin.txt
@@ -465,6 +465,8 @@ The Apache Software License, Version 2.0
- io.dropwizard.metrics-metrics-jmx-4.1.12.1.jar
* Prometheus
- io.prometheus-simpleclient_httpserver-0.16.0.jar
+ * Oxia
+- io.streamnative.oxia-oxia-client-0.1.0-shaded.jar
* Java JSON WebTokens
- io.jsonwebtoken-jjwt-api-0.11.1.jar
- io.jsonwebtoken-jjwt-impl-0.11.1.jar
diff --git a/pom.xml b/pom.xml
index 0c216c9dab8..4dfeb30821a 100644
--- a/pom.xml
+++ b/pom.xml
@@ -242,6 +242,7 @@ flexible messaging model and an intuitive client
API.
4.5.13
4.4.15
0.7.5
+0.1.0
2.0
1.10.12
5.3.3
@@ -1152,6 +1153,18 @@ flexible messaging model and an intuitive client
API.
${sketches.version}
+
+io.streamnative.oxia
+oxia-client
+${oxia.version}
+shaded
+
+
+io.streamnative.oxia
+oxia-testcontainers
+${oxia.version}
+
+
com.amazonaws
aws-java-sdk-bom
diff --git a/pulsar-broker/pom.xml b/pulsar-broker/pom.xml
index 9dd319f7911..c39de184b05 100644
--- a/pulsar-broker/pom.xml
+++ b/pulsar-broker/pom.xml
@@ -164,6 +164,12 @@
test
+
+ io.streamnative.oxia
+ oxia-testcontainers
+ test
+
+
io.dropwizard.metrics
diff --git a/pulsar-metadata/pom.xml b/pulsar-metadata/pom.xml
index d232a1f5c00..8600d0ea191 100644
--- a/pulsar-metadata/pom.xml
+++ b/pulsar-metadata/pom.xml
@@ -62,6 +62,18 @@
+
+ io.streamnative.oxia
+ oxia-client
+ shaded
+
+
+
+ io.streamnative.oxia
+ oxia-testcontainers
+ test
+
+
io.dropwizard.metrics
metrics-core
diff --git
a/pulsar-metadata/src/main/java/org/apache/pulsar/metadata/impl/MetadataStoreFactoryImpl.java
b/pulsar-metadata/src/main/java/org/apache/pulsar/metadata/impl/MetadataStoreFactoryImpl.java
index dd4df69fc43..cb7bea718e4 100644
---
a/pulsar-metadata/src/main/java/org/apache/pulsar/metadata/impl/MetadataStoreFactoryImpl.java
+++
b/pulsar-metadata/src/main/java/org/apache/pulsar/metadata/impl/MetadataStoreFactoryImpl.java
@@ -22,6 +22,7 @@ import static
org.apache.pulsar.metadata.impl.EtcdMetadataStore.ETCD_SCHEME_IDEN
import static
org.apache.pulsar.metadata.impl.LocalMemoryMetadataStore.MEMORY_SCHEME_IDENTIFIER;
import static
org.apache.pulsar.metadata.impl.RocksdbMetadataStore.ROCKSDB_SCHEME_IDENTIFIER;
import static
org.apache.pulsar.metadata.impl.ZKMetadataStore.ZK_SCHEME_IDENTIFIER;
+import static
org.apache.pulsar.metadata.impl.oxia.OxiaMetadataStoreProvider.OXIA_SCHEME_IDENTIFIER;
import com.google.common.base.Splitter;
import java.util.HashMap;
import java.util.Map;
@@ -31,6 +32,7 @@ import org.apache.pulsar.metadata.api.MetadataStoreConfig;
import org.apache.pulsar.metadata.api.MetadataStoreException;
import org.apache.pulsar.metadata.api.MetadataStoreProvider;
import org.apache.pulsar.metadata.api.extended.MetadataStoreExtended;
+import org.apache.pulsar.metadata.impl.oxia.OxiaMetadataStoreProvider;
@Slf4j
public class MetadataStoreFactoryImpl {
@@ -66,6 +68,7 @@ public class MetadataStoreFactoryImpl {
providers.put(MEMORY_SCHEME_IDENTIFIER, new
MemoryMetadataStoreProvider());
providers.put(ROCKSDB_SCHEME_IDENTIFIER, new
RocksdbMetadataStoreProvider());
providers.put(ETCD_SCHEME_IDENTIFIER, new EtcdMetadataStoreProvider());
+
Re: [PR] [feat] PIP-335: Add support Oxia as a metadata store [pulsar]
merlimat merged PR #22007: URL: https://github.com/apache/pulsar/pull/22007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(pulsar) branch master updated: [feat] PIP-335: Oxia metadata plugin (#22009)
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 1c5b4b8a0ca [feat] PIP-335: Oxia metadata plugin (#22009) 1c5b4b8a0ca is described below commit 1c5b4b8a0caf737c062d8e24879be3b592e0f5ed Author: Matteo Merli AuthorDate: Wed Feb 7 14:10:02 2024 -0800 [feat] PIP-335: Oxia metadata plugin (#22009) Co-authored-by: Zac Bentley --- pip/pip-335 Oxia metadata plugin.md | 51 + 1 file changed, 51 insertions(+) diff --git a/pip/pip-335 Oxia metadata plugin.md b/pip/pip-335 Oxia metadata plugin.md new file mode 100644 index 000..fdff8a85593 --- /dev/null +++ b/pip/pip-335 Oxia metadata plugin.md @@ -0,0 +1,51 @@ +# PIP-335: Support Oxia metadata store plugin + +# Motivation + +Oxia is a scalable metadata store and coordination system that can be used as the core infrastructure +to build large scale distributed systems. + +Oxia was created with the primary goal of providing an alternative Pulsar to replace ZooKeeper as the +long term preferred metadata store, overcoming all the current limitations in terms of metadata +access throughput and data set size. + +# Goals + +Add a Pulsar MetadataStore plugin that uses Oxia client SDK. + +Users will be able to start a Pulsar cluster using just Oxia, without any ZooKeeper involved. + +## Not in Scope + +It's not in the scope of this proposal to change any default behavior or configuration of Pulsar. + +# Detailed Design + +## Design & Implementation Details + +Oxia semantics and client SDK were already designed with Pulsar and MetadataStore plugin API in mind, so +there is not much integration work that needs to be done here. + +Just few notes: + 1. Oxia client already provides support for transparent batching of read and write operations, +so there will be no use of the batching logic in `AbstractBatchedMetadataStore` + 2. Oxia does not treat keys as a walkable file-system like interface, with directories and files. Instead +all the keys are independent. Though Oxia sorting of keys is aware of '/' and provides efficient key +range scanning operations to identify the first level children of a given key + 3. Oxia, unlike ZooKeeper, doesn't require the parent path of a key to exist. eg: we can create `/a/b/c` key +without `/a/b` and `/a` existing. +In the Pulsar integration for Oxia we're forcing to create all parent keys when they are not there. This +is due to several places in BookKeeper access where it does not create the parent keys, though it will +later make `getChildren()` operations on the parents. + +## Other notes + +Unlike in the ZooKeeper implementation, the notification of events is guaranteed in Oxia, because the Oxia +client SDK will use the transaction offset after server reconnections and session restarted events. This +will ensure that brokers cache will always be properly invalidated. We will then be able to remove the +current 5minutes automatic cache refresh which is in place to prevent the ZooKeeper missed watch issue. + +# Links + +Oxia: https://github.com/streamnative/oxia +Oxia Java Client SDK: https://github.com/streamnative/oxia-java
Re: [PR] [feat] PIP-335: Oxia metadata plugin [pulsar]
merlimat merged PR #22009: URL: https://github.com/apache/pulsar/pull/22009 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [feat][misc] PIP-320: Add OpenTelemetry scaffolding [pulsar]
dragosvictor commented on code in PR #22010:
URL: https://github.com/apache/pulsar/pull/22010#discussion_r1482152039
##
pulsar-otel-integration/src/main/java/org/apache/pulsar/common/stats/OpenTelemetryService.java:
##
@@ -0,0 +1,102 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.pulsar.common.stats;
+
+import static com.google.common.base.Preconditions.checkArgument;
+import com.google.common.annotations.VisibleForTesting;
+import io.opentelemetry.api.OpenTelemetry;
+import io.opentelemetry.api.common.AttributeKey;
+import io.opentelemetry.sdk.OpenTelemetrySdk;
+import io.opentelemetry.sdk.autoconfigure.AutoConfiguredOpenTelemetrySdk;
+import
io.opentelemetry.sdk.autoconfigure.AutoConfiguredOpenTelemetrySdkBuilder;
+import io.opentelemetry.sdk.autoconfigure.spi.AutoConfigurationCustomizer;
+import io.opentelemetry.sdk.resources.Resource;
+import java.io.Closeable;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Objects;
+import java.util.function.Consumer;
+import lombok.Builder;
+import org.apache.commons.lang3.StringUtils;
+
+/**
+ * Provides a common OpenTelemetry service for Pulsar components to use.
Responsible for instantiating the OpenTelemetry
+ * SDK with a set of override properties. Once initialized, furnishes access
to OpenTelemetry.
+ */
+public class OpenTelemetryService implements Closeable {
+
+public static final AttributeKey CLUSTER_ATTRIBUTE =
AttributeKey.stringKey("pulsar.cluster");
+public static final AttributeKey SERVICE_NAME_ATTRIBUTE =
AttributeKey.stringKey("service.name");
Review Comment:
Factored them out to `OpenTelemetryAttributes`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[I] [all] support contexts [pulsar-client-go]
jayshrivastava opened a new issue, #1170: URL: https://github.com/apache/pulsar-client-go/issues/1170 **Is your feature request related to a problem? Please describe.** The library does not take a context/context. **Describe the solution you'd like** I expect clients and producers to take a context argument upon creation and have all goroutines created by the clients and producers take a context as well. This is important for tracing (see https://medium.com/swlh/distributed-tracing-for-go-microservice-with-opentracing-1fc1aec76b3e). The context needs to be piped into all goroutines for observability. It's also important to select on `ctx.Done()` when sending or recieving to channels. The libary does not do that at the moment. Ex. What if the command chan is full and `cp` cannot be send? This method will block. It would be beneficial to also select on a context provided by the user of the library in case the caller wants to cancel long running blocked operations. https://github.com/apache/pulsar-client-go/blob/f476814a9e1bac484e9589d4fb3f299066f54ddc/pulsar/producer_partition.go#L1462-L1473 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [WIP] Enable static code scanning [pulsar]
merlimat closed pull request #21845: [WIP] Enable static code scanning URL: https://github.com/apache/pulsar/pull/21845 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[PR] [pip-338] Add default lookup listener and fix inconsistency with listener's usage between different protocols [pulsar]
Meet0861 opened a new pull request, #22039: URL: https://github.com/apache/pulsar/pull/22039 ### Motivation A pip proposal to add a new default lookup listener config and fix bug with listener usage's for http protocol. **Issue in existing Code flow** Currently, the listener mentioned as `internalListenerName` in broker config helps in deciding the listener from the list of `advertisedListeners` to specify the service URL, is being used for broker-to-broker communication but that is exposed to the client in case of lookup results or redirects as well. Even if the client sends a `listenerName` (PIP-95) corresponding to the http protocol broker’s addresses, it is only used in the `pulsar` and `pulsar+ssl` protocols and is not consistent for the other protocols. **Need to have lookupListener** It might not be feasible to have the listerner config at the client side in every tech stack or connector. Also, Currently, there is no option to pass the listener while using the admin APIs. As admin APIs can be called from an external network as well, the use of the internal listener’s broker service URL can lead all admin operations to get affected. ### Modifications 1. Fix Code Flow - Inconsistency with listener usage with protocols other than pulsar and pulsar+ssl 2. Add a new config to be considered in case of missing listener in client request and return the broker service URL corresponding to the lookupListener ### Verifying this change - [ ] Make sure that the change passes the CI checks. ### Does this pull request potentially affect one of the following parts: *If the box was checked, please highlight the changes* - [ ] Dependencies (add or upgrade a dependency) - [x] The public API - [ ] The schema - [ ] The default values of configurations - [ ] The threading model - [ ] The binary protocol - [ ] The REST endpoints - [ ] The admin CLI options - [ ] The metrics - [ ] Anything that affects deployment ### Documentation - [ ] `doc` - [x] `doc-required` - [ ] `doc-not-needed` - [ ] `doc-complete` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] [feat][misc] PIP-320: Add OpenTelemetry scaffolding [pulsar]
dragosvictor commented on code in PR #22010:
URL: https://github.com/apache/pulsar/pull/22010#discussion_r1481903197
##
pulsar-broker/pom.xml:
##
@@ -470,6 +472,11 @@
${project.version}
+
+ io.rest-assured
Review Comment:
I had to move `PrometheusMetricsClient` to `pulsar-broker-common` for it to
be available in `pulsar-otel-integration` without causing cyclic dependencies
otherwise (`pulsar-otel-integration` <---> `pulsar-broker`). Doing so,
`rest-assured` gets excluded from the broker, causing test issues, so I had to
include it explicitly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: [PR] [feat][misc] PIP-320: Add OpenTelemetry scaffolding [pulsar]
asafm commented on code in PR #22010:
URL: https://github.com/apache/pulsar/pull/22010#discussion_r1481052604
##
pulsar-broker/src/main/java/org/apache/pulsar/broker/stats/PulsarBrokerOpenTelemetry.java:
##
@@ -0,0 +1,50 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.pulsar.broker.stats;
+
+import io.opentelemetry.api.metrics.Meter;
+import java.io.Closeable;
+import lombok.Getter;
+import org.apache.pulsar.PulsarVersion;
+import org.apache.pulsar.broker.ServiceConfiguration;
+import org.apache.pulsar.common.stats.OpenTelemetryService;
+
+public class PulsarBrokerOpenTelemetry implements Closeable {
+
+public static final String SERVICE_NAME = "pulsar-broker";
+private static final String INSTRUMENTATION_SCOPE_NAME =
"org.apache.pulsar.broker";
Review Comment:
Since you're using it in a single place, and it's private, I would inline it
##
pulsar-functions/worker/src/main/java/org/apache/pulsar/functions/worker/stats/PulsarWorkerOpenTelemetry.java:
##
@@ -0,0 +1,49 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.pulsar.functions.worker.stats;
+
+import io.opentelemetry.api.metrics.Meter;
+import java.io.Closeable;
+import lombok.Getter;
+import org.apache.pulsar.PulsarVersion;
+import org.apache.pulsar.common.stats.OpenTelemetryService;
+import org.apache.pulsar.functions.worker.WorkerConfig;
+
+public class PulsarWorkerOpenTelemetry implements Closeable {
+
+public static final String SERVICE_NAME = "pulsar-function-worker";
+private static final String INSTRUMENTATION_SCOPE_NAME =
"org.apache.pulsar.function_worker";
Review Comment:
Same as the previous comment. Used only in 1 place - I would inline it.
##
pulsar-otel-integration/src/main/java/org/apache/pulsar/common/stats/OpenTelemetryService.java:
##
@@ -0,0 +1,102 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+package org.apache.pulsar.common.stats;
+
+import static com.google.common.base.Preconditions.checkArgument;
+import com.google.common.annotations.VisibleForTesting;
+import io.opentelemetry.api.OpenTelemetry;
+import io.opentelemetry.api.common.AttributeKey;
+import io.opentelemetry.sdk.OpenTelemetrySdk;
+import io.opentelemetry.sdk.autoconfigure.AutoConfiguredOpenTelemetrySdk;
+import
io.opentelemetry.sdk.autoconfigure.AutoConfiguredOpenTelemetrySdkBuilder;
+import io.opentelemetry.sdk.autoconfigure.spi.AutoConfigurationCustomizer;
+import io.opentelemetry.sdk.resources.Resource;
+import java.io.Closeable;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Objects;
+import java.util.function.Cons
[PR] Fix missing docker cmd [pulsar-site]
Technoboy- opened a new pull request, #785: URL: https://github.com/apache/pulsar-site/pull/785 This PR fixes https://github.com/apache/pulsar/issues/22027 - [ ] `doc` - [ ] `doc-required` - [x] `doc-not-needed` - [ ] `doc-complete` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(pulsar-site) branch fix-docker-cmd created (now 988f8ed3abae)
This is an automated email from the ASF dual-hosted git repository. technoboy pushed a change to branch fix-docker-cmd in repository https://gitbox.apache.org/repos/asf/pulsar-site.git at 988f8ed3abae Fix missing docker cmd This branch includes the following new commits: new 988f8ed3abae Fix missing docker cmd The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(pulsar-site) 01/01: Fix missing docker cmd
This is an automated email from the ASF dual-hosted git repository. technoboy pushed a commit to branch fix-docker-cmd in repository https://gitbox.apache.org/repos/asf/pulsar-site.git commit 988f8ed3abae140a003055e559e9f8a3183b4f2e Author: Jiwe Guo AuthorDate: Wed Feb 7 21:18:59 2024 +0800 Fix missing docker cmd --- docs/getting-started-docker.md | 1 + versioned_docs/version-3.2.x/getting-started-docker.md | 1 + 2 files changed, 2 insertions(+) diff --git a/docs/getting-started-docker.md b/docs/getting-started-docker.md index 7daa1b604e38..994b41f89c0f 100644 --- a/docs/getting-started-docker.md +++ b/docs/getting-started-docker.md @@ -28,6 +28,7 @@ For macOS, Linux, and Windows, run the following command to start Pulsar within ```shell +docker run -it \ -p 6650:6650 \ -p 8080:8080 \ --mount source=pulsardata,target=/pulsar/data \ diff --git a/versioned_docs/version-3.2.x/getting-started-docker.md b/versioned_docs/version-3.2.x/getting-started-docker.md index 7daa1b604e38..994b41f89c0f 100644 --- a/versioned_docs/version-3.2.x/getting-started-docker.md +++ b/versioned_docs/version-3.2.x/getting-started-docker.md @@ -28,6 +28,7 @@ For macOS, Linux, and Windows, run the following command to start Pulsar within ```shell +docker run -it \ -p 6650:6650 \ -p 8080:8080 \ --mount source=pulsardata,target=/pulsar/data \
Re: [PR] Remove JWT validation from production code [pulsar-manager]
eolivelli merged PR #547: URL: https://github.com/apache/pulsar-manager/pull/547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
(pulsar-manager) branch master updated: Remove JWT validation from production code (#547)
This is an automated email from the ASF dual-hosted git repository.
eolivelli pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar-manager.git
The following commit(s) were added to refs/heads/master by this push:
new 4476f5e Remove JWT validation from production code (#547)
4476f5e is described below
commit 4476f5e5537c701744da80b6e9cdf9634f341723
Author: Jonathan Leitschuh
AuthorDate: Wed Feb 7 06:51:47 2024 -0500
Remove JWT validation from production code (#547)
Signed-off-by: Jonathan Leitschuh
---
.../apache/pulsar/manager/service/JwtService.java | 6 -
.../manager/service/impl/JwtServiceImpl.java | 31 --
.../{ => impl}/BrokerTokensServiceImplTest.java| 19 ++---
3 files changed, 27 insertions(+), 29 deletions(-)
diff --git a/src/main/java/org/apache/pulsar/manager/service/JwtService.java
b/src/main/java/org/apache/pulsar/manager/service/JwtService.java
index 64d5162..3c126d7 100644
--- a/src/main/java/org/apache/pulsar/manager/service/JwtService.java
+++ b/src/main/java/org/apache/pulsar/manager/service/JwtService.java
@@ -13,10 +13,6 @@
*/
package org.apache.pulsar.manager.service;
-import io.jsonwebtoken.Claims;
-import org.springframework.stereotype.Service;
-
-import java.security.Key;
import java.util.Optional;
public interface JwtService {
@@ -27,8 +23,6 @@ public interface JwtService {
String createBrokerToken(String role, String expiryTime);
-Claims validateBrokerToken(String token);
-
void setToken(String key, String value);
String getToken(String key);
diff --git
a/src/main/java/org/apache/pulsar/manager/service/impl/JwtServiceImpl.java
b/src/main/java/org/apache/pulsar/manager/service/impl/JwtServiceImpl.java
index fa460e5..fe9d816 100644
--- a/src/main/java/org/apache/pulsar/manager/service/impl/JwtServiceImpl.java
+++ b/src/main/java/org/apache/pulsar/manager/service/impl/JwtServiceImpl.java
@@ -13,6 +13,7 @@
*/
package org.apache.pulsar.manager.service.impl;
+import com.google.common.annotations.VisibleForTesting;
import io.jsonwebtoken.*;
import io.jsonwebtoken.security.Keys;
import org.apache.pulsar.manager.service.JwtService;
@@ -24,6 +25,7 @@ import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.stereotype.Service;
+import javax.annotation.Nullable;
import java.io.IOException;
import java.security.Key;
import java.util.Date;
@@ -111,16 +113,21 @@ public class JwtServiceImpl implements JwtService {
}
}
-public String createBrokerToken(String role, String expiryTime) {
-Key signingKey;
+@VisibleForTesting
+@Nullable
+Key getSigningKey() {
if (jwtBrokerTokenMode.equals("SECRET")) {
-signingKey = decodeBySecretKey();
+return decodeBySecretKey();
} else if (jwtBrokerTokenMode.equals("PRIVATE")){
-signingKey = decodeByPrivateKey();
+return decodeByPrivateKey();
} else {
log.info("Default disable JWT auth, please set
jwt.broker.token.mode.");
return null;
}
+}
+
+public String createBrokerToken(String role, String expiryTime) {
+Key signingKey = getSigningKey();
if (signingKey == null) {
log.error("JWT Auth failed, signingKey is not empty");
return null;
@@ -144,20 +151,4 @@ public class JwtServiceImpl implements JwtService {
return null;
}
}
-
-public Claims validateBrokerToken(String token) {
-Key validationKey;
-if (jwtBrokerTokenMode.equals("SECRET")) {
-validationKey = decodeBySecretKey();
-} else if (jwtBrokerTokenMode.equals("PRIVATE")){
-validationKey = decodeByPrivateKey();
-} else {
-log.info("Default disable JWT auth, please set
jwt.broker.token.mode.");
-return null;
-}
-Jwt jwt = Jwts.parser()
-.setSigningKey(validationKey)
-.parse(token);
-return jwt.getBody();
-}
}
diff --git
a/src/test/java/org/apache/pulsar/manager/service/BrokerTokensServiceImplTest.java
b/src/test/java/org/apache/pulsar/manager/service/impl/BrokerTokensServiceImplTest.java
similarity index 78%
rename from
src/test/java/org/apache/pulsar/manager/service/BrokerTokensServiceImplTest.java
rename to
src/test/java/org/apache/pulsar/manager/service/impl/BrokerTokensServiceImplTest.java
index 618dee7..3b936fc 100644
---
a/src/test/java/org/apache/pulsar/manager/service/BrokerTokensServiceImplTest.java
+++
b/src/test/java/org/apache/pulsar/manager/service/impl/BrokerTokensServiceImplTest.java
@@ -11,11 +11,14 @@
* See the License for the specific language governing permissions and
* limitations under the License.
*/
-package org.apache.pulsar.manager.service;
+package org.apache.pu
(pulsar-dotpulsar) branch master updated: Added compression benchmarks
This is an automated email from the ASF dual-hosted git repository.
blankensteiner pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar-dotpulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 5357829 Added compression benchmarks
5357829 is described below
commit 53578295ad9f2552f50f6e2b05c30171e274af6e
Author: Daniel Blankensteiner
AuthorDate: Wed Feb 7 12:21:59 2024 +0100
Added compression benchmarks
---
DotPulsar.sln| 9 +++
benchmarks/Compression/Compress.cs | 69 +
benchmarks/Compression/Compression.csproj| 32 ++
benchmarks/Compression/Decompress.cs | 89
benchmarks/Compression/Factories.cs | 64
benchmarks/Compression/MessageBytes.cs | 76
benchmarks/Compression/MessageSize.cs| 21 +++
benchmarks/Compression/MessageType.cs| 21 +++
benchmarks/Compression/Messages.proto| 30 ++
benchmarks/Compression/Program.cs| 40 +
tests/DotPulsar.Tests/DotPulsar.Tests.csproj | 4 +-
11 files changed, 453 insertions(+), 2 deletions(-)
diff --git a/DotPulsar.sln b/DotPulsar.sln
index 35c2690..1706858 100644
--- a/DotPulsar.sln
+++ b/DotPulsar.sln
@@ -26,6 +26,10 @@ Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") =
"Solution Items", "Solution
EndProject
Project("{9A19103F-16F7-4668-BE54-9A1E7A4F7556}") = "Processing",
"samples\Processing\Processing.csproj", "{CC1494FA-4EB5-4DB9-8BE9-0A6E8D0D963E}"
EndProject
+Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "Compression",
"benchmarks\Compression\Compression.csproj",
"{040F8253-074D-4977-BDB1-0D9798B52CE2}"
+EndProject
+Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") = "Benchmarks",
"Benchmarks", "{2C57AF4B-0D23-42D7-86FE-80277FD52875}"
+EndProject
Global
GlobalSection(SolutionConfigurationPlatforms) = preSolution
Debug|Any CPU = Debug|Any CPU
@@ -56,6 +60,10 @@ Global
{CC1494FA-4EB5-4DB9-8BE9-0A6E8D0D963E}.Debug|Any CPU.Build.0 =
Debug|Any CPU
{CC1494FA-4EB5-4DB9-8BE9-0A6E8D0D963E}.Release|Any
CPU.ActiveCfg = Release|Any CPU
{CC1494FA-4EB5-4DB9-8BE9-0A6E8D0D963E}.Release|Any CPU.Build.0
= Release|Any CPU
+ {040F8253-074D-4977-BDB1-0D9798B52CE2}.Debug|Any CPU.ActiveCfg
= Debug|Any CPU
+ {040F8253-074D-4977-BDB1-0D9798B52CE2}.Debug|Any CPU.Build.0 =
Debug|Any CPU
+ {040F8253-074D-4977-BDB1-0D9798B52CE2}.Release|Any
CPU.ActiveCfg = Release|Any CPU
+ {040F8253-074D-4977-BDB1-0D9798B52CE2}.Release|Any CPU.Build.0
= Release|Any CPU
EndGlobalSection
GlobalSection(SolutionProperties) = preSolution
HideSolutionNode = FALSE
@@ -66,6 +74,7 @@ Global
{14934BED-A222-47B2-A58A-CFC4AAB89B49} =
{E7106D0F-B255-4631-9FB8-734FC5748FA9}
{6D44683B-865C-4D15-9F0A-1A8441354589} =
{E7106D0F-B255-4631-9FB8-734FC5748FA9}
{CC1494FA-4EB5-4DB9-8BE9-0A6E8D0D963E} =
{E7106D0F-B255-4631-9FB8-734FC5748FA9}
+ {040F8253-074D-4977-BDB1-0D9798B52CE2} =
{2C57AF4B-0D23-42D7-86FE-80277FD52875}
EndGlobalSection
GlobalSection(ExtensibilityGlobals) = postSolution
SolutionGuid = {88355922-E70A-4B73-B7F8-ABF8F2B59789}
diff --git a/benchmarks/Compression/Compress.cs
b/benchmarks/Compression/Compress.cs
new file mode 100644
index 000..66b7b56
--- /dev/null
+++ b/benchmarks/Compression/Compress.cs
@@ -0,0 +1,69 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License");
+ * you may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+namespace Compression;
+
+using BenchmarkDotNet.Attributes;
+using BenchmarkDotNet.Order;
+using System.Buffers;
+
+[RankColumn, Orderer(SummaryOrderPolicy.FastestToSlowest)]
+public class Compress
+{
+[ParamsAllValues]
+public MessageSize Size { get; set; }
+
+[ParamsAllValues]
+public MessageType Type { get; set; }
+
+[GlobalSetup]
+public void Setup() => Data = MessageBytes.GetBytes(Size, Type);
+
+public ReadOnlySequence Data { get; private set; }
+
+[Benchmark]
+public void K4aosCompressionLz4()
+{
+using var compressor =
Factories.K4aosCompressionLz4CompressorFactory.Create();
+_ = compressor.Compress(Data);
+}
+
+[Benchmark]
+public void IronSnappy()
+{
+
Re: [PR] chore: upgrade gradle,java and spring-boot [pulsar-manager]
jonasgeiregat commented on PR #546: URL: https://github.com/apache/pulsar-manager/pull/546#issuecomment-1931780050 Thanks. Well there are some tests failures that I can't explain I was hoping someone could help me with -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
