[GitHub] [pulsar-client-node] izumo27 opened a new pull request #162: Add Connection Status Support to Producer/Consumer/Reader
izumo27 opened a new pull request #162:
URL: https://github.com/apache/pulsar-client-node/pull/162
Add connection status support from the C++ library by utilizing
`pulsar_{producer/consumer/reader}_is_connected`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Re: Re: [PIP] Expose Pulsar-Client via Function/Connector BaseContext
Thank you for reviewing the PIP and the PR On 2021/07/01 06:04:15 Enrico Olivelli wrote: > overall the Proposal is good to me > so +1 from my side > > This is the implementation PR > https://github.com/apache/pulsar/pull/11056 > > I am happy that this work will fix a long standing problem with Functions > and Pulsar IO > > I would like to cite that > we still have some problem on using the Pulsar API inside Functions/Pulsar > IO > there is an open work from Matteo that is willing to fix and unblock all > the API features inside that context > https://github.com/apache/pulsar/pull/10922 > > Thank you Neng for sending the PIP > > Enrico > > Il giorno mer 30 giu 2021 alle ore 23:57 Sijie Guo ha > scritto: > > > Hi Neng, > > > > Thank you for starting the discussion! > > > > I have assigned PIP-85 to your PIP. > > > > https://github.com/apache/pulsar/wiki/PIP-85:-Expose-Pulsar-Client-via-Function-Connector-BaseContext > > > > The proposal looks good to me. +1 > > > > - Sijie > > > > On Wed, Jun 30, 2021 at 12:40 PM Neng Lu wrote: > > > > > > Hi All, > > > > > > I've prepared a brief PIP for the pulsarclient changes we have > > discussed. Please take a look and let me know what you think. > > > > > > I would really appreciate it. > > > > > > Best Regards, > > > Neng Lu > > >
Re: Re: [PIP] Expose Pulsar-Client via Function/Connector BaseContext
Thank you for the help. On 2021/06/30 21:57:07 Sijie Guo wrote: > Hi Neng, > > Thank you for starting the discussion! > > I have assigned PIP-85 to your PIP. > https://github.com/apache/pulsar/wiki/PIP-85:-Expose-Pulsar-Client-via-Function-Connector-BaseContext > > The proposal looks good to me. +1 > > - Sijie > > On Wed, Jun 30, 2021 at 12:40 PM Neng Lu wrote: > > > > Hi All, > > > > I've prepared a brief PIP for the pulsarclient changes we have discussed. > > Please take a look and let me know what you think. > > > > I would really appreciate it. > > > > Best Regards, > > Neng Lu >
Re: [VOTE] Apache Pulsar Adapters Release 2.8.0 Candidate 1
Sure, let's fix it as a part of the 2.9.0 release to build an adapter repo without building pulsar locally. +1 for me. - Validated signature and src code build. Thanks, Rajan On Thu, Jul 1, 2021 at 1:43 PM Enrico Olivelli wrote: > Rajan, > Thanks for testing probably the instructions are not clear, see my answers > below > > Il Gio 1 Lug 2021, 21:27 Rajan Dhabalia ha scritto: > > > Hi, > > > > Right now, Build is failing with the below error which prevents us from > > building the project with all test execution. README page also suggests > to > > build project by skipping tests (using -DskipTests options) > > > > The skip tests flag is to build Pulsar from > https://github.com/apache/pulsar > at tag v2.8.0 > Not to build the pulsar-adapters repo. > > This is because the integration tests jar is not deployed to Maven Central > as you can see in the error you posted. > > > > [ERROR] Failed to execute goal on project > > pulsar-kafka-compat-client-test: Could not resolve dependencies for > > project > org.apache.pulsar.tests:pulsar-kafka-compat-client-test:jar:2.8.0: > > Failure to find org.apache.pulsar.tests:integration:jar:tests:2.8.0 > > > > I think we should fix the build failure or disable the test module if > it's > > not correctly migrated from the Pulsar git-repository, rather than > > releasing and validating release with -DskipTests option. > > > > The tests are all passing and this is confirmed by the fact that the latest > PRs were validated in CI. > > During the past month we enabled CI and we fixed all the tests > > Can you try to build locally Pulsar at tag v2.8.0? > This way your maven local repository will contain the jar that is missing > > It is something we can fix for the the Pulsar release, but for 2.8.0 there > is no other way. > > Enrico > > > > Thanks, > > Rajan > > > > > > > > > > On Tue, Jun 29, 2021 at 3:27 AM PengHui Li wrote: > > > > > Hi Enrico, > > > sorry for the late reply > > > > > > 1. Checked the signature > > > 2. Build via the source code > > > 3. Passed all the tests locally > > > > > > The only one I found is when I unzip the package, it shows me an > > > apache-pulsar-2.8.0-src directory, > > > Looks a little wired, I think it should be > > > apache-pulsar-adaptors-2.8.0-src? > > > > > > Thanks, > > > Penghui > > > > > > Enrico Olivelli 于2021年6月29日周二 下午1:55写道： > > > > > > > Hi everyone, > > > > please take a look. > > > > If you want to build the source package locally you have to follow > the > > > > steps in the README > > > > https://github.com/apache/pulsar-adapters > > > > > > > > Enrico > > > > > > > > Il giorno sab 26 giu 2021 alle ore 13:51 Enrico Olivelli < > > > > eolive...@gmail.com> ha scritto: > > > > > > > > > This is the first release candidate for Apache Pulsar Adapters, > > version > > > > > 2.8.0. > > > > > > > > > > It fixes the following issues: > > > > > https://github.com/apache/pulsar-adapters/milestone/2?closed=1 > > > > > > > > > > *** Please download, test and vote on this release. This vote will > > stay > > > > > open > > > > > for at least 72 hours *** > > > > > > > > > > Note that we are voting upon the source (tag), binaries are > provided > > > for > > > > > convenience and are released only to Maven Central. > > > > > > > > > > Source and binary files: > > > > > > > > > > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/pulsar/pulsar-adapters-2.8.0-candidate-1/ > > > > > > > > > > SHA-512 checksums: > > > > > > > > > > > > > > > > > > > > 6f1f34fc454fdaa9b5065d0dce96d468d8b5081cff333564cb88dca7e9c9aba828bb7469bb8c3aa4d23fe653d1a03285418d9ba36d5617a39a783e0433d01dba > > > > > apache-pulsar-adapters-2.8.0-src.tar.gz > > > > > > > > > > Maven staging repo: > > > > > > > > > https://repository.apache.org/content/repositories/orgapachepulsar-1091/ > > > > > > > > > > The tag to be voted upon: > > > > > v2.8.0-candidate-1 (581fee3b68caaf74122e7051e9741494b57fcbd7) > > > > > > > > > > > > > > > https://github.com/apache/pulsar-adapters/releases/tag/v2.8.0-candidate-1 > > > > > > > > > > Pulsar's KEYS file containing PGP keys we use to sign the release: > > > > > https://dist.apache.org/repos/dist/dev/pulsar/KEYS > > > > > > > > > > Please download the source package, and follow the README to build > > the > > > > > Pulsar Adapters code > > > > > > > > > > Enrico Olivelli > > > > > > > > > > > > > > >
Re: [VOTE] Apache Pulsar Adapters Release 2.8.0 Candidate 1
Rajan, Thanks for testing probably the instructions are not clear, see my answers below Il Gio 1 Lug 2021, 21:27 Rajan Dhabalia ha scritto: > Hi, > > Right now, Build is failing with the below error which prevents us from > building the project with all test execution. README page also suggests to > build project by skipping tests (using -DskipTests options) > The skip tests flag is to build Pulsar from https://github.com/apache/pulsar at tag v2.8.0 Not to build the pulsar-adapters repo. This is because the integration tests jar is not deployed to Maven Central as you can see in the error you posted. > [ERROR] Failed to execute goal on project > pulsar-kafka-compat-client-test: Could not resolve dependencies for > project org.apache.pulsar.tests:pulsar-kafka-compat-client-test:jar:2.8.0: > Failure to find org.apache.pulsar.tests:integration:jar:tests:2.8.0 > > I think we should fix the build failure or disable the test module if it's > not correctly migrated from the Pulsar git-repository, rather than > releasing and validating release with -DskipTests option. > The tests are all passing and this is confirmed by the fact that the latest PRs were validated in CI. During the past month we enabled CI and we fixed all the tests Can you try to build locally Pulsar at tag v2.8.0? This way your maven local repository will contain the jar that is missing It is something we can fix for the the Pulsar release, but for 2.8.0 there is no other way. Enrico > Thanks, > Rajan > > > > > On Tue, Jun 29, 2021 at 3:27 AM PengHui Li wrote: > > > Hi Enrico, > > sorry for the late reply > > > > 1. Checked the signature > > 2. Build via the source code > > 3. Passed all the tests locally > > > > The only one I found is when I unzip the package, it shows me an > > apache-pulsar-2.8.0-src directory, > > Looks a little wired, I think it should be > > apache-pulsar-adaptors-2.8.0-src? > > > > Thanks, > > Penghui > > > > Enrico Olivelli 于2021年6月29日周二 下午1:55写道： > > > > > Hi everyone, > > > please take a look. > > > If you want to build the source package locally you have to follow the > > > steps in the README > > > https://github.com/apache/pulsar-adapters > > > > > > Enrico > > > > > > Il giorno sab 26 giu 2021 alle ore 13:51 Enrico Olivelli < > > > eolive...@gmail.com> ha scritto: > > > > > > > This is the first release candidate for Apache Pulsar Adapters, > version > > > > 2.8.0. > > > > > > > > It fixes the following issues: > > > > https://github.com/apache/pulsar-adapters/milestone/2?closed=1 > > > > > > > > *** Please download, test and vote on this release. This vote will > stay > > > > open > > > > for at least 72 hours *** > > > > > > > > Note that we are voting upon the source (tag), binaries are provided > > for > > > > convenience and are released only to Maven Central. > > > > > > > > Source and binary files: > > > > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/pulsar/pulsar-adapters-2.8.0-candidate-1/ > > > > > > > > SHA-512 checksums: > > > > > > > > > > > > > > 6f1f34fc454fdaa9b5065d0dce96d468d8b5081cff333564cb88dca7e9c9aba828bb7469bb8c3aa4d23fe653d1a03285418d9ba36d5617a39a783e0433d01dba > > > > apache-pulsar-adapters-2.8.0-src.tar.gz > > > > > > > > Maven staging repo: > > > > > > https://repository.apache.org/content/repositories/orgapachepulsar-1091/ > > > > > > > > The tag to be voted upon: > > > > v2.8.0-candidate-1 (581fee3b68caaf74122e7051e9741494b57fcbd7) > > > > > > > > > > https://github.com/apache/pulsar-adapters/releases/tag/v2.8.0-candidate-1 > > > > > > > > Pulsar's KEYS file containing PGP keys we use to sign the release: > > > > https://dist.apache.org/repos/dist/dev/pulsar/KEYS > > > > > > > > Please download the source package, and follow the README to build > the > > > > Pulsar Adapters code > > > > > > > > Enrico Olivelli > > > > > > > > > >
Re: [VOTE] Apache Pulsar Adapters Release 2.8.0 Candidate 1
Hi, Right now, Build is failing with the below error which prevents us from building the project with all test execution. README page also suggests to build project by skipping tests (using -DskipTests options) [ERROR] Failed to execute goal on project pulsar-kafka-compat-client-test: Could not resolve dependencies for project org.apache.pulsar.tests:pulsar-kafka-compat-client-test:jar:2.8.0: Failure to find org.apache.pulsar.tests:integration:jar:tests:2.8.0 I think we should fix the build failure or disable the test module if it's not correctly migrated from the Pulsar git-repository, rather than releasing and validating release with -DskipTests option. Thanks, Rajan On Tue, Jun 29, 2021 at 3:27 AM PengHui Li wrote: > Hi Enrico, > sorry for the late reply > > 1. Checked the signature > 2. Build via the source code > 3. Passed all the tests locally > > The only one I found is when I unzip the package, it shows me an > apache-pulsar-2.8.0-src directory, > Looks a little wired, I think it should be > apache-pulsar-adaptors-2.8.0-src? > > Thanks, > Penghui > > Enrico Olivelli 于2021年6月29日周二 下午1:55写道： > > > Hi everyone, > > please take a look. > > If you want to build the source package locally you have to follow the > > steps in the README > > https://github.com/apache/pulsar-adapters > > > > Enrico > > > > Il giorno sab 26 giu 2021 alle ore 13:51 Enrico Olivelli < > > eolive...@gmail.com> ha scritto: > > > > > This is the first release candidate for Apache Pulsar Adapters, version > > > 2.8.0. > > > > > > It fixes the following issues: > > > https://github.com/apache/pulsar-adapters/milestone/2?closed=1 > > > > > > *** Please download, test and vote on this release. This vote will stay > > > open > > > for at least 72 hours *** > > > > > > Note that we are voting upon the source (tag), binaries are provided > for > > > convenience and are released only to Maven Central. > > > > > > Source and binary files: > > > > > > > > > https://dist.apache.org/repos/dist/dev/pulsar/pulsar-adapters-2.8.0-candidate-1/ > > > > > > SHA-512 checksums: > > > > > > > > > 6f1f34fc454fdaa9b5065d0dce96d468d8b5081cff333564cb88dca7e9c9aba828bb7469bb8c3aa4d23fe653d1a03285418d9ba36d5617a39a783e0433d01dba > > > apache-pulsar-adapters-2.8.0-src.tar.gz > > > > > > Maven staging repo: > > > > https://repository.apache.org/content/repositories/orgapachepulsar-1091/ > > > > > > The tag to be voted upon: > > > v2.8.0-candidate-1 (581fee3b68caaf74122e7051e9741494b57fcbd7) > > > > > > https://github.com/apache/pulsar-adapters/releases/tag/v2.8.0-candidate-1 > > > > > > Pulsar's KEYS file containing PGP keys we use to sign the release: > > > https://dist.apache.org/repos/dist/dev/pulsar/KEYS > > > > > > Please download the source package, and follow the README to build the > > > Pulsar Adapters code > > > > > > Enrico Olivelli > > > > > >
[Pulsar Community Weekly Update] 2021-06-21 ~ 2021-06-27
Dear Pulsar enthusiast, This is the Pulsar community weekly update for 22021-06-21 ~ 2021-06-27, with updates on Pulsar client, broker, and so on. This Pulsar community weekly update is also available at https://streamnative.io/weekly/2021/2021-06/2021-06-28-pulsar-weekly. All Pulsar community weekly updates are available at https://streamnative.io/weekly/. === *Pulsar Highlight* - [Topic Policy] Fix potential data lost on the system topic when topic compaction is not triggered yet. https://github.com/apache/pulsar/pull/11003 ([@codelipenghui]( https://github.com/codelipenghui)) - [Broker] Add the resource-group configuration listener. https://github.com/apache/pulsar/pull/10657 ([@bharanic-dev]( https://github.com/bharanic-dev)) === *Development* - [PIP-82] [Broker] Add the resource-group configuration listener. https://github.com/apache/pulsar/pull/10657 ([@bharanic-dev]( https://github.com/bharanic-dev)) === *Notable Feature* - [Security] Upgrade Vertx to version 3.9.8 to address vulnerability CVE-2019-17640. https://github.com/apache/pulsar/pull/10889 ([@lhotari]( https://github.com/lhotari)) - [Security] Upgrade Commons Codec to version 1.15. https://github.com/apache/pulsar/pull/10864 ([@lhotari]( https://github.com/lhotari)) - [Build] Change the NAR package name for `pulsar-io-kafka-connect-adaptor`. https://github.com/apache/pulsar/pull/10976 ([@codelipenghui]( https://github.com/codelipenghui)) - [Broker] Avoid exposing meaningless stats for the consumer. https://github.com/apache/pulsar/pull/11005 ([@codelipenghui]( https://github.com/codelipenghui)) - [Tests] Convert JUnit tests to TestNG. https://github.com/apache/pulsar/pull/11020 ([@lhotari]( https://github.com/lhotari)) - [Admin] Exclude the system topic in the `maxTopicsPerNamespace` check. https://github.com/apache/pulsar/pull/10850 ([@yangl]( https://github.com/yangl)) - [Proxy] Limit the replay buffer size in `AdminProxyHandler`. https://github.com/apache/pulsar/pull/10944 ([@lhotari]( https://github.com/lhotari)) - [Schema Registry] Make `KeyValueSchema` and the `AutoConsume` component work even when the schema is not set on the topic. https://github.com/apache/pulsar/pull/10995 ([@eolivelli]( https://github.com/eolivelli)) - [Tests] Add a test for `TopicCountEquallyDivideBundleSplitAlgorithm`. https://github.com/apache/pulsar/pull/11015 ([@mattisonchao]( https://github.com/mattisonchao)) - [Functions] Reorganize the context hierarchy for Pulsar Functions. https://github.com/apache/pulsar/pull/10631 ([@nlu90]( https://github.com/nlu90)) - [Tests] Use TestNG instead of JUnit for tests. https://github.com/apache/pulsar/pull/11027 ([@315157973]( https://github.com/315157973)) - [Python Functions] Use the keyword argument to create `pulsar_client`. https://github.com/apache/pulsar/pull/11080 ([@freeznet]( https://github.com/freeznet)) - [Python Functions] Use the subscription name defined in Function details. https://github.com/apache/pulsar/pull/11076 ([@lhotari]( https://github.com/lhotari)) - [Broker] Print the message metadata when getting messages by the message ID. https://github.com/apache/pulsar/pull/11092 ([@codelipenghui]( https://github.com/codelipenghui)) - [C++ and Python] Add the connection timeout configuration. https://github.com/apache/pulsar/pull/11029 ([@BewareMyPower]( https://github.com/BewareMyPower)) - [Security] Exclude the `grpc-okhttp` dependency and set the OkHttp3 and Okio versions. https://github.com/apache/pulsar/pull/11025 ([@lhotari]( https://github.com/lhotari)) - [Authorization] Remove the ternary operation and correct `brokerClientAuthenticationParameter`. https://github.com/apache/pulsar/pull/11090 ([@Technoboy-]( https://github.com/Technoboy-)) - [Configuration] Add missing configuration entries. https://github.com/apache/pulsar/pull/11095 ([@junquero]( https://github.com/junquero)) === *Notable Bug Fix* - [Client] Fix the `NoClassDefFoundError` that the `io.airlift.compress.lz4.UnsafeUtil` class cannot be initialized. https://github.com/apache/pulsar/pull/10983 ([@newur]( https://github.com/newur)) - [Functions] Include the Common-IO in the Java Function instance. https://github.com/apache/pulsar/pull/10939 ([@bharanic-dev]( https://github.com/bharanic-dev)) - [Broker] Fix the issue that occurs when creating partitioned topics in the replicated namespace. https://github.com/apache/pulsar/pull/10963 ([@gaoran10]( https://github.com/gaoran10)) - [Broker] Fix the backlog issue cause by the `--precise-backlog=true` parameter. https://github.com/apache/pulsar/pull/10966 ([@congbobo184]( https://github.com/congbobo184)) - [Broker] Fix the incorrect port of the `advertisedListener`.
Re: [PIP] Expose Pulsar-Client via Function/Connector BaseContext
overall the Proposal is good to me so +1 from my side This is the implementation PR https://github.com/apache/pulsar/pull/11056 I am happy that this work will fix a long standing problem with Functions and Pulsar IO I would like to cite that we still have some problem on using the Pulsar API inside Functions/Pulsar IO there is an open work from Matteo that is willing to fix and unblock all the API features inside that context https://github.com/apache/pulsar/pull/10922 Thank you Neng for sending the PIP Enrico Il giorno mer 30 giu 2021 alle ore 23:57 Sijie Guo ha scritto: > Hi Neng, > > Thank you for starting the discussion! > > I have assigned PIP-85 to your PIP. > > https://github.com/apache/pulsar/wiki/PIP-85:-Expose-Pulsar-Client-via-Function-Connector-BaseContext > > The proposal looks good to me. +1 > > - Sijie > > On Wed, Jun 30, 2021 at 12:40 PM Neng Lu wrote: > > > > Hi All, > > > > I've prepared a brief PIP for the pulsarclient changes we have > discussed. Please take a look and let me know what you think. > > > > I would really appreciate it. > > > > Best Regards, > > Neng Lu >
