Re: [VOTE] Apache Bahir 2.3.1 (RC1)
+1 (binding) Regards JB On 30/11/2018 17:11, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.1 (RC1) based on > Apache Spark 2.3.1. > > Tag: v2.3.1-rc1 (6c4d67e0a99bcbbad199b7d1d26f3624491070b4) > > https://github.com/apache/bahir/tree/v2.3.1-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1026 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.1-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.1 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.0 (RC1)
+1 (binding) Regards JB On 30/11/2018 15:43, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.0 (RC1) based on > Apache Spark 2.3.0. > > Tag: v2.3.0-rc1 (e2d138bd2a927d0ab42e45739d8938eefafca352) > > https://github.com/apache/bahir/tree/v2.3.0-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1025 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.0-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.0 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.2 (RC1)
+1 (binding) Regards JB On 30/11/2018 21:57, Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.2 (RC1) based on > Apache Spark 2.3.2. > > Tag: v2.3.2-rc1 (6d24b270fd713352faf1c93f08f835e39e496489) > > https://github.com/apache/bahir/tree/v2.3.2-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1027 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.2-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.2 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.talend.com
Re: [VOTE] Apache Bahir 2.3.0 (RC1)
+1 Ran test suite which passed. On Fri, Nov 30, 2018 at 6:43 AM Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.3.0 (RC1) based on > Apache Spark 2.3.0. > > Tag: v2.3.0-rc1 (e2d138bd2a927d0ab42e45739d8938eefafca352) > > https://github.com/apache/bahir/tree/v2.3.0-rc1 > > Release files: > > https://repository.apache.org/content/repositories/orgapachebahir-1025 > > Source distribution: > > https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.0-rc1/ > > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Bahir 2.3.0 > [ ] -1 Do not release this package because ... > > > Thanks for your vote! > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ >
Re: Release 2.3.x
I have created the following RCs - 2.3.0 - 2.3.1 - 2.3.2 They are mostly the same, mostly changing the Spark dependencies. Please help review/vote these. On Thu, Nov 29, 2018 at 10:42 AM Jean-Baptiste Onofré wrote: > > Nothing from my side. +1 for the release. > > Regards > JB > > On 29/11/2018 10:40, Luciano Resende wrote: > > I am planning to start working on getting the 2.3.x releases soon, any > > jiras or prs that I should wait for ? > > > > Thanks > > > > -- > Jean-Baptiste Onofré > jbono...@apache.org > http://blog.nanthrax.net > Talend - http://www.talend.com -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
[VOTE] Apache Bahir 2.3.2 (RC1)
Dear community member, Please vote to approve the release of Apache Bahir 2.3.2 (RC1) based on Apache Spark 2.3.2. Tag: v2.3.2-rc1 (6d24b270fd713352faf1c93f08f835e39e496489) https://github.com/apache/bahir/tree/v2.3.2-rc1 Release files: https://repository.apache.org/content/repositories/orgapachebahir-1027 Source distribution: https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.2-rc1/ The vote is open for at least 72 hours and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Bahir 2.3.2 [ ] -1 Do not release this package because ... Thanks for your vote! -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
[VOTE] Apache Bahir 2.3.1 (RC1)
Dear community member, Please vote to approve the release of Apache Bahir 2.3.1 (RC1) based on Apache Spark 2.3.1. Tag: v2.3.1-rc1 (6c4d67e0a99bcbbad199b7d1d26f3624491070b4) https://github.com/apache/bahir/tree/v2.3.1-rc1 Release files: https://repository.apache.org/content/repositories/orgapachebahir-1026 Source distribution: https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.1-rc1/ The vote is open for at least 72 hours and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Bahir 2.3.1 [ ] -1 Do not release this package because ... Thanks for your vote! -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
[VOTE] Apache Bahir 2.3.0 (RC1)
Dear community member, Please vote to approve the release of Apache Bahir 2.3.0 (RC1) based on Apache Spark 2.3.0. Tag: v2.3.0-rc1 (e2d138bd2a927d0ab42e45739d8938eefafca352) https://github.com/apache/bahir/tree/v2.3.0-rc1 Release files: https://repository.apache.org/content/repositories/orgapachebahir-1025 Source distribution: https://dist.apache.org/repos/dist/dev/bahir/bahir-spark/2.3.0-rc1/ The vote is open for at least 72 hours and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Bahir 2.3.0 [ ] -1 Do not release this package because ... Thanks for your vote! -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
[jira] [Commented] (BAHIR-182) Create PubNub extension for Apache Spark Streaming
[ https://issues.apache.org/jira/browse/BAHIR-182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704583#comment-16704583 ] ASF GitHub Bot commented on BAHIR-182: -- Github user asfgit closed the pull request at: https://github.com/apache/bahir/pull/70 > Create PubNub extension for Apache Spark Streaming > -- > > Key: BAHIR-182 > URL: https://issues.apache.org/jira/browse/BAHIR-182 > Project: Bahir > Issue Type: New Feature > Components: Spark Streaming Connectors >Reporter: Lukasz Antoniak >Priority: Major > Fix For: Spark-2.3.0 > > > Implement new connector for PubNub ([https://www.pubnub.com/)] which is > increasing in popularity cloud messaging infrastructure. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BAHIR-182) Create PubNub extension for Apache Spark Streaming
[ https://issues.apache.org/jira/browse/BAHIR-182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704581#comment-16704581 ] ASF subversion and git services commented on BAHIR-182: --- Commit 9373fa4e7feb402f5b85367174afc5ad6b593a04 in bahir's branch refs/heads/master from [~lukasz.antoniak] [ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=9373fa4 ] [BAHIR-182] Spark Streaming PubNub connector Implement new connector for PubNub (https://www.pubnub.com/) which is increasing in popularity as a cloud messaging infrastructure. Closes #70 > Create PubNub extension for Apache Spark Streaming > -- > > Key: BAHIR-182 > URL: https://issues.apache.org/jira/browse/BAHIR-182 > Project: Bahir > Issue Type: New Feature > Components: Spark Streaming Connectors >Reporter: Lukasz Antoniak >Priority: Major > Fix For: Spark-2.3.0 > > > Implement new connector for PubNub ([https://www.pubnub.com/)] which is > increasing in popularity cloud messaging infrastructure. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-182) Create PubNub extension for Apache Spark Streaming
[ https://issues.apache.org/jira/browse/BAHIR-182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende reassigned BAHIR-182: - Assignee: Lukasz Antoniak > Create PubNub extension for Apache Spark Streaming > -- > > Key: BAHIR-182 > URL: https://issues.apache.org/jira/browse/BAHIR-182 > Project: Bahir > Issue Type: New Feature > Components: Spark Streaming Connectors >Reporter: Lukasz Antoniak >Assignee: Lukasz Antoniak >Priority: Major > Fix For: Spark-2.3.0 > > > Implement new connector for PubNub ([https://www.pubnub.com/)] which is > increasing in popularity cloud messaging infrastructure. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (BAHIR-182) Create PubNub extension for Apache Spark Streaming
[ https://issues.apache.org/jira/browse/BAHIR-182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende resolved BAHIR-182. --- Resolution: Fixed Fix Version/s: Spark-2.3.0 > Create PubNub extension for Apache Spark Streaming > -- > > Key: BAHIR-182 > URL: https://issues.apache.org/jira/browse/BAHIR-182 > Project: Bahir > Issue Type: New Feature > Components: Spark Streaming Connectors >Reporter: Lukasz Antoniak >Assignee: Lukasz Antoniak >Priority: Major > Fix For: Spark-2.3.0 > > > Implement new connector for PubNub ([https://www.pubnub.com/)] which is > increasing in popularity cloud messaging infrastructure. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BAHIR-66) Add test that ZeroMQ streaming connector can receive data
[ https://issues.apache.org/jira/browse/BAHIR-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704520#comment-16704520 ] ASF GitHub Bot commented on BAHIR-66: - Github user lresende commented on the issue: https://github.com/apache/bahir/pull/71 Thanks, LGTM. > Add test that ZeroMQ streaming connector can receive data > - > > Key: BAHIR-66 > URL: https://issues.apache.org/jira/browse/BAHIR-66 > Project: Bahir > Issue Type: Sub-task > Components: Spark Streaming Connectors >Reporter: Christian Kadner >Priority: Major > Labels: test > > Add test cases that verify that the *ZeroMQ streaming connector* can receive > streaming data. > See [BAHIR-63|https://issues.apache.org/jira/browse/BAHIR-63] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (BAHIR-66) Add test that ZeroMQ streaming connector can receive data
[ https://issues.apache.org/jira/browse/BAHIR-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende resolved BAHIR-66. -- Resolution: Fixed Fix Version/s: Spark-2.3.0 > Add test that ZeroMQ streaming connector can receive data > - > > Key: BAHIR-66 > URL: https://issues.apache.org/jira/browse/BAHIR-66 > Project: Bahir > Issue Type: Sub-task > Components: Spark Streaming Connectors >Reporter: Christian Kadner >Assignee: Lukasz Antoniak >Priority: Major > Labels: test > Fix For: Spark-2.3.0 > > > Add test cases that verify that the *ZeroMQ streaming connector* can receive > streaming data. > See [BAHIR-63|https://issues.apache.org/jira/browse/BAHIR-63] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BAHIR-66) Add test that ZeroMQ streaming connector can receive data
[ https://issues.apache.org/jira/browse/BAHIR-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende reassigned BAHIR-66: Assignee: Lukasz Antoniak > Add test that ZeroMQ streaming connector can receive data > - > > Key: BAHIR-66 > URL: https://issues.apache.org/jira/browse/BAHIR-66 > Project: Bahir > Issue Type: Sub-task > Components: Spark Streaming Connectors >Reporter: Christian Kadner >Assignee: Lukasz Antoniak >Priority: Major > Labels: test > Fix For: Spark-2.3.0 > > > Add test cases that verify that the *ZeroMQ streaming connector* can receive > streaming data. > See [BAHIR-63|https://issues.apache.org/jira/browse/BAHIR-63] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BAHIR-66) Add test that ZeroMQ streaming connector can receive data
[ https://issues.apache.org/jira/browse/BAHIR-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704522#comment-16704522 ] ASF subversion and git services commented on BAHIR-66: -- Commit fb752570c7ac817b414c738e05b751dd5864feb6 in bahir's branch refs/heads/master from [~lukasz.antoniak] [ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=fb75257 ] [BAHIR-66] Switch to Java binding for ZeroMQ Initially, I just wanted to implement integration test for BAHIR-66. Google pointed me to JeroMQ, which provides official ZeroMQ binding for Java and does not require native libraries. I have decided to give it a try, but quickly realized that akka-zeromq module (transient dependency from current Bahir master) is not compatible with JeroMQ. Actually Akka team also wanted to move to JeroMQ (akka/akka#13856), but in the end decided to remove akka-zeromq project completely (akka/akka#15864, https://www.lightbend.com/blog/akka-roadmap-update-2014). Having in mind that akka-zeromq does not support latest version of ZeroMQ protocol and further development may come delayed, I have decided to refactor streaming-zeromq implementation and leverage JeroMQ. With the change we receive various benefits, such as support for PUB-SUB and PUSH-PULL messaging patterns and the ability to bind the socket on whatever end of communication channel (see test cases), subscription to multiple channels, etc. JeroMQ seems pretty reliable and reconnection is handled out-of-the-box. Actually, we could even start the ZeroMQ subscriber trying to connect to remote socket before other end created and bound the socket. While I tried to preserve backward compatibility of method signatures, there was no easy way to support Akka API and business logic that users could put there (e.g. akka.actor.ActorSystem). Closes #71 > Add test that ZeroMQ streaming connector can receive data > - > > Key: BAHIR-66 > URL: https://issues.apache.org/jira/browse/BAHIR-66 > Project: Bahir > Issue Type: Sub-task > Components: Spark Streaming Connectors >Reporter: Christian Kadner >Priority: Major > Labels: test > > Add test cases that verify that the *ZeroMQ streaming connector* can receive > streaming data. > See [BAHIR-63|https://issues.apache.org/jira/browse/BAHIR-63] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BAHIR-66) Add test that ZeroMQ streaming connector can receive data
[ https://issues.apache.org/jira/browse/BAHIR-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704524#comment-16704524 ] ASF GitHub Bot commented on BAHIR-66: - Github user asfgit closed the pull request at: https://github.com/apache/bahir/pull/71 > Add test that ZeroMQ streaming connector can receive data > - > > Key: BAHIR-66 > URL: https://issues.apache.org/jira/browse/BAHIR-66 > Project: Bahir > Issue Type: Sub-task > Components: Spark Streaming Connectors >Reporter: Christian Kadner >Priority: Major > Labels: test > > Add test cases that verify that the *ZeroMQ streaming connector* can receive > streaming data. > See [BAHIR-63|https://issues.apache.org/jira/browse/BAHIR-63] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
