[GitHub] incubator-distributedlog pull request #135: (WIP) DL-2: DistributedLog shoul...

2017-07-26 Thread zhaijack 
GitHub user zhaijack opened a pull request:

https://github.com/apache/incubator-distributedlog/pull/135

(WIP) DL-2: DistributedLog should work with the official apache bookkeeper

This change is to upgrade bookkeeper version to BK 4.5.0. (It is still WIP)

- upgrade bookkeeper version to 4.5.0-SNAPSHOT (still waiting a few pull 
requests to merge apache/bookkeeper#297 apache/bookkeeper#287
  - change registerSuccessEvent for StatsLogger to add TimeUnit
  - use netty4 eventloop
  - move twitter repository dependencies to proxy related module only. core 
library will not depend on scala dependency anymore.

This change is a collaboration change with @sijie 

We will provide a performance comparison between 0.4.0 (using Twitter BK) 
and 0.5.0 (using BK 4.5.) in a separate pull request or email.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zhaijack/incubator-distributedlog 
bump_dl_version

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-distributedlog/pull/135.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #135


commit 2f25d9fead78d982920fe72720b5470a5cb949f7
Author: Sijie Guo 
Date:   2017-07-19T23:33:46Z

Bump BK version to 4.5.0-SNAPSHOT

- registerSuccessEvent and registerFailureEvent needs TimeUnit
- change HashedWheelTimer to netty 4
- change channelFactory to eventLoopGroup

commit ccd74487da38d0fde64569005b777fea658a0adb
Author: Jia Zhai 
Date:   2017-07-27T01:07:52Z

DL-2: DistributedLog should work with the official apache bookkeeper version




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [Discuss] Release DL 0.5.0

2017-07-26 Thread Jia Zhai 
Hi sijie,
I am inserested to be the release manager for 0.5.0, but there will be some
instruction and help needed from you guys. :)

Thanks.
-Jia

On Thu, Jul 27, 2017 at 1:35 AM, Sijie Guo  wrote:

> +1. Jia, thank you for raising this up.
>
> I have a few questions:
>
> - Release Manager:
>   Any volunteers on driving this release?
>
> - Pending changes:
>   What are the pending changes that are blocking DL upgrade BK to 4.5.0
> (both BK and DL side)?
>
> Any thoughts?
>
> - Sijie
>
>
>
> On Tue, Jul 25, 2017 at 6:17 PM, Jia Zhai  wrote:
>
> > Hi All,
> > Because DL is merged to BK, if BK is going to release 4.5.0, it would be
> > good that DL can release 0.5.0 as well.  What do you think of this？ :)
> >
> > Thanks a lot.
> > -Jia
> >
>

Re: [DISCUSS] Slack Channel for BookKeeper

2017-07-26 Thread Sijie Guo 
On Wed, Jul 26, 2017 at 3:50 AM, atracymartin 
wrote:

> I am interested in learning more about the decision to merge DL into BK.
> What will that look like, and when will it be available?  What can I do to
> help?
>

Thank you Martin.

In short, DL (especially the core library) is more an extension to BK to
provide continuous log stream abstraction over bookkeeper.
Merge DL into BK is to bring a high level API on bookkeeper to simplify the
usage of BookKeeper and consolidate the efforts on building log stream
abstraction over BookKeeper. The vote

link provides more insights about the considerations behind this.

>> What will that look like, and when will it be available?

DL has become a sub-project of BookKeeper already. But there are a few
INFRA tasks that BK PMC is working with INFRA team on it.
The git repo, mailing lists will remain same in the following few months.

At the same time, there are a couple of things happening (or will happen):

- the documentation, release procedure, ci builds will be aligned between
projects.
- we are working with Pulsar community for combining its managedledger
library (built over bookkeeper) with DL to provide a more robust log stream
library over bookkeeper.


>> What can I do to help?

Both BK and DL have some good projects for contributions.

Specially on the topic of merging DL into BK, there is one big outstanding
topic is to work with Pulsar community for combining its managedledger
library with DL to provide a unified log stream library on bookkeeper.
We started a gist a while ago -
https://gist.github.com/sijie/d7a242eb7d185e182b9a72c63534830b If you are
interested in this topic, feel free to participant.

Besides features/projects,

- Documentation is an area that need more contributions. Both BK and DL
don't have good documentation - the internal details of bookkeeper (for
developers), how to use it (for users), how to deploy and operate a cluster
(for administrators).
  It can be a good start to help us writing documentation around how to use
it and examples.
- Automate builds and release procedure can be another good area to
contribute as well.

Hope this helps.

- Sijie









>
>
> Sent from my T-Mobile 4G LTE Device
>  Original message From: Sijie Guo 
> Date: 7/25/17  8:22 PM  (GMT-05:00) To: d...@bookkeeper.apache.org Cc:
> dev@distributedlog.incubator.apache.org Subject: Re: [DISCUSS] Slack
> Channel for BookKeeper
> Currently BK doesn't has one yet.
>
> On Tue, Jul 25, 2017 at 9:29 AM, Henry Saputra 
> wrote:
>
> > Is Apache BookKeeper has its own Slack team? If it has then we could just
> > add a channel for DistLog.
> >
> > - Henry
> >
> > On Mon, Jul 24, 2017 at 11:42 PM, Enrico Olivelli 
> > wrote:
> >
> > > Awesome +1
> > >
> > > Il mar 25 lug 2017, 05:39 Dustin Castor  d>
> > > ha
> > > scritto:
> > >
> > > > Agreed! Or an IRC.
> > > >
> > > > On Monday, July 24, 2017, 6:50:22 PM PDT, Jia Zhai <
> > zhaiji...@gmail.com>
> > > > wrote:
> > > >
> > > >  It is great to have a slack channel. It make things more effective
> > and
> > > > smooth.
> > > >
> > > > On Tue, Jul 25, 2017 at 8:11 AM, Sijie Guo 
> wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > What do you guys all think about having a dedicated slack channel
> for
> > > > > informal discussion for the community? There are a handful of
> Apache
> > > > > projects are doing that already, there are also ways to have a bot
> > that
> > > > > sends daily digest of the conversation to the mailing lists (to
> keep
> > > the
> > > > > records in ASF infrastructure).
> > > > >
> > > > > As the followup steps for merging DL into BookKeeper, we are
> > > transferring
> > > > > the DL slack channel to BookKeeper PMC. We can just make it a BK
> > slack
> > > > > channel, and have different channels under it for different
> > > discussions.
> > > > >
> > > > > Thoughts?
> > > > >
> > > > > - Sijie
> > > > >
> > >
> > > --
> > >
> > >
> > > -- Enrico Olivelli
> > >
> >
>

Re: [Discuss] Release DL 0.5.0

2017-07-26 Thread Sijie Guo 
+1. Jia, thank you for raising this up.

I have a few questions:

- Release Manager:
  Any volunteers on driving this release?

- Pending changes:
  What are the pending changes that are blocking DL upgrade BK to 4.5.0
(both BK and DL side)?

Any thoughts?

- Sijie



On Tue, Jul 25, 2017 at 6:17 PM, Jia Zhai  wrote:

> Hi All,
> Because DL is merged to BK, if BK is going to release 4.5.0, it would be
> good that DL can release 0.5.0 as well.  What do you think of this？ :)
>
> Thanks a lot.
> -Jia
>

Re: [DISCUSS] Slack Channel for BookKeeper

2017-07-26 Thread atracymartin 
I am interested in learning more about the decision to merge DL into BK.   What 
will that look like, and when will it be available?  What can I do to help?


Sent from my T-Mobile 4G LTE Device
 Original message From: Sijie Guo  Date: 
7/25/17  8:22 PM  (GMT-05:00) To: d...@bookkeeper.apache.org Cc: 
dev@distributedlog.incubator.apache.org Subject: Re: [DISCUSS] Slack Channel 
for BookKeeper 
Currently BK doesn't has one yet.

On Tue, Jul 25, 2017 at 9:29 AM, Henry Saputra 
wrote:

> Is Apache BookKeeper has its own Slack team? If it has then we could just
> add a channel for DistLog.
>
> - Henry
>
> On Mon, Jul 24, 2017 at 11:42 PM, Enrico Olivelli 
> wrote:
>
> > Awesome +1
> >
> > Il mar 25 lug 2017, 05:39 Dustin Castor 
> > ha
> > scritto:
> >
> > > Agreed! Or an IRC.
> > >
> > > On Monday, July 24, 2017, 6:50:22 PM PDT, Jia Zhai <
> zhaiji...@gmail.com>
> > > wrote:
> > >
> > >  It is great to have a slack channel. It make things more effective
> and
> > > smooth.
> > >
> > > On Tue, Jul 25, 2017 at 8:11 AM, Sijie Guo  wrote:
> > >
> > > > Hi all,
> > > >
> > > > What do you guys all think about having a dedicated slack channel for
> > > > informal discussion for the community? There are a handful of Apache
> > > > projects are doing that already, there are also ways to have a bot
> that
> > > > sends daily digest of the conversation to the mailing lists (to keep
> > the
> > > > records in ASF infrastructure).
> > > >
> > > > As the followup steps for merging DL into BookKeeper, we are
> > transferring
> > > > the DL slack channel to BookKeeper PMC. We can just make it a BK
> slack
> > > > channel, and have different channels under it for different
> > discussions.
> > > >
> > > > Thoughts?
> > > >
> > > > - Sijie
> > > >
> >
> > --
> >
> >
> > -- Enrico Olivelli
> >
>