Re: Journal Corruption when disk is full

[Bobby Evans]

I don't have the read only mode on disk full feature yet.  I will look at
pulling it back to our fork, but I will also look at fixing the journaling
in general.  Having spoken with the HDFS team here, they have seen a lot of
scary things that appear similar to this situation when a disk starts to go
bad. It would probably be in our best interest to guard against some of
those things on the bookies too.  Thanks again

On Thu, Feb 15, 2018 at 12:00 PM, Enrico Olivelli <eolive...@gmail.com>
wrote:

> Il gio 15 feb 2018, 18:45 Ivan Kelly <iv...@apache.org> ha scritto:
>
> > Hi Bobby,
> >
> > One thing that should circumvent this is that the bookie should go
> > into readonly mode when it hits 95% full disk.
> >
> > This change is in your branch[1]. Have you disabled it?
> >
> > Regards,
> > Ivan
> >
> > [1]
> > https://github.com/yahoo/bookkeeper/blob/7fb556fa2dbc1d308b5d7ec3e2676b
> 8b11704698/bookkeeper-server/conf/bk_server.conf#L247
> >
> > On Thu, Feb 15, 2018 at 6:19 PM, Bobby Evans <ev...@oath.com.invalid>
> > wrote:
> > > We recently had a situation where the disk a journal is on filled up
> and
> > we
> > > ended up with a partial edit in the journal.  This ended up being a
> > > METAENTRY_ID_LEDGER_KEY so only a partial master key was output and
> this
> > > ended up making the bookie fail on startup.
> > >
> > > Because we are running a forked version of bookkeeper I was wondering
> if
> > > anyone had done something to fix this in the past.  If not I am happy
> to
> > > take a crack at it, but I don't want to double up efforts if it is
> > already
> > > fixed.
> > >
> > > Thanks,
> > >
> > > Bobby
> >
>
>
> Nothing by my side, sorry.
>
> I know that sometimes some bookie crashed due to lack of disk space but my
> collegues simply dropped the bookie.
> Now that bookies turn into read-only mode the problems is mitigated a lot.
> Sorry
>
> Enrico
>
> > --
>
>
> -- Enrico Olivelli
>

Journal Corruption when disk is full

[Bobby Evans]

We recently had a situation where the disk a journal is on filled up and we
ended up with a partial edit in the journal.  This ended up being a
METAENTRY_ID_LEDGER_KEY so only a partial master key was output and this
ended up making the bookie fail on startup.

Because we are running a forked version of bookkeeper I was wondering if
anyone had done something to fix this in the past.  If not I am happy to
take a crack at it, but I don't want to double up efforts if it is already
fixed.

Thanks,

Bobby

Re: [DISCUSS] Issue Tracking - Jira or Github Issues

[Bobby Evans]

Apache does have a requirement that community discussions and especially votes 
are stored on apache servers.  This is often done by linking different systems 
together (like pull requests to JIRA) or by having a fire-hose of changes from 
the external system sent to some apache mailing list that it can archive.
I have not used github issues much but from what I have done it does not look 
even close to being as full featured as JIRA. So my vote would be to ask people 
to use JIRA, but not ignore the github issues. 

- Bobby

On Friday, May 26, 2017, 9:57:43 AM CDT, Sijie Guo  
wrote:Hi all,

Currently we are using Jira for issue tracking and using Github for
managing pull requests. For a new developer, he has to create two accounts
in order to engage with BookKeeper community. I am thinking - shall we also
move the issue tracking to use Github Issues (which I believe Apache Infra
supports that now)? So most of the development activities will happen in
Github.

Another reason I asked this - I saw a Github issue was created.
https://github.com/apache/bookkeeper/issues/165 I believe we somehow
requested to change the permissions to allow creating Github issues before.

Any thoughts?

- Sijie

Re: Bookie labels and Placement policy

[Bobby Evans]

OK so I am not keen on the idea of labels.  Probably because when I have seen 
it done in the past (YARN) it just felt like a hack that was trying to avoid 
fixing the real underlying problem. YARN wanted to schedule for arbitrary 
resources but that is hard so they went with Node Labels instead.  Node labels 
have evolved in YARN and are now used for partitioning a cluster for isolation 
as well (although it really is because network scheduling/isolation is hard).

Now that I am done with my YARN node label rant I want to add that HBase put in 
an option for isolating table groups from each other on different region 
servers that has worked really well for a multi-tenant setup, so I am not 
completely opposed to the idea I just want to be sure we do it right.

In my opinion if this is a feature to isolate different groups from each other 
to avoid one bad actor impacting everyone else I would prefer to see something 
with quotas for clients and/or users and nodes reporting their capabilities + 
current usage instead.  If you want some kind of affinity because you bought 
hardware to handle longer term vs shorter term storage then I would prefer to 
see that called out explicitly when the ledger is created instead of having 
arbitrary labels.  That way a long lived ledger could be placed on a node with 
lots of free capacity and short lived ledgers can go anywhere.  A client could 
either set it when they create a ledger and have a default in the config if it 
is not specified.

If we do go with labels I want to be sure that we stress that users should keep 
their matching rules as simple as possible.
Hard partitioning of a cluster on labels provides a lot of possibility to shoot 
yourself in the foot and not notice it.
They need to make sure that they have ways to easily monitor bookies grouped in 
the same way their client rules do.  They need to make sure that when doing a 
rolling upgrade that they take the client rules into account when deciding what 
to take out and upgrade to avoid making a group of clients completely unusable.

- Bobby

On Tuesday, May 16, 2017, 6:05:21 AM CDT, Enrico Olivelli  
wrote:Hi bookkeepers,
I'm using BookKeeper for serveral projects, every project has its own
workload characteristics and I would like to be able to assign bookies
depending of the client type. It is quite common to share a BookKeeper
cluster between different applications.

For instance I am using Bookies to store Database logs, Task Brokers
logs and recently I have started to use BookKeeper as data storage.

Within the cluster I would like to use specific Bookies for mid-term
storage, some bookies for logs...and so on, but current placement
policies are not able to "distinguish" bookies.

Actually I can achieve my goal by using a custom policy + custom
metadata + out of band bookie metadata.

I would like to introduce a first step, following the work of on
"Resource aware data placement" (1), and introduce a list of "labels"
to be assigned to every bookie.

For instance: bookies for long term storage will have label
"long-term", bookies for transaction logs may have label "wals".

Another use case is to be able to request BookKeeper to write ledger
data on specific sets of bookies depending on the "customer" who is
the owner of data (I have customers already grouped by labels/tags)

I would like to have a simple "standard" policy which uses some
"standard" metadata to select bookies.

Thinks to add:
- a set  of "labels" configurable for bookies
- Enrich the API (getBookieInfo) to query for labels and BookKeeper
client to keep a local cache of label-to-bookie assignments
- add a standard "custom metadata field"  which is a list of labels to
use to select bookies, a bookie would be used only of it currently
"has" all of the labels requested


[1] 
https://cwiki.apache.org/confluence/display/BOOKKEEPER/BP-2+-+Resource+aware+data+placement

All comments are welcome

-- Enrico

Re: Publish SNAPSHOT artifacts on Maven Central

[Bobby Evans]

There is a special SNAPSHOTS repo that is already setup.  I know that hadoop 
has been using it for a while, so you should just need to ask where the 
snapshot repo is.  Maven also will only push a -SNAPSHOT build to a repo that 
has been confiugred to accept snapshots.


- Bobby

On Thursday, April 27, 2017, 7:57:31 AM CDT, Enrico Olivelli 
 wrote:2017-04-24 23:35 GMT+02:00 Sijie Guo 
:
> On Sat, Apr 22, 2017 at 12:30 AM, Enrico Olivelli 
> wrote:
>
>> Il sab 22 apr 2017, 02:27 Sijie Guo  ha scritto:
>>
>> > I don't have any objections on doing this, if we can figure out
>> following:
>> >
>> > - does Apache infra allow doing this?
>> >
>>
>> Yes. See the lonk from tomcat mailing kist. Maybe we can ask Mark.
>>
>
> How does the SNAPSHOT version look like? is it just SNAPSHOT or SNAPSHOT
> with gitsha suffix.
>
> The reason I asked this -
>
> - If we just use SNAPSHOT, does the CI job overwrite the packages every
> time?
> - If we use SNAPSHOT-gitsha, then can we do smaller RC releases within a
> big release?
>

I think we can ask infra help to setup an auto-clean up of the
repository, usually -SNASHOT is deployed with a timestamp suffix of
whatever

If you are OK a can contact infra in order to ask for help and ask if
is feasible




>
>>
>> > - what does SNAPSHOT mean? How many snapshots do you want to publish?
>> >
>> Only the last successful build on jenkins
>>
>> - why not shorten the release scope and publish a release instead?
>>
>>
>> I really would like to have a release ASAP but I think this is a different
>> problem.
>>
>> The idea is to simplify testing of other downstream project against the
>> current master without the need to publish local forks of BK to local maven
>> repositories.
>> For all downstream open source projects this will be very useful
>>
>> I volunteer to setup the jenkins job and deal with infra
>>
>
> +1 on this.
>
>>
>> >
>> >
>> > Thoughts?
>> >
>> > On Apr 21, 2017 9:29 AM, "Venkateswara Rao Jujjuri" 
>> > wrote:
>> >
>> > +1
>> >
>> > On Fri, Apr 21, 2017 at 8:16 AM, Matteo Merli 
>> > wrote:
>> >
>> > > +1
>> > > On Fri, Apr 21, 2017 at 7:06 AM Enrico Olivelli 
>> > > wrote:
>> > >
>> > > > I wonder if we can start publishing the 4.5.0-SNAPSHOT binaries on
>> > > > Maven Central.
>> > > >
>> > > > This will help projects which want to try the upcoming version
>> without
>> > > > dealing with custom local Maven Repositories.
>> > > >
>> > > > I see recently Apache Tomcat started doing so
>> > > > http://marc.info/?l=tomcat-dev=149269803006113=2
>> > > >
>> > > >
>> > > > I you all agree I would like to work on this.
>> > > >
>> > > >
>> > > > -- Enrico
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > Jvrao
>> > ---
>> > First they ignore you, then they laugh at you, then they fight you, then
>> > you win. - Mahatma Gandhi
>> >
>> --
>>
>>
>> -- Enrico Olivelli
>>

Re: Github mirror not in sync

[Bobby Evans]

Typically you file a JIRA with INFRA and have them take a look at it.  It could 
be that the nodes are down that do the sync, or they are overloaded.  It could 
be that there is an error happening as part of the sync for some reason.  They 
would know better.

- Bobby

On Tuesday, April 25, 2017, 10:33:23 AM CDT, Enrico Olivelli 
 wrote:Hi,
Github mirror is not in synch.
What can we do?
This is a problem for PRs

Enrico
-- 


-- Enrico Olivelli

Re: Next community meeting and notes

[Bobby Evans]

What is the URL.  I can never find it


- Bobby

On Thursday, April 6, 2017, 5:02:53 AM CDT, Enrico Olivelli 
 wrote:Anyone on the Hangout ?

2017-04-05 14:19 GMT+02:00 Enrico Olivelli :

> Hi all,
> I have just created the page for the upcoming meeting
> https://cwiki.apache.org/confluence/display/BOOKKEEPER/
> 2017-4-6+Meeting+notes
>
> I have just created the page (please update with missing parts)
> https://cwiki.apache.org/confluence/display/BOOKKEEPER/
> 2017-3-24+Meeting+notes
>
> I'm sorry I think I told I would have done the notes for the last meeting
> but I forgot
>
> I have created a proposed agenda, I think the most important topics are:
> - Netty 4 patch
> - V2 protocol support
> - Current PRs https://github.com/apache/bookkeeper/pulls
>
> @JV and @Kishore
> do you have any news about Netty 4 patch ?
>
> Cheers
>
> -- Enrico
>
>
>
>

Re: Current build status

[Bobby Evans]

ensurePasswordUsedForOldLedgers will be fixed when the 64 bit ledger ID 
generation patch is merged in.  It is failing because it is checking if the 
LongLedgerManager is compatible with the old LedgerManager which it is not and 
it is failing.


- Bobby

On Friday, March 31, 2017, 3:50:02 AM CDT, Enrico Olivelli 
 wrote:Hi BookKeeper,
currently we have some issues on master, failing test cases and findbugs
issues.

I remember Bobby is working on ensurePasswordUsedForOldLedgers

Is anyone else working on other issues ?
https://builds.apache.org/job/bookkeeper-master/1704/display/redirect

Tests in error:
  BookKeeperTest.testReadHandleWithExplicitLAC:404 » TestTimedOut test
timed out...
  BookKeeperTest.testReadHandleWithExplicitLAC:404 » TestTimedOut test
timed out...
  BookieRecoveryTest.ensurePasswordUsedForOldLedgers[4] »
BKNoSuchLedgerExists
  BookieRecoveryTest.ensurePasswordUsedForOldLedgers[5] »
BKNoSuchLedgerExists


Cheers
--- Enrico

Re: Community Meeting Link

[Bobby Evans]

I plan on being there.  But I don't really have anything to cover beyond seeing 
when we can get some of our pull requests merged in.


- Bobby

On Wednesday, March 22, 2017, 5:38:25 AM CDT, Enrico Olivelli 
 wrote:Hi all,
This is just a reminder for the community meeting.

Maybe we can check today who is going to attend the upcoming meeting on
Thurday, 23 March at 8 PST and make proposals for the agenda.

I think Sijie will be at Vault2017

https://vault2017.sched.com/event/A4wM/apache-bookkeeper-a-high-performance-and-low-latency-cloud-storage-service-sijie-guo-twitter?iframe=no=100%=yes=no

Maybe if we cannot talk about PRs or upcoming features we can talk about
our projects based upon BookKeeper (Pulsar, DistributedLog, Majordodo,
HerdDB...) or the latest public project  activity.

Ideas ?

Enrico







2017-03-09 23:25 GMT+01:00 Sijie Guo :

> Good job Enrico.
>
> Sorry I missed the meeting this morning :(
>
> - Sijie
>
> On Thu, Mar 9, 2017 at 8:34 AM, Enrico Olivelli 
> wrote:
>
> > I have drafted a report
> > https://cwiki.apache.org/confluence/display/BOOKKEEPER/
> > 2017-3-09+Meeting+notes
> >
> > feel free to change it
> >
> > -- Enrico
> >
> > 2017-03-09 16:56 GMT+01:00 Kkasiud1 :
> >
> > > I will not be able to attend the meeting this morning. Couple of
> updates
> > > from my end on the PRs
> > >
> > > - I am integrating Enrico's SSL changes with my changes in SF branch
> and
> > > currently testing the changes. Will post a PR shortly.
> > > - Netty 4.1 support should also come out as a PR on Monday.
> > >
> > > Thanks,
> > > Kishore
> > >
> > > > On Mar 9, 2017, at 7:48 AM, Enrico Olivelli 
> > wrote:
> > > >
> > > > I have updated the wiki page
> > > > https://cwiki.apache.org/confluence/display/BOOKKEEPER/
> > > Community+Meetings
> > > >
> > > > There is no agenda for upcoming meeting:
> > > > I think it would be better to look at current PR backlog
> > > >
> > > > IMHO Maybe we could also see from each corporate "fork" (Twitter,
> > Yahoo,
> > > > SF) the amount of work not yet scheduled as JIRA tickets, this way we
> > > will
> > > > be able to have a first estimate 4.5 release date
> > > >
> > > > (I will have to leave the meeting at 8.30)
> > > > -- Enrico
> > > >
> > > >
> > > > 2017-03-09 8:53 GMT+01:00 Enrico Olivelli :
> > > >
> > > >> for me it is working
> > > >>
> > > >> Enrico
> > > >>
> > > >> 2017-03-09 6:05 GMT+01:00 Sijie Guo :
> > > >>
> > > >>> FYI. As the discussion last community meeting, we need a public
> > > (non-corp)
> > > >>> link for the community meeting.
> > > >>>
> > > >>> Here is the new public link for community meeting :
> > > https://goo.gl/iyRA6G
> > > >>>
> > > >>> Please use it for tomorrow's community meeting. Let me know if it
> > > works or
> > > >>> not.
> > > >>>
> > > >>> - Sijie
> > > >>>
> > > >>
> > > >>
> > >
> >
>

Re: Netty 4 and linux epoll

[Bobby Evans]

The code we have will try for epoll and then fall back to nio if it does not 
work.
There are a few places in the code that we do this, but they all more or less 
boil down to something like the following

    static EventLoopGroup getDefaultEventLoopGroup() {
ThreadFactory threadFactory = new DefaultThreadFactory("bookkeeper-io");
final int numThreads = Runtime.getRuntime().availableProcessors() * 2;

if (SystemUtils.IS_OS_LINUX) {
try {
return new EpollEventLoopGroup(numThreads, threadFactory);
} catch (Throwable t) {
if (LOG.isDebugEnabled()) {
LOG.debug("Could not use Netty Epoll event loop: {}", 
t.getMessage());
}
return new NioEventLoopGroup(numThreads, threadFactory);
}
} else {
return new NioEventLoopGroup(numThreads, threadFactory);
}
}
...
    if (eventLoopGroup instanceof EpollEventLoopGroup) {
bootstrap.channel(EpollServerSocketChannel.class);
} else {
bootstrap.channel(NioServerSocketChannel.class);
}



- Bobby

On Saturday, March 4, 2017, 8:29:52 AM CST, Enrico Olivelli 
 wrote:Hi all,
As we are switching to netty 4.1 maybe ee can look to this too:
http://netty.io/wiki/native-transports.html

Even if I have been using netty 4 for some year I did not get this
promising feature on linux.

Did any of you ever give it a try?

Enrico
-- 


-- Enrico Olivelli

Re: SSL and Netty 4/OpenSSL news

[Bobby Evans]

Is the meetup happening?  I have the last three hangout URLs up and just 
waiting for someone to join/let me into the hangout.


- Bobby

On Friday, February 24, 2017, 6:01:10 AM CST, Enrico Olivelli 
<eolive...@gmail.com> wrote:Thank you @Kishore for review the initial SSL patch.

I have addressed most of the issues and rebased the patch to current master.

See you at the meeting

-- Enrico

2017-02-23 17:05 GMT+01:00 Enrico Olivelli <eolive...@gmail.com>:

> Ok see you tomorrow
>
> Il gio 23 feb 2017, 17:03 Venkateswara Rao Jujjuri <jujj...@gmail.com> ha
> scritto:
>
>> Hmm. I am not sure if we have decided. Ok lets move it to Friday. tomorrow
>> 8 AM PST.
>> Lets discuss and get agreement on the slot tomorrow.
>>
>> On Thu, Feb 23, 2017 at 8:00 AM, Bobby Evans <ev...@yahoo-inc.com.invalid
>> >
>> wrote:
>>
>> > I was assuming Friday, because that is what it was last week.
>> >
>> >
>> > - Bobby
>> >
>> > On Thursday, February 23, 2017, 9:59:00 AM CST, Enrico Olivelli <
>> > eolive...@gmail.com> wrote:Ss we are going to meet today, Thursday or
>> on
>> > Friday?
>> >
>> > Il gio 23 feb 2017, 16:13 Venkateswara Rao Jujjuri <jujj...@gmail.com>
>> ha
>> > scritto:
>> >
>> > > Sijie is still in China. Use the link I provided for today's meeting.
>> > >
>> > > On Thu, Feb 23, 2017 at 6:49 AM, Venkateswara Rao Jujjuri <
>> > > jujj...@gmail.com
>> > > > wrote:
>> > >
>> > > > If @sjije is not there I can host it. @sjijie can you respond?
>> > > >
>> > > > https://hangouts.google.com/call/delo7ot7ajdidcakwvrklcnpkme
>> > > >
>> > > >
>> > > >
>> > > > On Thu, Feb 23, 2017 at 6:39 AM, Enrico Olivelli <
>> eolive...@gmail.com>
>> > > > wrote:
>> > > >
>> > > >> It depends on the "host".
>> > > >> Last time Sijie was away and JV hosted the meeting. Usually we use
>> the
>> > > >> room
>> > > >> linked at
>> > > >>
>> > > https://cwiki.apache.org/confluence/display/BOOKKEEPER/
>> > Community+Meetings
>> > > >> (hosted by Siji @Twitter)
>> > > >>
>> > > >> I don't know whether Sijie will attend.
>> > > >>
>> > > >> If Sijie is not available does anyone volunteer to drive/host the
>> > > meeting
>> > > >> ?
>> > > >>
>> > > >>
>> > > >>
>> > > >> 2017-02-23 15:13 GMT+01:00 Bobby Evans <ev...@yahoo-inc.com.invalid
>> >:
>> > > >>
>> > > >> > What is the hangout URL we are going to use?  Last time there was
>> > > >> > confusion so I was not able to join, and I want to be sure I join
>> > the
>> > > >> right
>> > > >> > one this time.
>> > > >> >
>> > > >> >
>> > > >> > - Bobby
>> > > >> >
>> > > >> > On Thursday, February 23, 2017, 2:06:08 AM CST, Enrico Olivelli <
>> > > >> > eolive...@gmail.com> wrote:Great!
>> > > >> >
>> > > >> > I have drafted the agenda of the next meeting
>> > > >> > https://cwiki.apache.org/confluence/display/BOOKKEEPER/
>> > > >> > 2017-2-24+Meeting+notes
>> > > >> >
>> > > >> >
>> > > >> > Enrico
>> > > >> >
>> > > >> >
>> > > >> > 2017-02-23 0:26 GMT+01:00 Venkateswara Rao Jujjuri <
>> > jujj...@gmail.com
>> > > >:
>> > > >> >
>> > > >> > > Kishore has done bunch of work, and he is reviewing Enrico's
>> > patch.
>> > > >> > > I will request Kishore to be in next meeting. The patch kishore
>> > has
>> > > >> takes
>> > > >> > > to Netty 4.1.7.
>> > > >> > >
>> > > >> > > On Wed, Feb 22, 2017 at 8:39 AM, Bobby Evans
>> > > >> <ev...@yahoo-inc.com.invalid
>> > > >> > >
>> > > >> > > wrote:
>> > > >> > >
>> > > >> > > > I just filed BOOKKEEPER-1008 for this work.  If ot

Re: SSL and Netty 4/OpenSSL news

[Bobby Evans]

I was assuming Friday, because that is what it was last week.


- Bobby

On Thursday, February 23, 2017, 9:59:00 AM CST, Enrico Olivelli 
<eolive...@gmail.com> wrote:Ss we are going to meet today, Thursday or on 
Friday?

Il gio 23 feb 2017, 16:13 Venkateswara Rao Jujjuri <jujj...@gmail.com> ha
scritto:

> Sijie is still in China. Use the link I provided for today's meeting.
>
> On Thu, Feb 23, 2017 at 6:49 AM, Venkateswara Rao Jujjuri <
> jujj...@gmail.com
> > wrote:
>
> > If @sjije is not there I can host it. @sjijie can you respond?
> >
> > https://hangouts.google.com/call/delo7ot7ajdidcakwvrklcnpkme
> >
> >
> >
> > On Thu, Feb 23, 2017 at 6:39 AM, Enrico Olivelli <eolive...@gmail.com>
> > wrote:
> >
> >> It depends on the "host".
> >> Last time Sijie was away and JV hosted the meeting. Usually we use the
> >> room
> >> linked at
> >>
> https://cwiki.apache.org/confluence/display/BOOKKEEPER/Community+Meetings
> >> (hosted by Siji @Twitter)
> >>
> >> I don't know whether Sijie will attend.
> >>
> >> If Sijie is not available does anyone volunteer to drive/host the
> meeting
> >> ?
> >>
> >>
> >>
> >> 2017-02-23 15:13 GMT+01:00 Bobby Evans <ev...@yahoo-inc.com.invalid>:
> >>
> >> > What is the hangout URL we are going to use?  Last time there was
> >> > confusion so I was not able to join, and I want to be sure I join the
> >> right
> >> > one this time.
> >> >
> >> >
> >> > - Bobby
> >> >
> >> > On Thursday, February 23, 2017, 2:06:08 AM CST, Enrico Olivelli <
> >> > eolive...@gmail.com> wrote:Great!
> >> >
> >> > I have drafted the agenda of the next meeting
> >> > https://cwiki.apache.org/confluence/display/BOOKKEEPER/
> >> > 2017-2-24+Meeting+notes
> >> >
> >> >
> >> > Enrico
> >> >
> >> >
> >> > 2017-02-23 0:26 GMT+01:00 Venkateswara Rao Jujjuri <jujj...@gmail.com
> >:
> >> >
> >> > > Kishore has done bunch of work, and he is reviewing Enrico's patch.
> >> > > I will request Kishore to be in next meeting. The patch kishore has
> >> takes
> >> > > to Netty 4.1.7.
> >> > >
> >> > > On Wed, Feb 22, 2017 at 8:39 AM, Bobby Evans
> >> <ev...@yahoo-inc.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > > > I just filed BOOKKEEPER-1008 for this work.  If others have a
> >> different
> >> > > > opinion on this feel free to comment here or on the JIRA.  I want
> to
> >> > make
> >> > > > sure we have the backing of the community on this.
> >> > > >
> >> > > >
> >> > > > - Bobby
> >> > > >
> >> > > > On Wednesday, February 22, 2017, 10:35:29 AM CST, Bobby Evans
> >> > > > <ev...@yahoo-inc.com.INVALID> wrote:I would be happy to give it a
> >> try.
> >> > > > Like I said we are coming up on needing to push it back anyways.
> >> Our
> >> > > code
> >> > > > is based off of 4.0.36.Final, but I can take a look at 4.1.x and
> see
> >> > what
> >> > > > differences there are with the API.
> >> > > >
> >> > > > - Bobby
> >> > > >
> >> > > > On Wednesday, February 22, 2017, 9:57:52 AM CST, Enrico Olivelli <
> >> > > > eolive...@gmail.com> wrote:I'm using Netty 4.1.x for all of my
> >> > projects
> >> > > > and I am very +1 on the switch
> >> > > > to Netty 4
> >> > > >
> >> > > > @Sijie what do you think ?
> >> > > > If we all agree to switch to Netty 4 (I hope 4.1.x)  who can take
> >> care
> >> > of
> >> > > > the first port ?
> >> > > >
> >> > > >
> >> > > > Enrico
> >> > > >
> >> > > > 2017-02-22 16:32 GMT+01:00 Bobby Evans
> <ev...@yahoo-inc.com.invalid
> >> >:
> >> > > >
> >> > > > > I really would like to get netty4 in sooner rather then later.
> >> > Simply
> >> > > > > because we have been running with it for quite a while in
> >> production
&

Re: SSL and Netty 4/OpenSSL news

[Bobby Evans]

What is the hangout URL we are going to use?  Last time there was confusion so 
I was not able to join, and I want to be sure I join the right one this time.


- Bobby

On Thursday, February 23, 2017, 2:06:08 AM CST, Enrico Olivelli 
<eolive...@gmail.com> wrote:Great!

I have drafted the agenda of the next meeting
https://cwiki.apache.org/confluence/display/BOOKKEEPER/2017-2-24+Meeting+notes


Enrico


2017-02-23 0:26 GMT+01:00 Venkateswara Rao Jujjuri <jujj...@gmail.com>:

> Kishore has done bunch of work, and he is reviewing Enrico's patch.
> I will request Kishore to be in next meeting. The patch kishore has takes
> to Netty 4.1.7.
>
> On Wed, Feb 22, 2017 at 8:39 AM, Bobby Evans <ev...@yahoo-inc.com.invalid>
> wrote:
>
> > I just filed BOOKKEEPER-1008 for this work.  If others have a different
> > opinion on this feel free to comment here or on the JIRA.  I want to make
> > sure we have the backing of the community on this.
> >
> >
> > - Bobby
> >
> > On Wednesday, February 22, 2017, 10:35:29 AM CST, Bobby Evans
> > <ev...@yahoo-inc.com.INVALID> wrote:I would be happy to give it a try.
> > Like I said we are coming up on needing to push it back anyways.  Our
> code
> > is based off of 4.0.36.Final, but I can take a look at 4.1.x and see what
> > differences there are with the API.
> >
> > - Bobby
> >
> > On Wednesday, February 22, 2017, 9:57:52 AM CST, Enrico Olivelli <
> > eolive...@gmail.com> wrote:I'm using Netty 4.1.x for all of my projects
> > and I am very +1 on the switch
> > to Netty 4
> >
> > @Sijie what do you think ?
> > If we all agree to switch to Netty 4 (I hope 4.1.x)  who can take care of
> > the first port ?
> >
> >
> > Enrico
> >
> > 2017-02-22 16:32 GMT+01:00 Bobby Evans <ev...@yahoo-inc.com.invalid>:
> >
> > > I really would like to get netty4 in sooner rather then later.  Simply
> > > because we have been running with it for quite a while in production so
> > we
> > > know it is relatively stable, and it is the basis of a lot of other
> > patches
> > > we want to push back.  Meaning we only have a handful of patches to
> push
> > > back before netty4 starts to make things much more difficult if not
> > > impossible for other patches.  If we do want to wait until 4.6.x for
> > netty4
> > > then I would propose that we create a 4.5.x branch simply so we can
> start
> > > to move forward with netty4 on master.  I realize that a change this
> big
> > is
> > > going to add more work to others too so I am open to other opinions.
> > >
> > >
> > > - Bobby
> > >
> > > On Wednesday, February 22, 2017, 9:22:39 AM CST, Enrico Olivelli <
> > > eolive...@gmail.com> wrote:Hi all BookKeepers,
> > > At the last community meeting JV reported that a Salesforce there is
> some
> > > work on SSL/TLS, in particular due to better performances using native
> > > OpenSSL + netty 4.
> > >
> > > How the work is going ?
> > >
> > > Open questions are:
> > >
> > > 1) status of my current patch on SSL
> > >
> > > should I rebase, than get it merged and then continue the work from it
> > > or JV and SF guys will pick up the work entirely ?
> > >
> > > 2) switch to Netty 4:
> > > Initially we said that the switch to Netty 4 (from Yahoo and now from
> > > Salesforce) could be skipped and done maybe for 4.6.x.
> > >
> > > What are your current thoughts ?
> > >
> > > -- Enrico
> > >
> >
>
>
>
> --
> Jvrao
> ---
> First they ignore you, then they laugh at you, then they fight you, then
> you win. - Mahatma Gandhi
>

Re: SSL and Netty 4/OpenSSL news

[Bobby Evans]

I just filed BOOKKEEPER-1008 for this work.  If others have a different opinion 
on this feel free to comment here or on the JIRA.  I want to make sure we have 
the backing of the community on this.


- Bobby

On Wednesday, February 22, 2017, 10:35:29 AM CST, Bobby Evans 
<ev...@yahoo-inc.com.INVALID> wrote:I would be happy to give it a try.  Like I 
said we are coming up on needing to push it back anyways.  Our code is based 
off of 4.0.36.Final, but I can take a look at 4.1.x and see what differences 
there are with the API.

- Bobby

On Wednesday, February 22, 2017, 9:57:52 AM CST, Enrico Olivelli 
<eolive...@gmail.com> wrote:I'm using Netty 4.1.x for all of my projects and I 
am very +1 on the switch
to Netty 4

@Sijie what do you think ?
If we all agree to switch to Netty 4 (I hope 4.1.x)  who can take care of
the first port ?


Enrico

2017-02-22 16:32 GMT+01:00 Bobby Evans <ev...@yahoo-inc.com.invalid>:

> I really would like to get netty4 in sooner rather then later.  Simply
> because we have been running with it for quite a while in production so we
> know it is relatively stable, and it is the basis of a lot of other patches
> we want to push back.  Meaning we only have a handful of patches to push
> back before netty4 starts to make things much more difficult if not
> impossible for other patches.  If we do want to wait until 4.6.x for netty4
> then I would propose that we create a 4.5.x branch simply so we can start
> to move forward with netty4 on master.  I realize that a change this big is
> going to add more work to others too so I am open to other opinions.
>
>
> - Bobby
>
> On Wednesday, February 22, 2017, 9:22:39 AM CST, Enrico Olivelli <
> eolive...@gmail.com> wrote:Hi all BookKeepers,
> At the last community meeting JV reported that a Salesforce there is some
> work on SSL/TLS, in particular due to better performances using native
> OpenSSL + netty 4.
>
> How the work is going ?
>
> Open questions are:
>
> 1) status of my current patch on SSL
>
> should I rebase, than get it merged and then continue the work from it
> or JV and SF guys will pick up the work entirely ?
>
> 2) switch to Netty 4:
> Initially we said that the switch to Netty 4 (from Yahoo and now from
> Salesforce) could be skipped and done maybe for 4.6.x.
>
> What are your current thoughts ?
>
> -- Enrico
>

Re: SSL and Netty 4/OpenSSL news

[Bobby Evans]

I would be happy to give it a try.  Like I said we are coming up on needing to 
push it back anyways.  Our code is based off of 4.0.36.Final, but I can take a 
look at 4.1.x and see what differences there are with the API.

- Bobby

On Wednesday, February 22, 2017, 9:57:52 AM CST, Enrico Olivelli 
<eolive...@gmail.com> wrote:I'm using Netty 4.1.x for all of my projects and I 
am very +1 on the switch
to Netty 4

@Sijie what do you think ?
If we all agree to switch to Netty 4 (I hope 4.1.x)  who can take care of
the first port ?


Enrico

2017-02-22 16:32 GMT+01:00 Bobby Evans <ev...@yahoo-inc.com.invalid>:

> I really would like to get netty4 in sooner rather then later.  Simply
> because we have been running with it for quite a while in production so we
> know it is relatively stable, and it is the basis of a lot of other patches
> we want to push back.  Meaning we only have a handful of patches to push
> back before netty4 starts to make things much more difficult if not
> impossible for other patches.  If we do want to wait until 4.6.x for netty4
> then I would propose that we create a 4.5.x branch simply so we can start
> to move forward with netty4 on master.  I realize that a change this big is
> going to add more work to others too so I am open to other opinions.
>
>
> - Bobby
>
> On Wednesday, February 22, 2017, 9:22:39 AM CST, Enrico Olivelli <
> eolive...@gmail.com> wrote:Hi all BookKeepers,
> At the last community meeting JV reported that a Salesforce there is some
> work on SSL/TLS, in particular due to better performances using native
> OpenSSL + netty 4.
>
> How the work is going ?
>
> Open questions are:
>
> 1) status of my current patch on SSL
>
> should I rebase, than get it merged and then continue the work from it
> or JV and SF guys will pick up the work entirely ?
>
> 2) switch to Netty 4:
> Initially we said that the switch to Netty 4 (from Yahoo and now from
> Salesforce) could be skipped and done maybe for 4.6.x.
>
> What are your current thoughts ?
>
> -- Enrico
>

Re: SSL and Netty 4/OpenSSL news

[Bobby Evans]

I really would like to get netty4 in sooner rather then later.  Simply because 
we have been running with it for quite a while in production so we know it is 
relatively stable, and it is the basis of a lot of other patches we want to 
push back.  Meaning we only have a handful of patches to push back before 
netty4 starts to make things much more difficult if not impossible for other 
patches.  If we do want to wait until 4.6.x for netty4 then I would propose 
that we create a 4.5.x branch simply so we can start to move forward with 
netty4 on master.  I realize that a change this big is going to add more work 
to others too so I am open to other opinions.


- Bobby

On Wednesday, February 22, 2017, 9:22:39 AM CST, Enrico Olivelli 
 wrote:Hi all BookKeepers,
At the last community meeting JV reported that a Salesforce there is some
work on SSL/TLS, in particular due to better performances using native
OpenSSL + netty 4.

How the work is going ?

Open questions are:

1) status of my current patch on SSL

should I rebase, than get it merged and then continue the work from it
or JV and SF guys will pick up the work entirely ?

2) switch to Netty 4:
Initially we said that the switch to Netty 4 (from Yahoo and now from
Salesforce) could be skipped and done maybe for 4.6.x.

What are your current thoughts ?

-- Enrico

Re: [discuss] moving the community meeting to Friday

[Bobby Evans]

So is the meeting happening on Friday then?  Because it looks like no one is 
around to let people into the hangout.  Is https://goo.gl/6UZR1w the right URL?


- Bobby

On Thursday, February 9, 2017, 4:26:12 AM CST, Francesco Caliumi - Diennea 
<francesco.cali...@diennea.com> wrote:If the meeting is going to take place 
this Friday 8 AM, I could present
bookkeeper docker image (how to build, configure and use it), if
someone is interested.

We could then discuss whether to put build files in bookkeeper
repository or let them reside in a separate one and who will be in
charge of updating images when new versions are released.

- Francesco

On Wed, 2017-02-08 at 21:33 -0800, Venkateswara Rao Jujjuri wrote:
> May be it is too late; I am ok moving it Friday 8 AM
>
> @Sijie what would you think? We also need Agenda
>
> On Wed, Feb 8, 2017 at 9:13 AM, Enrico Olivelli <eolive...@gmail.com>
> wrote:
>
> >
> > Sorry for bothering everybody, this week we are going to meet on
> > Thursday?
> >
> > This is the link to the discussion page
> > https://cwiki.apache.org/confluence/display/BOOKKEEPER/Community+Me
> > etings
> >
> > Cheers
> > Enrico
> >
> > Il mar 7 feb 2017, 15:46 Bobby Evans <ev...@yahoo-inc.com.invalid>
> > ha
> > scritto:
> >
> > >
> > > Yes I would love to join too.  We missed the last meeting
> > > invite.  In
> > > general we can make time most days, especially if it is in the
> > > morning.
> > >
> > >
> > > - Bobby
> > >
> > > On Tuesday, February 7, 2017, 5:21:49 AM CST, Enrico Olivelli <
> > > eolive...@gmail.com> wrote:Any news ?
> > > This week the meeting will be on Friday ?
> > >
> > > @Bobby
> > > It would be great if some of your new team at Yahoo could join
> > > the
> > meeting
> > >
> > >
> > > 2017-01-31 7:44 GMT+01:00 Enrico Olivelli <eolive...@gmail.com>:
> > >
> > > >
> > > > For me Friday is ok too. And 8am pt is ideal for me.
> > > >
> > > > I hope that more guus can attend these useful meetings
> > > >
> > > > Enrico
> > > >
> > > > Il mar 31 gen 2017, 02:17 Sijie Guo <si...@apache.org> ha
> > > > scritto:
> > > >
> > > > >
> > > > > It was raised in the other email thread. I'd like to pull
> > > > > that out to
> > > > > discuss here. Is anyone good on moving the community meeting
> > > > > to Friday
> > > > > same
> > > > > time (8am pst)?
> > > > >
> > > > > please give us your options and we can try to coordinate
> > > > > here.
> > > > >
> > > > > - Sijie
> > > > >
> > > > --
> > > >
> > > >
> > > > -- Enrico Olivelli
> > > >
> > >
> > --
> >
> >
> > -- Enrico Olivelli
> >
>
>
>
--
Francesco Caliumi
Developer @ Diennea - MagNews
Tel.: (+39) 0546 066100 - Int. 266
Viale G.Marconi 30/14 - 48018 Faenza (RA)





Iscriviti alla nostra newsletter per rimanere aggiornato su digital ed email 
marketing! http://www.magnews.it/newsletter/

The information in this email is confidential and may be legally privileged. If 
you are not the intended recipient please notify the sender immediately and 
destroy this email. Any unauthorized, direct or indirect, disclosure, copying, 
storage, distribution or other use is strictly forbidden.

Re: [discuss] moving the community meeting to Friday

[Bobby Evans]

Yes I would love to join too.  We missed the last meeting invite.  In general 
we can make time most days, especially if it is in the morning.


- Bobby

On Tuesday, February 7, 2017, 5:21:49 AM CST, Enrico Olivelli 
 wrote:Any news ?
This week the meeting will be on Friday ?

@Bobby
It would be great if some of your new team at Yahoo could join the meeting

2017-01-31 7:44 GMT+01:00 Enrico Olivelli :

> For me Friday is ok too. And 8am pt is ideal for me.
>
> I hope that more guus can attend these useful meetings
>
> Enrico
>
> Il mar 31 gen 2017, 02:17 Sijie Guo  ha scritto:
>
>> It was raised in the other email thread. I'd like to pull that out to
>> discuss here. Is anyone good on moving the community meeting to Friday
>> same
>> time (8am pst)?
>>
>> please give us your options and we can try to coordinate here.
>>
>> - Sijie
>>
> --
>
>
> -- Enrico Olivelli
>

Re: Apache BookKeeper 4.5.0 release plan

[Bobby Evans]

Me and my team are still coming up to speed on the Yahoo side.  2-3 month 
sounds like a reasonable goal, but we may have to push ourselves to get all of 
it done by then.


- Bobby

On Friday, January 13, 2017, 5:19:39 AM CST, Enrico Olivelli 
 wrote:Hi BookKeepers,
is it time to think about a draft of the release plan for 4.5.0 ?

I have updated the Roadmap page (
https://cwiki.apache.org/confluence/display/BOOKKEEPER/Roadmap) with
references to Security issues.

I see that there is still a lot of work to be done to merge Twitter,
Salesforce and Yahoo versions.

I am very interested in having a release within 2-3 months

What do you think ?

Enrico

Helping with BookKeeper at Yahoo

[Bobby Evans]

Hi,

My name is Bobby Evans and I wanted to introduce myself to everyone.  My
team is going to start helping out the Pulsar team here at Yahoo in
maintaining/improving BookKeeper.  So if you see some new names on JIRAs
that is who we are.  Also if you have some suggestions on bug fixes,
documentation updates, or other things that we can do to get started with
the community please let us know.

Thanks,

Bobby