[VOTE] Graduate Apache DistributedLog as a subproject of Apache BookKeeper

[Flavio Junqueira]

The Apache DistributedLog community has voted to graduate the project and make 
it a subproject of Apache BookKeeper. The Apache BookKeeper PMC has also voted 
to accept DistributedLog as a subproject. The links to the vote threads are the 
following:

DistributedLog PPMC vote:
https://mail-search.apache.org/members/private-arch/distributedlog-private/201706.mbox/%3ccao2ydyy3nzjtb934g-aryujswzjetktpupf_la0jkhf263f...@mail.gmail.com%3e
 

https://mail-search.apache.org/members/private-arch/distributedlog-private/201706.mbox/%3cCAO2yDybfqt72xGtrvR-9eUYycHJvpCo5=ts87rzhpsm096r...@mail.gmail.com%3e
 


DistributedLog Community vote:
http://mail-archives.apache.org/mod_mbox/incubator-distributedlog-dev/201706.mbox/%3ccao2ydyzzinfghjxqmvehxdaulkwdt9v2nkqeyuzxe0i4tzg...@mail.gmail.com%3e
 

http://mail-archives.apache.org/mod_mbox/incubator-distributedlog-dev/201706.mbox/%3cCAO2yDya-=0cBfUM0SsL5kuf9HJ1G=pL7Z_=7Ps+TQgqwJs=c...@mail.gmail.com%3e
 


BookKeeper PMC vote:
https://mail-search.apache.org/members/private-arch/bookkeeper-private/201706.mbox/%3cCAO2yDyacdXuXh==iw1oqrriugoxhprp_htnofojot5rxmv6...@mail.gmail.com%3e
 

https://mail-search.apache.org/members/private-arch/bookkeeper-private/201706.mbox/%3cCAO2yDyYzV_7vVNg6Efyp3TPjddoYRyQx4rXvqP=W=c09qk2...@mail.gmail.com%3e
 


This message is to start an IPMC vote. Please vote on the following:

[ ] +1 Graduate Apache DistributedLog from the Incubator.
[ ] +0 No opinion
[ ] -1 Don't graduate Apache DistributedLog from the Incubator (please provide
the reason)

This VOTE will be opened for the next 72 hours.

-Flavio

Re: [VOTE] Release 0.4.0, release candidate #1

[Flavio Junqueira]

You're saying my machine is slow... ;-)

-Flavio

> On 12 Jan 2017, at 16:38, Sijie Guo <si...@apache.org> wrote:
> 
> Yeah, currently some of the tests are time dependent. So they failed
> sometimes when the machine is slow. There were efforts on improving this
> and will also do this in next release.
> 
> Sijie
> 
> On Jan 12, 2017 3:32 AM, "Flavio Junqueira" <f...@apache.org 
> <mailto:f...@apache.org>> wrote:
> 
>> Ok, so I've seen the following test cases showing errors:
>> 
>> TestBKDistributedLogManager.testNumberOfTransactionsWithIn
>> progressAtEnd:325
>> TestAsyncReaderLock.testReaderLockDlmClosed » Cancellation
>> 
>> They don't seem to fail consistently for me, though.
>> 
>> -Flavio
>> 
>>> On 10 Jan 2017, at 18:10, Sijie Guo <si...@apache.org> wrote:
>>> 
>>> Liang had a pull request for the assembly issue. Going to cancel this
>> vote
>>> and produce a new RC.
>>> 
>>> Flavio, what are the tests failed in your case?
>>> 
>>> Sijie
>>> 
>>> On Jan 10, 2017 9:10 AM, "Flavio Junqueira" <f...@apache.org 
>>> <mailto:f...@apache.org> > f...@apache.org <mailto:f...@apache.org>>> wrote:
>>> 
>>> Yeah, I can't build because of the same issue:
>>> 
>>>   [ERROR] Failed to execute goal org.apache.maven.plugins:
>>> maven-assembly-plugin:2.2.1:single (default) on project
>>> distributedlog-service: Failed to create assembly: Error adding file to
>>>   archive: distributedlog-0.4.0-incubating/distributedlog-
>> service/../README.md
>>> isn't a file. -> [Help 1]
>>> 
>>> The command I ran is:
>>> 
>>>  mvn clean apache-rat:check package findbugs:check -DskipTests
>>> 
>>> I also tried other commands, and they all seem to fail on tests.
>>> 
>>> -Flavio
>>> 
>>>> On 10 Jan 2017, at 07:24, Xi Liu <xi.liu@gmail.com 
>>>> <mailto:xi.liu@gmail.com>> wrote:
>>>> 
>>>> On Mon, Jan 9, 2017 at 8:00 PM, liang xie <xieliang...@gmail.com 
>>>> <mailto:xieliang...@gmail.com>
>> <mailto:xieliang...@gmail.com <mailto:xieliang...@gmail.com>> >> xieliang...@gmail.com>> wrote:
>>>> 
>>>>> Glad to see 0.4 will be release soon :)
>>>>> I could not find tutorials package from link[2], it should be released
>>>>> as well, please correct me if i am wrong.
>>>>> I can pass this command with current git master code: "mvn clean
>>>>> apache-rat:check package findbugs:check -DskipTests", but failed with
>>>>> from distributedlog-0.4.0-incubating-src.tar.gz which downloaded from
>>>>> dist.apache.org, the error msg:
>>>>> 
>>>>> [ERROR] Failed to execute goal
>>>>> org.apache.maven.plugins:maven-assembly-plugin:2.2.1:single (default)
>>>>> on project distributedlog-service: Failed to create assembly: Error
>>>>> adding file to archive:
>>>>> /tmp/distributedlog-0.4.0-incubating/distributedlog-
>> service/../README.md
>>>>> isn't a file. -> [Help 1]
>>>>> 
>>>> 
>>>> I also saw this issue.
>>>> 
>>>> 
>>>>> 
>>>>> And none of you saw this : DL-181, it can be reproduced on my local
>>>>> box always w/o patched,  weird...
>>>>> 
>>>>> On Mon, Jan 9, 2017 at 12:04 PM, Sijie Guo <si...@apache.org> wrote:
>>>>>> Hi all,
>>>>>> 
>>>>>> Please review and vote on the release candidate #1 for the version
>>> 0.4.0,
>>>>>> as follows:
>>>>>> 
>>>>>> [ ] +1, Approve the release
>>>>>> [ ] -1, Do not approve the release (please provide specific comments)
>>>>>> 
>>>>>> The complete staging area is available for your review, which
>> includes:
>>>>>> 
>>>>>>  * JIRA release notes [1],
>>>>>>  * the official Apache source release to be deployed to
>>>>> dist.apache.org
>>>>>> [2],
>>>>>>  * all artifacts to be deployed to the Maven Central Repository [3],
>>>>>>  * source code tag "v0.4.0-RC1" [4],
>>>>>>  * website pull request listing the release [5] and publishing the
>> API
>>>>>> reference manual.
>>>>>> 
>>>>>> A simple instruction for validation the source and binary packages.
>>>>>> 
>>>>>> - source package: run "*./scripts/integration/smoketest.sh*" after
>>>>> building
>>>>>> the package with "*mvn clean apache-rat:check package findbugs:check
>>>>>> -DskipTests*"
>>>>>> 
>>>>>> The vote will be open for at least 72 hours. It is adopted by majority
>>>>>> approval, with at least 3 PPMC affirmative votes.
>>>>>> 
>>>>>> Thanks,
>>>>>> Sijie
>>>>>> 
>>>>>> [1]
>>>>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
>>>>> projectId=12320620=12337980
>>>>>> [2]
>>>>>> https://dist.apache.org/repos/dist/dev/incubator/
>> distributedlog/0.4.0-
>>>>> incubating/
>>>>>> [3]
>>>>>> https://repository.apache.org/content/repositories/
>>>>> orgapachedistributedlog-1001/
>>>>>> [4]
>>>>>> https://github.com/apache/incubator-distributedlog/tree/
>>>>> v0.4.0-incubating-RC1
>>>>>> [5] https://github.com/apache/incubator-distributedlog/pull/109

Re: [VOTE] Release 0.4.0, release candidate #1

[Flavio Junqueira]

Ok, so I've seen the following test cases showing errors:

TestBKDistributedLogManager.testNumberOfTransactionsWithInprogressAtEnd:325
TestAsyncReaderLock.testReaderLockDlmClosed » Cancellation

They don't seem to fail consistently for me, though.

-Flavio

> On 10 Jan 2017, at 18:10, Sijie Guo <si...@apache.org> wrote:
> 
> Liang had a pull request for the assembly issue. Going to cancel this vote
> and produce a new RC.
> 
> Flavio, what are the tests failed in your case?
> 
> Sijie
> 
> On Jan 10, 2017 9:10 AM, "Flavio Junqueira" <f...@apache.org 
> <mailto:f...@apache.org>> wrote:
> 
> Yeah, I can't build because of the same issue:
> 
>[ERROR] Failed to execute goal org.apache.maven.plugins:
> maven-assembly-plugin:2.2.1:single (default) on project
> distributedlog-service: Failed to create assembly: Error adding file to
>archive: 
> distributedlog-0.4.0-incubating/distributedlog-service/../README.md
> isn't a file. -> [Help 1]
> 
> The command I ran is:
> 
>   mvn clean apache-rat:check package findbugs:check -DskipTests
> 
> I also tried other commands, and they all seem to fail on tests.
> 
> -Flavio
> 
>> On 10 Jan 2017, at 07:24, Xi Liu <xi.liu@gmail.com> wrote:
>> 
>> On Mon, Jan 9, 2017 at 8:00 PM, liang xie <xieliang...@gmail.com 
>> <mailto:xieliang...@gmail.com>  xieliang...@gmail.com>> wrote:
>> 
>>> Glad to see 0.4 will be release soon :)
>>> I could not find tutorials package from link[2], it should be released
>>> as well, please correct me if i am wrong.
>>> I can pass this command with current git master code: "mvn clean
>>> apache-rat:check package findbugs:check -DskipTests", but failed with
>>> from distributedlog-0.4.0-incubating-src.tar.gz which downloaded from
>>> dist.apache.org, the error msg:
>>> 
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-assembly-plugin:2.2.1:single (default)
>>> on project distributedlog-service: Failed to create assembly: Error
>>> adding file to archive:
>>> /tmp/distributedlog-0.4.0-incubating/distributedlog-service/../README.md
>>> isn't a file. -> [Help 1]
>>> 
>> 
>> I also saw this issue.
>> 
>> 
>>> 
>>> And none of you saw this : DL-181, it can be reproduced on my local
>>> box always w/o patched,  weird...
>>> 
>>> On Mon, Jan 9, 2017 at 12:04 PM, Sijie Guo <si...@apache.org> wrote:
>>>> Hi all,
>>>> 
>>>> Please review and vote on the release candidate #1 for the version
> 0.4.0,
>>>> as follows:
>>>> 
>>>> [ ] +1, Approve the release
>>>> [ ] -1, Do not approve the release (please provide specific comments)
>>>> 
>>>> The complete staging area is available for your review, which includes:
>>>> 
>>>>   * JIRA release notes [1],
>>>>   * the official Apache source release to be deployed to
>>> dist.apache.org
>>>> [2],
>>>>   * all artifacts to be deployed to the Maven Central Repository [3],
>>>>   * source code tag "v0.4.0-RC1" [4],
>>>>   * website pull request listing the release [5] and publishing the API
>>>> reference manual.
>>>> 
>>>> A simple instruction for validation the source and binary packages.
>>>> 
>>>> - source package: run "*./scripts/integration/smoketest.sh*" after
>>> building
>>>> the package with "*mvn clean apache-rat:check package findbugs:check
>>>> -DskipTests*"
>>>> 
>>>> The vote will be open for at least 72 hours. It is adopted by majority
>>>> approval, with at least 3 PPMC affirmative votes.
>>>> 
>>>> Thanks,
>>>> Sijie
>>>> 
>>>> [1]
>>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
>>> projectId=12320620=12337980
>>>> [2]
>>>> https://dist.apache.org/repos/dist/dev/incubator/distributedlog/0.4.0-
>>> incubating/
>>>> [3]
>>>> https://repository.apache.org/content/repositories/
>>> orgapachedistributedlog-1001/
>>>> [4]
>>>> https://github.com/apache/incubator-distributedlog/tree/
>>> v0.4.0-incubating-RC1
>>>> [5] https://github.com/apache/incubator-distributedlog/pull/109

Re: [VOTE] Release 0.4.0, release candidate #1

[Flavio Junqueira]

Yeah, I can't build because of the same issue:

[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-assembly-plugin:2.2.1:single (default) on 
project distributedlog-service: Failed to create assembly: Error adding file to 
 
archive: 
distributedlog-0.4.0-incubating/distributedlog-service/../README.md isn't a 
file. -> [Help 1]

The command I ran is:

   mvn clean apache-rat:check package findbugs:check -DskipTests

I also tried other commands, and they all seem to fail on tests.

-Flavio

> On 10 Jan 2017, at 07:24, Xi Liu  wrote:
> 
> On Mon, Jan 9, 2017 at 8:00 PM, liang xie  > wrote:
> 
>> Glad to see 0.4 will be release soon :)
>> I could not find tutorials package from link[2], it should be released
>> as well, please correct me if i am wrong.
>> I can pass this command with current git master code: "mvn clean
>> apache-rat:check package findbugs:check -DskipTests", but failed with
>> from distributedlog-0.4.0-incubating-src.tar.gz which downloaded from
>> dist.apache.org, the error msg:
>> 
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-assembly-plugin:2.2.1:single (default)
>> on project distributedlog-service: Failed to create assembly: Error
>> adding file to archive:
>> /tmp/distributedlog-0.4.0-incubating/distributedlog-service/../README.md
>> isn't a file. -> [Help 1]
>> 
> 
> I also saw this issue.
> 
> 
>> 
>> And none of you saw this : DL-181, it can be reproduced on my local
>> box always w/o patched,  weird...
>> 
>> On Mon, Jan 9, 2017 at 12:04 PM, Sijie Guo  wrote:
>>> Hi all,
>>> 
>>> Please review and vote on the release candidate #1 for the version 0.4.0,
>>> as follows:
>>> 
>>> [ ] +1, Approve the release
>>> [ ] -1, Do not approve the release (please provide specific comments)
>>> 
>>> The complete staging area is available for your review, which includes:
>>> 
>>>* JIRA release notes [1],
>>>* the official Apache source release to be deployed to
>> dist.apache.org
>>> [2],
>>>* all artifacts to be deployed to the Maven Central Repository [3],
>>>* source code tag "v0.4.0-RC1" [4],
>>>* website pull request listing the release [5] and publishing the API
>>> reference manual.
>>> 
>>> A simple instruction for validation the source and binary packages.
>>> 
>>> - source package: run "*./scripts/integration/smoketest.sh*" after
>> building
>>> the package with "*mvn clean apache-rat:check package findbugs:check
>>> -DskipTests*"
>>> 
>>> The vote will be open for at least 72 hours. It is adopted by majority
>>> approval, with at least 3 PPMC affirmative votes.
>>> 
>>> Thanks,
>>> Sijie
>>> 
>>> [1]
>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
>> projectId=12320620=12337980
>>> [2]
>>> https://dist.apache.org/repos/dist/dev/incubator/distributedlog/0.4.0-
>> incubating/
>>> [3]
>>> https://repository.apache.org/content/repositories/
>> orgapachedistributedlog-1001/
>>> [4]
>>> https://github.com/apache/incubator-distributedlog/tree/
>> v0.4.0-incubating-RC1
>>> [5] https://github.com/apache/incubator-distributedlog/pull/109

Re: Distributedlog Podling Report Draft - November 2016

[Flavio Junqueira]

+1

> On 02 Nov 2016, at 09:22, Khurrum Nasim <khurrumnas...@gmail.com> wrote:
> 
> +1 from me (non-binding).
> 
> - KN
> 
> On Tue, Nov 1, 2016 at 7:18 PM, Jia Zhai <zhaiji...@gmail.com> wrote:
> 
>> Thanks so much for your suggestions. Here is a new draft:
>> 
>> ===
>> DistributedLog
>> 
>> DistributedLog is a high-performance replicated log service. It offers
>> durability, replication and strong consistency, which provides a
>> fundamental building block for building reliable distributed systems.
>> DistributedLog has been incubating since 2016-06-24.
>> 
>> Three most important issues to address in the move towards graduation:
>> 1.Continue to grow the community, and increase diversity of community.
>> 2.Improve documentation, including documentation of project and processes.
>> 3.Successful releases.
>> 
>> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
>> of?
>> None
>> 
>> How has the community developed since the last report?
>> 1. Increase in contributions from community.
>>   - 8 created and 4 resolved issues in community JIRA in October.
>> 2. Lots of engagement on documentation.
>>   - Enhance existing documents,
>>   - Setup guides for developers and committers.
>> 3. Increased traffic on the mailing list, in particular, due to committers
>> engaging more actively with contributors.
>>   - we have 35 people subscribed mail list.
>>   - 125 messages to distributedlog mail list in October.
>> 
>> How has the project developed since the last report?
>> 1. Documentation has improved for project build and project deployment.
>> Added more information on  community page.
>> New added pages:
>>  https://cwiki.apache.org/confluence/display/DL/Developer+Guide
>>  https://cwiki.apache.org/confluence/display/DL/Committer+Guide
>> 2. Involved more discussion of new ideas and bring in new features. Include
>> major discussions like 'transaction support', 'batch commit', "EventStore"
>> . etc.
>> 3. First release expected on November, and repackaging of the project under
>> apache namespace are being discussed.
>> - Pull requests for repackaging.
>> - The major blocker is https://issues.apache.org/jira/browse/DL-2. We were
>> expecting to let DL depends on an official bk version.
>> 
>> 
>> 
>> On Tue, Nov 1, 2016 at 5:54 PM, Sijie Guo <si...@apache.org> wrote:
>> 
>>> Thank you Jia and Flavio. Comments inline.
>>> 
>>> On Tue, Nov 1, 2016 at 1:54 AM, Jia Zhai <zhaiji...@gmail.com> wrote:
>>> 
>>>> Hi Sijie,
>>>> Would you please help address some of Flavio's comments first, You may
>>> have
>>>> more information for story behind the result. I would like to handle
>> this
>>>> after your comments.
>>>> 
>>>> Thanks a lot.
>>>> -Jia
>>>> 
>>>> On Tue, Nov 1, 2016 at 10:42 AM, Jia Zhai <zhaiji...@gmail.com> wrote:
>>>> 
>>>>> Thanks a lot for your comments, will address them and post a new
>> draft.
>>>>> 
>>>>> On Mon, Oct 31, 2016 at 6:02 PM, Flavio Junqueira <
>>>>> fpjunque...@yahoo.com.invalid> wrote:
>>>>> 
>>>>>> Thanks, Jia. It would be good to have concrete metrics where
>> possible.
>>>>>> See my comments below:
>>>>>> 
>>>>>>> On 30 Oct 2016, at 10:53, Jia Zhai <zhaiji...@gmail.com> wrote:
>>>>>>> 
>>>>>>> Thanks a lot for your suggestions Flavio.
>>>>>>> And Guys, Here is a draft. Please help comments on it.
>>>>>>> Regards.
>>>>>>> -Jia
>>>>>>> 
>>>>>>> =
>>>>>>> 
>>>>>>> DistributedLog
>>>>>>> 
>>>>>>> DistributedLog is a high-performance replicated log service. It
>>> offers
>>>>>>> 
>>>>>>> durability, replication and strong consistency, which provides a
>>>>>> fundamental
>>>>>>> 
>>>>>>> building block for building reliable distributed systems.
>>>>>>> 
>>>>>>> DistributedLog has been incubating since 2016-06-24.
>>>>>>> 
>>>>>>> Three most important issues to address in the move towards
>

Re: Distributedlog Podling Report Draft - November 2016

[Flavio Junqueira]

Thanks, Jia. It would be good to have concrete metrics where possible. See my 
comments below:

> On 30 Oct 2016, at 10:53, Jia Zhai <zhaiji...@gmail.com> wrote:
> 
> Thanks a lot for your suggestions Flavio.
> And Guys, Here is a draft. Please help comments on it.
> Regards.
> -Jia
> 
> =
> 
> DistributedLog
> 
> DistributedLog is a high-performance replicated log service. It offers
> 
> durability, replication and strong consistency, which provides a fundamental
> 
> building block for building reliable distributed systems.
> 
> DistributedLog has been incubating since 2016-06-24.
> 
> Three most important issues to address in the move towards graduation:
> 1.   Continue to grow the community, especially people from outside
> Twitter.
> [Ask the PMC for helping check the number of people subscribed to dev@ mail
> list]

I think you're referring to the project PMC checking the subscription list. I 
checked and we have 35 people subscribed. A lot of people have gmail and 
apache.org <http://apache.org/> addresses so it is hard to tell affiliation. 
One typical sign of community diversity is to have active committers from 
multiple organizations, which is just a natural extension of a diverse 
community. As folks contribute to the project, I'd expect the PPMC to offer 
committership to the contributors.

Please do not refer to Twitter specifically, just say that we want to increase 
diversity.

> 2.   Improve documentation.

Project documentation is important, but from a community perspective, it is 
more important to have all processes documented well: how to contribute, how to 
merge, notes for first time committers, how to cut a release, check licenses. 
We need to make sure all this is in place once we suggest graduation.


> 3.   First Apache release

When is the first release due? it would be good for this community to release 
sooner rather later. I'd expect multiple releases upon graduation. I think I'd 
just say "Release successfully".

> 
> 
> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
> 
> of?
> 
> None
> 
> How has the community developed since the last report?
> 
> 1. Increase in contributions from community.
> 

How do we measure this? Here are a few suggestions:

- Number of messages to the list
- Number of jiras created/resolved
- Number of individual contributors 

> 2. Lots of engagement on documentation.
> 

What are you using to determine this? Mailing list discussion or jira?

There are other interesting threads going on too, like transactions and event 
sourcing.

> 3. Improved responsiveness of committers to community members
> 

I'd phrase this differently. I'd say something like: 

Increased traffic on the mailing list, in particular, due to committers 
engaging more actively with contributors.

> 
> How has the project developed since the last report?
> 
> 1. Documentation has improved for project build and project deployment.
> Added more information on  community page.
> 

Please try to be a bit more specific.

> 2. Involved more discussion of new ideas and bring in new features. Include
> major discussions like 'transaction support', 'batch commit' .etc.

Ok, I see you talked about other threads here.

> 
> 3. First release and repackaging of the project under apache namespace are
> 
>   being discussed, such as:
> 
> - Pull requests for repackaging.
> 
> - Twitter folks are working on porting twitter's bk version back to
> community

It is a bit unclear why this is important, and I'd again avoid referring to a 
specific company if possible.

If there is a major change happening and the community is all involved, then 
I'd mention it, but as stated it sounds like this is relevant to the BookKeeper 
community, although it affects this community because of the dependency.

> 
> - Expect to cut a release on Nov.

We should mention this above when we refer to the first release. I'd also be 
interested in knowing why the delay, what is holding it, and who is the release 
manager. We don't necessarily need to add it to the report, although more 
detail isn't bad.

-Flavio

> 
> 
> 
> 
> On Fri, Oct 28, 2016 at 11:10 PM, Flavio Junqueira <f...@apache.org> wrote:
> 
>> Hi Jia,
>> 
>> I'd suggest that you put a draft together and share on the list so that we
>> can comment before posting on the wiki.
>> 
>> -Flavio
>> 
>>> On 27 Oct 2016, at 16:44, Jia Zhai <zhaiji...@gmail.com> wrote:
>>> 
>>> Hi Guys,
>>> If there is an opportunity, I would like to have a try for this month. :)
>>> 
>>> Thanks a lot.
>>> -Jia
>>> 
>>> On Thu, Oct 27, 2016 at 7:01 AM, <johndam...@apache.org> wrote:
>>> 
>> 

Re: hundreds of millions of streams?

[Flavio Junqueira]

Perhaps this is an obvious observation, but can't you deploy multiple instances 
to scale to whatever size you like?

-Flavio

> On 28 Oct 2016, at 20:27, Poule Dodue  wrote:
> 
> I think it would cause more concurrency problems in write operations as
> described at page 12 point #2 of this thesis:
> 
> http://www.diva-portal.se/smash/get/diva2:877307/FULLTEXT01.pdf
> 
> 
> 
>> Le 28 oct. 2016 à 11:48, Leigh Stewart  a 
>> écrit :
>> 
>> Got it. We probably can't support that scale at this time.
>> Curious: do you resort to sharing streams among objects with systems that
>> don't support 100s millions of streams? (i.e. partitioning objects across
>> streams?)
>> 
>> On Fri, Oct 28, 2016 at 8:24 AM, Poule Dodue  wrote:
>> 
>>> yes aka ES/CQRS
>>> 
>>> some links:
>>> 
>>> https://msdn.microsoft.com/en-us/library/jj554200.aspx
>>> http://williamverdolini.github.io/2014/08/11/cqrses-architecture/
>>> http://docs.geteventstore.com/introduction/3.9.0/event-sourcing-basics/
>>> 
>>> it needs lot of streams to basically replay events for any entity on a
>>> system.
>>> 
>>> example: i could replay events for all changes that happened in 1 Cart of
>>> 1 User:
>>> 
>>> 
>>> (read events from stream "cart-of-user-233293111" ):
>>> 
>>> 1- added item X
>>> 2- deleted item X
>>> 3- added item Y
>>> 
>>> 
>>> by replaying that stream, I can rebuild a user's cart state
>>> 
>>> 
 Le 28 oct. 2016 à 10:13, Leigh Stewart  a
>>> écrit :
 
 Poule- would you mind sharing some information on Event Sourcing? Are you
 referring to something like
 http://martinfowler.com/eaaDev/EventSourcing.html ?
 
 On Fri, Oct 28, 2016 at 7:11 AM, Leigh Stewart 
>>> wrote:
 
> DL is not able to handle 100s of millions of streams. 10^5-106 is
>>> probably
> ok.
> ZK is probably the biggest challenge (we are looking at ways to
>>> eliminate
> this as we would like to scale to 10^6-10^7 in the not too distant
>>> future),
> but 100s of millions is so far beyond what we've worked with there would
> likely be other scaling challenges on the way to that point.
> 
> On Fri, Oct 28, 2016 at 5:56 AM, Poule Dodue 
> wrote:
> 
>> In Event Sourcing, we need to have 1 stream per entity/aggregate so for
>> a typical prod system it means we need hundreds of millions of streams.
>> 
>> Is DL able to handle that or it is limited to, say, few hundreds
>> thousands of streams?
>> 
>> 
>> 
> 
>>> 
>>> 
> 

Re: Podling Report Reminder - November 2016

[Flavio Junqueira]

Hi Jia,

I'd suggest that you put a draft together and share on the list so that we can 
comment before posting on the wiki.

-Flavio
 
> On 27 Oct 2016, at 16:44, Jia Zhai  wrote:
> 
> Hi Guys,
> If there is an opportunity, I would like to have a try for this month. :)
> 
> Thanks a lot.
> -Jia
> 
> On Thu, Oct 27, 2016 at 7:01 AM,  wrote:
> 
>> Dear podling,
>> 
>> This email was sent by an automated system on behalf of the Apache
>> Incubator PMC. It is an initial reminder to give you plenty of time to
>> prepare your quarterly board report.
>> 
>> The board meeting is scheduled for Wed, 16 November 2016, 10:30 am PDT.
>> The report for your podling will form a part of the Incubator PMC
>> report. The Incubator PMC requires your report to be submitted 2 weeks
>> before the board meeting, to allow sufficient time for review and
>> submission (Wed, November 02).
>> 
>> Please submit your report with sufficient time to allow the Incubator
>> PMC, and subsequently board members to review and digest. Again, the
>> very latest you should submit your report is 2 weeks prior to the board
>> meeting.
>> 
>> Thanks,
>> 
>> The Apache Incubator PMC
>> 
>> Submitting your Report
>> 
>> --
>> 
>> Your report should contain the following:
>> 
>> *   Your project name
>> *   A brief description of your project, which assumes no knowledge of
>>the project or necessarily of its field
>> *   A list of the three most important issues to address in the move
>>towards graduation.
>> *   Any issues that the Incubator PMC or ASF Board might wish/need to be
>>aware of
>> *   How has the community developed since the last report
>> *   How has the project developed since the last report.
>> 
>> This should be appended to the Incubator Wiki page at:
>> 
>> http://wiki.apache.org/incubator/November2016
>> 
>> Note: This is manually populated. You may need to wait a little before
>> this page is created from a template.
>> 
>> Mentors
>> ---
>> 
>> Mentors should review reports for their project(s) and sign them off on
>> the Incubator wiki page. Signing off reports shows that you are
>> following the project - projects that are not signed may raise alarms
>> for the Incubator PMC.
>> 
>> Incubator PMC
>> 

Re: Repackaging the package namespace

[Flavio Junqueira]

It isn't strictly necessary, here is what the documentation says:

On Repackaging

It is recommended - but not mandated - that source is repackaged under the 
Apache namespace. There is no need to use the incubator namespace. For example, 
Java source might be repackaged to org.apache.foo.Bar or a DTD to 
http://dtd.apache.org/foo/bar.

Existing open source projects moving to Apache may well need to consider 
carefully how they will approach this transition.



My suggestion is to repackage before the first release, though. This way 
applications written against the early release will have the right namespace 
already. 

-Flavio

> On 10 Sep 2016, at 20:32, Sijie Guo  wrote:
> 
> Any suggestions from mentors for the first release?
> 
> - Sijie
> 
> On Tue, Aug 30, 2016 at 11:18 PM, Sijie Guo  wrote:
> 
>> Does anyone know if it is required to repackage the namespace to under
>> org.apache for the first release? Any suggestions from mentors?
>> 
>> - Sijie
>> 

Re: [DRAFT] Podling report for September 2016

[Flavio Junqueira]

I'd actually prefer to add this information for the current one, we still have 
time. Even if we don't add it all, some clarification with respect to the 
contributions would be great.

-Flavio

> On 10 Sep 2016, at 20:20, Sijie Guo <si...@apache.org> wrote:
> 
> Yup. +1 on Flavio's suggestion. We should start report these things on next
> report.
> 
> - Sijie
> 
> On Fri, Sep 9, 2016 at 2:21 PM, Flavio Junqueira <f...@apache.org> wrote:
> 
>> It looks good. It'd be nice to add some more detail, though. For example:
>> 
>> - Number of jiras created
>> - Number of jiras resolved
>> - Jenkins has been set up
>> - Number of contributors reporting jira issues
>> - Can we quantify a "a few people contributing"? Is that 2-3 or more like
>> 10?
>> - Can we quantify the ideas being proposed, like was it one or more?
>> 
>> It is not a big issue to not report these things early on, but I find it
>> good practice to do it even if the numbers aren't impressive at this point
>> (it's a starting project after all). Having these figures will help later
>> on to determine how the community has been growing.
>> 
>> -Flavio
>> 
>>> On 09 Sep 2016, at 16:20, Chris Nauroth <cnaur...@hortonworks.com>
>> wrote:
>>> 
>>> I entered my sign-off.  Nice job, Khurrum!
>>> 
>>> --Chris Nauroth
>>> 
>>> On 9/7/16, 11:59 PM, "Sijie Guo" <si...@apache.org> wrote:
>>> 
>>>   I submitted the podling report.
>>> 
>>>   Can any mentor take a look and sign off?
>>> 
>>>   - Sijie
>>> 
>>>   On Wed, Sep 7, 2016 at 10:17 PM, Khurrum Nasim <
>> khurrumnas...@gmail.com>
>>>   wrote:
>>> 
>>>> It seems that I have troubles with my account. Can anyone submit the
>>>> report?
>>>> 
>>>> KN
>>>> 
>>>> On Wed, Sep 7, 2016 at 9:26 PM, Khurrum Nasim <khurrumnas...@gmail.com>
>>>> wrote:
>>>> 
>>>>> If no objection, I will update the wiki to submit the report.
>>>>> 
>>>>> KN
>>>>> 
>>>>> On Tue, Sep 6, 2016 at 11:43 PM, Khurrum Nasim <
>> khurrumnas...@gmail.com>
>>>>> wrote:
>>>>> 
>>>>>> Thank you Sijie. I've requested the wiki permission at the incubator
>>>> list.
>>>>>> 
>>>>>> - KN
>>>>>> 
>>>>>> On Tue, Sep 6, 2016 at 6:48 PM, Sijie Guo <si...@apache.org> wrote:
>>>>>> 
>>>>>>> LGTM +1
>>>>>>> 
>>>>>>> Btw you might need to request the permission to edit the incubator
>>>> wiki.
>>>>>>> You can send an email to general@i.a.o to ask for the permission.
>>>>>>> 
>>>>>>> Sijie
>>>>>>> 
>>>>>>> On Tuesday, September 6, 2016, Khurrum Nasim <
>> khurrumnas...@gmail.com>
>>>>>>> wrote:
>>>>>>> 
>>>>>>>> DistributedLog
>>>>>>>> 
>>>>>>>> DistributedLog (DL) is a high-performance, replicated log service,
>>>>>>> offering
>>>>>>>> durability, replication and strong consistency as essentials for
>>>>>>> building
>>>>>>>> reliable distributed systems.
>>>>>>>> 
>>>>>>>> Three most important issues to address in the move towards
>>>> graduation:
>>>>>>>> * Getting an Apache release out
>>>>>>>> * Improve general documentation
>>>>>>>> * Grow user base
>>>>>>>> 
>>>>>>>> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to
>> be
>>>>>>> aware
>>>>>>>> of?
>>>>>>>> There is currently no issue.
>>>>>>>> 
>>>>>>>> How has the community developed since the last report?
>>>>>>>> * A few people began actively to involve in the project discussion
>>>>>>>> * Some project ideas have been initiated and discussed on the
>> mailing
>>>>>>> list
>>>>>>>> 
>>>>>>>> How has the project developed since the last report?
>>>>>>>> * The wiki has been filled up with development and contribution
>>>>>>>> information.
>>>>>>>> * The existing website content has been pushed to asf-site branch
>> and
>>>>>>> live
>>>>>>>> under http://distributedlog.incubator.apache.org. The new website
>>>> has
>>>>>>> been
>>>>>>>> discussed.
>>>>>>>> * The pom file was updated to follow Apache's principle and the
>>>> status
>>>>>>> page
>>>>>>>> is updated.
>>>>>>>> * Various project ideas are under developing.
>>>>>>>> 
>>>>>>>> 
>>>>>>>> - KN
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 
>>> 
>> 
>> 

First release?

[Flavio Junqueira]

No pressure, really, but I was wondering what the plan for the first release 
is. Better to do a first release sooner than later. You already have a working 
system so it is mostly about sorting out any issues related to releasing in 
Apache.

-Flavio

Re: [draft] Podling report for August 2016

[Flavio Junqueira]

Thanks for putting this together, Franck. A few things that might be worth 
adding:

- Status page is up and we have started filling it out
- Most accounts of initial committers have been created
- Jira queue has been created
- Repository has been created

-Flavio

> On 28 Jul 2016, at 19:19, Chris Nauroth  wrote:
> 
> Hello Franck,
> 
> Thank you for writing the draft.  This looks good to me.  My only 
> recommendation is to add one more bullet point under project development to 
> state that the SGA from Twitter has been completed.
> 
> --Chris Nauroth
> 
> On 7/28/16, 11:12 AM, "Franck Cuny"  wrote:
> 
>Here's a draft of the report. Please review and comment, and I'll update
>the incubator wiki page in the next couple of days.
> 
>Thanks
> 
>---
> 
>DistributedLog
> 
>DistributedLog (DL) is a high-performance, replicated log service, offering
>durability, replication and strong consistency as essentials for building
>reliable distributed systems.
> 
>Three most important issues to address in the move towards graduation:
>* Getting an Apache release out
>* Improve general documentation
>* Grow user base
> 
>Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
>of?
>There is currently no issue.
> 
>How has the community developed since the last report?
>* A few people have started to report issues
> 
>How has the project developed since the last report?
>* The wiki has been set up
>* Existing issues have been migrated from the old GitHub repository to JIRA
>* A few contributions were made to the repository on GitHub and are in the
>process of being merged
>* Various mailing lists have been set up
> 
> 

Re: Board Report?

[Flavio Junqueira]

Hi John,

It looks like folks want to submit the report this month, Sijie copied here is 
working on one and will update it.

-Flavio

> On 10 Jul 2016, at 16:46, Flavio Junqueira <f...@apache.org> wrote:
> 
> Twitter is still working on the SGA, so moving to group 2 sounds like a good 
> option.
> 
> -Flavio
> 
>> On 09 Jul 2016, at 16:23, John D. Ament <johndam...@apache.org> wrote:
>> 
>> DistributedLog,
>> 
>> Do you plan to submit a board report this month?  If not, I will move you
>> to reporting group 2 and monthly August -> October instead of July.
>> 
>> John
> 

Re: [DRAFT] DistributedLog Report

[Flavio Junqueira]

That's fine for me, the formatting is a bit broken, though.

-Flavio

> On 11 Jul 2016, at 07:21, Sijie Guo <si...@apache.org> wrote:
> 
> Hello all,
> 
> Below is the draft of incubator report for DistributedLog. Let me know
> if it looks good.
> 
> 
> ---
> 
> DistributedLogDistributedLog is a high-performance replicated log
> service. It offersdurability, replication and strong consistency,
> which provides a fundamentalbuilding block for building reliable
> distributed systems.DistributedLog has been incubating since
> 2016-06-24.Three most important issues to address in the move towards
> graduation:  1. Establish the project at the ASF, including moving
> code, wiki, website and such.
>  2. Make initial Apache branded release and release on a regular schedule.
>  3. Attract more contributions. Reach a bigger community.  Any issues
> that the Incubator PMC (IPMC) or ASF Board wish/need to beaware of?
> 
> None How has the community developed since the last report?
> We just setup the dev mail list. We will start development discussions
> in the mail list.How has the project developed since the last report?
> 
> We setup the mail lists, and are moving the repo from GitHub to apache
> but waiting for Twitter's SGA. Date of last release:
> N/AWhen were the last committers or PMC members elected?
> N/ASigned-off-by:  [ ](distributedlog) Flavio Junqueira  [
> ](distributedlog) Chris Nauroth  [ ](distributedlog) Henry
> SaputraShepherd/Mentor notes:
> 
> - Sijie