Re: Incubator Workshop

2018-09-09 Thread Yaniv Rodenski
Hi Justin,

I think an online version would be really helpful.
As for the self-paced version, I think just making the recording available
later should be enough.

Cheers,
Yaniv

On Mon, 10 Sep 2018 at 10:30 am, Justin Mclean 
wrote:

> Hi,
>
> A few month back I ran an incubator workshop at FOSS backstage that
> covered making and voting on releases and voting on committers into the
> projects. It had several exercises
>
> Would anyone be interested in either a:
> 1) Online self-paced version
> 2) Online live version (i.e. me going through it) with Q+A at the end.
> This could be recorded and put up for other to watch after it’s taken place.
>
> Now I’m probably talking to the wrong audience here, and this email might
> be better if it was sent out to podlings dev lists, and in particular ones
> new to the incubator? If the mentors of  those prolongs think it would be
> of interest please forward this email.
>
> The workshop didn’t cover entry into graduation, naming, IP clearance,
> trademarks, branding or graduation process. Which I’d like to expand on and
> it would be great to have some help on producing content for that.
>
> Thanks,
> Justin

-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


[ANNOUNCE] Apache Amaterasu (incubating) 0.2.0-incubating released

2018-07-11 Thread Yaniv Rodenski
Hi All,

We are pleased to announce that Apache Amaterasu (incubating) 0.2.0-incubating
is
released.

Apache Amaterasu is a configuration management and deployment framework for
Big Data Pipelines.

The release is available at:
http://amaterasu.incubator.apache.org/downloads.html

On behalf of the Amaterasu team,
Yaniv Rodenski


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc4)

2018-07-10 Thread Yaniv Rodenski
Thanks to all who voted!

The release has passed with the following IPMC votes:

+1 Jean-Baptiste Onofré (binding)
+1 Justin Mclean (binding)
+1 Davor Bonaci (binding)

The Vote Thread:
https://mail-archives.apache.org/mod_mbox/incubator-general/201807.mbox/%3CCAKm_3C3-C6Fs2Qa7tZ5VGs3EoCEd_8gmi5QyDzxPbsvzf4nNNg%40mail.gmail.com%3E

We will be publishing the release shortly and send the announcement.

On behalf of the Apache Amaterasu community, thanks to everyone for helping
us in our first release in the incubator!

On Tue, Jul 10, 2018 at 4:32 AM Davor Bonaci  wrote:

> +1 (carried over)
>
> On Sun, Jul 8, 2018 at 12:15 AM, Justin Mclean 
> wrote:
>
> > Hi,
> >
> > +1 (binding)
> >
> > Sorry did this a while back but forgot to send
> >
> > I checked:
> > - incubating in name
> > - signatures and hashes correct
> > - DISCLAIMER exists
> > - LICENSE is OK but could be improved
> > - NOTICE year needs updating
> > - no unexpected binary files
> > - all ASF source files have correct headers
> > - can compile from source
> >
> > For the license it would be nice to mention the version of the bundled
> > software and what the license is rather than just pointing to the license
> > file.Also the license files pointed to also contain multiple licenses
> which
> > is a little surprising, it’s may be better to put that info in the
> LICENSE
> > file an/or only have a single license per file.
> >
> > The source release also contains multiple archives [2][3][4][5] which
> > makes it harder to review, could these be expanded in the release?
> >
> > Thanks,
> > Justin
> >
> > 1. incubator-amaterasu-version-0.2.0-incubating-rc4 <
> > http://localhost:8081/repo/?mod=license=2=6>/executor <
> > http://localhost:8081/repo/?mod=license=2=54>/src <
> > http://localhost:8081/repo/?mod=license=2=56>/main <
> > http://localhost:8081/repo/?mod=license=2=57>/resources <
> > http://localhost:8081/repo/?mod=license=2=58>/codegen.py
> > 2. incubator-amaterasu-version-0.2.0-incubating-rc4/executor/
> > src/test/resources/py4j-0.10.4-src.zip
> > 3. incubator-amaterasu-version-0.2.0-incubating-rc4/executor/
> > src/test/resources/py4j.tar.gz
> > 4. incubator-amaterasu-version-0.2.0-incubating-rc4/executor/
> > src/test/resources/pyspark.tar.gz
> > 5. incubator-amaterasu-version-0.2.0-incubating-rc4/executor/
> > src/test/resources/pyspark.zip
>


-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc4)

2018-07-07 Thread Yaniv Rodenski
Hi All,

Just a reminder, we are still in need for reviews/votes.

Thanks in advance,
Yaniv

On Thu, 5 Jul 2018 at 10:01 am, Yaniv Rodenski  wrote:

> Hi all,
>
> Just bumping this thread, we are still in need of reviews/votes.
>
> Thanks in advance,
> Yaniv
>
>
> On Sun, Jul 1, 2018 at 3:08 PM, Yaniv Rodenski  wrote:
>
>> Hi All,
>>
>> The Apache Amaterasu (incubating) community has voted on and approved a
>> proposal to release Apache Amaterasu 0.2.0-rc4.
>>
>> We now kindly request that the Incubator PMC members review and vote on
>> this incubator release candidate.
>>
>> Apache Amaterasu is a Configuration Managment and Deployment
>> Framework for Big Data Pipelines.
>>
>> The vote thread is available at:
>>
>> https://lists.apache.org/thread.html/4e57fefc663bf9458440bd2d77255f11f1296cf3b029f39414a8af15@%3Cdev.amaterasu.apache.org%3E
>>
>>
>> and the result is available at:
>>
>> https://lists.apache.org/thread.html/67977aef91a0fc947b2b1c2a87196a0a99704c9747b04da7178da566@%3Cdev.amaterasu.apache.org%3E
>>
>>
>> This is the first incubator release and it includes much-awaited
>> improvements such as YARN support, PySpark and SparkSQL support and
>> stability improvements.
>> In addition, RC4 fixed the issues that ware detected in RC3 during the
>> previous vote.
>>
>> All distribution packages, including signatures, digests, etc. can be
>> found at:
>> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/0.2.0rc4/
>>
>>
>> This release has been signed with PGP key corresponding to
>> ya...@apache.org, which is included in the repository's KEYS file (
>> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/KEYS).
>>
>> The release candidate has been tagged in git with
>> version-0.2.0-incubating-rc4:
>>
>> https://github.com/apache/incubator-amaterasu/releases/tag/version-0.2.0-incubating-rc4
>>
>> Please review and vote. The vote will be open for at least 72 hours.
>>
>> Thank you very much,
>> Yaniv
>>
>>
>
>
> --
> Yaniv Rodenski
>
> +61 477 778 405
> ya...@shinto.io
>
> --
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc4)

2018-07-04 Thread Yaniv Rodenski
Hi all,

Just bumping this thread, we are still in need of reviews/votes.

Thanks in advance,
Yaniv


On Sun, Jul 1, 2018 at 3:08 PM, Yaniv Rodenski  wrote:

> Hi All,
>
> The Apache Amaterasu (incubating) community has voted on and approved a
> proposal to release Apache Amaterasu 0.2.0-rc4.
>
> We now kindly request that the Incubator PMC members review and vote on
> this incubator release candidate.
>
> Apache Amaterasu is a Configuration Managment and Deployment Framework for
> Big Data Pipelines.
>
> The vote thread is available at:
> https://lists.apache.org/thread.html/4e57fefc663bf9458440bd2d77255f
> 11f1296cf3b029f39414a8af15@%3Cdev.amaterasu.apache.org%3E
>
> and the result is available at:
> https://lists.apache.org/thread.html/67977aef91a0fc947b2b1c2a87196a
> 0a99704c9747b04da7178da566@%3Cdev.amaterasu.apache.org%3E
>
> This is the first incubator release and it includes much-awaited
> improvements such as YARN support, PySpark and SparkSQL support and
> stability improvements.
> In addition, RC4 fixed the issues that ware detected in RC3 during the
> previous vote.
>
> All distribution packages, including signatures, digests, etc. can be
> found at:
> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/0.2.0rc4/
>
>
> This release has been signed with PGP key corresponding to
> ya...@apache.org, which is included in the repository's KEYS file (
> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/KEYS).
>
> The release candidate has been tagged in git with
> version-0.2.0-incubating-rc4:
> https://github.com/apache/incubator-amaterasu/releases/
> tag/version-0.2.0-incubating-rc4
>
> Please review and vote. The vote will be open for at least 72 hours.
>
> Thank you very much,
> Yaniv
>
>


-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


[VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc4)

2018-06-30 Thread Yaniv Rodenski
Hi All,

The Apache Amaterasu (incubating) community has voted on and approved a
proposal to release Apache Amaterasu 0.2.0-rc4.

We now kindly request that the Incubator PMC members review and vote on
this incubator release candidate.

Apache Amaterasu is a Configuration Managment and Deployment Framework for
Big Data Pipelines.

The vote thread is available at:
https://lists.apache.org/thread.html/4e57fefc663bf9458440bd2d77255f11f1296cf3b029f39414a8af15@%3Cdev.amaterasu.apache.org%3E


and the result is available at:
https://lists.apache.org/thread.html/67977aef91a0fc947b2b1c2a87196a0a99704c9747b04da7178da566@%3Cdev.amaterasu.apache.org%3E


This is the first incubator release and it includes much-awaited
improvements such as YARN support, PySpark and SparkSQL support and
stability improvements.
In addition, RC4 fixed the issues that ware detected in RC3 during the
previous vote.

All distribution packages, including signatures, digests, etc. can be
found at:
https://dist.apache.org/repos/dist/dev/incubator/amaterasu/0.2.0rc4/


This release has been signed with PGP key corresponding to
ya...@apache.org, which is included in the repository's KEYS file (
https://dist.apache.org/repos/dist/dev/incubator/amaterasu/KEYS).

The release candidate has been tagged in git with version-0.2.0-incubating-
rc4:
https://github.com/apache/incubator-amaterasu/releases/tag/version-0.2.0-incubating-rc4

Please review and vote. The vote will be open for at least 72 hours.

Thank you very much,
Yaniv


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)

2018-06-20 Thread Yaniv Rodenski
Hi Justin,

While some of the issues are fixed in the correct branch (as we,
unfortunately, packaged the wrong code with the release) I'm fixing some of
the license issues you have found and have a couple of questions:

1. The gradle-wrapper.jar is a part of the standard Gradle project
structure, and a quick search showed me that that other projects, such as
Apache Beam do include it in their source releases. Do we need to do
something specific to have an approval for gradle-wrapper.jar?
2. we use both PySpark and py4j in our integration tests (which we plan to
remove in one of our next releases), which account for the majority of the
files you have specified. Do we need to include a license for every
sub-component of those, or a general one is enough? If so, PySpark is an
Apache project so I believe no additional license is needed, is that
correct?

Thanks in advance,
Yaniv

On Wed, Jun 20, 2018 at 1:28 PM, Justin Mclean 
wrote:

> Hi,
>
> Sorry but it’s -1 binding as there compiled code in the source release and
> some software is of an unknown license
>
> I checked:
> - incubating name
> - signatures and hashes correct
> - DISCLAIMER exists
> - LICENSE is missing a number of things
> - NOTICE has incorrect year
> - a number of source files are missing ASF headers
> - there is an unexpected binary files in the source release [1]
> - can compile from source
>
> LICENSE is missing license for these bundled files:
> - Python license files [2][4]
> - BSD license files [3][7][8]
> - these files of unknown license [5][6]
>
> The MIT licensed file mentioned in LICENSE seems to be missing.
>
> Thanks,
> Justin
>
> 1. incubator-amaterasu-version-0.2.0-incubating-rc3/gradle/
> wrapper/gradle-wrapper.jar
> 2. executor/src/test/resources/py4j-0.10.4-src.zip/py4j/backport.py
> 3. executor/src/main/resources/codegen.py
> 4. executor/src/test/resources/pyspark.tar.gz/pyspark.tar/
> pyspark/heapq3.py
> 5. executor/src/test/resources/py4j-0.10.4-src.zip/py4j/
> tests/memory_leak_test.py
> 6  executor/src/test/resources/py4j.tar.gz/py4j.tar/py4j/protocol.py
> 7. executor/src/test/resources/pyspark.tar.gz/pyspark.tar/
> pyspark/cloudpickle.py
> 8 executor/src/test/resources/pyspark.tar.gz/pyspark.tar/pyspark/join.py
>
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


[VOTE][CANCEL]: Release Apache Amaterasu (incubating) 0.2.0 (rc3)

2018-06-19 Thread Yaniv Rodenski
Hi All,

We will cancel this vote and release a new RC.

Thanks everyone,
-- 
Yaniv Rodenski


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)

2018-06-19 Thread Yaniv Rodenski
Thanks Justin,

The keys ware invalidated and deleted the moment we have spotted them in
the repository.
However, I just took a deeper look and it seems that the sources released
are from our master branch and not the RC branch, hence the deleted keys so
I believe a new RC is needed.
Both our binaries and sources are packaged by our release build, we will
fix it and restart the voting process.

Thanks again everyone,
Yaniv

On Wed, Jun 20, 2018 at 12:52 PM, Justin Mclean  wrote:

> Hi,
>
> > However, this key is a private key added by mistake by one of our
> > contributors and belonged to him (and since was decommissioned). In this
> > situation, is this a blocking issue? If so, we will release a new RC and
> > restart the voting.
>
>
> IMO given the key is no longer valid I don't see any issue or need to make
> another RC. It can be removed in the next release.
>
> Thanks,
> Justin
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)

2018-06-19 Thread Yaniv Rodenski
Hi Willem,

Thanks for that, this is really strange as the key was deleted from the
source a while back and is not there in the repository (I've just double
verified looking at the git repo). I will investigate why it does come out
in the source tar.gz file.

However, this key is a private key added by mistake by one of our
contributors and belonged to him (and since was decommissioned). In this
situation, is this a blocking issue? If so, we will release a new RC and
restart the voting.

Thanks in advance,
Yaniv

On Wed, Jun 20, 2018 at 11:45 AM, Willem Jiang 
wrote:

> Hi Yaniv,
>
> I just checked the source tar, it has the ama-key and ama-key.pub.
> I'm not sure what's ama key used to.
> We normally don't ship any public key in the release kit, and should never
> ship private key in the release kit,
>
>
>
> Willem Jiang
>
> Twitter: willemjiang
> Weibo: 姜宁willem
>
> On Tue, Jun 19, 2018 at 7:58 AM, Yaniv Rodenski  wrote:
>
> > Hi all,
> >
> > Just a kind reminder that we are still in need for reviews/votes, if
> anyone
> > else can help with the vote, that would be lovely.
> >
> > Thanks in advance
> > Yaniv
> >
> > On Tue, 19 Jun 2018 at 12:56 am, Davor Bonaci  wrote:
> >
> > > +1 (binding), carried over.
> > >
> > > On Thu, Jun 14, 2018 at 9:37 PM, Yaniv Rodenski 
> wrote:
> > >
> > > > Hi,
> > > >
> > > > I've removed the md5's, and will update the Amaterasu release
> procedure
> > > > accordingly.
> > > >
> > > > Cheers,
> > > > Yaniv
> > > >
> > > > On Fri, Jun 15, 2018 at 1:04 AM, Henk P. Penning 
> > wrote:
> > > >
> > > > > On Thu, 14 Jun 2018, Yaniv Rodenski wrote:
> > > > >
> > > > > Date: Thu, 14 Jun 2018 16:32:19 +0200
> > > > >> From: Yaniv Rodenski 
> > > > >> To: general@incubator.apache.org
> > > > >> Subject: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)
> > > > >>
> > > > >
> > > > >   Please remove the .md5's ; see policy :
> > > > >
> > > > > https://www.apache.org/dev/release-distribution#sigs-and-sums
> > > > >
> > > > >   This does NOT affect the VOTE ; please continue ...
> > > > >
> > > > >   Regards,
> > > > >
> > > > >   Henk Penning
> > > > >
> > > > >    _
> > > > > Henk P. Penning, ICT-beta R Uithof MG-403_/ \_
> > > > > Faculty of Science, Utrecht UniversityT +31 30 253 4106 / \_/ \
> > > > > Leuvenlaan 4, 3584CE Utrecht, NL  F +31 30 253 4553 \_/ \_/
> > > > > http://www.staff.science.uu.nl/~penni101/ M penn...@uu.nl \_/
> > > > >
> > > > >
> > > > > The Apache Amaterasu (incubating) community has voted on and
> > approved a
> > > > >> proposal to release Apache Amaterasu 0.2.0-rc3.
> > > > >>
> > > > >> We now kindly request that the Incubator PMC members review and
> vote
> > > on
> > > > >> this incubator release candidate.
> > > > >>
> > > > >> Apache Amaterasu is a Configuration Managment and Deployment
> > Framework
> > > > for
> > > > >> Big Data Pipelines.
> > > > >>
> > > > >> The vote thread is at:
> > > > >> http://mail-archives.apache.org/mod_mbox/amaterasu-dev/20180
> > > > >> 5.mbox/%3CCAKm_
> > > > >> 3C0qT7pYPjZm_C4JRiruQasW6be2F1xLx%2Bf2zfQvxBWJTA%40mail.gmail.com
> > %3E
> > > > >>
> > > > >> and the result is at:
> > > > >> http://mail-archives.apache.org/mod_mbox/amaterasu-dev/20180
> > > > >> 6.mbox/%3CCAKm_3C1qYgM9%3DaOxt7JNo4R23UvoeP%3DhUi7GQpiVEc5Ad
> > > > >> vAwMg%40mail.gmail.com%3E
> > > > >>
> > > > >>
> > > > >> This is the first incubator release and it includes much-awaited
> > > > >> improvements such as YARN support, PySpark and SparkSQL support
> and
> > > > >> stability improvements.
> > > > >>
> > > > >> All distribution packages, including signatures, digests, etc. can
> > be
> > > > >> found at:
> > > > >>
> > > > >> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/
> > 0.2.0rc3/
> > > > >>
> > > > >>
> > > > >> This release has been signed with PGP key corresponding to
> > > > >> ya...@apache.org, which is included in the repository's KEYS
> file (
> > > > >> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/KEYS).
> > > > >>
> > > > >> The release candidate has been tagged in git with
> > > > >> version-0.2.0-incubating-rc3:
> > > > >> https://github.com/apache/incubator-amaterasu/releases/tag/
> > > > >> version-0.2.0-incubating-rc3
> > > > >>
> > > > >> Please review and vote. The vote will be open for at least 72
> hours.
> > > > >>
> > > > >> Thank you very much,
> > > > >> Yaniv
> > > > >>
> > > > >>
> > > > > 
> > -
> > > > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > > > > For additional commands, e-mail: general-h...@incubator.apache.org
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Yaniv Rodenski
> > > >
> > > > +61 477 778 405
> > > > ya...@shinto.io
> > > >
> > >
> > --
> > Yaniv Rodenski
> >
> > +61 477 778 405
> > ya...@shinto.io
> >
>



-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)

2018-06-18 Thread Yaniv Rodenski
Hi all,

Just a kind reminder that we are still in need for reviews/votes, if anyone
else can help with the vote, that would be lovely.

Thanks in advance
Yaniv

On Tue, 19 Jun 2018 at 12:56 am, Davor Bonaci  wrote:

> +1 (binding), carried over.
>
> On Thu, Jun 14, 2018 at 9:37 PM, Yaniv Rodenski  wrote:
>
> > Hi,
> >
> > I've removed the md5's, and will update the Amaterasu release procedure
> > accordingly.
> >
> > Cheers,
> > Yaniv
> >
> > On Fri, Jun 15, 2018 at 1:04 AM, Henk P. Penning  wrote:
> >
> > > On Thu, 14 Jun 2018, Yaniv Rodenski wrote:
> > >
> > > Date: Thu, 14 Jun 2018 16:32:19 +0200
> > >> From: Yaniv Rodenski 
> > >> To: general@incubator.apache.org
> > >> Subject: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)
> > >>
> > >
> > >   Please remove the .md5's ; see policy :
> > >
> > > https://www.apache.org/dev/release-distribution#sigs-and-sums
> > >
> > >   This does NOT affect the VOTE ; please continue ...
> > >
> > >   Regards,
> > >
> > >   Henk Penning
> > >
> > >    _
> > > Henk P. Penning, ICT-beta R Uithof MG-403_/ \_
> > > Faculty of Science, Utrecht UniversityT +31 30 253 4106 / \_/ \
> > > Leuvenlaan 4, 3584CE Utrecht, NL  F +31 30 253 4553 \_/ \_/
> > > http://www.staff.science.uu.nl/~penni101/ M penn...@uu.nl \_/
> > >
> > >
> > > The Apache Amaterasu (incubating) community has voted on and approved a
> > >> proposal to release Apache Amaterasu 0.2.0-rc3.
> > >>
> > >> We now kindly request that the Incubator PMC members review and vote
> on
> > >> this incubator release candidate.
> > >>
> > >> Apache Amaterasu is a Configuration Managment and Deployment Framework
> > for
> > >> Big Data Pipelines.
> > >>
> > >> The vote thread is at:
> > >> http://mail-archives.apache.org/mod_mbox/amaterasu-dev/20180
> > >> 5.mbox/%3CCAKm_
> > >> 3C0qT7pYPjZm_C4JRiruQasW6be2F1xLx%2Bf2zfQvxBWJTA%40mail.gmail.com%3E
> > >>
> > >> and the result is at:
> > >> http://mail-archives.apache.org/mod_mbox/amaterasu-dev/20180
> > >> 6.mbox/%3CCAKm_3C1qYgM9%3DaOxt7JNo4R23UvoeP%3DhUi7GQpiVEc5Ad
> > >> vAwMg%40mail.gmail.com%3E
> > >>
> > >>
> > >> This is the first incubator release and it includes much-awaited
> > >> improvements such as YARN support, PySpark and SparkSQL support and
> > >> stability improvements.
> > >>
> > >> All distribution packages, including signatures, digests, etc. can be
> > >> found at:
> > >>
> > >> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/0.2.0rc3/
> > >>
> > >>
> > >> This release has been signed with PGP key corresponding to
> > >> ya...@apache.org, which is included in the repository's KEYS file (
> > >> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/KEYS).
> > >>
> > >> The release candidate has been tagged in git with
> > >> version-0.2.0-incubating-rc3:
> > >> https://github.com/apache/incubator-amaterasu/releases/tag/
> > >> version-0.2.0-incubating-rc3
> > >>
> > >> Please review and vote. The vote will be open for at least 72 hours.
> > >>
> > >> Thank you very much,
> > >> Yaniv
> > >>
> > >>
> > > -
> > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > > For additional commands, e-mail: general-h...@incubator.apache.org
> > >
> > >
> >
> >
> > --
> > Yaniv Rodenski
> >
> > +61 477 778 405
> > ya...@shinto.io
> >
>
-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


Re: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)

2018-06-14 Thread Yaniv Rodenski
Hi,

I've removed the md5's, and will update the Amaterasu release procedure
accordingly.

Cheers,
Yaniv

On Fri, Jun 15, 2018 at 1:04 AM, Henk P. Penning  wrote:

> On Thu, 14 Jun 2018, Yaniv Rodenski wrote:
>
> Date: Thu, 14 Jun 2018 16:32:19 +0200
>> From: Yaniv Rodenski 
>> To: general@incubator.apache.org
>> Subject: [VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)
>>
>
>   Please remove the .md5's ; see policy :
>
> https://www.apache.org/dev/release-distribution#sigs-and-sums
>
>   This does NOT affect the VOTE ; please continue ...
>
>   Regards,
>
>   Henk Penning
>
>    _
> Henk P. Penning, ICT-beta R Uithof MG-403_/ \_
> Faculty of Science, Utrecht UniversityT +31 30 253 4106 / \_/ \
> Leuvenlaan 4, 3584CE Utrecht, NL  F +31 30 253 4553 \_/ \_/
> http://www.staff.science.uu.nl/~penni101/ M penn...@uu.nl \_/
>
>
> The Apache Amaterasu (incubating) community has voted on and approved a
>> proposal to release Apache Amaterasu 0.2.0-rc3.
>>
>> We now kindly request that the Incubator PMC members review and vote on
>> this incubator release candidate.
>>
>> Apache Amaterasu is a Configuration Managment and Deployment Framework for
>> Big Data Pipelines.
>>
>> The vote thread is at:
>> http://mail-archives.apache.org/mod_mbox/amaterasu-dev/20180
>> 5.mbox/%3CCAKm_
>> 3C0qT7pYPjZm_C4JRiruQasW6be2F1xLx%2Bf2zfQvxBWJTA%40mail.gmail.com%3E
>>
>> and the result is at:
>> http://mail-archives.apache.org/mod_mbox/amaterasu-dev/20180
>> 6.mbox/%3CCAKm_3C1qYgM9%3DaOxt7JNo4R23UvoeP%3DhUi7GQpiVEc5Ad
>> vAwMg%40mail.gmail.com%3E
>>
>>
>> This is the first incubator release and it includes much-awaited
>> improvements such as YARN support, PySpark and SparkSQL support and
>> stability improvements.
>>
>> All distribution packages, including signatures, digests, etc. can be
>> found at:
>>
>> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/0.2.0rc3/
>>
>>
>> This release has been signed with PGP key corresponding to
>> ya...@apache.org, which is included in the repository's KEYS file (
>> https://dist.apache.org/repos/dist/dev/incubator/amaterasu/KEYS).
>>
>> The release candidate has been tagged in git with
>> version-0.2.0-incubating-rc3:
>> https://github.com/apache/incubator-amaterasu/releases/tag/
>> version-0.2.0-incubating-rc3
>>
>> Please review and vote. The vote will be open for at least 72 hours.
>>
>> Thank you very much,
>> Yaniv
>>
>>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


-- 
Yaniv Rodenski

+61 477 778 405
ya...@shinto.io


[VOTE] Release Apache Amaterasu (incubating) 0.2.0 (rc3)

2018-06-14 Thread Yaniv Rodenski
Hi All,

The Apache Amaterasu (incubating) community has voted on and approved a
proposal to release Apache Amaterasu 0.2.0-rc3.

We now kindly request that the Incubator PMC members review and vote on
this incubator release candidate.

Apache Amaterasu is a Configuration Managment and Deployment Framework for
Big Data Pipelines.

The vote thread is at:
http://mail-archives.apache.org/mod_mbox/amaterasu-dev/201805.mbox/%3CCAKm_
3C0qT7pYPjZm_C4JRiruQasW6be2F1xLx%2Bf2zfQvxBWJTA%40mail.gmail.com%3E

and the result is at:
http://mail-archives.apache.org/mod_mbox/amaterasu-dev/201806.mbox/%3CCAKm_3C1qYgM9%3DaOxt7JNo4R23UvoeP%3DhUi7GQpiVEc5AdvAwMg%40mail.gmail.com%3E


This is the first incubator release and it includes much-awaited
improvements such as YARN support, PySpark and SparkSQL support and
stability improvements.

All distribution packages, including signatures, digests, etc. can be
found at:

https://dist.apache.org/repos/dist/dev/incubator/amaterasu/0.2.0rc3/


This release has been signed with PGP key corresponding to
ya...@apache.org, which is included in the repository's KEYS file (
https://dist.apache.org/repos/dist/dev/incubator/amaterasu/KEYS).

The release candidate has been tagged in git with
version-0.2.0-incubating-rc3:
https://github.com/apache/incubator-amaterasu/releases/tag/version-0.2.0-incubating-rc3

Please review and vote. The vote will be open for at least 72 hours.

Thank you very much,
Yaniv


Re: Wiki user might be locked

2017-12-27 Thread Yaniv Rodenski
Thanks John,
Will do

On Thu, 28 Dec 2017 at 2:25 pm, John D. Ament <johndam...@apache.org> wrote:

> I would recommend putting in a ticket w/ infra.
>
> John
>
> On Wed, Dec 27, 2017 at 9:57 PM Yaniv Rodenski <roa...@gmail.com> wrote:
>
> > Hi John,
> >
> > Yes, my username is YanivRodenski
> >
> >
> >
> > On Thu, Dec 28, 2017 at 1:22 PM, John D. Ament <john.d.am...@gmail.com>
> > wrote:
> >
> > > Yaniv,
> > >
> > > What is your wiki username?
> > >
> > > Note that the moin moin wikis are not tied to LDAP, so your ASF
> username
> > > may not match what is in the wiki.
> > >
> > > I do see one potential account, it's your first and last name
> > concatenated.
> > >
> > > John
> > >
> > > On Wed, Dec 27, 2017 at 8:09 PM Yaniv Rodenski <roa...@gmail.com>
> wrote:
> > >
> > > > Hi All,
> > > >
> > > > I'm trying to login to the incubator wiki but getting Invalid
> username
> > or
> > > > password for some reason. I've also tried to reset my password but I
> > > didn't
> > > > receive the reset email so @Davor our mentor suggested the account
> > might
> > > be
> > > > locked.
> > > >
> > > > can anyone have a look and see what's wrong with my account?
> > > >
> > > > Thanks
> > > > Yaniv
> > > >
> > >
> >
>


Re: Wiki user might be locked

2017-12-27 Thread Yaniv Rodenski
Hi John,

Yes, my username is YanivRodenski



On Thu, Dec 28, 2017 at 1:22 PM, John D. Ament <john.d.am...@gmail.com>
wrote:

> Yaniv,
>
> What is your wiki username?
>
> Note that the moin moin wikis are not tied to LDAP, so your ASF username
> may not match what is in the wiki.
>
> I do see one potential account, it's your first and last name concatenated.
>
> John
>
> On Wed, Dec 27, 2017 at 8:09 PM Yaniv Rodenski <roa...@gmail.com> wrote:
>
> > Hi All,
> >
> > I'm trying to login to the incubator wiki but getting Invalid username or
> > password for some reason. I've also tried to reset my password but I
> didn't
> > receive the reset email so @Davor our mentor suggested the account might
> be
> > locked.
> >
> > can anyone have a look and see what's wrong with my account?
> >
> > Thanks
> > Yaniv
> >
>


Wiki user might be locked

2017-12-27 Thread Yaniv Rodenski
Hi All,

I'm trying to login to the incubator wiki but getting Invalid username or
password for some reason. I've also tried to reset my password but I didn't
receive the reset email so @Davor our mentor suggested the account might be
locked.

can anyone have a look and see what's wrong with my account?

Thanks
Yaniv


Write access to Incubator Wiki

2017-10-29 Thread Yaniv Rodenski
Hi,

Can I please have access to the incubator wiki to post reports on Amaterasu?
My username is YanivRodensky, my email is ya...@apache.org

Thanks in advance,
Yaniv


Re: [VOTE] Accept Amaterasu into the Apache Incubator

2017-04-19 Thread Yaniv Rodenski
+1 non-binding

We are very happy with both of them :) but if anyone wants to join that
would be great too.

On Wed, 19 Apr 2017 at 7:35 pm, Bertrand Delacretaz <
bdelacre...@codeconsult.ch> wrote:

> On Sun, Apr 16, 2017 at 8:20 PM, Jean-Baptiste Onofré 
> wrote:
> > ...following the discussion thread, I think we can start the vote on
> accepting
> > Amaterasu into the Apache Incubator...
>
> +1
>
> Having only two mentors is fine IMO if they are active.
>
> -Bertrand
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [DISCUSS] Apache Amaterasu Incubator Proposal

2017-03-28 Thread Yaniv Rodenski
dy in mind for many
> >> tools which are Apache projects, and we see Amaterasu as an extension
> >> of these projects. We hope that by being an Apache project, we can
> >> integrate better, and collaborate more effectively with the relevant
> >> projects. As Amaterasu matures, we see mutual benefits for all involved.
> >>
> >> === Initial Source ===
> >>
> >> https://github.com/shintoio/amaterasu
> >>
> >> === External Dependencies ===
> >>
> >> All external dependencies are licensed under an Apache 2.0 license or
> >> Apache-compatible license. As we grow the Amaterasu community we will
> >> configure our build process to require and validate all contributions
> >> and dependencies are licensed under the Apache 2.0 license or are under
> an Apache-compatible license.
> >>
> >>  * Apache Spark
> >>  * Apache Hadoop
> >>  * Apache Maven (maven-core)
> >>  * Apache Commons
> >>  * Apache Log4j
> >>  * Apache Mesos
> >>  * Apache Zookeeper
> >>  * Apache Curator
> >>  * Scala
> >>  * Junit
> >>  * Py4j
> >>
> >> Future versions are planned to integrate with:
> >>
> >>  * Apache YARN
> >>  * Apache Hive
> >>  * Apache Drill
> >>
> >> === Required Resources ===
> >>
> >>  Mailing lists 
> >>
> >>  * priv...@amaterasu.incubator.apache.org (moderated subscriptions)
> >>  * comm...@amaterasu.incubator.apache.org
> >>  * d...@amaterasu.incubator.apache.org
> >>  * iss...@amaterasu.incubator.apache.org
> >>
> >>  Git Repository 
> >>
> >>  * https://git-wip-us.apache.org/repos/asf/incubator-amaterasu.git
> >>
> >>  Issue Tracking 
> >>
> >>  * JIRA Project Amaterasu
> >>
> >>  Initial Committers =
> >>
> >>  * Yaniv Rodenski
> >>  * Jean-Baptiste Onofré
> >>  * Eyal Ben Ivri
> >>  * Karel Alfonso
> >>  * Kirupagaran (Kirupa) Devarajan
> >>  * Nadav Har Tzvi
> >>
> >>  Affiliations 
> >>
> >>  * Yaniv Rodenski - Shinto
> >>  * Jean-Baptiste Onofré - Talend
> >>  * Olivier Lamy - Webtide
> >>
> >>  Sponsors 
> >>
> >>  Champion 
> >>
> >>  * Jean-Baptiste Onofré
> >>
> >>  Mentors 
> >>
> >>  * Jean-Baptiste Onofré
> >>  * Olivier Lamy
> >>
> >>  Sponsoring Entity 
> >>
> >> The Apache Incubator
> >>
> >
> > --
> > Jean-Baptiste Onofré
> > jbono...@apache.org
> > http://blog.nanthrax.net
> > Talend - http://www.talend.com
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > For additional commands, e-mail: general-h...@incubator.apache.org
> >
> >
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > For additional commands, e-mail: general-h...@incubator.apache.org
> >
>
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: Slack

2017-03-26 Thread Yaniv Rodenski
Hi JB,

A common practice/hack is to create a small web app that allows people to
send themselves invitations using the Slack API.
For example:
http://www.skill-space.com/blog/2015/11/16/create-an-auto-invite-channel-using-slack-heroku1

Cheers,
Yaniv


On Mon, 27 Mar 2017 at 3:40 pm, Jean-Baptiste Onofré 
wrote:

> Hi Wade,
>
> You are right: invite people on Slack means adding them as member.
>
> However, how can we accept Slack participants without inviting them ? Is it
> possible ?
>
> Thanks !
> Regards
> JB
>
> On 03/26/2017 07:05 PM, Wade Chandler wrote:
> > My understanding is there isn’t a max limit on Slack for users for free,
> and I have confirmed this with Slack there is not supposed to be a
> limitation on numbers of members. NetBeans for instance has 320 members.
> Did someone tell you this or did you run into some issue? If so, you might
> write them to ask what is the deal.. It could be the difference in setup;
> we use a registration page which sends invitations
> https://netbeans.signup.team/  and is
> using bots from https://stacktodo.com/  Or, it
> could be something about when it was setup and differences in plans over
> time.
> >
> > It doesn’t change the limits on the log and file storage, but we explain
> to folks it is for ephemeral real time communication and never to be
> considered historic, but we are looking into setting up a log bot which
> Slack personnel told us could also be helpful for OSS use. Slack said they
> don’t have plans for more features for OSS specific projects at the moment
> as one request from us was they make some new individual/personal low pay
> option which could help communities with dedicated membership to pay for
> their own personal use, but they said no plans at this time, but would take
> it into consideration as an idea.
> >
> > Thanks,
> >
> > Wade
> >
> >
> >> On Mar 26, 2017, at 01:58, Jean-Baptiste Onofré 
> wrote:
> >>
> >> Hi,
> >>
> >> Slack is very convenient for quick communication, but clearly, it
> doesn't change that the mailing list is the first communication channel. If
> discussions happen on Slack, minute notes/discussion has to be forwarded on
> the mailing list.
> >>
> >> I wonder if we plan to ask for some "pro" Slack account for Apache
> projects (as we have license for IntelliJ for example). Now, at Apache
> Beam, we reached the max capacity of the Slack free version (90 Slack users
> on Beam channel and limited history). We already received new member
> request that we can't accept for now.
> >>
> >> Thoughts ?
> >>
> >> Regards
> >> JB
> >>
> >> On 03/22/2017 10:37 PM, Craig Russell wrote:
> >>> Hi James,
> >>>
> >>> There was a pretty extensive discussion on the netbeans dev list. I’d
> encourage you to review this thread https://lists.apache.org/thread.html/
> 2dce365d03334c82d31b12c8b3dcad1a925a2f71af75658b8d8a5a07@%
> 3Cdev.netbeans.apache.org%3E
> >>>
> >>> You can get all of the messages in the thread by doing a quick search
> for “slack” on the d...@netbeans.apache.org list in lists.apache.org.
> >>>
> >>> My takeaway is that Slack not a substitute for email. But it is useful
> for ping-pong communication when people are in the heat of development.
> >>>
> >>> But no decisions are made on Slack, and any discussion there (aside
> from “add a semicolon there” and “let’s get lunch") needs to be brought
> back to the dev list.
> >>>
> >>> The underlying principle is that “if it didn’t happen on dev, then it
> didn’t happen”. We strive for open, inclusive communications at Apache and
> that means attempting to encourage participation by everyone who wants to,
> regardless of primary language, time zone, and availability of tools. (We
> assume everyone has a device that handles email clients).
> >>>
> >>> Hope this helps.
> >>>
> >>> Craig
> >>>
>  On Mar 22, 2017, at 1:27 PM, James Bognar 
> wrote:
> 
>  Can someone remind me?  I thought there was a discussion a couple of
> months
>  ago about allowing incubator projects to use Slack for
> communication.  What
>  was the final decision?
> >>>
> >>> Craig L Russell
> >>> c...@apache.org
> >>>
> >>>
> >>
> >
> >
>
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: Slack

2017-03-26 Thread Yaniv Rodenski
Hi,

Having a "pro" slack subscription will defiantly help projects that are
using it.

Also, Slack can integrate with the mailing list, for example using this app
https://get.slack.help/hc/en-us/articles/206819278-Send-emails-to-Slack, I
think that if nothing else, this can be seen as another form of a mail
client, from a "pure" mailing list point of view.

Cheers,
Yaniv

On Sun, 26 Mar 2017 at 4:58 pm, Jean-Baptiste Onofré 
wrote:

> Hi,
>
> Slack is very convenient for quick communication, but clearly, it doesn't
> change
> that the mailing list is the first communication channel. If discussions
> happen
> on Slack, minute notes/discussion has to be forwarded on the mailing list.
>
> I wonder if we plan to ask for some "pro" Slack account for Apache
> projects (as
> we have license for IntelliJ for example). Now, at Apache Beam, we reached
> the
> max capacity of the Slack free version (90 Slack users on Beam channel and
> limited history). We already received new member request that we can't
> accept
> for now.
>
> Thoughts ?
>
> Regards
> JB
>
> On 03/22/2017 10:37 PM, Craig Russell wrote:
> > Hi James,
> >
> > There was a pretty extensive discussion on the netbeans dev list. I’d
> encourage you to review this thread https://lists.apache.org/thread.html/
> 2dce365d03334c82d31b12c8b3dcad1a925a2f71af75658b8d8a5a07@%
> 3Cdev.netbeans.apache.org%3E
> >
> > You can get all of the messages in the thread by doing a quick search
> for “slack” on the d...@netbeans.apache.org list in lists.apache.org.
> >
> > My takeaway is that Slack not a substitute for email. But it is useful
> for ping-pong communication when people are in the heat of development.
> >
> > But no decisions are made on Slack, and any discussion there (aside from
> “add a semicolon there” and “let’s get lunch") needs to be brought back to
> the dev list.
> >
> > The underlying principle is that “if it didn’t happen on dev, then it
> didn’t happen”. We strive for open, inclusive communications at Apache and
> that means attempting to encourage participation by everyone who wants to,
> regardless of primary language, time zone, and availability of tools. (We
> assume everyone has a device that handles email clients).
> >
> > Hope this helps.
> >
> > Craig
> >
> >> On Mar 22, 2017, at 1:27 PM, James Bognar 
> wrote:
> >>
> >> Can someone remind me?  I thought there was a discussion a couple of
> months
> >> ago about allowing incubator projects to use Slack for communication.
> What
> >> was the final decision?
> >
> > Craig L Russell
> > c...@apache.org
> >
> >
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > For additional commands, e-mail: general-h...@incubator.apache.org
> >
>
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [DISCUSS] Apache Amaterasu Incubator Proposal

2017-03-07 Thread Yaniv Rodenski
Hi Liang,

Currently the deployment is really extracting the tar on a node that can be
access by the Mesos cluster and running a job (once you do that the Mesos
framework takes care of everything).
Next versions (especially once adding YARN support) we will have more
moving parts and we will make sure installation remains a simple process.

Cheers,
Yaniv


On Wed, Mar 8, 2017 at 1:30 PM, Liang Chen <chenliang6...@gmail.com> wrote:

> Hi Yaniv
>
> Thanks, i would find some time to try it.
>
> Is there any deployment UI from Amaterasu for easier using?
>
> Regards
> Liang
>
>
> Yaniv Rodenski wrote
> > Hi Liang,
> >
> > We are currently working on YARN support, but it's not quite there yet.
> >
> > What you can do at this point (as a workaround) is setup a single node
> > Mesos cluster and configure it to use your YARN cluster.
> >
> > If you would like to try that LMK, and I'll help you set it up (it's not
> > that straight forward).
> >
> > Cheers,
> > Yaniv
> >
> > On Wed, 8 Mar 2017 at 11:04 am, Liang Chen 
>
> > chenliang6136@
>
> >  wrote:
> >
> >> Hi
> >> Good luck!
> >> one question:If my system using YARN cluster, can i use Amaterasu for
> >> development?
> >>
> >> 
> --
> >> We have also created a Mesos cluster you can use to test Amaterasu or
> use
> >> for development purposes
> >>
> >> Regards
> >> Liang
> >>
> >> 2017-03-08 4:49 GMT+08:00 Jean-Baptiste Onofré 
>
> > jb@
>
> > :
> >>
> >> > Hi all,
> >> >
> >> > I would like to submit a new proposal to bring Amaterasu to the Apache
> >> > Software Foundation incubator.
> >> >
> >> > The proposal is included below and available on the wiki:
> >> >
> >> > https://wiki.apache.org/incubator/AmaterasuProposal
> >> >
> >> > We are eager to get your comments and questions.
> >> >
> >> > Thanks !
> >> > JB (on behalf of the Amaterasu community)
> >> >
> >> > = Apache Amaterasu =
> >> >
> >> > == Abstract ==
> >> >
> >> > Apache Amaterasu is a framework providing continuous deployment for
> Big
> >> > Data pipelines.
> >> >
> >> > It provides the following capabilities:
> >> >
> >> >  * '''Continuous integration''' tools to '''package pipelines and run
> >> > tests'''.
> >> >  * A repository to store those packaged applications: the
> >> '''applications
> >> > repository'''.
> >> >  * A repository to store the pipelines, and engine configuration (for
> >> > instance, location of the Spark master, etc.): per environment - the
> >> > '''configuration repository'''.
> >> >  * A '''dashboard''' to monitor the pipelines.
> >> >  * A '''DSL and integration hooks''' allowing third parties to easily
> >> > integrate.
> >> >
> >> > == Proposal ==
> >> >
> >> > Amaterasu is a simple and powerful framework to build and dispense
> >> > pipelines.  It aims to help data engineers and data scientists to
> >> compose,
> >> > configure, test, package, deploy and execute data pipelines written
> >> using
> >> > multiple tools, languages and frameworks. Amaterasu provides a
> standard
> >> > repo structure to package big data pipelines, a YAML based Domain
> >> Specific
> >> > Languages (DSL) for data engineers, data scientists and operations
> >> > engineers to manage complex pipelines throughout their entire
> lifecycle
> >> > (Dev, UAT, Prod, etc.).
> >> >
> >> > == Background ==
> >> >
> >> > Amaterasu is a relatively new project that was created to deal with
> >> some
> >> > of the issues that as Consultants, we have seen recurring at different
> >> > client sites. Mainly the need to continuously deploy complex pipelines
> >> > built in multiple tools and languages.
> >> > Amaterasu started as a pet project and is currently being evaluated by
> >> a
> >> > couple of organizations, supported by the contributors, on a personal
> >> time
> >> > and voluntary bases.
> >> >
> >> > == Rational ==
> >> >
> >> > As software engineers working on big data p

Re: [DISCUSS] Apache Amaterasu Incubator Proposal

2017-03-07 Thread Yaniv Rodenski
 to continue the development of Amaterasu, add new
> > features as well as  integrate better with other frameworks, including:
> >
> >  * Apache Arrow
> >  * Apache Hive
> >  * Apache Drill
> >  * Apache Beam
> >  * Apache YARN
> >  * Farther and more complete integration with Apache Spark
> >
> > Other frameworks will be evaluated after those initial goals are reached.
> >
> > == Current Status ==
> >
> > Amaterasu is preview state but provide a large set of features. We plan
> to
> > stabilize and head to a first production ready release during the
> > incubation process. The current license is already Apache 2.0.
> >
> > === Meritocracy ===
> >
> > We intend to radically expand the initial developer and user community by
> > running the project in accordance with the "Apache Way". Users and new
> > contributors will be treated with respect and welcomed. By participating
> in
> > the community and providing quality patches/support that move the project
> > forward, they will earn merit. They also will be encouraged to provide
> > non-code contributions (documentation, events, community management,
> etc.)
> > and will gain merit for doing so. Those with a proven support and quality
> > track record will be encouraged to become committers.
> >
> > === Community ===
> >
> > As a relatively new project, Amaterasu has a small, but growing
> community.
> > Amaterasu is an open project, not just with it’s source code but also
> with
> > our discussions which are held openly in our slack
> > https://shintoio.slack.com which contains channels for design, tech and
> > future directions discussions.
> >
> > If Amaterasu is accepted for incubation, the primary initial goal is to
> > build a large and strong community. We are confident that Amaterasu can
> > become a key project for big data operations, which hopefully will
> create a
> > large community of users and developers.
> >
> > === Known Risks ===
> >
> > Development has been sponsored mostly by a one company. For the project
> to
> > fully transition to the Apache Way governance model, development must
> shift
> > towards the meritocracy-centric model of growing a community of
> > contributors balanced with the needs for extreme stability and core
> > implementation coherency.
> >
> > === Orphaned products ===
> >
> > We are fully committed on Amaterasu. A few organizations have expressed
> > their interest in using Amaterasu.
> >
> > === Inexperience with Open Source ===
> >
> > We have been developing and using open source software for a long time.
> > Additionally, several ASF veterans have agreed to mentor the project and
> > they are listed in this proposal. The project will rely on their guidance
> > and collective wisdom to quickly transition the entire team of initial
> > committers towards practicing the Apache Way.
> >
> > === Reliance on Salaried Developers ===
> >
> > Most of the current contributors are employed in the Big Data space.
> While
> > they might wander from their current employers, they are unlikely to
> > venture far from their core expertises and thus will continue to be
> engaged
> > with the project regardless of their current employers.
> >
> > === An Excessive Fascination with the Apache Brand ===
> >
> > While we intend to leverage the Apache ‘branding’ when talking to other
> > projects as testament of our project’s ‘neutrality’, we have no plans for
> > making use of Apache brand in press releases nor posting billboards
> > advertising acceptance of Amaterasu into Apache Incubator.
> >
> > The main purpose in applying for Apache incubation is due to the fact
> that
> > Amaterasu is built with integration already in mind for many tools which
> > are Apache projects, and we see Amaterasu as an extension of these
> > projects. We hope that by being an Apache project, we can integrate
> better,
> > and collaborate more effectively with the relevant projects. As Amaterasu
> > matures, we see mutual benefits for all involved.
> >
> > === Initial Source ===
> >
> > https://github.com/shintoio/amaterasu
> >
> > === External Dependencies ===
> >
> > All external dependencies are licensed under an Apache 2.0 license or
> > Apache-compatible license. As we grow the Amaterasu community we will
> > configure our build process to require and validate all contributions and
> > dependencies are licensed under the Apache 2.0