Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2

2015-02-18 Thread Brock Noland
[x] +1 Release this as Apache Parquet Format 2.3.0

verified sigs, hashes, no jars, and inspected tarball.

On Mon, Feb 16, 2015 at 8:03 AM, Ryan Blue  wrote:
> Hi everyone,
>
> I propose RC2 to be released as official Apache Parquet 2.3.0 release.
>
> A similar vote has passed in the podling, with 4 +1 votes and 0 -1 or +0
> votes. (With one binding +1 from an IPMC member.)
>
> The commit id is 7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9
> * This corresponds to the tag: apache-parquet-format-2.3.0-incubating
> * https://github.com/apache/incubator-parquet-format/tree/7a6079ed
> *
> https://git-wip-us.apache.org/repos/asf/incubator/repo?p=incubator-parquet-format.git&a=commit&h=7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9
>
> The release tarball, signature, and checksums are here:
> *
> https://dist.apache.org/repos/dist/dev/incubator/parquet/apache-parquet-format-2.3.0-incubating-rc2
>
> You can find the KEYS file here:
> * https://dist.apache.org/repos/dist/dev/incubator/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
> *
> https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/
>
> Parquet Format 2.3.0 is functionally identical to the 2.2.0 release, but the
> classes have been moved to the org.apache.parquet package and the maven
> groupId is now org.apache.parquet.
>
> Please download, verify, and test. This vote will close on 19 Feb.
>
> [ ] +1 Release this as Apache Parquet Format 2.3.0
> [ ] +0
> [ ] -1 Do not release this because...
>
> --
> Ryan Blue
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2

2015-02-18 Thread Brock Noland
On Tue, Feb 17, 2015 at 9:45 PM, Ted Dunning  wrote:
> On Tue, Feb 17, 2015 at 5:02 PM, Ryan Blue  wrote:
>
>> In the mean time, if you take a look at the .travis.yml file, you can see
>> the preparation steps used to run CI jobs. That's what I usually point
>> people at instead of maintaining it in two places, but I agree that
>> shouldn't be the solution.
>>
>
> Does that answer the question about the checksum?

The sha file is somehow gzcompressed. e.g.:

$ file apache-parquet-format-2.3.0-incubating.tar.gz.sha
apache-parquet-format-2.3.0-incubating.tar.gz.sha: gzip compressed
data, from Unix
$ gzcat apache-parquet-format-2.3.0-incubating.tar.gz.sha
a3dee7852d670db575ab00af8386fc6356f96a01
apache-parquet-format-2.3.0-incubating.tar.gz
$ sha1sum apache-parquet-format-2.3.0-incubating.tar.gz
a3dee7852d670db575ab00af8386fc6356f96a01
apache-parquet-format-2.3.0-incubating.tar.gz

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Edit permissions for Incubator wiki

2015-02-18 Thread Adam Bordelon
Hello friends,

Last Friday, I presented the draft incubator proposal for Myriad, and Ted
Dunning added it to https://wiki.apache.org/incubator/MyriadProposal
Unfortunately, I do not have edit permissions on the wiki, so I cannot fix
formatting or update it in response to discussion.

Please give me edit permissions. I'm signed up on the wiki as user 'Adam'

Thanks,
-Adam-
me@apache


Re: Edit permissions for Incubator wiki

2015-02-18 Thread Marvin Humphrey
On Wed, Feb 18, 2015 at 11:20 AM, Adam Bordelon  wrote:

> Please give me edit permissions. I'm signed up on the wiki as user 'Adam'

Done. Enjoy!

Marvin Humphrey

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [DISCUSS] [PROPOSAL] Myriad for Apache Incubator

2015-02-18 Thread Adam Bordelon
Thanks for your support everyone. I have updated the wiki proposal to
remove the user@ mailing list, and fixed up the formatting.

I am personally in favor of adding Luciano Resende to the Nominated Mentors
list (the more the merrier, right?), but I want to get approval from the
other mentors/committers before nominating him in the proposal. See
http://incubator.apache.org/guides/proposal.html#template-mentors and
http://incubator.apache.org/guides/mentor.html for more details on the
role/responsibilities.
Alternatively, Luciano could act as a (small 'm') mentor, rather than an
official Podling Mentor. Thoughts, opinions?

Any high-level critiques or questions not answered in the proposal? Any
nit-picky grammer/spelling mistakes? [troll]

On Tue, Feb 17, 2015 at 10:19 PM, Naresh Agarwal 
wrote:

> Looks interesting. Looking forward to this.
>
> Thanks
> Naresh
>
> On Wed, Feb 18, 2015 at 11:08 AM, Henry Saputra 
> wrote:
>
> > I love this project and the idea. Tried to hack it couple years ago
> > could not make it work.
> >
> > Looking forward seeing it in ASF incubator for sure.
> >
> > @Adam and @Ted, like any new incubator projects coming we always check
> > if you need user@ so early in the process?
> > Would probably better to have all discussion in dev@ early in
> incubation.
> >
> > - Henry
> >
> > On Fri, Feb 13, 2015 at 5:06 PM, Adam Bordelon 
> wrote:
> > > Hello friends,
> > >
> > > The Myriad team and I would like to propose the Myriad project for
> > > inclusion in the Apache Incubator.
> > > Full text of the proposal is below. I can add it to the incubator wiki
> as
> > > well, if desired.
> > > Please review and discuss. If there are no major concerns, I will call
> > for
> > > a Vote after a week.
> > >
> > > Cheers,
> > > -Adam-
> > > me@apache
> > >
> > > ==
> > > Apache Myriad Proposal
> > >
> > > * Abstract
> > > Myriad enables co-existence of Apache Hadoop YARN and Apache Mesos
> > together
> > > on the same cluster and allows dynamic resource allocations across both
> > > Hadoop and other applications running on the same physical data center
> > > infrastructure.
> > >
> > > * Proposal
> > > The vision of Myriad is to provide a comprehensive framework to ensure
> > > Apache Hadoop YARN and Apache Mesos can interoperate with minimal
> changes
> > > on either side and prevent the static fragmentation of data center
> > > resources.
> > >
> > > * Background
> > > Project Myriad is the first resource management framework that allows
> big
> > > data developers to run YARN-based Hadoop jobs alongside other
> > applications
> > > and services in production. ebay Inc., MapR, and Mesosphere jointly
> built
> > > Myriad (available on Github at https://github.com/mesos/myriad) with
> the
> > > vision of freeing big data jobs from siloed clusters and consolidating
> > > infrastructure into a single pool of resources for greater utilization
> > and
> > > operational efficiency. Several companies including Twitter have
> > expressed
> > > interest in Myriad and have begun testing it.
> > >
> > > * Rationale
> > > Many Hadoop users are building larger clusters (data lake/data hub
> > > architectures) that support multiple workloads - made possible by the
> > > advent of Apache Hadoop YARN. As the clusters grow in size and
> > importance,
> > > they become an important application within the broader datacenter. At
> > the
> > > same time, Apache Mesos enables efficient resource isolation and
> sharing
> > > across distributed applications for the broader data center, for
> instance
> > > MPI, Spark, long running web services, build/test infrastructure,
> > > traditional linux applications/scripts, and others (including arbitrary
> > > docker images).
> > >
> > > Myriad aims to enable co-existence of Apache Hadoop YARN and Apache
> Mesos
> > > on the same physical data center resources, reducing fragmentation of
> > data
> > > center resources.
> > >
> > > * Project Goals
> > > ** Initial Goals
> > > - Run Myriad alongside Apache Hadoop YARN and Apache Mesos to allow
> > policy
> > > based allocation of data center resources across Apache Hadoop and
> other
> > > distributed applications
> > > - Ensure YARN based execution frameworks work without any changes when
> > > running alongside Myriad. YARN Applications will continue to interact
> and
> > > run on top of YARN and can choose to be unaware of Myriad.
> > > - Ensure Mesos based execution frameworks work without any changes when
> > > running alongside Myriad. Mesos applications will continue to interact
> > and
> > > run on Mesos and can choose to be unaware of Myriad.
> > > - Provide isolation for multi-tenancy.
> > >   - Use linux cgroups (and optionally Docker-like technologies to ease
> > > packaging, deployment and broader isolation) so that multiple YARN
> > clusters
> > > can run in their own space and are isolated from each other. YARN’s RM
> > and
> > > NMs are dockerized.
> > > 

Re: [VOTE] Release of Apache MRQL 0.9.4 incubating (RC2)

2015-02-18 Thread Leonidas Fegaras

Hello,
This release still needs one more IPMC vote.
(We got +1 IPMC votes from Alan Cabrera and Justin Mclean).
It would be greatly appreciated If someone could take a look
at our release and vote.
Thank you
Leonidas Fegaras


On 02/15/2015 05:19 PM, Leonidas Fegaras wrote:

Hello,
This is a call for a vote on Apache MRQL 0.9.4 incubating.
Apache MRQL is a query processing and optimization system for
large-scale, distributed data analysis, built on top of Apache Hadoop,
Hama, Spark, and Flink. This is our third release.
A vote was held on the MRQL developer mailing list and it passed with
four +1 PPMC votes, no -1 votes, and no 0 votes (see the vote thread
[1] and result thread [2]), and now requires a vote on this list.
The vote will be open for at least 72 hours and passes if a majority
of at least three +1 IPMC votes are cast.

[ ] +1 Release this package as Apache MRQL 0.9.4-incubating
[ ] -1 Do not release this package because ...

The release tarballs, including signatures, digests, etc can be found at:
https://dist.apache.org/repos/dist/dev/incubator/mrql/0.9.4-incubating-RC2/
The release candidate consists of the following source distribution
archives:
- apache-mrql-0.9.4-incubating-src.[tar.gz|zip]
SHA1 of TGZ: 9B21 81B9 7CAB D1D4 B58F  49B3 C013 5841 B439 D590
SHA1 of ZIP: B08F C4DE A84F F203 8EEA  C124 727A 1A53 76FA 34F3
You can compile the sources using 'mvn clean install'.
In addition, the following supplementary binary distributions are
provided for user convenience at the same location:
- apache-mrql-0.9.4-incubating-bin.[tar.gz|zip]
SHA1 of TGZ: F25B A476 D095 8C01 AEA3  4F94 4800 01AB 9FA4 BCBF
SHA1 of ZIP: AF61 F9E3 F84A 11CA CE39  B769 B490 D963 C495 C5DD

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachemrql-1003

The release candidate has been signed through the key 798764F1 in:
http://www.apache.org/dist/incubator/mrql/KEYS

The release candidate is based on the sources tagged with
MRQL-0.9.4-incubating-RC2 in:
https://git-wip-us.apache.org/repos/asf?p=incubator-mrql.git;a=commit;h=6bf94302fb5aa8a5bd7f60362fe0fe8505da6ebb

The list of fixed issues:
https://git-wip-us.apache.org/repos/asf?p=incubator-mrql.git;a=blob_plain;f=RELEASE_NOTES;hb=6bf94302fb5aa8a5bd7f60362fe0fe8505da6ebb

To learn more about Apache MRQL, please visit:
http://wiki.apache.org/mrql/
Thanks,
Leonidas Fegaras

[1] http://markmail.org/message/dm2n2ljgdlztsdsf
[2] http://markmail.org/message/4hajddzyqlcwijyj


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org




-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2

2015-02-18 Thread Jake Farrell
+1 binding

verified signatures, hashes, no binaries, compiles and tests pass

-Jake

On Mon, Feb 16, 2015 at 11:03 AM, Ryan Blue  wrote:

> Hi everyone,
>
> I propose RC2 to be released as official Apache Parquet 2.3.0 release.
>
> A similar vote has passed in the podling, with 4 +1 votes and 0 -1 or +0
> votes. (With one binding +1 from an IPMC member.)
>
> The commit id is 7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9
> * This corresponds to the tag: apache-parquet-format-2.3.0-incubating
> * https://github.com/apache/incubator-parquet-format/tree/7a6079ed
> * https://git-wip-us.apache.org/repos/asf/incubator/repo?p=
> incubator-parquet-format.git&a=commit&h=7a6079ed5ddfa98a59cf8ac8728bcf
> 5b0a1233b9
>
> The release tarball, signature, and checksums are here:
> * https://dist.apache.org/repos/dist/dev/incubator/parquet/
> apache-parquet-format-2.3.0-incubating-rc2
>
> You can find the KEYS file here:
> * https://dist.apache.org/repos/dist/dev/incubator/parquet/KEYS
>
> Binary artifacts are staged in Nexus here:
> * https://repository.apache.org/content/groups/staging/org/
> apache/parquet/parquet-format/
>
> Parquet Format 2.3.0 is functionally identical to the 2.2.0 release, but
> the classes have been moved to the org.apache.parquet package and the maven
> groupId is now org.apache.parquet.
>
> Please download, verify, and test. This vote will close on 19 Feb.
>
> [ ] +1 Release this as Apache Parquet Format 2.3.0
> [ ] +0
> [ ] -1 Do not release this because...
>
> --
> Ryan Blue
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2

2015-02-18 Thread Justin Mclean
Hi,

Changing my vote from +0 to +1 binding.

Thanks,
Justin

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2

2015-02-18 Thread Ted Dunning
OK.  I will change my vote to +1.  The sha that Brock demonstrates is the
same one that I saw when I was checking sums.

I would *strongly* encourage the project to improve things before the next
release by:

- fix the sha has to not be compressed.  This is unconventional and thus
not a good thing.  Anything that discourages the checking of a secure
signature is a bad thing

- add either a COMPILING or INSTALL file or more info in the README that
describes the obscure method for compilation

- check in the generated code or at least include it in the source artifact
so that thrift and protoc are not necessary for a simple compilation.  It
is better than downstream users have an easier experience than a hard
experience is documented





On Wed, Feb 18, 2015 at 10:58 AM, Brock Noland  wrote:

> [x] +1 Release this as Apache Parquet Format 2.3.0
>
> verified sigs, hashes, no jars, and inspected tarball.
>
> On Mon, Feb 16, 2015 at 8:03 AM, Ryan Blue  wrote:
> > Hi everyone,
> >
> > I propose RC2 to be released as official Apache Parquet 2.3.0 release.
> >
> > A similar vote has passed in the podling, with 4 +1 votes and 0 -1 or +0
> > votes. (With one binding +1 from an IPMC member.)
> >
> > The commit id is 7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9
> > * This corresponds to the tag: apache-parquet-format-2.3.0-incubating
> > * https://github.com/apache/incubator-parquet-format/tree/7a6079ed
> > *
> >
> https://git-wip-us.apache.org/repos/asf/incubator/repo?p=incubator-parquet-format.git&a=commit&h=7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9
> >
> > The release tarball, signature, and checksums are here:
> > *
> >
> https://dist.apache.org/repos/dist/dev/incubator/parquet/apache-parquet-format-2.3.0-incubating-rc2
> >
> > You can find the KEYS file here:
> > * https://dist.apache.org/repos/dist/dev/incubator/parquet/KEYS
> >
> > Binary artifacts are staged in Nexus here:
> > *
> >
> https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/
> >
> > Parquet Format 2.3.0 is functionally identical to the 2.2.0 release, but
> the
> > classes have been moved to the org.apache.parquet package and the maven
> > groupId is now org.apache.parquet.
> >
> > Please download, verify, and test. This vote will close on 19 Feb.
> >
> > [ ] +1 Release this as Apache Parquet Format 2.3.0
> > [ ] +0
> > [ ] -1 Do not release this because...
> >
> > --
> > Ryan Blue
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> > For additional commands, e-mail: general-h...@incubator.apache.org
> >
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> For additional commands, e-mail: general-h...@incubator.apache.org
>
>


Re: [DISCUSS] [PROPOSAL] Myriad for Apache Incubator

2015-02-18 Thread Ted Dunning
On Wed, Feb 18, 2015 at 12:24 PM, Adam Bordelon  wrote:

> I am personally in favor of adding Luciano Resende to the Nominated Mentors
> list (the more the merrier, right?), but I want to get approval from the
> other mentors/committers before nominating him in the proposal.
>

+1

I don't think that you really need to worry about other mentors approving
the addition of a mentor.  This is a duty well shared by more hands.  I
haven't seen a bad mentor except ones that go missing and having an extra
helps with that.