Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2
[x] +1 Release this as Apache Parquet Format 2.3.0 verified sigs, hashes, no jars, and inspected tarball. On Mon, Feb 16, 2015 at 8:03 AM, Ryan Blue wrote: > Hi everyone, > > I propose RC2 to be released as official Apache Parquet 2.3.0 release. > > A similar vote has passed in the podling, with 4 +1 votes and 0 -1 or +0 > votes. (With one binding +1 from an IPMC member.) > > The commit id is 7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9 > * This corresponds to the tag: apache-parquet-format-2.3.0-incubating > * https://github.com/apache/incubator-parquet-format/tree/7a6079ed > * > https://git-wip-us.apache.org/repos/asf/incubator/repo?p=incubator-parquet-format.git&a=commit&h=7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9 > > The release tarball, signature, and checksums are here: > * > https://dist.apache.org/repos/dist/dev/incubator/parquet/apache-parquet-format-2.3.0-incubating-rc2 > > You can find the KEYS file here: > * https://dist.apache.org/repos/dist/dev/incubator/parquet/KEYS > > Binary artifacts are staged in Nexus here: > * > https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/ > > Parquet Format 2.3.0 is functionally identical to the 2.2.0 release, but the > classes have been moved to the org.apache.parquet package and the maven > groupId is now org.apache.parquet. > > Please download, verify, and test. This vote will close on 19 Feb. > > [ ] +1 Release this as Apache Parquet Format 2.3.0 > [ ] +0 > [ ] -1 Do not release this because... > > -- > Ryan Blue > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2
On Tue, Feb 17, 2015 at 9:45 PM, Ted Dunning wrote: > On Tue, Feb 17, 2015 at 5:02 PM, Ryan Blue wrote: > >> In the mean time, if you take a look at the .travis.yml file, you can see >> the preparation steps used to run CI jobs. That's what I usually point >> people at instead of maintaining it in two places, but I agree that >> shouldn't be the solution. >> > > Does that answer the question about the checksum? The sha file is somehow gzcompressed. e.g.: $ file apache-parquet-format-2.3.0-incubating.tar.gz.sha apache-parquet-format-2.3.0-incubating.tar.gz.sha: gzip compressed data, from Unix $ gzcat apache-parquet-format-2.3.0-incubating.tar.gz.sha a3dee7852d670db575ab00af8386fc6356f96a01 apache-parquet-format-2.3.0-incubating.tar.gz $ sha1sum apache-parquet-format-2.3.0-incubating.tar.gz a3dee7852d670db575ab00af8386fc6356f96a01 apache-parquet-format-2.3.0-incubating.tar.gz - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Edit permissions for Incubator wiki
Hello friends, Last Friday, I presented the draft incubator proposal for Myriad, and Ted Dunning added it to https://wiki.apache.org/incubator/MyriadProposal Unfortunately, I do not have edit permissions on the wiki, so I cannot fix formatting or update it in response to discussion. Please give me edit permissions. I'm signed up on the wiki as user 'Adam' Thanks, -Adam- me@apache
Re: Edit permissions for Incubator wiki
On Wed, Feb 18, 2015 at 11:20 AM, Adam Bordelon wrote: > Please give me edit permissions. I'm signed up on the wiki as user 'Adam' Done. Enjoy! Marvin Humphrey - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [DISCUSS] [PROPOSAL] Myriad for Apache Incubator
Thanks for your support everyone. I have updated the wiki proposal to remove the user@ mailing list, and fixed up the formatting. I am personally in favor of adding Luciano Resende to the Nominated Mentors list (the more the merrier, right?), but I want to get approval from the other mentors/committers before nominating him in the proposal. See http://incubator.apache.org/guides/proposal.html#template-mentors and http://incubator.apache.org/guides/mentor.html for more details on the role/responsibilities. Alternatively, Luciano could act as a (small 'm') mentor, rather than an official Podling Mentor. Thoughts, opinions? Any high-level critiques or questions not answered in the proposal? Any nit-picky grammer/spelling mistakes? [troll] On Tue, Feb 17, 2015 at 10:19 PM, Naresh Agarwal wrote: > Looks interesting. Looking forward to this. > > Thanks > Naresh > > On Wed, Feb 18, 2015 at 11:08 AM, Henry Saputra > wrote: > > > I love this project and the idea. Tried to hack it couple years ago > > could not make it work. > > > > Looking forward seeing it in ASF incubator for sure. > > > > @Adam and @Ted, like any new incubator projects coming we always check > > if you need user@ so early in the process? > > Would probably better to have all discussion in dev@ early in > incubation. > > > > - Henry > > > > On Fri, Feb 13, 2015 at 5:06 PM, Adam Bordelon > wrote: > > > Hello friends, > > > > > > The Myriad team and I would like to propose the Myriad project for > > > inclusion in the Apache Incubator. > > > Full text of the proposal is below. I can add it to the incubator wiki > as > > > well, if desired. > > > Please review and discuss. If there are no major concerns, I will call > > for > > > a Vote after a week. > > > > > > Cheers, > > > -Adam- > > > me@apache > > > > > > == > > > Apache Myriad Proposal > > > > > > * Abstract > > > Myriad enables co-existence of Apache Hadoop YARN and Apache Mesos > > together > > > on the same cluster and allows dynamic resource allocations across both > > > Hadoop and other applications running on the same physical data center > > > infrastructure. > > > > > > * Proposal > > > The vision of Myriad is to provide a comprehensive framework to ensure > > > Apache Hadoop YARN and Apache Mesos can interoperate with minimal > changes > > > on either side and prevent the static fragmentation of data center > > > resources. > > > > > > * Background > > > Project Myriad is the first resource management framework that allows > big > > > data developers to run YARN-based Hadoop jobs alongside other > > applications > > > and services in production. ebay Inc., MapR, and Mesosphere jointly > built > > > Myriad (available on Github at https://github.com/mesos/myriad) with > the > > > vision of freeing big data jobs from siloed clusters and consolidating > > > infrastructure into a single pool of resources for greater utilization > > and > > > operational efficiency. Several companies including Twitter have > > expressed > > > interest in Myriad and have begun testing it. > > > > > > * Rationale > > > Many Hadoop users are building larger clusters (data lake/data hub > > > architectures) that support multiple workloads - made possible by the > > > advent of Apache Hadoop YARN. As the clusters grow in size and > > importance, > > > they become an important application within the broader datacenter. At > > the > > > same time, Apache Mesos enables efficient resource isolation and > sharing > > > across distributed applications for the broader data center, for > instance > > > MPI, Spark, long running web services, build/test infrastructure, > > > traditional linux applications/scripts, and others (including arbitrary > > > docker images). > > > > > > Myriad aims to enable co-existence of Apache Hadoop YARN and Apache > Mesos > > > on the same physical data center resources, reducing fragmentation of > > data > > > center resources. > > > > > > * Project Goals > > > ** Initial Goals > > > - Run Myriad alongside Apache Hadoop YARN and Apache Mesos to allow > > policy > > > based allocation of data center resources across Apache Hadoop and > other > > > distributed applications > > > - Ensure YARN based execution frameworks work without any changes when > > > running alongside Myriad. YARN Applications will continue to interact > and > > > run on top of YARN and can choose to be unaware of Myriad. > > > - Ensure Mesos based execution frameworks work without any changes when > > > running alongside Myriad. Mesos applications will continue to interact > > and > > > run on Mesos and can choose to be unaware of Myriad. > > > - Provide isolation for multi-tenancy. > > > - Use linux cgroups (and optionally Docker-like technologies to ease > > > packaging, deployment and broader isolation) so that multiple YARN > > clusters > > > can run in their own space and are isolated from each other. YARN’s RM > > and > > > NMs are dockerized. > > >
Re: [VOTE] Release of Apache MRQL 0.9.4 incubating (RC2)
Hello, This release still needs one more IPMC vote. (We got +1 IPMC votes from Alan Cabrera and Justin Mclean). It would be greatly appreciated If someone could take a look at our release and vote. Thank you Leonidas Fegaras On 02/15/2015 05:19 PM, Leonidas Fegaras wrote: Hello, This is a call for a vote on Apache MRQL 0.9.4 incubating. Apache MRQL is a query processing and optimization system for large-scale, distributed data analysis, built on top of Apache Hadoop, Hama, Spark, and Flink. This is our third release. A vote was held on the MRQL developer mailing list and it passed with four +1 PPMC votes, no -1 votes, and no 0 votes (see the vote thread [1] and result thread [2]), and now requires a vote on this list. The vote will be open for at least 72 hours and passes if a majority of at least three +1 IPMC votes are cast. [ ] +1 Release this package as Apache MRQL 0.9.4-incubating [ ] -1 Do not release this package because ... The release tarballs, including signatures, digests, etc can be found at: https://dist.apache.org/repos/dist/dev/incubator/mrql/0.9.4-incubating-RC2/ The release candidate consists of the following source distribution archives: - apache-mrql-0.9.4-incubating-src.[tar.gz|zip] SHA1 of TGZ: 9B21 81B9 7CAB D1D4 B58F 49B3 C013 5841 B439 D590 SHA1 of ZIP: B08F C4DE A84F F203 8EEA C124 727A 1A53 76FA 34F3 You can compile the sources using 'mvn clean install'. In addition, the following supplementary binary distributions are provided for user convenience at the same location: - apache-mrql-0.9.4-incubating-bin.[tar.gz|zip] SHA1 of TGZ: F25B A476 D095 8C01 AEA3 4F94 4800 01AB 9FA4 BCBF SHA1 of ZIP: AF61 F9E3 F84A 11CA CE39 B769 B490 D963 C495 C5DD A staged Maven repository is available for review at: https://repository.apache.org/content/repositories/orgapachemrql-1003 The release candidate has been signed through the key 798764F1 in: http://www.apache.org/dist/incubator/mrql/KEYS The release candidate is based on the sources tagged with MRQL-0.9.4-incubating-RC2 in: https://git-wip-us.apache.org/repos/asf?p=incubator-mrql.git;a=commit;h=6bf94302fb5aa8a5bd7f60362fe0fe8505da6ebb The list of fixed issues: https://git-wip-us.apache.org/repos/asf?p=incubator-mrql.git;a=blob_plain;f=RELEASE_NOTES;hb=6bf94302fb5aa8a5bd7f60362fe0fe8505da6ebb To learn more about Apache MRQL, please visit: http://wiki.apache.org/mrql/ Thanks, Leonidas Fegaras [1] http://markmail.org/message/dm2n2ljgdlztsdsf [2] http://markmail.org/message/4hajddzyqlcwijyj - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2
+1 binding verified signatures, hashes, no binaries, compiles and tests pass -Jake On Mon, Feb 16, 2015 at 11:03 AM, Ryan Blue wrote: > Hi everyone, > > I propose RC2 to be released as official Apache Parquet 2.3.0 release. > > A similar vote has passed in the podling, with 4 +1 votes and 0 -1 or +0 > votes. (With one binding +1 from an IPMC member.) > > The commit id is 7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9 > * This corresponds to the tag: apache-parquet-format-2.3.0-incubating > * https://github.com/apache/incubator-parquet-format/tree/7a6079ed > * https://git-wip-us.apache.org/repos/asf/incubator/repo?p= > incubator-parquet-format.git&a=commit&h=7a6079ed5ddfa98a59cf8ac8728bcf > 5b0a1233b9 > > The release tarball, signature, and checksums are here: > * https://dist.apache.org/repos/dist/dev/incubator/parquet/ > apache-parquet-format-2.3.0-incubating-rc2 > > You can find the KEYS file here: > * https://dist.apache.org/repos/dist/dev/incubator/parquet/KEYS > > Binary artifacts are staged in Nexus here: > * https://repository.apache.org/content/groups/staging/org/ > apache/parquet/parquet-format/ > > Parquet Format 2.3.0 is functionally identical to the 2.2.0 release, but > the classes have been moved to the org.apache.parquet package and the maven > groupId is now org.apache.parquet. > > Please download, verify, and test. This vote will close on 19 Feb. > > [ ] +1 Release this as Apache Parquet Format 2.3.0 > [ ] +0 > [ ] -1 Do not release this because... > > -- > Ryan Blue > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2
Hi, Changing my vote from +0 to +1 binding. Thanks, Justin - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
Re: [VOTE] Release Apache Parquet Format 2.3.0 RC2
OK. I will change my vote to +1. The sha that Brock demonstrates is the same one that I saw when I was checking sums. I would *strongly* encourage the project to improve things before the next release by: - fix the sha has to not be compressed. This is unconventional and thus not a good thing. Anything that discourages the checking of a secure signature is a bad thing - add either a COMPILING or INSTALL file or more info in the README that describes the obscure method for compilation - check in the generated code or at least include it in the source artifact so that thrift and protoc are not necessary for a simple compilation. It is better than downstream users have an easier experience than a hard experience is documented On Wed, Feb 18, 2015 at 10:58 AM, Brock Noland wrote: > [x] +1 Release this as Apache Parquet Format 2.3.0 > > verified sigs, hashes, no jars, and inspected tarball. > > On Mon, Feb 16, 2015 at 8:03 AM, Ryan Blue wrote: > > Hi everyone, > > > > I propose RC2 to be released as official Apache Parquet 2.3.0 release. > > > > A similar vote has passed in the podling, with 4 +1 votes and 0 -1 or +0 > > votes. (With one binding +1 from an IPMC member.) > > > > The commit id is 7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9 > > * This corresponds to the tag: apache-parquet-format-2.3.0-incubating > > * https://github.com/apache/incubator-parquet-format/tree/7a6079ed > > * > > > https://git-wip-us.apache.org/repos/asf/incubator/repo?p=incubator-parquet-format.git&a=commit&h=7a6079ed5ddfa98a59cf8ac8728bcf5b0a1233b9 > > > > The release tarball, signature, and checksums are here: > > * > > > https://dist.apache.org/repos/dist/dev/incubator/parquet/apache-parquet-format-2.3.0-incubating-rc2 > > > > You can find the KEYS file here: > > * https://dist.apache.org/repos/dist/dev/incubator/parquet/KEYS > > > > Binary artifacts are staged in Nexus here: > > * > > > https://repository.apache.org/content/groups/staging/org/apache/parquet/parquet-format/ > > > > Parquet Format 2.3.0 is functionally identical to the 2.2.0 release, but > the > > classes have been moved to the org.apache.parquet package and the maven > > groupId is now org.apache.parquet. > > > > Please download, verify, and test. This vote will close on 19 Feb. > > > > [ ] +1 Release this as Apache Parquet Format 2.3.0 > > [ ] +0 > > [ ] -1 Do not release this because... > > > > -- > > Ryan Blue > > > > - > > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > > For additional commands, e-mail: general-h...@incubator.apache.org > > > > - > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > >
Re: [DISCUSS] [PROPOSAL] Myriad for Apache Incubator
On Wed, Feb 18, 2015 at 12:24 PM, Adam Bordelon wrote: > I am personally in favor of adding Luciano Resende to the Nominated Mentors > list (the more the merrier, right?), but I want to get approval from the > other mentors/committers before nominating him in the proposal. > +1 I don't think that you really need to worry about other mentors approving the addition of a mentor. This is a duty well shared by more hands. I haven't seen a bad mentor except ones that go missing and having an extra helps with that.