Re: initial draft of security scoping document/roadmap
Hey folks, I'm hoping to start breaking down some tasks from this document in the next couple days. If you were planning to take a look, please try to do so soon. -Todd On Mon, Oct 3, 2016 at 5:33 PM, Todd Lipconwrote: > Hi all, > > Now that we've reached 1.0, one of the next big barriers to Kudu adoption > is its lack of security features. I've started working on a document which > tries to scope out some initial support for authentication, authorization, > and data security: > > https://docs.google.com/document/d/1cPNDTpVkIUo676RlszpTF1gHZ8l0T > dbB7zFBAuOuYUw/edit#heading=h.gsibhnd5dyem > > The aim here is to lay out a roadmap that has some milestones that are > achievable in the next few upcoming releases. As noted in the last section > of the document, there will be more work to follow, but the goal here is to > get us started with the base infrastructure. > > It's rough, yet, but please take a look and leave comments, questions, and > suggestions. > > Thanks > -Todd > -- > Todd Lipcon > Software Engineer, Cloudera > -- Todd Lipcon Software Engineer, Cloudera
[RESULT] [VOTE] Apache Kudu 1.0.1 RC1
The vote is now closed. It passes with: 3 binding +1s: Alexey, Dan, JD 1 binding +0: David 2 non-binding +1s: Brock, Dinesh 0 -1s I will be uploading the sources and jars soon. Thanks to everyone that participated! - Dan On Mon, Oct 10, 2016 at 4:52 PM, Jean-Daniel Cryanswrote: > +1 > > I downloaded the tarball, compiled everything and ran the tests on RHEL6 > (100% passed). > > I also deployed custom packages on a 4 nodes EC2 cluster, modified YCSB to > use the 1.0.1 jar, inserted 10M rows, ran a combination of > inserts/reads/updates over 100K rows, looks good. > > J-D > > On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert wrote: > > > Hi, > > > > We're happy to announce the first release candidate for Apache Kudu > 1.0.1. > > > > This release includes bug fixes and documentation updates since the 1.0.0 > > release. > > > > The is a source-only release. The artifacts were staged here: > > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ > > > > It was built from this tag: > > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h= > > e60b610253f4303b24d41575f7bafbc5d69edddb > > > > The release notes can be found here (the release notes on > kudu.apache.org > > will be updated with the release): > > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc > > > > KEYS file: > > https://www.apache.org/dist/kudu/KEYS > > > > I'd suggest going through the README, building Kudu, and running the > > unit tests. > > > > Please try the release and vote; vote will be open for at least 72 hours. > > > > Thanks, > > > > - Dan > > >
Re: [VOTE] Apache Kudu 1.0.1 RC1
+1 I downloaded the tarball, compiled everything and ran the tests on RHEL6 (100% passed). I also deployed custom packages on a 4 nodes EC2 cluster, modified YCSB to use the 1.0.1 jar, inserted 10M rows, ran a combination of inserts/reads/updates over 100K rows, looks good. J-D On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkertwrote: > Hi, > > We're happy to announce the first release candidate for Apache Kudu 1.0.1. > > This release includes bug fixes and documentation updates since the 1.0.0 > release. > > The is a source-only release. The artifacts were staged here: > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ > > It was built from this tag: > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h= > e60b610253f4303b24d41575f7bafbc5d69edddb > > The release notes can be found here (the release notes on kudu.apache.org > will be updated with the release): > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc > > KEYS file: > https://www.apache.org/dist/kudu/KEYS > > I'd suggest going through the README, building Kudu, and running the > unit tests. > > Please try the release and vote; vote will be open for at least 72 hours. > > Thanks, > > - Dan >
Scoping document for disk failures
Hi All, I put together a draft of how to mitigate the impact of disk failures in kudu at the link below: https://goo.gl/wP5BJb This is still a work in progress, your reviews/feedback on the doc would be much appreciated. Thanks, Dinesh.
Re: [VOTE] Apache Kudu 1.0.1 RC1
+1 non-binding - Checked checksums - Release bits built on centos6.6 - Ran test under distributed test, 4 tests failed, _no_ regressions seen: 2 of them failed due to network flakiness 1 of them seems like a test bug(will triage-and-fix). 1 of them needs RCA/trying-to-repro. Thanks, Dinesh. > On Oct 7, 2016, at 2:00 PM, Dan Burkertwrote: > > Hi, > > We're happy to announce the first release candidate for Apache Kudu 1.0.1. > > This release includes bug fixes and documentation updates since the 1.0.0 > release. > > The is a source-only release. The artifacts were staged here: > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ > > It was built from this tag: > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=e60b610253f4303b24d41575f7bafbc5d69edddb > > The release notes can be found here (the release notes on kudu.apache.org > will be updated with the release): > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc > > KEYS file: > https://www.apache.org/dist/kudu/KEYS > > I'd suggest going through the README, building Kudu, and running the > unit tests. > > Please try the release and vote; vote will be open for at least 72 hours. > > Thanks, > > - Dan
Re: [VOTE] Apache Kudu 1.0.1 RC1
+0 Compiled thirdparty successfully, but couldn't compile the sources in macOS Sierra/XCode 8 as this is missing https://gerrit.cloudera.org/#/c/4482/ and https://gerrit.cloudera.org/#/c/4495/ Since this is just a bug fix/doc update release and this problem only affects macOS (macOS is only supported for development and development is usually made on trunk) I don't think this issue should hold the release. -david On Mon, Oct 10, 2016 at 1:54 PM, Dan Burkertwrote: > +1 > > * Compiled and tested release mode on OS X 10.10, with no unexpected > failures. > * Compiled and tested Debug/ASAN/TSAN/Release on Centos 6, no failures. > * Checked signatures and licenses (RAT) > > - Dan > > On Mon, Oct 10, 2016 at 12:27 PM, Alexey Serbin > wrote: > > > +1 > > > > I compiled the project from source using the 1.0.1-RC1 tag (release and > > debug modes) and ran the test suite using 'ctest -j4' at CentOS 6.6 > (kernel > > 2.6.32-504.30.3.el6.x86_64). All tests passed. > > > > Also, I compiled the project from source using the 1.0.1-RC1 tag (release > > and debug modes) and ran the tests using 'ctest -j2' at MacOS X 10.11.5. > > All tests passed except for pstack_watcher-test, which is a known issue > for > > Kudu on MacOS X. > > > > Besides, I run 'kudu test loadgen' tool against the newly built binaries > > multiple times, inserting several million of rows and it passed. > > > > > > Best regards, > > > > Alexey > > > > > > On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert > wrote: > > > > > Hi, > > > > > > We're happy to announce the first release candidate for Apache Kudu > > 1.0.1. > > > > > > This release includes bug fixes and documentation updates since the > 1.0.0 > > > release. > > > > > > The is a source-only release. The artifacts were staged here: > > > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ > > > > > > It was built from this tag: > > > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h= > > > e60b610253f4303b24d41575f7bafbc5d69edddb > > > > > > The release notes can be found here (the release notes on > > kudu.apache.org > > > will be updated with the release): > > > https://github.com/apache/kudu/blob/branch-1.0.x/docs/ > release_notes.adoc > > > > > > KEYS file: > > > https://www.apache.org/dist/kudu/KEYS > > > > > > I'd suggest going through the README, building Kudu, and running the > > > unit tests. > > > > > > Please try the release and vote; vote will be open for at least 72 > hours. > > > > > > Thanks, > > > > > > - Dan > > > > > >
Re: [VOTE] Apache Kudu 1.0.1 RC1
+1 * Compiled and tested release mode on OS X 10.10, with no unexpected failures. * Compiled and tested Debug/ASAN/TSAN/Release on Centos 6, no failures. * Checked signatures and licenses (RAT) - Dan On Mon, Oct 10, 2016 at 12:27 PM, Alexey Serbinwrote: > +1 > > I compiled the project from source using the 1.0.1-RC1 tag (release and > debug modes) and ran the test suite using 'ctest -j4' at CentOS 6.6 (kernel > 2.6.32-504.30.3.el6.x86_64). All tests passed. > > Also, I compiled the project from source using the 1.0.1-RC1 tag (release > and debug modes) and ran the tests using 'ctest -j2' at MacOS X 10.11.5. > All tests passed except for pstack_watcher-test, which is a known issue for > Kudu on MacOS X. > > Besides, I run 'kudu test loadgen' tool against the newly built binaries > multiple times, inserting several million of rows and it passed. > > > Best regards, > > Alexey > > > On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert wrote: > > > Hi, > > > > We're happy to announce the first release candidate for Apache Kudu > 1.0.1. > > > > This release includes bug fixes and documentation updates since the 1.0.0 > > release. > > > > The is a source-only release. The artifacts were staged here: > > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ > > > > It was built from this tag: > > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h= > > e60b610253f4303b24d41575f7bafbc5d69edddb > > > > The release notes can be found here (the release notes on > kudu.apache.org > > will be updated with the release): > > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc > > > > KEYS file: > > https://www.apache.org/dist/kudu/KEYS > > > > I'd suggest going through the README, building Kudu, and running the > > unit tests. > > > > Please try the release and vote; vote will be open for at least 72 hours. > > > > Thanks, > > > > - Dan > > >
Re: [VOTE] Apache Kudu 1.0.1 RC1
+1 I compiled the project from source using the 1.0.1-RC1 tag (release and debug modes) and ran the test suite using 'ctest -j4' at CentOS 6.6 (kernel 2.6.32-504.30.3.el6.x86_64). All tests passed. Also, I compiled the project from source using the 1.0.1-RC1 tag (release and debug modes) and ran the tests using 'ctest -j2' at MacOS X 10.11.5. All tests passed except for pstack_watcher-test, which is a known issue for Kudu on MacOS X. Besides, I run 'kudu test loadgen' tool against the newly built binaries multiple times, inserting several million of rows and it passed. Best regards, Alexey On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkertwrote: > Hi, > > We're happy to announce the first release candidate for Apache Kudu 1.0.1. > > This release includes bug fixes and documentation updates since the 1.0.0 > release. > > The is a source-only release. The artifacts were staged here: > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ > > It was built from this tag: > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h= > e60b610253f4303b24d41575f7bafbc5d69edddb > > The release notes can be found here (the release notes on kudu.apache.org > will be updated with the release): > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc > > KEYS file: > https://www.apache.org/dist/kudu/KEYS > > I'd suggest going through the README, building Kudu, and running the > unit tests. > > Please try the release and vote; vote will be open for at least 72 hours. > > Thanks, > > - Dan >
Re: [VOTE] Apache Kudu 1.0.1 RC1
+1 non-binding * Checked hashes and sig * Built from source * Ran tests, which passed On Fri, Oct 7, 2016 at 4:00 PM, Dan Burkertwrote: > Hi, > > We're happy to announce the first release candidate for Apache Kudu 1.0.1. > > This release includes bug fixes and documentation updates since the 1.0.0 > release. > > The is a source-only release. The artifacts were staged here: > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ > > It was built from this tag: > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h= > e60b610253f4303b24d41575f7bafbc5d69edddb > > The release notes can be found here (the release notes on kudu.apache.org > will be updated with the release): > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc > > KEYS file: > https://www.apache.org/dist/kudu/KEYS > > I'd suggest going through the README, building Kudu, and running the > unit tests. > > Please try the release and vote; vote will be open for at least 72 hours. > > Thanks, > > - Dan >