Re: initial draft of security scoping document/roadmap

[Todd Lipcon]

Hey folks,

I'm hoping to start breaking down some tasks from this document in the next
couple days. If you were planning to take a look, please try to do so soon.

-Todd

On Mon, Oct 3, 2016 at 5:33 PM, Todd Lipcon  wrote:

> Hi all,
>
> Now that we've reached 1.0, one of the next big barriers to Kudu adoption
> is its lack of security features. I've started working on a document which
> tries to scope out some initial support for authentication, authorization,
> and data security:
>
> https://docs.google.com/document/d/1cPNDTpVkIUo676RlszpTF1gHZ8l0T
> dbB7zFBAuOuYUw/edit#heading=h.gsibhnd5dyem
>
> The aim here is to lay out a roadmap that has some milestones that are
> achievable in the next few upcoming releases. As noted in the last section
> of the document, there will be more work to follow, but the goal here is to
> get us started with the base infrastructure.
>
> It's rough, yet, but please take a look and leave comments, questions, and
> suggestions.
>
> Thanks
> -Todd
> --
> Todd Lipcon
> Software Engineer, Cloudera
>



-- 
Todd Lipcon
Software Engineer, Cloudera

[RESULT] [VOTE] Apache Kudu 1.0.1 RC1

[Dan Burkert]

The vote is now closed. It passes with:

3 binding +1s: Alexey, Dan, JD
1 binding +0: David
2 non-binding +1s: Brock, Dinesh
0 -1s

I will be uploading the sources and jars soon. Thanks to everyone that
participated!

- Dan


On Mon, Oct 10, 2016 at 4:52 PM, Jean-Daniel Cryans 
wrote:

> +1
>
> I downloaded the tarball, compiled  everything and ran the tests on RHEL6
> (100% passed).
>
> I also deployed custom packages on a 4 nodes EC2 cluster, modified YCSB to
> use the 1.0.1 jar, inserted 10M rows, ran a combination of
> inserts/reads/updates over 100K rows, looks good.
>
> J-D
>
> On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert  wrote:
>
> > Hi,
> >
> > We're happy to announce the first release candidate for Apache Kudu
> 1.0.1.
> >
> > This release includes bug fixes and documentation updates since the 1.0.0
> > release.
> >
> > The is a source-only release. The artifacts were staged here:
> > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/
> >
> > It was built from this tag:
> > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=
> > e60b610253f4303b24d41575f7bafbc5d69edddb
> >
> > The release notes can be found here (the release notes on
> kudu.apache.org
> > will be updated with the release):
> > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc
> >
> > KEYS file:
> > https://www.apache.org/dist/kudu/KEYS
> >
> > I'd suggest going through the README, building Kudu, and running the
> > unit tests.
> >
> > Please try the release and vote; vote will be open for at least 72 hours.
> >
> > Thanks,
> >
> > - Dan
> >
>

Re: [VOTE] Apache Kudu 1.0.1 RC1

[Jean-Daniel Cryans]

+1

I downloaded the tarball, compiled  everything and ran the tests on RHEL6
(100% passed).

I also deployed custom packages on a 4 nodes EC2 cluster, modified YCSB to
use the 1.0.1 jar, inserted 10M rows, ran a combination of
inserts/reads/updates over 100K rows, looks good.

J-D

On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert  wrote:

> Hi,
>
> We're happy to announce the first release candidate for Apache Kudu 1.0.1.
>
> This release includes bug fixes and documentation updates since the 1.0.0
> release.
>
> The is a source-only release. The artifacts were staged here:
> https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/
>
> It was built from this tag:
> https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=
> e60b610253f4303b24d41575f7bafbc5d69edddb
>
> The release notes can be found here (the release notes on kudu.apache.org
> will be updated with the release):
> https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc
>
> KEYS file:
> https://www.apache.org/dist/kudu/KEYS
>
> I'd suggest going through the README, building Kudu, and running the
> unit tests.
>
> Please try the release and vote; vote will be open for at least 72 hours.
>
> Thanks,
>
> - Dan
>

Scoping document for disk failures

[Dinesh Bhat]

Hi All,

I put together a draft of how to mitigate the impact of disk failures in kudu 
at the link below:
https://goo.gl/wP5BJb
This is still a work in progress, your reviews/feedback on the doc would be 
much appreciated.

Thanks,
Dinesh.

Re: [VOTE] Apache Kudu 1.0.1 RC1

[Dinesh Bhat]

+1 non-binding

- Checked checksums
- Release bits built on centos6.6
- Ran test under distributed test, 4 tests failed, _no_ regressions seen:
  2 of them failed due to network flakiness
  1 of them seems like a test bug(will triage-and-fix).
  1 of them needs RCA/trying-to-repro.

Thanks,
Dinesh.

> On Oct 7, 2016, at 2:00 PM, Dan Burkert  wrote:
> 
> Hi,
> 
> We're happy to announce the first release candidate for Apache Kudu 1.0.1.
> 
> This release includes bug fixes and documentation updates since the 1.0.0
> release.
> 
> The is a source-only release. The artifacts were staged here:
> https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/
> 
> It was built from this tag:
> https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=e60b610253f4303b24d41575f7bafbc5d69edddb
> 
> The release notes can be found here (the release notes on kudu.apache.org
> will be updated with the release):
> https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc
> 
> KEYS file:
> https://www.apache.org/dist/kudu/KEYS
> 
> I'd suggest going through the README, building Kudu, and running the
> unit tests.
> 
> Please try the release and vote; vote will be open for at least 72 hours.
> 
> Thanks,
> 
> - Dan

Re: [VOTE] Apache Kudu 1.0.1 RC1

[David Alves]

+0 Compiled thirdparty successfully, but couldn't compile the sources in
macOS Sierra/XCode 8 as this is missing
https://gerrit.cloudera.org/#/c/4482/ and
https://gerrit.cloudera.org/#/c/4495/

Since this is just a bug fix/doc update release and this problem only
affects macOS (macOS is only supported for development and development is
usually made on trunk) I don't think this issue should hold the release.

-david


On Mon, Oct 10, 2016 at 1:54 PM, Dan Burkert  wrote:

> +1
>
> * Compiled and tested release mode on OS X 10.10, with no unexpected
> failures.
> * Compiled and tested Debug/ASAN/TSAN/Release on Centos 6, no failures.
> * Checked signatures and licenses (RAT)
>
> - Dan
>
> On Mon, Oct 10, 2016 at 12:27 PM, Alexey Serbin 
> wrote:
>
> > +1
> >
> > I compiled the project from source using the 1.0.1-RC1 tag (release and
> > debug modes) and ran the test suite using 'ctest -j4' at CentOS 6.6
> (kernel
> > 2.6.32-504.30.3.el6.x86_64).  All tests passed.
> >
> > Also, I compiled the project from source using the 1.0.1-RC1 tag (release
> > and debug modes) and ran the tests using 'ctest -j2' at MacOS X 10.11.5.
> > All tests passed except for pstack_watcher-test, which is a known issue
> for
> > Kudu on MacOS X.
> >
> > Besides, I run 'kudu test loadgen' tool against the newly built binaries
> > multiple times, inserting several million of rows and it passed.
> >
> >
> > Best regards,
> >
> > Alexey
> >
> >
> > On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert 
> wrote:
> >
> > > Hi,
> > >
> > > We're happy to announce the first release candidate for Apache Kudu
> > 1.0.1.
> > >
> > > This release includes bug fixes and documentation updates since the
> 1.0.0
> > > release.
> > >
> > > The is a source-only release. The artifacts were staged here:
> > > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/
> > >
> > > It was built from this tag:
> > > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=
> > > e60b610253f4303b24d41575f7bafbc5d69edddb
> > >
> > > The release notes can be found here (the release notes on
> > kudu.apache.org
> > > will be updated with the release):
> > > https://github.com/apache/kudu/blob/branch-1.0.x/docs/
> release_notes.adoc
> > >
> > > KEYS file:
> > > https://www.apache.org/dist/kudu/KEYS
> > >
> > > I'd suggest going through the README, building Kudu, and running the
> > > unit tests.
> > >
> > > Please try the release and vote; vote will be open for at least 72
> hours.
> > >
> > > Thanks,
> > >
> > > - Dan
> > >
> >
>

Re: [VOTE] Apache Kudu 1.0.1 RC1

[Dan Burkert]

+1

* Compiled and tested release mode on OS X 10.10, with no unexpected
failures.
* Compiled and tested Debug/ASAN/TSAN/Release on Centos 6, no failures.
* Checked signatures and licenses (RAT)

- Dan

On Mon, Oct 10, 2016 at 12:27 PM, Alexey Serbin 
wrote:

> +1
>
> I compiled the project from source using the 1.0.1-RC1 tag (release and
> debug modes) and ran the test suite using 'ctest -j4' at CentOS 6.6 (kernel
> 2.6.32-504.30.3.el6.x86_64).  All tests passed.
>
> Also, I compiled the project from source using the 1.0.1-RC1 tag (release
> and debug modes) and ran the tests using 'ctest -j2' at MacOS X 10.11.5.
> All tests passed except for pstack_watcher-test, which is a known issue for
> Kudu on MacOS X.
>
> Besides, I run 'kudu test loadgen' tool against the newly built binaries
> multiple times, inserting several million of rows and it passed.
>
>
> Best regards,
>
> Alexey
>
>
> On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert  wrote:
>
> > Hi,
> >
> > We're happy to announce the first release candidate for Apache Kudu
> 1.0.1.
> >
> > This release includes bug fixes and documentation updates since the 1.0.0
> > release.
> >
> > The is a source-only release. The artifacts were staged here:
> > https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/
> >
> > It was built from this tag:
> > https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=
> > e60b610253f4303b24d41575f7bafbc5d69edddb
> >
> > The release notes can be found here (the release notes on
> kudu.apache.org
> > will be updated with the release):
> > https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc
> >
> > KEYS file:
> > https://www.apache.org/dist/kudu/KEYS
> >
> > I'd suggest going through the README, building Kudu, and running the
> > unit tests.
> >
> > Please try the release and vote; vote will be open for at least 72 hours.
> >
> > Thanks,
> >
> > - Dan
> >
>

Re: [VOTE] Apache Kudu 1.0.1 RC1

[Alexey Serbin]

+1

I compiled the project from source using the 1.0.1-RC1 tag (release and
debug modes) and ran the test suite using 'ctest -j4' at CentOS 6.6 (kernel
2.6.32-504.30.3.el6.x86_64).  All tests passed.

Also, I compiled the project from source using the 1.0.1-RC1 tag (release
and debug modes) and ran the tests using 'ctest -j2' at MacOS X 10.11.5.
All tests passed except for pstack_watcher-test, which is a known issue for
Kudu on MacOS X.

Besides, I run 'kudu test loadgen' tool against the newly built binaries
multiple times, inserting several million of rows and it passed.


Best regards,

Alexey


On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert  wrote:

> Hi,
>
> We're happy to announce the first release candidate for Apache Kudu 1.0.1.
>
> This release includes bug fixes and documentation updates since the 1.0.0
> release.
>
> The is a source-only release. The artifacts were staged here:
> https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/
>
> It was built from this tag:
> https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=
> e60b610253f4303b24d41575f7bafbc5d69edddb
>
> The release notes can be found here (the release notes on kudu.apache.org
> will be updated with the release):
> https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc
>
> KEYS file:
> https://www.apache.org/dist/kudu/KEYS
>
> I'd suggest going through the README, building Kudu, and running the
> unit tests.
>
> Please try the release and vote; vote will be open for at least 72 hours.
>
> Thanks,
>
> - Dan
>

Re: [VOTE] Apache Kudu 1.0.1 RC1

[Brock Noland]

+1 non-binding

* Checked hashes and sig
* Built from source
* Ran tests, which passed

On Fri, Oct 7, 2016 at 4:00 PM, Dan Burkert  wrote:

> Hi,
>
> We're happy to announce the first release candidate for Apache Kudu 1.0.1.
>
> This release includes bug fixes and documentation updates since the 1.0.0
> release.
>
> The is a source-only release. The artifacts were staged here:
> https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/
>
> It was built from this tag:
> https://git-wip-us.apache.org/repos/asf?p=kudu.git;a=commit;h=
> e60b610253f4303b24d41575f7bafbc5d69edddb
>
> The release notes can be found here (the release notes on kudu.apache.org
> will be updated with the release):
> https://github.com/apache/kudu/blob/branch-1.0.x/docs/release_notes.adoc
>
> KEYS file:
> https://www.apache.org/dist/kudu/KEYS
>
> I'd suggest going through the README, building Kudu, and running the
> unit tests.
>
> Please try the release and vote; vote will be open for at least 72 hours.
>
> Thanks,
>
> - Dan
>