Re: [VOTE] Apache Kudu 1.8.0-RC2

+1 Built and ran C++ tests on MacOS. Had three failures (fs_manager-test, kudu-tool-test, and trace-test), but I believe they are all MacOS-specific, and shouldn't be release blockers. - Dan On Fri, Oct 19, 2018 at 11:48 PM Andrew Wong wrote: > +1 > > Built and ran all C++ tests on Centos 6.6

Re: Proposal: Gradle as the primary build tool

Sounds great, thanks for chasing this down! - Dan On Wed, Oct 3, 2018 at 7:20 PM Grant Henke wrote: > Hi Kudu dev community, > > I wanted to provide a progress and plan update to switching over to Gradle > as the primary build tool. > > First, the following steps have already been completed: >

Re: Kudu 1.8.0 Release

Sounds good to me. - Dan On Fri, Sep 21, 2018 at 11:14 AM Andrew Wong wrote: > I've been discussing with members of the dev community and I think it makes > sense to push out branching, to let some in-progress work finish and bake, > and to let some devs come back from time off. So I'm now prop

KUDU-428 Sentry Integration Design Doc

Hi Kudu developers, I've drafted a design doc for KUDU-428 Sentry Integration [1]. This is the next major step under the security umbrella. The high level goal is table and column level access control and authorization in Kudu by integrating with Apache Sentry. Please take a look at the doc --

Re: securing our infra

I think redirecting http://kudu.apache.org to https://kudu.apache.org would be a great step. Adding https to the jenkins instance would also be nice, but there may be some complication because of the infra it's hosted on (I think a Cloudera-managed GCE instance?). - Dan On Wed, Jul 25, 2018 at 1

[ANNOUNCE] Recognizing the newest Apache Kudu committers

Hi all, I'm pleased to announce that the Kudu PMC has voted to add Attila Bukor and Sailesh Mukil as committers and PMC members. Attila has contributed many supportability, build, docs, and quality of life improvements. In addition, Attila has been very active helping users on our Slack and emai

Re: [VOTE] Apache Kudu 1.7.1 RC2

+1 Built on macOS 10.12, all tests passed. - Dan On Tue, Jun 5, 2018 at 5:21 PM, William Berkeley wrote: > +1 > > Built on el7. > Ran tests. Passed. > Put on a 4-node cluster with some existing data written by 1.5. Was able to > scan the data back (same results as before). > > -Will > > On Wed

Re: Adding examples

Sounds great to me. Having examples in the repository proper means they can be hooked into the build, and prevented from going stale. Having that kind of integration with CI is critical to making sure things don't bit-rot. - Dan On Tue, Mar 27, 2018 at 2:45 PM, William Berkeley wrote: > Hi Ku

Re: [VOTE] Apache Kudu 1.6.0 RC1

+1 built and ran tests on macos. - Dan On Tue, Dec 5, 2017 at 7:06 PM, Mike Percy wrote: > +1 > > I built 1.6.0-RC1 on RHEL 7 in RELEASE mode. > > - Checksums and sigs match > - README.txt and LICENSE.txt look good > - RAT check passed > - All tests passed except for one flaky test (delete_tabl

Re: INT128 Column Support Interest

Aren't we going to need efficient encodings in order to make decimal work well, anyway? - Dan On Thu, Nov 16, 2017 at 2:54 PM, Todd Lipcon wrote: > On Thu, Nov 16, 2017 at 2:28 PM, Dan Burkert > wrote: > > > I think it would be useful. As far as I've seen the main c

Re: INT128 Column Support Interest

I think it would be useful. As far as I've seen the main costs in carrying data types are in writing performant encoders, and updating integrations to work with them. I'm guessing with 128 bit integers there would be some integrations that can't or won't support it, which might be a cause for con

Re: RFC: Canceling RPC in mid-transmission

palad nodes will still block >> waiting for these few overloaded during cancellation and hold up memory >> resources on those Impalad nodes. >> >> Thanks, >> Michael >> >> On Fri, Oct 13, 2017 at 11:30 AM, Dan Burkert wrote: >> >>> I

Re: RFC: Canceling RPC in mid-transmission

I'm still hung up on the premise that if the network is down, cancellation should still be expected to complete in bounded time. If the network is partitioned or congested to the point of non-delivery, how is the coordinator going to deliver the cancellation messages to the fragments in the first

[ANNOUNCE] Apache Kudu 1.5.0 released

The Apache Kudu team is happy to announce the release of Kudu 1.5.0. Kudu is an open source storage engine for structured data which supports low-latency random access together with efficient analytical access patterns. It is designed within the context of the Apache Hadoop ecosystem and supports

Re: [VOTE] Apache Kudu 1.5.0 RC3

Thanks for voting, everyone! We have 6 binding +1 votes and 3 non-binding +1s. I'll work on publishing the release today, and send out announcements on Monday. - Dan On Fri, Sep 8, 2017 at 1:50 PM, Dan Burkert wrote: > +1 > > Built and ran tests on macos, no unexpected failu

Re: [VOTE] Apache Kudu 1.5.0 RC3

+1 Built and ran tests on macos, no unexpected failures. - Dan On Thu, Sep 7, 2017 at 8:24 PM, Jean-Daniel Cryans wrote: > +1 > > Built on CentOS 7.3.1611 in release mode, ran all unit tests, also ran the > Java unit tests. > > J-D > > On Tue, Sep 5, 2017 at 10:40

Re: [VOTE] Apache Kudu 1.5.0 RC2

rt KUDU-1726 or do a quick fix which > > > adds > > > > a > > > > > user > > > > > facing flag to config tablet copy session expire time (such as > > > > > --tablet_copy_idle_timeout_ms). > > > > > Apologiz

[VOTE] Apache Kudu 1.5.0 RC3

Hi, The Apache Kudu team is happy to announce the third release candidate for Apache Kudu 1.5.0. Apache Kudu 1.5.0 is a minor release which offers many improvements and fixes since the prior release. The is a source-only release. The artifacts are staged here: https://dist.apache.org/repos/dist/

Re: [VOTE] Apache Kudu 1.5.0 RC2

Subject line updated to indicate that this is RC 2. On Fri, Sep 1, 2017 at 4:43 PM, Dan Burkert wrote: > Hi, > > The Apache Kudu team is happy to announce the second release candidate for > Apache Kudu 1.5.0. > > Apache Kudu 1.5.0 is a minor release which offers many improv

[VOTE] Apache Kudu 1.5.0 RC1

Hi, The Apache Kudu team is happy to announce the second release candidate for Apache Kudu 1.5.0. Apache Kudu 1.5.0 is a minor release which offers many improvements and fixes since the prior release. The is a source-only release. The artifacts are staged here: https://dist.apache.org/repos/dist

Re: [VOTE] Apache Kudu 1.5.0 RC1

We need to check that. If the former is the case, we simply > change to the proper header. If the latter is the case, the files need to > be added to the LICENSE.txt file. > > Mike > > [1] https://www.apache.org/legal/src-headers.html > > On Fri, Sep 1, 2017 at 9:53 AM, Da

Re: [VOTE] Apache Kudu 1.5.0 RC1

Java convenience binaries in the form of a Maven repository are staged here: https://repository.apache.org/content/repositories/orgapachekudu-1013. Testing out the Maven repo would be appreciated. - Dan On Fri, Sep 1, 2017 at 9:53 AM, Dan Burkert wrote: > Hi, > > The Apache Kudu team

[VOTE] Apache Kudu 1.5.0 RC1

Hi, The Apache Kudu team is happy to announce the first release candidate for Apache Kudu 1.5.0. Apache Kudu 1.5.0 is a minor release which offers many improvements and fixes since the prior release. The is a source-only release. The artifacts are staged here: https://dist.apache.org/repos/dist/

Re: Upcoming 1.5 release

o the list please reply: https://gerrit.cloudera.org/#/c/7824/ https://gerrit.cloudera.org/#/c/7748/ https://gerrit.cloudera.org/#/c/7852/ - Dan On Mon, Aug 28, 2017 at 11:35 AM, Dan Burkert wrote: > I'm going to shoot for 5:30 PM Pacific time, +- 30 minutes, since I know > there'

Re: Upcoming 1.5 release

about an hour or 5? > > Thanks, > > J-D > > On Mon, Aug 28, 2017 at 11:25 AM, Dan Burkert > wrote: > > > Hi all, reminder that we will be branching today for 1.5. Still on track > > for a first RC on Wednesday or Thursday. Keep those release notes > coming, &

Re: Upcoming 1.5 release

he Java client in the context of KUDU-2013. > > > > > > Kind regards, > > > > Alexey > > > > > > On 8/24/17 4:47 PM, Mike Percy wrote: > > > >> +1, thanks for RM'ing Dan. > >> > >> Mike > >> > >> On Th

Re: IWYU configuration for gerrit pre-commit checks

Thanks, Alexey! - Dan On Thu, Aug 24, 2017 at 4:46 PM, Mike Percy wrote: > Thanks for setting this up, Alexey! > > Mike > > On Thu, Aug 24, 2017 at 11:18 AM, Alexey Serbin > wrote: > > > Hi, > > > > Today I enabled the IWYU (include-what-you-use) configuration > > for the pre-commit Jenkins jo

Upcoming 1.5 release

Hey everyone, I think it's time to get the ball rolling on a 1.5 release. It's been a bit over 2 months since 1.4, and we've had ~250 commits to master since then. I volunteer to RM, unless someone else wants the honor. I propose we branch 1.5 this coming Monday, August 28th, with the aim to st

Re: Java 7 and Spark Support

deprecation so that users can smoothly transition to the new API. Also relevant, from the same source: > Major version X (X.y.z | X > 0) MUST be incremented if any backwards incompatible changes are introduced to the public API. - Dan > > On Tue, Aug 15, 2017 at 2:18 PM, Dan Burke

Re: Java 7 and Spark Support

I'll preface my response by saying I don't think there are any hard and fast rules here, but I'd like us to try and continue following SemVer rules as much as possible. On Tue, Aug 15, 2017 at 2:03 PM, Grant Henke wrote: > > >- Should/can we drop Spark 1 support in the next minor release? >

Re: Preconditions vs assert in the Kudu Java client

situations, but which fail catastrophically and unpredictably due to failure to handle black-swan error cases. - Dan On Tue, Jul 11, 2017 at 1:24 PM, Dan Burkert wrote: > My general rule of thumb is that I use 'assert' whenever I'm claiming that > something must be true give

Re: Preconditions vs assert in the Kudu Java client

My general rule of thumb is that I use 'assert' whenever I'm claiming that something must be true given static (non-runtime) knowledge local to the context (usually a method or class). If the assert fails, it indicates that there is irrefutably a bug in that context. I use the Preconditions helpe

Re: Allow user spoofing in insecure clusters?

I'm in favor of providing an easy to use workaround for this case, but I'd like to see it implemented a bit differently. I think the user name should be an option in the Kudu client builder (alongside e.g. import_authentication_credentials

Re: [VOTE] Apache Kudu 1.4.0 RC2

+1 Built and ran tests on OS X 10.10. - Dan On Mon, Jun 12, 2017 at 9:49 AM, Brock Noland wrote: > +1 (non-binding) > > Built and ran tests > > On Mon, Jun 12, 2017 at 9:49 AM, Jean-Daniel Cryans > wrote: > > Err sorry I meant to vote on Friday but then Happy Hour happened :) > > > > +1, ran

Re: Thinking about renaming TabletPeer

> none seems better than TabletReplica IMO. + 1 On Wed, May 3, 2017 at 1:05 PM, wrote: > none seems better than TabletReplica IMO. >

Re: Multi-word Flag Style

- Dan On Mon, Apr 10, 2017 at 1:24 PM, Alexey Serbin wrote: > Oops, sure -- we cannot use dashes when referring to the variables in our > C++ code. > > > On 4/10/17 12:40 PM, Dan Burkert wrote: > >> On Mon, Apr 10, 2017 at 11:56 AM, Adar Dembo wrote: >> >

Re: UI for whitelist unauthenticated connections from public IP address

Hi Hao, First off, thanks for working on this. I think it's crucial to avoid the bad reactions that a lot of other databases have been getting recently. Secure by Default! I like the idea of a 'trusted-subnets' flag, which defaults to the private and loopback address blocks. E.g. something alon

Re: Adding extra data to Kudu::Status

Between RVO and move semantics we shouldn't be (deep) copying Status objects very much. That being said, while I agree that the Status pattern is not optimal in a lot of ways, I think changing it to be templated is going to be very painful (if not impossible due to public API concerns). Piping thr

Re: [VOTE] Apache Kudu 1.3.1 RC1

+1 Built and ran tests on OS X 10.10. delete_tablet-itest fails, but it appears to fail on master as well, all they way back to when it was introduced about a month ago. Not a blocker IMO. - Dan On Mon, Apr 17, 2017 at 4:32 PM, Todd Lipcon wrote: > +1 > > Built the release build bits on Cent

Re: Multi-word Flag Style

t; > > > > > > On 4/10/17 10:42 AM, William Berkeley wrote: > >> > >> I agree, for the reason you gave: dashes are the norm in Unix, so they > >> "feel right" for flag names. > >> > >> -Will > >> > >

Multi-word Flag Style

Hi all, As of Kudu 1.3, multi-word flags can use a dash '-' separator in lieu of the underscore '_' separator. For example, --memory_limit_hard_bytes can now be specified as --memory-limit-hard-bytes, or even --memory_limit-hard_bytes. Of the people I've talked to, most seem to prefer dashes to

Re: [VOTE] Apache Kudu 1.3.0 RC1

a > > release whose default build configuration (i.e. without NO_TESTS=1) > > fails to build on a commonly used platform, and I'd like to avoid > > setting that precedent. Between this and the macOS build breakages Dan > > pointed out, I think we have enough reason to do

Re: [VOTE] Apache Kudu 1.3.0 RC1

+0 - env_util-test.cc fails to build on OS X 10.10 (fixed on master in 97831ead ) - external_mini_cluster-test and security-itest fail on OS X 10.10 (fixed on master in c5ec0ddb0

Kerberos replay attack mitigation in Kudu

Hi all, While testing the new Kudu security features, Todd found that the Kerberos replay cache is causing excessively slow connection setup. Apparently krb5 will fsync the replay cache file while holding a global lock during every connection setup on the server. Workarounds include configuring

Re: Proposal for 1.3 branch and release

+1 SGTM, thanks! - Dan On Tue, Feb 21, 2017 at 11:19 AM, Hao Hao wrote: > +1 Thanks a lot Todd for putting this together and volunteered to be the > RM. > > Best, > Hao > > On Tue, Feb 21, 2017 at 10:40 AM, Dave Wang wrote: > > > Strong +1 on your proposal Todd. > > > > - Dave > > > > On Tue,

Re: TLS for localhost connections

On Fri, Feb 10, 2017 at 10:14 AM, Alexey Serbin wrote: > > From the other side, I think dropping TLS opens a door for localhost MITM > attacks if an attacker can control access to ipfilter (fiddling with data > like rewriting traffic?). > This would require root, right? > > BTW, if dropping enc

Re: TLS for localhost connections

On Fri, Feb 10, 2017 at 10:02 AM, Todd Lipcon wrote: > > Yea, I figured that both sides would check the remote peer, and if they > both agree that the other side is local, they'd offer TLS_NEGOTIATION_ONLY > or somesuch. This could also be used in a scenario where a user needs > authentication but

Re: TLS for localhost connections

A couple thoughts: * You had to explicitly turn on the ADH and AECDH ciphers, right? We shouldn't be using those in any circumstances, but I don't think it would change the results of your test. * We've discussed adding checksums to the RPC system in the past, but punted since we would get it 'f

Re: Monitoring Use Cases for Kudu

Hi Senthil, Kudu masters and tservers expose internal metrics in JSON format at the /metrics endpoint of the web UI. You could start by scraping this endpoint every 10 seconds or so, and recording that. I think that's more or less how Cloudera Manager exposes Kudu metrics. Our docs

Re: TokenPB contents

7;s a good reason not to do it that way. Our normal required feature flags mechanism should work in that case, where the field is not critical/required. > > > Best regards, > > Alexey > > On Wed, Jan 25, 2017 at 3:14 PM, Dan Burkert > wrote: > > > That's

Re: TokenPB contents

unknown fields. >> optional bytes token_contents = 2; >> >> // The cryptographic signature of 'token_contents'. >> optional bytes signature = 3; >> >> // The sequence number of the key which produced 'signature'. >> optional int64 s

Re: TokenPB contents

ytes token_contents = 2; > > // The cryptographic signature of 'token_contents'. > optional bytes signature = 3; > > // The sequence number of the key which produced 'signature'. > optional int64 signing_key_seq_num = 4; > }; > > This looks great to

Re: TokenPB contents

I think it must go in the 'token_contents' itself, otherwise it can be modified by a malicious client. Other than that, looks good. - Dan On Wed, Jan 25, 2017 at 12:37 PM, Todd Lipcon wrote: > Hey folks > > I'm working on the token signing/verification stuff at the moment. Curious > to solicit

Re: Use of boost non-header-only functionality

Is there an equivalent library for the JVM? - Dan On Thu, Jan 19, 2017 at 4:33 PM, Dan Burkert wrote: > I think for a long time we resisted vendoring boost, and so avoiding the > dynamically linked parts of boost was advantageous to avoid > incompatibilities in system boost versions.

Re: Use of boost non-header-only functionality

I think for a long time we resisted vendoring boost, and so avoiding the dynamically linked parts of boost was advantageous to avoid incompatibilities in system boost versions. I recall we are vendoring boost now, so that should be less of a concern, I would think. - Dan On Thu, Jan 19, 2017 at

Re: [VOTE] Apache Kudu 1.2.0 RC1

Little bit late to the party, but release LGTM. Compiled and passed all tests on OS X 10.10. - Dan On Wed, Jan 18, 2017 at 8:48 AM, William Berkeley wrote: > Yeah I'm ok with passing it. Just a thought since it would be a quick fix. > > -Will > > On Wed, Jan 18, 2017 at 5:05 AM, Dinesh Bhat w

Re: initial draft of security scoping document/roadmap

On Mon, Oct 17, 2016 at 6:48 PM, William Berkeley > > wrote: > > > Fixed link: > > https://docs.google.com/document/d/1Yu4iuIhaERwug1vS95yWDd_ > > WzrNRIKvvVGUb31y-_mY/edit# > > > > -Will > > > > On Mon, Oct 17, 2016 at 9:42 PM, Dan Burkert > >

Re: checkstyle on console during precommit builds

entially take a look > at > > this, but it won't be before Tuesday. > > > > Mike > > > > On Wed, Nov 23, 2016 at 8:08 PM, Dan Burkert wrote: > > > > > Nevermind, that didn't fix it. > > > > > > On Wed, Nov 23, 2016 at 11:59

Re: checkstyle on console during precommit builds

Nevermind, that didn't fix it. On Wed, Nov 23, 2016 at 11:59 AM, Dan Burkert wrote: > Still double checking, but this seems to have done the trick: > https://gerrit.cloudera.org/#/c/5206/. Not sure why, probably never will. > > - Dan > > On Wed, Nov 23, 2016 at 11:50

Re: checkstyle on console during precommit builds

Still double checking, but this seems to have done the trick: https://gerrit.cloudera.org/#/c/5206/. Not sure why, probably never will. - Dan On Wed, Nov 23, 2016 at 11:50 AM, Todd Lipcon wrote: > On Wed, Nov 23, 2016 at 11:13 AM, Dan Burkert wrote: > >> I'm looking into thi

Re: checkstyle on console during precommit builds

I'm looking into this a bit. It does get disabled on generated sources when I run it locally, and there is a line in the pom.xml calling that out. I haven't been able to pinpoint what is different on the build slaves yet. The version

Re: [VOTE] Apache Kudu 1.1.0 RC1

obably by mid-afternoon tomorrow PST. > > -Todd > > On Thu, Nov 17, 2016 at 8:26 PM, Jordan Birdsell < > jordantbirds...@gmail.com> > wrote: > > > Agreed with proceeding and doing a 1.1.1 release. > > > > On Thu, Nov 17, 2016, 5:11 PM Dan Burkert wrote: &

Re: [VOTE] Apache Kudu 1.1.0 RC1

so present in 1.0? If it's not > a regression i think it's reasonable to continue with the release and try > to fix in a 1.1.1 along with a couple other late discovered bugs. > > Todd > > On Nov 17, 2016 6:50 PM, "Dan Burkert" wrote: > > Dimitris T

Re: [VOTE] Apache Kudu 1.1.0 RC1

Dimitris Tsirogiannis just uncovered a bug that allows unintended range partitions to be dropped: KUDU-1750 . The bug allows a range partition to be dropped if either the lower or upper bound range partition key matches, instead of requiring both t

Re: [VOTE] Apache Kudu 1.1.0 RC1

+1 Built and tested on OS X 10.10 in debug mode, and checked hashes and signature. A few of the tests failed, but these are expected for this release (and have already been fixed on master): * client_samples-test * external_mini_cluster-test * sasl_rpc-test * pstack_watcher-test sasl_rpc-test h

Re: 1.1.0 rc coming today

Sounds good. On Mon, Nov 14, 2016 at 3:09 PM, Jordan Birdsell wrote: > Sounds reasonable to me > > On Mon, Nov 14, 2016, 5:06 PM Todd Lipcon wrote: > > > Hey folks, > > > > I'm wrapping up the creation of 1.1.0 RC0 in the next few minutes. I > > noticed during my review of the branch that there

Re: Patches that need release notes for Kudu 1.1.0

'pruning fails with IS NOT NULL' and 'DNS resolves killing tservers' were both fixed in 1.0.1. I'll write up notes for IN LIST. - Dan On Tue, Nov 8, 2016 at 9:58 AM, Jean-Daniel Cryans wrote: > Hey devs, > > I'm doing a pass over the stuff committed since 1.0.1 >

Re: Internal daemon-to-daemon authorization

I like the implementation; I think it walks a good line between being uncumbersome but quickly auditable for missing authz on services. - Dan On Tue, Nov 1, 2016 at 11:51 AM, Brock Noland wrote: > This looks really straightforward IMO. I think as a dev if you are > modifying the wire protocol,

Heads Up: new (test-only) system dependencies

Hi all, As you can see in the recent commit history, work has gotten started on adding security features to Kudu. As part of this, we are now relying on MIT Kerberos (krb5), OpenSSL, and the GSSAPI SASL plugin. Since these are security-sensitive dependencies, we are relying on the system to prov

Re: initial draft of security scoping document/roadmap

Hi all, We've been thinking about some of the particular details laid out in the scope doc, and have come up with some alternatives. You can see the alternative and discussion here: https://docs.google.com/document/d/1Yu4iuIhaERwug1vS95yWDd_ WzrNRIKvvVGUb31y-_mY/edit# - Dan On Mon, Oct 10, 201

Re: Plan for upcoming releases

Sounds good to me, thanks for volunteering. - Dan On Mon, Oct 17, 2016 at 5:27 PM, Jordan Birdsell wrote: > Seems reasonable to me, have a few things for Python left I'd like to get > in for 1.1: range partition implementation and alter table capabilities, > that should be enough time. > > Than

Improved Backup and Bulk Load scope doc

Hi all, I've been iterating on a scope doc laying out some options for improving Kudu's backup/restore and bulk load story in the near future. You can find it at https://s.apache.org/kudu-backup-scope . Comments and concerns are welcome! - Dan

[ANNOUNCE] Apache Kudu 1.0.1 release

The Apache Kudu team is happy to announce the release of Kudu 1.0.1! Kudu is an open source storage engine for structured data which supports low-latency random access together with efficient analytical access patterns. It is designed within the context of the Apache Hadoop ecosystem and supports

[RESULT] [VOTE] Apache Kudu 1.0.1 RC1

good. > > J-D > > On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert wrote: > > > Hi, > > > > We're happy to announce the first release candidate for Apache Kudu > 1.0.1. > > > > This release includes bug fixes and documentation updates since the 1.0.0

Re: [VOTE] Apache Kudu 1.0.1 RC1

several million of rows and it passed. > > > Best regards, > > Alexey > > > On Fri, Oct 7, 2016 at 2:00 PM, Dan Burkert wrote: > > > Hi, > > > > We're happy to announce the first release candidate for Apache Kudu > 1.0.1. > > > > This rele

[VOTE] Apache Kudu 1.0.1 RC1

Hi, We're happy to announce the first release candidate for Apache Kudu 1.0.1. This release includes bug fixes and documentation updates since the 1.0.0 release. The is a source-only release. The artifacts were staged here: https://dist.apache.org/repos/dist/dev/kudu/1.0.1-RC1/ It was built fro

Re: Kudu 1.0.1 patch release

> > Thanks, > > Alexey > > On Fri, Oct 7, 2016 at 12:00 PM, Dan Burkert wrote: > > > I've pulled in all of the doc fixups between 1.0.0 and now into 1.0.x. I > > cherry-picked KUDU-1681, but none of the other I listed yesterday, since > > the consensus

Re: Kudu 1.0.1 patch release

an On Fri, Oct 7, 2016 at 2:13 AM, Mike Percy wrote: > On Thu, Oct 6, 2016 at 8:12 PM, Dan Burkert wrote: > > > I'll make sure we release a new build of the website since a lot of docs > > have changed. My understanding is that this can be decoupled from the > > act

Re: Kudu 1.0.1 patch release

the following should make the cut: > > > > KUDU-1660 / 69e657 > > <https://github.com/apache/kudu/commit/69e65780843040c085ca34901803b9 > > 7b59595c0e>: > > Kudu fails to start up on single CPU system > > KUDU-1652 part 2 <https://gerrit.clou

Re: Fault tolerant scanner returning out-of-order partitions

It's also strange that the first two rows have the same value for c79. That is extremely unlikely. I can dig in more tomorrow. - Dan On Mon, Oct 3, 2016 at 10:53 PM, Dan Burkert wrote: > The first three rows (including the out of order row) all fall in the same > range partition, s

Re: Fault tolerant scanner returning out-of-order partitions

The first three rows (including the out of order row) all fall in the same range partition, so the issue is likely that the intra-tablet scan returned out of order results (as opposed to the client scanning tablets out of order). I'm under the same impression about SetFaultTolerant(), which is why

Re: Kudu 1.0.1 patch release

mit/69e65780843040c085ca34901803b97b59595c0e>: Kudu fails to start up on single CPU system KUDU-1652 part 2 <https://gerrit.cloudera.org/#/c/4612/> - Dan On Tue, Sep 27, 2016 at 11:22 AM, Dan Burkert wrote: > Yep, I can take care of that. > > - Dan > > On Tue, Sep 27, 2016 at 11:21 AM, Todd

Re: Heads-up: thirdparty tree changes may cause build breakages for a bit

Thanks, Adar! This is really tedious work, but it's much appreciated. - Dan On Thu, Sep 29, 2016 at 11:06 AM, Adar Dembo wrote: > All of the patches have been merged. Once you rebase, you'll probably > need the big hammer ('git clean -xdf thirdparty') to clean up your > local repo. Also, _PLEA

Re: Kudu 1.0.1 patch release

gt; > On Tue, Sep 27, 2016 at 11:11 AM, Dan Burkert > wrote: > > > Fixes have landed for KUDU-1651 > > <https://github.com/apache/kudu/commit/1f40913de6d3427847f3d435e1b84f > > b928a6f6a9> > > and KUDU-1652 > > <https://github.com/apache/kudu/commit/

Re: Kudu 1.0.1 patch release

35/ >> >> This fixes a crash when running on single-core systems. Again not too >> common (even most VMs have two cores these days) but it can be a blocker if >> you need to run on a single-core. >> >> -Todd >> >> On Mon, Sep 26, 2016 at 10:49 AM, Da

Kudu 1.0.1 patch release

Hi all, Since the 1.0.0 release there have been a few issues found which may warrant a bug fix on the 1.0.x line. I'd like to get the ball rolling and figure out what we might want to include in a bug release, if we decide to go ahead with a bug release fix. Potential inclusions: KUDU-1652

Re: Kudu Build: Unsupported options error

he thirdparty ? > > Regards, > Valencia > > > > [image: Inactive hide details for Dan Burkert ---09/23/2016 10:40:06 > PM---Valencia, If these are just issues with building libstdc++ in]Dan > Burkert ---09/23/2016 10:40:06 PM---Valencia, If these are just issues with > buildin

Re: 'tidy-bot' now running (experimentally)

Another couple of things: Tidy-bot uses a very strict definition of lexicographic ordering, e.g. it prefers: #include "kudu/client/value-internal.h" #include "kudu/client/value.h" Whereas we have typically preferred the reverse ordering. I'm +1 on tidy bot's way, since it allows imports to be o

Re: Kudu Build: Unsupported options error

Valencia, If these are just issues with building libstdc++ in thirdparty, then the effect on Kudu should be negligible. libstdc++ is *only* used (linked-to) when building with thread sanitizer (TSAN) support. Right now we unconditionally build thirdparty libraries for TSAN when compiling on Linu

Re: 'tidy-bot' now running (experimentally)

I'd vote to keep as well. - Dan On Mon, Sep 19, 2016 at 2:19 PM, Adar Dembo wrote: > Personally I haven't seen much of a need for abbreviated parameter > names. I'd vote for keeping the warning. > > On Mon, Sep 19, 2016 at 2:14 PM, Todd Lipcon wrote: > > How do people feel about this warning?

Re: [ANNOUNCE] Two new Kudu committer/PMC members

Congrats! On Mon, Sep 12, 2016 at 4:27 PM, Jordan Birdsell wrote: > Congrats > > On Mon, Sep 12, 2016 at 7:09 PM Brock Noland wrote: > >> Congratulations!! >> >> On Mon, Sep 12, 2016 at 6:06 PM, David Alves >> wrote: >> >>> Congrats Alexey and Will!! >>> >>> On Mon, Sep 12, 2016 at 3:55 PM, To

Re: Deploying to the ASF maven repo

Both the staging and nightly repos look good to me, I was able to use them from a thirdparty maven project. apache.snapshots Apache Snapshot Repository https://repository.apache.org/snapshots apache.kudu.staging Apache Kudu Staging Repository

Re: [VOTE] Apache Kudu 0.10.0 RC1

+1 Compiled + unit tests run on OS X 10.10.5 Will pointed out an issue when using the C++ Scan Token API on tables with non-covering range partitioning. Since this is the intersection of a rarely used API (scan token creation via C++) with a brand new feature (non-covering range partitioning), I

Re: Kudu Spark integration updates

show +---+---+---+ | a| b| c| +---+---+---+ | 1|101|101| | 2| 2| 2| | 3| 3| 3| +---+---+---+ scala> deleteDF.write.option("kudu.table", "t").option("kudu.operation", "delete").mode("append").kudu scala> sqlContext.read.option("

Kudu Spark integration updates

Hi all, Will Berkeley has been working on some proposed updates updates to the Kudu Spark connector (see the code in review here ). The high level overview of the patch is * Explicit support for inserting, dropping, upserting, and deleting rows in DataFrames

Re: RFC: rename "remote bootstrap" to "tablet copy"?

I support the rename. I like 'tablet snapshot copy/transfer' over 'tablet copy', but not by a big margin. Both are a lot clearer than 'remote bootstrap'. - Dan On Mon, Aug 1, 2016 at 3:10 PM, Adar Dembo wrote: > I don't have much of an opinion one way or the other. I'm not put off > by the cur

Re: Change packaging from org.kududb to org.apache.kudu?

To get the ball rolling on this I put up a series of patchsets (1 , 2 , 3 ). No attempt was made at maintaining backwards compatibility with applications. In-flight changes to the