Re: Kudu 1.8.0 Release Notes Draft

2018-10-03 Thread Jordan Birdsell
Thanks for taking care of this! I've updated w/ my notes. On Wed, Oct 3, 2018 at 8:56 PM Andrew Wong wrote: > Looks like this'll be a big release. Thanks Attila! > > On Wed, Oct 3, 2018 at 2:07 PM Attila Bukor wrote: > > > Hi Devs, > > > > I've created a Google doc to collect the release notes

Re: RFC: dropping Python 2.6 support

2018-08-07 Thread Jordan Birdsell
ch a transition? > > > > 1. https://github.com/apache/kudu/blob/master/python/requirements.txt > > 2. https://github.com/apache/kudu/blob/master/build- > > support/jenkins/build-and-test.sh#L437 > > 3. https://access.redhat.com/solutions/472793 > > > -- Jordan Birdsell Principal Solutions Architect, phData 678-670-7316 | phData.io <https://www.phdata.io/> <https://github.com/jtbirdsell> <https://twitter.com/jordanbirdsell> <https://www.linkedin.com/in/jordan-birdsell-25985732/>

Re: [ANNOUNCE] Recognizing the newest Apache Kudu committers

2018-07-26 Thread Jordan Birdsell
I know I speak for the rest of the PMC when I congratulate our newest > > members and encourage them to keep up the good work! > > > > - Dan > > > -- Jordan Birdsell Principal Solutions Architect, phData 678-670-7316 | phData.io <https://www.phdata.io/> <https://github.com/jtbirdsell> <https://twitter.com/jordanbirdsell> <https://www.linkedin.com/in/jordan-birdsell-25985732/>

Re: [ANNOUNCE] New committers over past several months

2017-12-18 Thread Jordan Birdsell
Congrats all! On Tue, Dec 19, 2017, 12:00 AM Todd Lipcon wrote: > Hi Kudu community, > > I'm pleased to announce that the Kudu PMC has voted to add Andrew Wong, > Grant Henke, and Hao Hao as Kudu committers and PMC members. This > announcement is a bit delayed, but I figured it's better late tha

Re: RFC: using C++ mini cluster implementation in Java and Python tests

2017-08-28 Thread Jordan Birdsell
Agreed, I too am hoping to have some time free up again in the near future for additional work on the python client. On Mon, Aug 28, 2017 at 10:26 AM Wes McKinney wrote: > +1. I hope to find some time in the next 6-12 months to hack on the > Python client and add Arrow support at the C++ client

Re: Proposal for 1.2 branch and release plan

2016-12-07 Thread Jordan Birdsell
+1 On Wed, Dec 7, 2016 at 8:16 PM Jean-Daniel Cryans wrote: > +1, let's get a 1.2.x branch soon. > > J-D > > On Tue, Dec 6, 2016 at 8:44 PM, Todd Lipcon wrote: > > > Hi Kudu developers, > > > > Back in mid-October I proposed a plan for the 1.1 and 1.2 releases[1]. > 1.1 > > is now behind us, so

Re: checkstyle on console during precommit builds

2016-11-28 Thread Jordan Birdsell
This has gone in, you will need to rebase any patches if you want to avoid the extra large build output. On Fri, Nov 25, 2016, 4:25 PM Jordan Birdsell wrote: > This appears to have done it https://gerrit.cloudera.org/#/c/5225/. > > Used a SuppressionFilter module in the style config

Re: checkstyle on console during precommit builds

2016-11-25 Thread Jordan Birdsell
This appears to have done it https://gerrit.cloudera.org/#/c/5225/. Used a SuppressionFilter module in the style config and that seemed to work. On Fri, Nov 25, 2016 at 12:02 PM Mike Percy wrote: > I am familiar with checkstyle on Maven and could potentially take a look at > this, but it won't

Re: [VOTE] Apache Kudu 1.1.0 RC1

2016-11-17 Thread Jordan Birdsell
Agreed with proceeding and doing a 1.1.1 release. On Thu, Nov 17, 2016, 5:11 PM Dan Burkert wrote: > Not a regression, it's been there since the add/drop range partitions > feature landed. > > - Dan > > On Thu, Nov 17, 2016 at 4:58 PM, Todd Lipcon wrote: > > > Sorry for radio silence on the vot

Re: [VOTE] Apache Kudu 1.1.0 RC1

2016-11-15 Thread Jordan Birdsell
+1 Tested on RHEL 7.2, all tests passed except what is noted below for Python 3 . 2 known issues were presented with Python 3, neither of these are blockers: - setup.py contained multiprocessing as a test dependency, however this is included as a standard library in all version of python s

Re: 1.1.0 rc coming today

2016-11-14 Thread Jordan Birdsell
Sounds reasonable to me On Mon, Nov 14, 2016, 5:06 PM Todd Lipcon wrote: > Hey folks, > > I'm wrapping up the creation of 1.1.0 RC0 in the next few minutes. I > noticed during my review of the branch that there are still a few items > missing on the release notes (eg the wire compatibility secti

Re: Branch for 1.1

2016-11-10 Thread Jordan Birdsell
I'd like the following in there: https://gerrit.cloudera.org/#/c/4823/ https://gerrit.cloudera.org/#/c/4586/ On Thu, Nov 10, 2016 at 12:29 PM Todd Lipcon wrote: > Hey folks, > > We're rapidly approaching the proposed date for the 1.1 release, so I'm > hoping to cut a branch today in order to s

Re: Python Client - Roadmap

2016-11-09 Thread Jordan Birdsell
riority) - Pandas integration - Additional "pythonic" improvements - Keep pace with other changes, particularly new security features Let me know if you have any opinions or questions. Thanks, Jordan On Thu, Oct 6, 2016 at 12:16 PM Todd Lipcon wrote: > On Tue, Sep 27,

Re: Plan for upcoming releases

2016-10-17 Thread Jordan Birdsell
Seems reasonable to me, have a few things for Python left I'd like to get in for 1.1: range partition implementation and alter table capabilities, that should be enough time. Thanks Todd, Jordan On Mon, Oct 17, 2016, 8:23 PM Todd Lipcon wrote: > Hey folks, > > I'd like to propose a release plan

Re: Simple solution for adding Pandas support in the Python API

2016-10-14 Thread Jordan Birdsell
I also agree with simple, particularly at this stage. I think we could always go back and do the more efficient vectorized mapping at a later point. Todd, to your point about it being simple, in my experience, Python developers take many forms, often times you will find those that really don't lik

Python Client - Roadmap

2016-09-27 Thread Jordan Birdsell
Hey folks, I know I've thrown around a few ideas lately regarding the python client as well as started trying to bring it up to speed with the rest of the kudu world, so I thought i'd try and bring it all back together with a road map of sorts and get you alls thoughts. For starters, I've had a c

Re: A couple more python patches

2016-09-14 Thread Jordan Birdsell
an add me as a reviewer to your python patches, I've likely > been the last one to work more extensively on it. > > Best > David > > On Wed, Sep 14, 2016 at 5:17 PM, Jordan Birdsell < > jordantbirds...@gmail.com> > wrote: > > > Hey folks, > > > &g

A couple more python patches

2016-09-14 Thread Jordan Birdsell
Hey folks, I've put together a couple more python patches: For KUDU-1612, KUDU-1615 and KUDU-1615: https://gerrit.cloudera.org/#/c/4417/ This addresses enabling getting/setting timestamps (unixtime_micros), scanner read at snapshot and a minor bug with write operations. I combined them because of

Re: Python API Docs

2016-09-13 Thread Jordan Birdsell
sing different > versions of the docs packages for different releases. This is basically > what we do with the Ruby-stack stuff for jekyll and asciidoc (using gem and > bundler). > > Mike > > On Tue, Sep 13, 2016 at 1:17 PM, Jordan Birdsell < > jordantbirds...@gmail.co

Re: Python API Docs

2016-09-13 Thread Jordan Birdsell
of the documentation, and just give the Python client its own page? > >> If > >> it's more strictly API docs, isn't that sort of built in using Python > doc > >> strings? (I'm not much of a Python programmer) > >> > >> -Todd > >> >

Re: [ANNOUNCE] Two new Kudu committer/PMC members

2016-09-12 Thread Jordan Birdsell
Congrats On Mon, Sep 12, 2016 at 7:09 PM Brock Noland wrote: > Congratulations!! > > On Mon, Sep 12, 2016 at 6:06 PM, David Alves > wrote: > >> Congrats Alexey and Will!! >> >> On Mon, Sep 12, 2016 at 3:55 PM, Todd Lipcon wrote: >> >> > Hi Kudu community, >> > >> > It's my great pleasure to an

KUDU-1604 - [python] Fix bug getting table column by index

2016-09-12 Thread Jordan Birdsell
Hey all, Submitted a patch for a little bug in the python client that was causing incorrect column names to be returned when getting a column from a table by index. Can someone take a look? https://gerrit.cloudera.org/#/c/4378/ Thanks, Jordan

Python API Docs

2016-09-10 Thread Jordan Birdsell
Anyone have any opinions/thoughts on Python API documentation? Pyspark, pandas and others use Sphinx, so I'm thinking python devs would be pretty comfortable with that format. Jordan

Re: Python Scan Token API

2016-09-10 Thread Jordan Birdsell
My bad, wrong change, here's the right one: https://gerrit.cloudera.org/#/c/4367/ Apologies for the extra email On Sat, Sep 10, 2016 at 6:30 PM Jordan Birdsell wrote: > Hey folks, > > I've made my first attempt at exposing the Scan Token API in the Python > client. Some

Python Scan Token API

2016-09-10 Thread Jordan Birdsell
Hey folks, I've made my first attempt at exposing the Scan Token API in the Python client. Someone mind taking a look? https://gerrit.cloudera.org/#/c/4344/ Thanks, Jordan

Re: Projection schema drops key

2016-09-09 Thread Jordan Birdsell
will need to be reset if desired. On Fri, Sep 9, 2016, 7:03 PM Todd Lipcon wrote: > On Fri, Sep 9, 2016 at 2:26 PM, Jordan Birdsell > > wrote: > > > Threw in a helper function in the SchemaBuilder to at least make it a > > little cleaner to construct a new schema with a

Re: Projection schema drops key

2016-09-09 Thread Jordan Birdsell
) builder.set_primary_keys(['key']) On Fri, Sep 9, 2016 at 3:10 PM Jordan Birdsell wrote: > I follow now, thanks > > On Fri, Sep 9, 2016 at 12:48 PM Todd Lipcon wrote: > >> Agreed with what David wrote. The dropping of 'key' status in projections >> is inten

Re: Projection schema drops key

2016-09-09 Thread Jordan Birdsell
ng of the > projection. > > If you really want to create a new table based on an existing one, you > > could get the schema from KuduTable. That one should be complete. > > > > -david > > > > On Fri, Sep 9, 2016 at 8:51 AM, Jordan Birdsell < > jordantbird

Re: Projection schema drops key

2016-09-09 Thread Jordan Birdsell
Note that this does not mean that you can't set predicates on the key, it's > just that they'll be evaluated server side, but the key won't actually be > returned. > Maybe I'm misunderstanding what you're saying? > Care to post a gist with the offending code

Re: Projection schema drops key

2016-09-09 Thread Jordan Birdsell
the projection > that was previously set on the scanner. If you don't a projection it should > indeed return all the columns. > Are you sure you didn't set a projection (with SetProjectedColumnNames > or SetProjectedColumnIndexes) that excluded the key? > > Best >

Projection schema drops key

2016-09-09 Thread Jordan Birdsell
Hey folks, i was doing some work on KUDU-854 and when testing the KuduScanner::GetProjectionSchema method call, found that the key was being dropped, which makes this much more challenging to test. Any ideas if it is intended to drop the key informa

KUDU-1304 Patch

2016-09-07 Thread Jordan Birdsell
Hey all, I've submitted a patch for KUDU-1304 to expose the ListTabletServers method and fix the Python unit test issue of tests running before all tservers have started. https://gerrit.cloudera.org/#/c/4328/ Can someone take a look? Thanks, Jor

Re: KUDU-1593 Patch

2016-09-06 Thread Jordan Birdsell
> I've left some comments. > > Best > David > > On 9/6/16, Jordan Birdsell wrote: > > Hey all, > > > > I've submitted a patch for KUDU-1593 > > <https://issues.apache.org/jira/browse/KUDU-1593>. This patch exposes > the > > num_rep

KUDU-1593 Patch

2016-09-06 Thread Jordan Birdsell
Can someone please review? https://gerrit.cloudera.org/#/c/4315/ Thanks, Jordan Birdsell