Re: UML State Diagrams for C++ Client

2015-01-08 Thread Tomer Shiran
Alex, the mailing list doesn't allow for attachments. Can you post it somewhere (Dropbox, Google Drive, etc.) and send the link. Thanks, Tomer On Thu, Jan 8, 2015 at 5:40 PM, Alexander Zarei wrote: > Hi all, > > > > We put together (attached) two UML State Diagrams for Drill C++ Client to > syn

Re: [DISCUSS] Cassandra storage for Drill

2015-01-08 Thread Yash Sharma
Great guys. That summaries the questions i had in mind. As the first phase of implementation I am planning to bypass the entire pushdown if the query falls in any of these cases. In next phase I would check if we can selectively apply few pushdowns even if the query falls in the cases. Since I am

Re: Support for Text Datatype

2015-01-08 Thread Abhishek Girish
Then there is a high chance I might have used it with Postgres instead. Like you said, the documentation needs to be updated. But I shall wait for your confirmation. Thanks! On Thu, Jan 8, 2015 at 6:18 PM, Aman Sinha wrote: > Text type fails validation in Calcite/Optiq so I don't think it was ev

Re: Support for Text Datatype

2015-01-08 Thread Aman Sinha
Text type fails validation in Calcite/Optiq so I don't think it was ever supported. There's a good chance the documentation needs to be updated..but let me confirm that by tomorrow. On Thu, Jan 8, 2015 at 4:29 PM, Abhishek Girish wrote: > Hi all, > > The documentation ( > https://cwiki.apache.o

[jira] [Created] (DRILL-1970) Hive views must not be listed with the show tables command

2015-01-08 Thread Abhishek Girish (JIRA)
Abhishek Girish created DRILL-1970: -- Summary: Hive views must not be listed with the show tables command Key: DRILL-1970 URL: https://issues.apache.org/jira/browse/DRILL-1970 Project: Apache Drill

[jira] [Created] (DRILL-1969) Error message thrown while querying Hive Views from Drill must be improved

2015-01-08 Thread Abhishek Girish (JIRA)
Abhishek Girish created DRILL-1969: -- Summary: Error message thrown while querying Hive Views from Drill must be improved Key: DRILL-1969 URL: https://issues.apache.org/jira/browse/DRILL-1969 Project:

UML State Diagrams for C++ Client

2015-01-08 Thread Alexander Zarei
Hi all, We put together (attached) two UML State Diagrams for Drill C++ Client to synchronize our comprehension of C++ Client and to foster contribution to it. I was wondering if you could review it and provide us with your feedback, suggestions and corrections. Thank you very much for your

[jira] [Created] (DRILL-1968) Provide locality information for Hive partitions

2015-01-08 Thread Abhishek Girish (JIRA)
Abhishek Girish created DRILL-1968: -- Summary: Provide locality information for Hive partitions Key: DRILL-1968 URL: https://issues.apache.org/jira/browse/DRILL-1968 Project: Apache Drill Iss

Re: Review Request 29648: DRILL-1874: Text reader should allow treating empty fields as NULLs instead of empty string

2015-01-08 Thread Aman Sinha
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29648/#review67349 --- exec/java-exec/src/main/codegen/data/Casts.tdd

Support for Text Datatype

2015-01-08 Thread Abhishek Girish
Hi all, The documentation ( https://cwiki.apache.org/confluence/display/DRILL/Data+Types) lists Text as a supported data type in Drill and I vaguely remember using the same sometime before in my CTAS scripts. As of now, my queries with an explicit cast to Text fails complaining "*Unknown datatype

Re: Review Request 29648: DRILL-1874: Text reader should allow treating empty fields as NULLs instead of empty string

2015-01-08 Thread Sean Hsuan-Yi Chu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29648/ --- (Updated Jan. 9, 2015, 12:14 a.m.) Review request for drill, Aman Sinha and Jin

[jira] [Created] (DRILL-1967) Null pointer exception in DrillParquetReader when caneled before data arrives

2015-01-08 Thread Jason Altekruse (JIRA)
Jason Altekruse created DRILL-1967: -- Summary: Null pointer exception in DrillParquetReader when caneled before data arrives Key: DRILL-1967 URL: https://issues.apache.org/jira/browse/DRILL-1967 Proje

[jira] [Created] (DRILL-1966) Fix mock data generation for date, time and decimal types

2015-01-08 Thread Jason Altekruse (JIRA)
Jason Altekruse created DRILL-1966: -- Summary: Fix mock data generation for date, time and decimal types Key: DRILL-1966 URL: https://issues.apache.org/jira/browse/DRILL-1966 Project: Apache Drill

Re: [DISCUSS] Cassandra storage for Drill

2015-01-08 Thread Jacques Nadeau
Drill's framework does the same. Drill leverages some of Calcite's extension capabilities to allow very easy pushdowns by allowing storage subsystems to expose optimizer rules (subclassed on top of Calcite's optimizer rule construct). On-top of what Calcite can do, Drill also understand concepts

[jira] [Created] (DRILL-1965) Expand read and write testing for parquet across all supported types

2015-01-08 Thread Jason Altekruse (JIRA)
Jason Altekruse created DRILL-1965: -- Summary: Expand read and write testing for parquet across all supported types Key: DRILL-1965 URL: https://issues.apache.org/jira/browse/DRILL-1965 Project: Apach

Re: Review Request 29716: DRILL-1955: C++ client should provide a clean method for detecting query completion in the async API.

2015-01-08 Thread Parth Chandra
> On Jan. 8, 2015, 10:07 p.m., Norris Lee wrote: > > Looks good to me. I'm not sure if this is your intention, but it's pretty > > much doing the same thing as it used to, where the state is returned with > > the DrillClientError in handleTerminatedQryState (which works perfectly > > fine for

[jira] [Created] (DRILL-1964) Missing key elements in returned array of maps

2015-01-08 Thread Chun Chang (JIRA)
Chun Chang created DRILL-1964: - Summary: Missing key elements in returned array of maps Key: DRILL-1964 URL: https://issues.apache.org/jira/browse/DRILL-1964 Project: Apache Drill Issue Type: Bug

[jira] [Resolved] (DRILL-1871) JSON reader cannot read compressed files

2015-01-08 Thread Jason Altekruse (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Altekruse resolved DRILL-1871. Resolution: Fixed > JSON reader cannot read compressed files >

[jira] [Created] (DRILL-1963) select * on a parquet file created from json with large no of columns fail

2015-01-08 Thread Rahul Challapalli (JIRA)
Rahul Challapalli created DRILL-1963: Summary: select * on a parquet file created from json with large no of columns fail Key: DRILL-1963 URL: https://issues.apache.org/jira/browse/DRILL-1963 Proj

[jira] [Created] (DRILL-1962) accessing nested array from multiple files causing IndexOutOfBoundException

2015-01-08 Thread Chun Chang (JIRA)
Chun Chang created DRILL-1962: - Summary: accessing nested array from multiple files causing IndexOutOfBoundException Key: DRILL-1962 URL: https://issues.apache.org/jira/browse/DRILL-1962 Project: Apache D

Re: Review Request 29716: DRILL-1955: C++ client should provide a clean method for detecting query completion in the async API.

2015-01-08 Thread Norris Lee
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29716/#review67303 --- Looks good to me. I'm not sure if this is your intention, but it's p

[jira] [Resolved] (DRILL-1625) non-bootstrap storage configuration loaded but not displayed

2015-01-08 Thread Sean Hsuan-Yi Chu (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Hsuan-Yi Chu resolved DRILL-1625. -- Resolution: Cannot Reproduce > non-bootstrap storage configuration loaded but not displa

[jira] [Created] (DRILL-1961) Field definition should match the structure of ValueVector

2015-01-08 Thread Hanifi Gunes (JIRA)
Hanifi Gunes created DRILL-1961: --- Summary: Field definition should match the structure of ValueVector Key: DRILL-1961 URL: https://issues.apache.org/jira/browse/DRILL-1961 Project: Apache Drill

Re: [DISCUSS] Cassandra storage for Drill

2015-01-08 Thread Julian Hyde
Calcite’s adapter framework makes it easy to push down filters, aggregations to third-party sources, and to express more powerful and data-source-specific optimizations. Is Drill building on Calcite’s support or doing it its own way? Calcite doesn’t have a Cassandra adapter but the same approa

Review Request 29723: DRILL-1960: Automatically realloc buffers when vector runs out of space

2015-01-08 Thread Steven Phillips
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29723/ --- Review request for drill and Jacques Nadeau. Repository: drill-git Descriptio

[jira] [Created] (DRILL-1960) Automatically realloc buffers when vector runs out of space

2015-01-08 Thread Steven Phillips (JIRA)
Steven Phillips created DRILL-1960: -- Summary: Automatically realloc buffers when vector runs out of space Key: DRILL-1960 URL: https://issues.apache.org/jira/browse/DRILL-1960 Project: Apache Drill

Re: Review Request 29648: DRILL-1874: Text reader should allow treating empty fields as NULLs instead of empty string

2015-01-08 Thread Aman Sinha
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29648/#review67284 --- common/src/main/java/org/apache/drill/common/expression/fn/CastFunc

[jira] [Created] (DRILL-1959) Issues with explicit casts to TINYINT and SMALLINT

2015-01-08 Thread Abhishek Girish (JIRA)
Abhishek Girish created DRILL-1959: -- Summary: Issues with explicit casts to TINYINT and SMALLINT Key: DRILL-1959 URL: https://issues.apache.org/jira/browse/DRILL-1959 Project: Apache Drill I

[jira] [Created] (DRILL-1958) select * fails on a text file with 3500 columns or more

2015-01-08 Thread Rahul Challapalli (JIRA)
Rahul Challapalli created DRILL-1958: Summary: select * fails on a text file with 3500 columns or more Key: DRILL-1958 URL: https://issues.apache.org/jira/browse/DRILL-1958 Project: Apache Drill

Re: Review Request 29648: DRILL-1874: Text reader should allow treating empty fields as NULLs instead of empty string

2015-01-08 Thread Sean Hsuan-Yi Chu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29648/ --- (Updated Jan. 8, 2015, 6:25 p.m.) Review request for drill, Aman Sinha and Jinf

Review Request 29716: DRILL-1955: C++ client should provide a clean method for detecting query completion in the async API.

2015-01-08 Thread Parth Chandra
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29716/ --- Review request for drill, Norris Lee and Xiao Meng. Repository: drill-git Des

Re: [DISCUSS] Cassandra storage for Drill

2015-01-08 Thread Tomer Shiran
I think that any valid SQL statement should work with any data source. Drill should: - Push down as much processing as possible into the data source (Cassandra in this case) - Maintain as much data locality as possible (ie, spread the work so that each drillbit is handling local data)

[DISCUSS] Cassandra storage for Drill

2015-01-08 Thread Yash Sharma
Hi Folks, This thread is to discuss few scenarios how Cassandra works - and how do we think it should be supported in Drill. While they are not supported in Cassandra inherently but its doable on Drill's end once we fetch a superset of data without these cases. 1. Filtering non indexed column in