[jira] [Created] (DRILL-4294) InfoSchema is not returning column metadata if the query contains escape character

2016-01-21 Thread Sudip Mukherjee (JIRA)
Sudip Mukherjee created DRILL-4294: -- Summary: InfoSchema is not returning column metadata if the query contains escape character Key: DRILL-4294 URL: https://issues.apache.org/jira/browse/DRILL-4294

Apache Drill 1.4 and TDE

2016-01-21 Thread Ghosh, Kalyan
Hi, Can Apache Drill 1.4 query Hive external tables where the HDFS is encrypted by TDE? Querying Hive from drill-embeded, I get this error: 09:15:05.155 [ingestsvc:task-delegate-thread] ERROR o.a.hadoop.hdfs.KeyProviderCache - Could not find uri with key [dfs.encryption.key.provider.uri] to cr

Re: query hanging in CANCELLATION_REQUEST

2016-01-21 Thread Jacques Nadeau
Do you have a jstack and heap dump from the moment of the hang? That would be the best way to determine what was going on. I've found that to be the easiest way to see what was hung on and the state of system at the time. -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 20, 2016 at 1:42 P

Re: Time for a 1.5 release?

2016-01-21 Thread Jacques Nadeau
Jinfeng, can you open a jira for the failing test if one isn't open? -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 20, 2016 at 7:57 AM, Jinfeng Ni wrote: > I still saw mvn full build failed on linux due to the following unit > test case sometime: > > Tests in error: > TestTopNSchem

Re: query hanging in CANCELLATION_REQUEST

2016-01-21 Thread Abdel Hakim Deneche
I may have a jstack but not the heap dump. I will try to reproduce it once again and will open a JIRA for it. On Thu, Jan 21, 2016 at 8:37 AM, Jacques Nadeau wrote: > Do you have a jstack and heap dump from the moment of the hang? That would > be the best way to determine what was going on. I've

Re: Time for a 1.5 release?

2016-01-21 Thread Steven Phillips
I merged a patch yesterday that I believe addresses that issue. Can you see if you still hit it? On Thu, Jan 21, 2016 at 8:39 AM, Jacques Nadeau wrote: > Jinfeng, can you open a jira for the failing test if one isn't open? > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Wed, Jan 20,

[jira] [Created] (DRILL-4295) Obsolete protobuf generated files under protocol/

2016-01-21 Thread Laurent Goujon (JIRA)
Laurent Goujon created DRILL-4295: - Summary: Obsolete protobuf generated files under protocol/ Key: DRILL-4295 URL: https://issues.apache.org/jira/browse/DRILL-4295 Project: Apache Drill Issu

[GitHub] drill pull request: DRILL-4295: Removes obsolete protobuf-generate...

2016-01-21 Thread laurentgo
GitHub user laurentgo opened a pull request: https://github.com/apache/drill/pull/333 DRILL-4295: Removes obsolete protobuf-generated files These files are obsolete protobuf-generated files, whose definition has been removed. You can merge this pull request into a Git repository by

Re: Time for a 1.5 release?

2016-01-21 Thread Jinfeng Ni
Looks like there was a patch merged in yesterday, and it modified the testcase [1]. While looking at the previous test, seems the expected results are not right. (order by "DESC" should use NULL FIRST policy). I'm surprised how it would happen with such random failure behavior. [1] https://gith

[jira] [Created] (DRILL-4296) Query hangs in CANCELLATION_REQUESTED when cancelled after it starts returning results

2016-01-21 Thread Deneche A. Hakim (JIRA)
Deneche A. Hakim created DRILL-4296: --- Summary: Query hangs in CANCELLATION_REQUESTED when cancelled after it starts returning results Key: DRILL-4296 URL: https://issues.apache.org/jira/browse/DRILL-4296

Re: query hanging in CANCELLATION_REQUEST

2016-01-21 Thread Abdel Hakim Deneche
DRILL-4296 created. I'm in the process of attaching jstack and heap dump On Thu, Jan 21, 2016 at 8:54 AM, Abdel Hakim Deneche wrote: > I may have a jstack but not the heap dump. I will try to reproduce it once > again and will open a JIRA for it. > > On Thu, Jan 21, 2016 at 8:37 AM, Jacques Nade

[jira] [Created] (DRILL-4297) Provide a new interface to send custom messages

2016-01-21 Thread amit hadke (JIRA)
amit hadke created DRILL-4297: - Summary: Provide a new interface to send custom messages Key: DRILL-4297 URL: https://issues.apache.org/jira/browse/DRILL-4297 Project: Apache Drill Issue Type: Im

[GitHub] drill pull request: DRILL-4295: Removes obsolete protobuf-generate...

2016-01-21 Thread jacques-n
Github user jacques-n commented on the pull request: https://github.com/apache/drill/pull/333#issuecomment-173678237 Can you look at a way to update the -Pproto-compile code so it first deletes all the files so we don't have this kind of problem in the future? --- If your project is

[jira] [Created] (DRILL-4298) SYSTEM ERROR: ChannelClosedException

2016-01-21 Thread Chun Chang (JIRA)
Chun Chang created DRILL-4298: - Summary: SYSTEM ERROR: ChannelClosedException Key: DRILL-4298 URL: https://issues.apache.org/jira/browse/DRILL-4298 Project: Apache Drill Issue Type: Bug

[GitHub] drill pull request: DRILL-4295: Removes obsolete protobuf-generate...

2016-01-21 Thread laurentgo
Github user laurentgo commented on the pull request: https://github.com/apache/drill/pull/333#issuecomment-173681422 I can check on how to delete first, but maybe you can share why these files are persisted in the first place under git, versus being generated everytime: is it because

[GitHub] drill pull request: DRILL-4295: Removes obsolete protobuf-generate...

2016-01-21 Thread jacques-n
Github user jacques-n commented on the pull request: https://github.com/apache/drill/pull/333#issuecomment-173683725 Fair question. For the first year the codebase only generated these files at build time (no check-in). In this situation newcomers had to install the right version of p

Re: Changing Map schema in an embeded list

2016-01-21 Thread Andries Engelbrecht
This seems to be an interesting issue with flatten. All the data seems to be recognized as a list, and would expect flatten to just unnest the the first layer?? Seems to be somewhat related to DRILL-1673 select typeof(t.RetailTransaction.POSLog.`ARTS:Transaction`.`ARTS:RetailTransaction`.`ARTS

[GitHub] drill pull request: DRILL-4295: Removes obsolete protobuf-generate...

2016-01-21 Thread laurentgo
Github user laurentgo commented on the pull request: https://github.com/apache/drill/pull/333#issuecomment-173687545 If changing protobuf version to 2.6.1 is an option, maven central now has protoc version for each architecture, that the protobuf maven plugin can take advantage of: ht

[GitHub] drill pull request: Add doc for Select with options

2016-01-21 Thread julienledem
Github user julienledem closed the pull request at: https://github.com/apache/drill/pull/290 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Naming the new ValueVector Initiative

2016-01-21 Thread Wes McKinney
Dear all — I converted our Google discussion document about the Arrow memory layout (prior to the ASF proposal) to Markdown and placed it here https://github.com/arrow-data/arrow-format Thanks, Wes On Wed, Jan 20, 2016 at 8:14 PM, Jacques Nadeau wrote: > Hey guys, one other note on PR. To make

[GitHub] drill pull request: DRILL-4270: Create a separate WindowFramer tha...

2016-01-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/322 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (DRILL-4270) Create a separate WindowFramer that supports the FRAME clause

2016-01-21 Thread Deneche A. Hakim (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deneche A. Hakim resolved DRILL-4270. - Resolution: Fixed Fixed in 3d0b4b0 > Create a separate WindowFramer that supports the FRA

[GitHub] drill pull request: DRILL-4295: Removes obsolete protobuf-generate...

2016-01-21 Thread jacques-n
Github user jacques-n commented on the pull request: https://github.com/apache/drill/pull/333#issuecomment-173713031 I'm not sure it is a simple option. I believe we have to worry about version conflicts between Drill, HDFS, HBase and MapRFS. (We used to shade for this purpose but we

Re: Naming the new ValueVector Initiative

2016-01-21 Thread Julian Hyde
To expand on what “straight to TLP” means (correct me if I’m wrong, Jacques). From an IP standpoint, the new project is a clone of Drill. It starts off with Drill’s code base. We then, as the sculptor said [1], chip away everything that doesn’t look like Arrow. Julian [1] http://quoteinvestig

[GitHub] drill pull request: DRILL-4295: Removes obsolete protobuf-generate...

2016-01-21 Thread laurentgo
Github user laurentgo commented on the pull request: https://github.com/apache/drill/pull/333#issuecomment-173742695 I was expecting this, so I added the clean before generate source code --- If your project is set up for it, you can reply to this email and have your reply appear on G

Re: Naming the new ValueVector Initiative

2016-01-21 Thread Jacques Nadeau
We can do it either way. The main charter is we will work to extract the code. My suggestion is to avoid a bulk copy and extract what makes sense. In the Drill community, we've already refactored large chunks of code to make this portion independent. We probably need to do one more pass to get all

Re: Naming the new ValueVector Initiative

2016-01-21 Thread Wes McKinney
Parth just split out the non-Drill-related bits here, we've been talking on the side about it https://github.com/parthchandra/arrow-cpp/commit/7565e570f7eabebcbba3a7fb3ccb6a0e605e6ef1 I've been assembling a C++ library from scratch from the specification ( https://github.com/arrow-data/arrow-cpp/

[GitHub] drill pull request: Drill 4261: add support for RANGE BETWEEN UNBO...

2016-01-21 Thread adeneche
GitHub user adeneche opened a pull request: https://github.com/apache/drill/pull/334 Drill 4261: add support for RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING You can merge this pull request into a Git repository by running: $ git pull https://github.com/adeneche/

[GitHub] drill pull request: Drill 4261: add support for RANGE BETWEEN UNBO...

2016-01-21 Thread adeneche
Github user adeneche commented on the pull request: https://github.com/apache/drill/pull/334#issuecomment-173749885 running regression tests now. @amansinha100 can you please review ? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] drill pull request: Drill 4261: add support for RANGE BETWEEN UNBO...

2016-01-21 Thread jaltekruse
Github user jaltekruse commented on a diff in the pull request: https://github.com/apache/drill/pull/334#discussion_r50482911 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/window/TestWindowFrame.java --- @@ -106,6 +106,16 @@ public void testMultipleFra

[jira] [Created] (DRILL-4299) Query that involves convert_from succeeds, exception is found in drillbit.log

2016-01-21 Thread Victoria Markman (JIRA)
Victoria Markman created DRILL-4299: --- Summary: Query that involves convert_from succeeds, exception is found in drillbit.log Key: DRILL-4299 URL: https://issues.apache.org/jira/browse/DRILL-4299 Pro

[jira] [Created] (DRILL-4300) Query fails with "DrillRuntimeException: Failed to pre-allocate memory for SV"

2016-01-21 Thread Abhishek Girish (JIRA)
Abhishek Girish created DRILL-4300: -- Summary: Query fails with "DrillRuntimeException: Failed to pre-allocate memory for SV" Key: DRILL-4300 URL: https://issues.apache.org/jira/browse/DRILL-4300 Proj

[GitHub] drill pull request: Drill 4261: add support for RANGE BETWEEN UNBO...

2016-01-21 Thread adeneche
Github user adeneche commented on a diff in the pull request: https://github.com/apache/drill/pull/334#discussion_r50492010 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/window/TestWindowFrame.java --- @@ -106,6 +106,16 @@ public void testMultipleFrame

[jira] [Created] (DRILL-4301) OOM : Unable to allocate sv2 for 1000 records, and not enough batchGroups to spill.

2016-01-21 Thread Khurram Faraaz (JIRA)
Khurram Faraaz created DRILL-4301: - Summary: OOM : Unable to allocate sv2 for 1000 records, and not enough batchGroups to spill. Key: DRILL-4301 URL: https://issues.apache.org/jira/browse/DRILL-4301 P