[jira] [Created] (DRILL-5365) FileNotFoundException when reading a parquet file

2017-03-17 Thread Chun Chang (JIRA)
Chun Chang created DRILL-5365:
-

 Summary: FileNotFoundException when reading a parquet file
 Key: DRILL-5365
 URL: https://issues.apache.org/jira/browse/DRILL-5365
 Project: Apache Drill
  Issue Type: Bug
  Components: Storage - Hive
Affects Versions: 1.10.0
Reporter: Chun Chang
Assignee: Chunhui Shi


The parquet file is generated through the following CTAS.

To reproduce the issue: 1) two or more nodes cluster; 2) enable impersonation; 
3) set "fs.default.name": "file:///" in hive storage plugin; 4) restart 
drillbits; 5) as a regular user, on node A, drop the table/file; 6) ctas from a 
large enough hive table as source to recreate the table/file; 7) query the 
table from node A should work; 8) query from node B as same user should 
reproduce the issue.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (DRILL-5364) Planner inserts sort for simple constant value query

2017-03-17 Thread Paul Rogers (JIRA)
Paul Rogers created DRILL-5364:
--

 Summary: Planner inserts sort for simple constant value query
 Key: DRILL-5364
 URL: https://issues.apache.org/jira/browse/DRILL-5364
 Project: Apache Drill
  Issue Type: Bug
Affects Versions: 1.10.0
Reporter: Paul Rogers


Consider the following query:

{code}
SELECT CURRENT_TIMESTAMP FROM (VALUES(1))
{code}

The following is the plan generated for the query. Notice the inclusion of an 
unnecessary sort.

{code}
  "graph" : [ {
"pop" : "Values",
"@id" : 4,
"content" : [ {
  "EXPR$0" : {
"$numberLong" : 1
  }
} ],
"initialAllocation" : 100,
"maxAllocation" : 100,
"cost" : 1.0
  }, {
"pop" : "project",
"@id" : 3,
"exprs" : [ {
  "ref" : "`CURRENT_TIMESTAMP`",
  "expr" : "current_timestamp() "
} ],
"child" : 4,
"initialAllocation" : 100,
"maxAllocation" : 100,
"cost" : 1.0
  }, {
"pop" : "external-sort",
"@id" : 2,
"child" : 3,
"orderings" : [ {
  "order" : "ASC",
  "expr" : "`CURRENT_TIMESTAMP`",
  "nullDirection" : "UNSPECIFIED"
} ],
"reverse" : false,
"initialAllocation" : 2000,
"maxAllocation" : 100,
"cost" : 1.0
  }, {
"pop" : "selection-vector-remover",
"@id" : 1,
"child" : 2,
"initialAllocation" : 100,
"maxAllocation" : 100,
"cost" : 1.0
  }, {
"pop" : "screen",
"@id" : 0,
"child" : 1,
"initialAllocation" : 100,
"maxAllocation" : 100,
"cost" : 1.0
  } ]
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Re: Having some trouble locating a file referenced in the Advanced Regression tests

2017-03-17 Thread Jason Altekruse
Thanks for the quick response Rahul! That looks to be exactly what I need,
test are running now.

- Jason

On Thu, Mar 16, 2017 at 6:07 PM, rahul challapalli <
challapallira...@gmail.com> wrote:

> I already did :)
>
> On Thu, Mar 16, 2017 at 5:31 PM, Aman Sinha  wrote:
>
> > I am guessing Rahul Chalapalli might have created that data file.  Rahul,
> > can you comment ?
> >
> > -Aman
> >
> > On 3/16/17, 11:57 AM, "Jason Altekruse" 
> wrote:
> >
> > Hey Drillers,
> >
> > I am working to set up a test environment to run the Advanced
> > Regression
> > suites. I have been successful getting most of the tests running, but
> > I am
> > unable to locate the file "widestrings" referenced by the tests in
> the
> > Advanced/data-shapes/wide-columns/5000/10rows/parquet suite. It
> > does
> > not appear to be in the list of files available on S3 specified in
> the
> > framework pom.xml file. This test suite also does not declare any
> > necessary
> > data preparation step in its test description JSON file.
> >
> > I do see that there is a bash file under
> > resources/Datasources/data-shapes/wide-strings.sh, but this is
> > producing a
> > json file, not a parquet file and is not referenced as a data-prep
> > prerequisite for any of the tests.
> >
> > Any help tracking down the file, or a description of the process
> > necessary
> > to re-create the file would be appreciated.
> >
> > Thanks,
> > Jason
> >
> >
> >
>


[GitHub] drill issue #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's SQL Par...

2017-03-17 Thread vdiravka
Github user vdiravka commented on the issue:

https://github.com/apache/drill/pull/520
  
@sudheeshkatkam Could you please review it?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2017-03-17 Thread laurentgo
Github user laurentgo commented on a diff in the pull request:

https://github.com/apache/drill/pull/520#discussion_r106681714
  
--- Diff: exec/jdbc-all/pom.xml ---
@@ -403,7 +402,6 @@
**/*.SF
**/*.RSA
**/*.DSA
-   javax/**
--- End diff --

sounds good!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2017-03-17 Thread laurentgo
Github user laurentgo commented on a diff in the pull request:

https://github.com/apache/drill/pull/520#discussion_r106681670
  
--- Diff: exec/jdbc/pom.xml ---
@@ -100,6 +100,11 @@
   xalan
   xalan
 
+
--- End diff --

aaahh, I thought it was included, but I searched for `@NotNull` instead and 
didn't find it! So, yes, should totally be included as a dependency!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2017-03-17 Thread vdiravka
Github user vdiravka commented on a diff in the pull request:

https://github.com/apache/drill/pull/520#discussion_r106658488
  
--- Diff: exec/jdbc-all/pom.xml ---
@@ -403,7 +402,6 @@
**/*.SF
**/*.RSA
**/*.DSA
-   javax/**
--- End diff --

This ` javax/**` exludes validation-api as well. 
Therefore it should be deleted. 

To avoid including unnecessary libraries I decided to add:
`   javax/activation/**`
`   javax/annotation-api/**`
`   javax/inject/**`
`   javax/servlet-api/**`
`   javax/json/**`
`   javax/ws/**`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2017-03-17 Thread vdiravka
Github user vdiravka commented on a diff in the pull request:

https://github.com/apache/drill/pull/520#discussion_r106654176
  
--- Diff: exec/jdbc/pom.xml ---
@@ -100,6 +100,11 @@
   xalan
   xalan
 
+
--- End diff --

Drill uses NotNull annotations in 
[DrillMetaImpl.java](https://github.com/apache/drill/blob/master/exec/jdbc/src/main/java/org/apache/drill/jdbc/impl/DrillMetaImpl.java#L263).
`validation-api` is present only in the dependency of the 
`jersey-server-2.8.jar`, which is excluded in the jdbc, as it should be.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---