[jira] [Created] (DRILL-4832) Metadata Cache Pruning is not taking place in some rare scenarios

2016-08-05 Thread Rahul Challapalli (JIRA)
Rahul Challapalli created DRILL-4832: Summary: Metadata Cache Pruning is not taking place in some rare scenarios Key: DRILL-4832 URL: https://issues.apache.org/jira/browse/DRILL-4832 Project: Apac

[GitHub] drill issue #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on the issue: https://github.com/apache/drill/pull/527 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73773119 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/metadata/MetadataProvider.java --- @@ -0,0 +1,451 @@ +/** + * Licensed to the

[GitHub] drill issue #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on the issue: https://github.com/apache/drill/pull/527 Rebased the patch and addressed review comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73770112 --- Diff: exec/jdbc-all/pom.xml --- @@ -441,7 +441,7 @@ This is likely due to you adding new dependencies to a java-exec and not

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73769951 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/metadata/MetadataProvider.java --- @@ -0,0 +1,451 @@ +/** + * Licensed to the Apa

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73769751 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/metadata/MetadataProvider.java --- @@ -0,0 +1,451 @@ +/** + * Licensed to the

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73769668 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/metadata/MetadataProvider.java --- @@ -0,0 +1,451 @@ +/** + * Licensed to the Apa

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73769636 --- Diff: exec/jdbc-all/pom.xml --- @@ -441,7 +441,7 @@ This is likely due to you adding new dependencies to a java-exec and not upda

[jira] [Created] (DRILL-4831) Running refresh table metadata concurrently randomly fails with JsonParseException

2016-08-05 Thread Rahul Challapalli (JIRA)
Rahul Challapalli created DRILL-4831: Summary: Running refresh table metadata concurrently randomly fails with JsonParseException Key: DRILL-4831 URL: https://issues.apache.org/jira/browse/DRILL-4831

[GitHub] drill issue #556: DRILL-4819 - update MapR version to 5.2.0

2016-08-05 Thread adityakishore
Github user adityakishore commented on the issue: https://github.com/apache/drill/pull/556 LGTM. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73767987 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/client/DrillClient.java --- @@ -411,6 +420,98 @@ public void runQuery(QueryType type, List pla

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73767794 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/client/DrillClient.java --- @@ -411,6 +420,98 @@ public void runQuery(QueryType type, List

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73767561 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/pojo/PojoRecordReader.java --- @@ -47,24 +46,30 @@ import org.apache.drill.exec

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73767470 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/SchemaTreeProvider.java --- @@ -0,0 +1,105 @@ +/** + * Licensed to the Apache So

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73767387 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/SchemaTreeProvider.java --- @@ -0,0 +1,105 @@ +/** + * Licensed to the Apache So

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73767170 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/pojo/PojoRecordReader.java --- @@ -47,24 +46,30 @@ import org.apache.drill.exec.vec

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73766580 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/pojo/PojoRecordReader.java --- @@ -47,24 +46,30 @@ import org.apache.drill.exec

[GitHub] drill issue #517: DRILL-4704 fix

2016-08-05 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/517 As a next step, using Dave's solution would better handle truncation: based on the precision of the input value, adjust the scale to truncate low-order digits. --- If your project is set up for

[GitHub] drill issue #517: DRILL-4704 fix

2016-08-05 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/517 Based on above discussion, I played around with the proposed solution. The following takes into consideration the max precision of both the input and output types. It DOES NOT handle truncation pr

[GitHub] drill issue #517: DRILL-4704 fix

2016-08-05 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/517 Hi Dave, I agree that Drill Decimal support clearly needs attention. I'm expermenting with adjusting the template code to at least generate a meaningful conversion for all int x decimal t

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread vkorukanti
Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73764733 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/ops/QueryContext.java --- @@ -97,7 +94,7 @@ public QueryContext(final UserSession session, fina

[GitHub] drill pull request #527: DRILL-4728: Add support for new metadata fetch APIs

2016-08-05 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/527#discussion_r73764478 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/ops/QueryContext.java --- @@ -97,7 +94,7 @@ public QueryContext(final UserSession session,

[jira] [Created] (DRILL-4830) We are reading from sub-directory cache when we have a view

2016-08-05 Thread Rahul Challapalli (JIRA)
Rahul Challapalli created DRILL-4830: Summary: We are reading from sub-directory cache when we have a view Key: DRILL-4830 URL: https://issues.apache.org/jira/browse/DRILL-4830 Project: Apache Dri

[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2016-08-05 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/520#discussion_r73758968 --- Diff: exec/jdbc/src/main/java/org/apache/drill/jdbc/impl/DrillDatabaseMetaDataImpl.java --- @@ -219,11 +226,26 @@ public boolean storesMixedCaseQuotedIde

[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2016-08-05 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/520#discussion_r73758663 --- Diff: exec/jdbc/src/main/java/org/apache/drill/jdbc/impl/DrillDatabaseMetaDataImpl.java --- @@ -219,11 +226,26 @@ public boolean storesMixedCaseQuotedIde

[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2016-08-05 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/520#discussion_r73758593 --- Diff: exec/jdbc/src/main/java/org/apache/drill/jdbc/impl/DrillDatabaseMetaDataImpl.java --- @@ -36,6 +42,7 @@ */ class DrillDatabaseMetaDataIm

[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2016-08-05 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/520#discussion_r73757533 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/SqlConverter.java --- @@ -139,6 +151,24 @@ public SqlNode parse(String sql) {

[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2016-08-05 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/520#discussion_r73756251 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/DrillSqlWorker.java --- @@ -61,7 +61,8 @@ public static PhysicalPlan getPlan(QueryCo

[GitHub] drill pull request #520: DRILL-3510: Add ANSI_QUOTES option so that Drill's ...

2016-08-05 Thread vdiravka
Github user vdiravka commented on a diff in the pull request: https://github.com/apache/drill/pull/520#discussion_r73755627 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/ExecConstants.java --- @@ -274,6 +274,9 @@ String ENABLE_BULK_LOAD_TABLE_LIST_KEY = "exec

Re: Time for a 1.8 release

2016-08-05 Thread Venki Korukanti
I will try to get these sometime today or eod tomorrow. 1) DRILL-4728: Add support for new metadata fetch APIs, https://github.com/apache/drill/pull/527 (Ready to commit after few minor changes) 2) DRILL-4729: Add support for prepared statement API on server side, https://github.com/apache/drill/

Re: Time for a 1.8 release

2016-08-05 Thread Sudheesh Katkam
Yes, that’s a typo. DRILL-3623 was for LIMIT 0 changes. That number will forever remain in my subconscious ;) Thank you, Sudheesh > On Aug 5, 2016, at 1:27 PM, Zelaine Fong wrote: > > I assume #3 has a typo. It should be DRILL-4623. > > -- Zelaine > > On Fri, Aug 5, 2016 at 1:15 PM, Sudhees

[jira] [Resolved] (DRILL-4825) Wrong data with UNION ALL when querying different sub-directories under the same table

2016-08-05 Thread Jinfeng Ni (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinfeng Ni resolved DRILL-4825. --- Resolution: Fixed > Wrong data with UNION ALL when querying different sub-directories under the > sam

[GitHub] drill pull request #559: DRILL-4825: Fix incorrect result issue caused by pa...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/559 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Re: Time for a 1.8 release

2016-08-05 Thread Zelaine Fong
I assume #3 has a typo. It should be DRILL-4623. -- Zelaine On Fri, Aug 5, 2016 at 1:15 PM, Sudheesh Katkam wrote: > Here’s my list that I will try to get in before Monday. > > 1) DRILL-4822: Pending commit. > PR: https://github.com/apache/drill/pull/558 > > 2) DRILL-4819: Pending review from

Re: Time for a 1.8 release

2016-08-05 Thread Sudheesh Katkam
Here’s my list that I will try to get in before Monday. 1) DRILL-4822: Pending commit. PR: https://github.com/apache/drill/pull/558 2) DRILL-4819: Pending review from Aditya. PR: https://github.com/apache/drill/pull/556 3) DRILL-3623: Pending tests (or test results). PR: https://github.com/apach

Re: Time for a 1.8 release

2016-08-05 Thread Jinfeng Ni
Just a reminder that if you want to include work-in-progress/under-review patch in 1.8 release, please reply to this email and get it reviewed asap. The tentative cut-off day is Monday. On Wed, Aug 3, 2016 at 11:49 AM, Jinfeng Ni wrote: > I would like to propose we set Monday 8/8 as the tentativ

[GitHub] drill issue #559: DRILL-4825: Fix incorrect result issue caused by partition...

2016-08-05 Thread amansinha100
Github user amansinha100 commented on the issue: https://github.com/apache/drill/pull/559 LGTM. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] drill issue #559: DRILL-4825: Fix incorrect result issue caused by partition...

2016-08-05 Thread jinfengni
Github user jinfengni commented on the issue: https://github.com/apache/drill/pull/559 @amansinha100 , thanks for your comments. Could you please take another look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] drill pull request #559: DRILL-4825: Fix incorrect result issue caused by pa...

2016-08-05 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/559#discussion_r73725525 --- Diff: exec/java-exec/src/test/java/org/apache/drill/TestPartitionFilter.java --- @@ -386,4 +386,49 @@ public void testPartitionFilterWithInSubquery() thr

[GitHub] drill pull request #559: DRILL-4825: Fix incorrect result issue caused by pa...

2016-08-05 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/559#discussion_r73725537 --- Diff: exec/java-exec/src/test/java/org/apache/drill/TestPartitionFilter.java --- @@ -386,4 +386,49 @@ public void testPartitionFilterWithInSubquery() thr

[GitHub] drill pull request #559: DRILL-4825: Fix incorrect result issue caused by pa...

2016-08-05 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/559#discussion_r73725484 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/dfs/FileSelection.java --- @@ -402,4 +402,18 @@ public String getCacheFileRoot() {

[GitHub] drill pull request #559: DRILL-4825: Fix incorrect result issue caused by pa...

2016-08-05 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/559#discussion_r73725279 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/DirPrunedEnumerableTableScan.java --- @@ -0,0 +1,73 @@ +/** + * License

Re: [Drill-Questions] Speed difference between GZ and BZ2

2016-08-05 Thread Shankar Mane
Yes, i went through the benchmarks and started testing this one. I have tested this one using Hadoop Map-Reduce. And it seems BZ worked faster than GZ. As i know GZ is non-splittable and BZ is splittable. Hadoop MR takes the advantage of this splittable property and launched multiple mappers and

Re: [Drill-Questions] Speed difference between GZ and BZ2

2016-08-05 Thread Khurram Faraaz
Shankar, This is expected behavior, bzip2 decompression is four to twelve times slower than decompressing gzip compressed files. You can look at the comparison benchmark here for numbers - http://tukaani.org/lzma/benchmarks.html On Thu, Aug 4, 2016 at 5:13 PM, Shankar Mane wrote: > Please find

[jira] [Created] (DRILL-4829) Configure the address to bind to

2016-08-05 Thread Daniel Stockton (JIRA)
Daniel Stockton created DRILL-4829: -- Summary: Configure the address to bind to Key: DRILL-4829 URL: https://issues.apache.org/jira/browse/DRILL-4829 Project: Apache Drill Issue Type: Improve