[jira] [Created] (DRILL-5755) TOP_N_SORT operator does not free memory while running

2017-08-30 Thread Boaz Ben-Zvi (JIRA)
Boaz Ben-Zvi created DRILL-5755: --- Summary: TOP_N_SORT operator does not free memory while running Key: DRILL-5755 URL: https://issues.apache.org/jira/browse/DRILL-5755 Project: Apache Drill

[jira] [Created] (DRILL-5754) Test framework does not enforce column orders

2017-08-30 Thread Jinfeng Ni (JIRA)
Jinfeng Ni created DRILL-5754: - Summary: Test framework does not enforce column orders Key: DRILL-5754 URL: https://issues.apache.org/jira/browse/DRILL-5754 Project: Apache Drill Issue Type: Bug

[GitHub] drill pull request #928: Drill 5716: Queue-driven memory allocation

2017-08-30 Thread paul-rogers
GitHub user paul-rogers opened a pull request: https://github.com/apache/drill/pull/928 Drill 5716: Queue-driven memory allocation Please see [DRILL-5716](https://issues.apache.org/jira/browse/DRILL-5716) for an overview. This PR provides five commits that implement a

[jira] [Created] (DRILL-5753) Managed External Sort: One or more nodes ran out of memory while executing the query.

2017-08-30 Thread Robert Hou (JIRA)
Robert Hou created DRILL-5753: - Summary: Managed External Sort: One or more nodes ran out of memory while executing the query. Key: DRILL-5753 URL: https://issues.apache.org/jira/browse/DRILL-5753

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136188895 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullVector.java --- @@ -0,0 +1,267 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136188791 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullVector.java --- @@ -0,0 +1,267 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136188197 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullVector.java --- @@ -0,0 +1,267 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136187915 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullVector.java --- @@ -0,0 +1,267 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136187789 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullHolder.java --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136187804 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullHolder.java --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136187598 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullHolder.java --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

Dedupping json records based on nested value

2017-08-30 Thread François Méthot
Hi, Congrat for the 1.11 release, we are happy to have our suggestion implemented in the new release (automatic HDFS block size for parquet files). It seems like we are pushing the limit of Drill with new type query...(I am learning new SQL trick in the process) We are trying to aggregate a

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136186438 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/UntypedNullHolder.java --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136185442 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/AbstractSingleRecordBatch.java --- @@ -125,4 +131,19 @@ public BatchSchema getSchema()

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136185139 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/AbstractSingleRecordBatch.java --- @@ -61,6 +63,10 @@ public IterOutcome innerNext() {

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136184973 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/record/AbstractBinaryRecordBatch.java --- @@ -0,0 +1,75 @@ +/** + * Licensed to the

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136182353 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/ProjectPrel.java --- @@ -35,18 +35,43 @@ import

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136181920 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/DrillScanRel.java --- @@ -160,12 +161,7 @@ public RelOptCost

gitbox?

2017-08-30 Thread Vlad Rozov
Hi, As I am new to Drill, I don't know if migration from "Git WiP" (https://git-wip-us.apache.org) to "Github Dual Master" (https://gitbox.apache.org) was already discussed by the community, but from my Apache Apex experience I would recommend to consider migrating Drill ASF repos to the

[GitHub] drill issue #919: DRILL-5721: Query with only root fragment and no non-root ...

2017-08-30 Thread sohami
Github user sohami commented on the issue: https://github.com/apache/drill/pull/919 @parthchandra - thanks for the review! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] drill issue #919: DRILL-5721: Query with only root fragment and no non-root ...

2017-08-30 Thread parthchandra
Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/919 +1 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] drill pull request #919: DRILL-5721: Query with only root fragment and no no...

2017-08-30 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/919#discussion_r136161134 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/Foreman.java --- @@ -1073,26 +1070,22 @@ public QueryId getQueryId() {

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136159563 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #919: DRILL-5721: Query with only root fragment and no no...

2017-08-30 Thread sohami
Github user sohami commented on a diff in the pull request: https://github.com/apache/drill/pull/919#discussion_r136157876 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/Foreman.java --- @@ -1073,26 +1070,22 @@ public QueryId getQueryId() { */

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136157330 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136157172 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #919: DRILL-5721: Query with only root fragment and no no...

2017-08-30 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/919#discussion_r13616 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/Foreman.java --- @@ -1073,26 +1070,22 @@ public QueryId getQueryId() {

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136154993 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136154585 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136152074 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136151330 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136149953 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136149852 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r136143881 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -39,88 +35,107 @@ import

[GitHub] drill issue #922: DRILL-5741: During startup Drill should not exceed the ava...

2017-08-30 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/922 This may be one of those times when we need to resort to a bit of design thinking. The core idea is that the user sets one environment variable to check the others. The first issue is

[jira] [Created] (DRILL-5752) Speed Up Unit Tests

2017-08-30 Thread Timothy Farkas (JIRA)
Timothy Farkas created DRILL-5752: - Summary: Speed Up Unit Tests Key: DRILL-5752 URL: https://issues.apache.org/jira/browse/DRILL-5752 Project: Apache Drill Issue Type: Improvement

Re: Speeding Up Unit Tests

2017-08-30 Thread Timothy Farkas
Hi Paul, I agree. Since that seems like the lowest hanging fruit at this point I'll focus on that. I'll start off with the categories you mentioned: High-level categories: - Fast - Slow Low-level categories: - Vector - WebUI - Planner - Operator - Storage - Hive - JDBC -

[GitHub] drill issue #909: DRILL-4264: Allow field names to include dots

2017-08-30 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/909 Thanks much for the great work! +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

Re: Speeding Up Unit Tests

2017-08-30 Thread Paul Rogers
Hi Tim, Here’s another thought. JUnit & SureFire have a way of grouping tests into categories. The classic grouping are the “fast” tests we want to run all the time, and the “slow” tests we run occasionally. I recently tried to get this working to move a couple of tests into the slow category.

Re: Drill 2.0 (design) hackathon

2017-08-30 Thread Paul Rogers
A partial list of Drill’s public APIs: IMHO, highest priority for Drill 2.0. * JDBC/ODBC drivers * Client (for JDBC/ODBC) + ODBC & JDBC * Client (for full Drill async, columnar) * Storage plugin * Format plugin * System/session options * Queueing (e.g. ZK-based

[GitHub] drill pull request #927: DRILL-5751: Fix unit tests to use local file system...

2017-08-30 Thread arina-ielchiieva
GitHub user arina-ielchiieva opened a pull request: https://github.com/apache/drill/pull/927 DRILL-5751: Fix unit tests to use local file system even if it is not… … set by default Please refer to [DRILL-5751](https://issues.apache.org/jira/browse/DRILL-5751) for

[jira] [Created] (DRILL-5751) Fix unit tests to use local file system even if it is not set by default

2017-08-30 Thread Arina Ielchiieva (JIRA)
Arina Ielchiieva created DRILL-5751: --- Summary: Fix unit tests to use local file system even if it is not set by default Key: DRILL-5751 URL: https://issues.apache.org/jira/browse/DRILL-5751

[GitHub] drill issue #915: DRILL-1051: Casting timestamp as date gives wrong result f...

2017-08-30 Thread vdiravka
Github user vdiravka commented on the issue: https://github.com/apache/drill/pull/915 @arina-ielchiieva The test failures are expected and should be corrected. Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] drill pull request #909: DRILL-4264: Allow field names to include dots

2017-08-30 Thread vvysotskyi
Github user vvysotskyi commented on a diff in the pull request: https://github.com/apache/drill/pull/909#discussion_r136016798 --- Diff: logical/src/main/java/org/apache/drill/common/expression/SchemaPath.java --- @@ -115,6 +112,33 @@ public static SchemaPath create(NamePart

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r135979350 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -130,562 +145,248 @@ public IterOutcome

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r135977556 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/union/UnionAllRecordBatch.java --- @@ -39,88 +35,107 @@ import

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

2017-08-30 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r135976739 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/unit/TestEmptyBatchMiniPlan.java --- @@ -0,0 +1,453 @@ +/* + * Licensed to