[jira] [Commented] (DRILL-5887) Display process user/ groups in Drill UI
[ https://issues.apache.org/jira/browse/DRILL-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220126#comment-16220126 ] ASF GitHub Bot commented on DRILL-5887: --- Github user arina-ielchiieva commented on the issue: https://github.com/apache/drill/pull/998 +1, LGTM. > Display process user/ groups in Drill UI > > > Key: DRILL-5887 > URL: https://issues.apache.org/jira/browse/DRILL-5887 > Project: Apache Drill > Issue Type: Bug > Components: Client - HTTP >Affects Versions: 1.11.0 >Reporter: Prasad Nagaraj Subramanya >Assignee: Prasad Nagaraj Subramanya >Priority: Minor > Fix For: 1.12.0 > > > Drill UI only lists admin user/ groups specified as options > We should display the process user/ groups who have admin privilege -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (DRILL-5887) Display process user/ groups in Drill UI
[ https://issues.apache.org/jira/browse/DRILL-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-5887: Reviewer: Arina Ielchiieva > Display process user/ groups in Drill UI > > > Key: DRILL-5887 > URL: https://issues.apache.org/jira/browse/DRILL-5887 > Project: Apache Drill > Issue Type: Bug > Components: Client - HTTP >Affects Versions: 1.11.0 >Reporter: Prasad Nagaraj Subramanya >Assignee: Prasad Nagaraj Subramanya >Priority: Minor > Labels: ready-to-commit > Fix For: 1.12.0 > > > Drill UI only lists admin user/ groups specified as options > We should display the process user/ groups who have admin privilege -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (DRILL-5887) Display process user/ groups in Drill UI
[ https://issues.apache.org/jira/browse/DRILL-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva reassigned DRILL-5887: --- Assignee: Prasad Nagaraj Subramanya (was: Arina Ielchiieva) > Display process user/ groups in Drill UI > > > Key: DRILL-5887 > URL: https://issues.apache.org/jira/browse/DRILL-5887 > Project: Apache Drill > Issue Type: Bug > Components: Client - HTTP >Affects Versions: 1.11.0 >Reporter: Prasad Nagaraj Subramanya >Assignee: Prasad Nagaraj Subramanya >Priority: Minor > Labels: ready-to-commit > Fix For: 1.12.0 > > > Drill UI only lists admin user/ groups specified as options > We should display the process user/ groups who have admin privilege -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (DRILL-5887) Display process user/ groups in Drill UI
[ https://issues.apache.org/jira/browse/DRILL-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-5887: Labels: ready-to-commit (was: ) > Display process user/ groups in Drill UI > > > Key: DRILL-5887 > URL: https://issues.apache.org/jira/browse/DRILL-5887 > Project: Apache Drill > Issue Type: Bug > Components: Client - HTTP >Affects Versions: 1.11.0 >Reporter: Prasad Nagaraj Subramanya >Assignee: Prasad Nagaraj Subramanya >Priority: Minor > Labels: ready-to-commit > Fix For: 1.12.0 > > > Drill UI only lists admin user/ groups specified as options > We should display the process user/ groups who have admin privilege -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (DRILL-5887) Display process user/ groups in Drill UI
[ https://issues.apache.org/jira/browse/DRILL-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva reassigned DRILL-5887: --- Assignee: Arina Ielchiieva (was: Prasad Nagaraj Subramanya) > Display process user/ groups in Drill UI > > > Key: DRILL-5887 > URL: https://issues.apache.org/jira/browse/DRILL-5887 > Project: Apache Drill > Issue Type: Bug > Components: Client - HTTP >Affects Versions: 1.11.0 >Reporter: Prasad Nagaraj Subramanya >Assignee: Arina Ielchiieva >Priority: Minor > Labels: ready-to-commit > Fix For: 1.12.0 > > > Drill UI only lists admin user/ groups specified as options > We should display the process user/ groups who have admin privilege -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (DRILL-5906) java.lang.NullPointerException while quering Hive ORC tables on MapR cluster.
[ https://issues.apache.org/jira/browse/DRILL-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220477#comment-16220477 ] ASF GitHub Bot commented on DRILL-5906: --- Github user arina-ielchiieva commented on the issue: https://github.com/apache/drill/pull/1010 +1, LGTM. > java.lang.NullPointerException while quering Hive ORC tables on MapR cluster. > -- > > Key: DRILL-5906 > URL: https://issues.apache.org/jira/browse/DRILL-5906 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.11.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Fix For: 1.12.0 > > > Record reader throw an exception when trying to read an empty split. > Possible fix: upgrade drill to > [1.2.0-mapr-1707|https://maprdocs.mapr.com/52/EcosystemRN/HiveRN-1.2.1-1707.html] > hive.version, where this issue was fixed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (DRILL-5906) java.lang.NullPointerException while quering Hive ORC tables on MapR cluster.
[ https://issues.apache.org/jira/browse/DRILL-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva reassigned DRILL-5906: --- Assignee: Vitalii Diravka (was: Arina Ielchiieva) > java.lang.NullPointerException while quering Hive ORC tables on MapR cluster. > -- > > Key: DRILL-5906 > URL: https://issues.apache.org/jira/browse/DRILL-5906 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.11.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Labels: ready-to-commit > Fix For: 1.12.0 > > > Record reader throw an exception when trying to read an empty split. > Possible fix: upgrade drill to > [1.2.0-mapr-1707|https://maprdocs.mapr.com/52/EcosystemRN/HiveRN-1.2.1-1707.html] > hive.version, where this issue was fixed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (DRILL-5906) java.lang.NullPointerException while quering Hive ORC tables on MapR cluster.
[ https://issues.apache.org/jira/browse/DRILL-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva reassigned DRILL-5906: --- Assignee: Arina Ielchiieva (was: Vitalii Diravka) > java.lang.NullPointerException while quering Hive ORC tables on MapR cluster. > -- > > Key: DRILL-5906 > URL: https://issues.apache.org/jira/browse/DRILL-5906 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.11.0 >Reporter: Vitalii Diravka >Assignee: Arina Ielchiieva > Labels: ready-to-commit > Fix For: 1.12.0 > > > Record reader throw an exception when trying to read an empty split. > Possible fix: upgrade drill to > [1.2.0-mapr-1707|https://maprdocs.mapr.com/52/EcosystemRN/HiveRN-1.2.1-1707.html] > hive.version, where this issue was fixed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (DRILL-5906) java.lang.NullPointerException while quering Hive ORC tables on MapR cluster.
[ https://issues.apache.org/jira/browse/DRILL-5906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-5906: Labels: ready-to-commit (was: ) > java.lang.NullPointerException while quering Hive ORC tables on MapR cluster. > -- > > Key: DRILL-5906 > URL: https://issues.apache.org/jira/browse/DRILL-5906 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.11.0 >Reporter: Vitalii Diravka >Assignee: Vitalii Diravka > Labels: ready-to-commit > Fix For: 1.12.0 > > > Record reader throw an exception when trying to read an empty split. > Possible fix: upgrade drill to > [1.2.0-mapr-1707|https://maprdocs.mapr.com/52/EcosystemRN/HiveRN-1.2.1-1707.html] > hive.version, where this issue was fixed. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (DRILL-5717) change some date time unit cases with specific timezone or Local
[ https://issues.apache.org/jira/browse/DRILL-5717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220538#comment-16220538 ] ASF GitHub Bot commented on DRILL-5717: --- Github user weijietong commented on the issue: https://github.com/apache/drill/pull/904 @vvysotskyi thanks for your hard work, I have rewritten the corresponding method. But I have not rewritten the other Locate related cases. Since mockup is a white box testing , I payed some tedious work to explore the possible invocation path, maybe the same as you. I think current Local solution is also acceptable. > change some date time unit cases with specific timezone or Local > > > Key: DRILL-5717 > URL: https://issues.apache.org/jira/browse/DRILL-5717 > Project: Apache Drill > Issue Type: Bug > Components: Tools, Build & Test >Affects Versions: 1.9.0, 1.11.0 >Reporter: weijie.tong > > Some date time test cases like JodaDateValidatorTest is not Local > independent .This will cause other Local's users's test phase to fail. We > should let these test cases to be Local env independent. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (DRILL-5910) ClassNotFoundException message enhancement
Volodymyr Tkach created DRILL-5910: -- Summary: ClassNotFoundException message enhancement Key: DRILL-5910 URL: https://issues.apache.org/jira/browse/DRILL-5910 Project: Apache Drill Issue Type: Bug Affects Versions: 1.11.0 Reporter: Volodymyr Tkach Assignee: Volodymyr Tkach -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (DRILL-5910) ClassNotFoundException message enhancement
[ https://issues.apache.org/jira/browse/DRILL-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Volodymyr Tkach updated DRILL-5910: --- Fix Version/s: Future Description: We need to add factory name in exception message when when ClassNotFoundException is caught and DrillRuntimeException is than re-thrown in ClientAuthenticatorProvider constructor. Steps to repoduce: 1) Configure plain authentication 2) Add -Ddrill.customAuthFactories=org.apache.drill.exec.rpc.security.maprsasl.MapRSaslFactory to SQLLINE_JAVA_OPTS or another class that is not present in classpath. 3) Run sqlline and connect to drillbit > ClassNotFoundException message enhancement > --- > > Key: DRILL-5910 > URL: https://issues.apache.org/jira/browse/DRILL-5910 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.11.0 >Reporter: Volodymyr Tkach >Assignee: Volodymyr Tkach > Fix For: Future > > > We need to add factory name in exception message when when > ClassNotFoundException is caught and DrillRuntimeException is than re-thrown > in ClientAuthenticatorProvider constructor. > Steps to repoduce: > 1) Configure plain authentication > 2) Add > -Ddrill.customAuthFactories=org.apache.drill.exec.rpc.security.maprsasl.MapRSaslFactory > to SQLLINE_JAVA_OPTS or another class that is not present in classpath. > 3) Run sqlline and connect to drillbit -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (DRILL-5910) ClassNotFoundException message enhancement
[ https://issues.apache.org/jira/browse/DRILL-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Volodymyr Tkach updated DRILL-5910: --- Description: We need to add factory name in exception message when ClassNotFoundException is caught and DrillRuntimeException is than re-thrown in ClientAuthenticatorProvider constructor. Steps to repoduce: 1) Configure plain authentication 2) Add -Ddrill.customAuthFactories=org.apache.drill.exec.rpc.security.maprsasl.MapRSaslFactory to SQLLINE_JAVA_OPTS or another class that is not present in classpath. 3) Run sqlline and connect to drillbit was: We need to add factory name in exception message when when ClassNotFoundException is caught and DrillRuntimeException is than re-thrown in ClientAuthenticatorProvider constructor. Steps to repoduce: 1) Configure plain authentication 2) Add -Ddrill.customAuthFactories=org.apache.drill.exec.rpc.security.maprsasl.MapRSaslFactory to SQLLINE_JAVA_OPTS or another class that is not present in classpath. 3) Run sqlline and connect to drillbit > ClassNotFoundException message enhancement > --- > > Key: DRILL-5910 > URL: https://issues.apache.org/jira/browse/DRILL-5910 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.11.0 >Reporter: Volodymyr Tkach >Assignee: Volodymyr Tkach >Priority: Minor > Fix For: Future > > > We need to add factory name in exception message when ClassNotFoundException > is caught and DrillRuntimeException is than re-thrown in > ClientAuthenticatorProvider constructor. > Steps to repoduce: > 1) Configure plain authentication > 2) Add > -Ddrill.customAuthFactories=org.apache.drill.exec.rpc.security.maprsasl.MapRSaslFactory > to SQLLINE_JAVA_OPTS or another class that is not present in classpath. > 3) Run sqlline and connect to drillbit -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (DRILL-5910) ClassNotFoundException message enhancement
[ https://issues.apache.org/jira/browse/DRILL-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Volodymyr Tkach updated DRILL-5910: --- Priority: Minor (was: Major) > ClassNotFoundException message enhancement > --- > > Key: DRILL-5910 > URL: https://issues.apache.org/jira/browse/DRILL-5910 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.11.0 >Reporter: Volodymyr Tkach >Assignee: Volodymyr Tkach >Priority: Minor > Fix For: Future > > > We need to add factory name in exception message when when > ClassNotFoundException is caught and DrillRuntimeException is than re-thrown > in ClientAuthenticatorProvider constructor. > Steps to repoduce: > 1) Configure plain authentication > 2) Add > -Ddrill.customAuthFactories=org.apache.drill.exec.rpc.security.maprsasl.MapRSaslFactory > to SQLLINE_JAVA_OPTS or another class that is not present in classpath. > 3) Run sqlline and connect to drillbit -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (DRILL-5910) ClassNotFoundException message enhancement
[ https://issues.apache.org/jira/browse/DRILL-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-5910: Issue Type: Improvement (was: Bug) > ClassNotFoundException message enhancement > --- > > Key: DRILL-5910 > URL: https://issues.apache.org/jira/browse/DRILL-5910 > Project: Apache Drill > Issue Type: Improvement >Affects Versions: 1.11.0 >Reporter: Volodymyr Tkach >Assignee: Volodymyr Tkach >Priority: Minor > Fix For: Future > > > We need to add factory name in exception message when ClassNotFoundException > is caught and DrillRuntimeException is than re-thrown in > ClientAuthenticatorProvider constructor. > Steps to repoduce: > 1) Configure plain authentication > 2) Add > -Ddrill.customAuthFactories=org.apache.drill.exec.rpc.security.maprsasl.MapRSaslFactory > to SQLLINE_JAVA_OPTS or another class that is not present in classpath. > 3) Run sqlline and connect to drillbit -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (DRILL-1170) YARN support for Drill
[ https://issues.apache.org/jira/browse/DRILL-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220752#comment-16220752 ] ASF GitHub Bot commented on DRILL-1170: --- GitHub user paul-rogers opened a pull request: https://github.com/apache/drill/pull/1011 Drill 1170: Drill-on-YARN Provides Drill integration with YARN. Runs Drill as a long-running task under YARN. Monitors the Drill cluster, restarting failed Drillbits. Provides a command-line UI to start, stop and resize the cluster. Provides a web-based UI to monitor the cluster. The Drill-on-YARN (DoY) code has been in use by commercial users for over a year, since Drill 1.8 and has proven quite stable. Usage has been on MapR's version of YARN, we seek feedback from users of the Apache and other versions of YARN. See [DRILL-1170](https://issues.apache.org/jira/browse/DRILL-1170) for design information. See the included `README.md`` for internals information and `USAGE.md` for a detailed user guide. This is a large PR; it will take time to review. The key goal at this moment is to allow interested users to download the PR, build DoY, and try it out in their environments. The DoY code is mostly independent of Drill itself. The DoY code can be used to launch any version of Drill since 1.8. See the usage guide for information. It has been suggested that the code move to the `contrib` directory. That change will be made. But, since the code works successfully in its current location; we'll leave it their for now to ensure users are successful if they choose to try it. You can merge this pull request into a Git repository by running: $ git pull https://github.com/paul-rogers/drill DRILL-1170 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/drill/pull/1011.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1011 commit e26012bc56cad3bf2819dff3bbdf70664de34955 Author: Paul Rogers Date: 2017-10-26T07:24:00Z DRILL-1170: YARN integration for Drill This commit includes documentation files. commit 3a6ffe78d9fe0e9a5beacd100e2e0ee6b40c7f34 Author: Paul Rogers Date: 2017-10-26T07:25:34Z Client app commit 509410c9710fc1ff23a4a13f51320a4c153f9328 Author: Paul Rogers Date: 2017-10-26T07:26:50Z Files common to several modules commit 36b8d323118077115ef1097ba8b23f6fc4a5390a Author: Paul Rogers Date: 2017-10-26T07:42:17Z Application master commit 7fbc387634bb1acaf7807b02348b40364c81d282 Author: Paul Rogers Date: 2017-10-26T07:44:33Z App Master web UI commit 21fb93792290625b719899a4742573b8c3d4a7ce Author: Paul Rogers Date: 2017-10-26T07:45:44Z Distribution and project files commit 567d36787b9ada60dd2141077e629158c53fc0c4 Author: Paul Rogers Date: 2017-10-26T07:47:54Z Test files > YARN support for Drill > -- > > Key: DRILL-1170 > URL: https://issues.apache.org/jira/browse/DRILL-1170 > Project: Apache Drill > Issue Type: New Feature >Reporter: Neeraja >Assignee: Paul Rogers > Fix For: Future > > Attachments: Drill-on-YARNDesignOverview.pdf, > Drill-on-YARNUserGuide.pdf > > > This is a tracking item to make Drill work with YARN. > Below are few requirements/needs to consider. > - Drill should run as an YARN based application, side by side with other YARN > enabled applications (on same nodes or different nodes). Both memory and CPU > resources of Drill should be controlled in this mechanism. > - As an YARN enabled application, Drill resource consumption should be > adaptive to the load on the cluster. For ex: When there is no load on the > Drill , Drill should consume no resources on the cluster. As the load on > Drill increases, resources permitting, usage should grow proportionally. > - Low latency is a key requirement for Apache Drill along with support for > multiple users (concurrency in 100s-1000s). This should be supported when run > as YARN application as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220964#comment-16220964
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147229235
--- Diff: common/src/test/java/org/apache/drill/test/SubDirTestWatcher.java
---
@@ -0,0 +1,108 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.drill.test;
+
+import com.google.common.base.Preconditions;
+import com.google.common.collect.Lists;
+import org.junit.rules.TestWatcher;
+import org.junit.runner.Description;
+
+import java.io.File;
+import java.util.List;
+
+public class SubDirTestWatcher extends TestWatcher {
--- End diff --
Done
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220967#comment-16220967
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147229627
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestCorruptParquetDateCorrection.java
---
@@ -76,43 +78,50 @@
//- detecting corrupt values must be deferred to actual data
page reading
//- one from 1.4, where there is a proper created-by, but the
corruption is present
private static final String MIXED_CORRUPTED_AND_CORRECT_DATES_PATH =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/mixed_drill_versions";
+ "/parquet/4203_corrupt_dates/mixed_drill_versions";
// partitioned with 1.2.0, no certain metadata that these were written
with Drill
// the value will be checked to see that they look corrupt and they will
be corrected
// by default. Users can use the format plugin option
autoCorrectCorruptDates to disable
// this behavior if they have foreign parquet files with valid rare date
values that are
// in the similar range as Drill's corrupt values
+ private static final String PARTITIONED_1_2_FOLDER =
"partitioned_with_corruption_4203_1_2";
private static final String CORRUPTED_PARTITIONED_DATES_1_2_PATH =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/partitioned_with_corruption_4203_1_2";
+ Paths.get("/parquet/4203_corrupt_dates",
PARTITIONED_1_2_FOLDER).toString();
--- End diff --
Updated all paths to be relative in the tests
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220966#comment-16220966
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147229478
--- Diff: exec/java-exec/src/test/java/org/apache/drill/TestBugFixes.java
---
@@ -33,8 +35,11 @@
@Category(UnlikelyTest.class)
public class TestBugFixes extends BaseTestQuery {
private static final org.slf4j.Logger logger =
org.slf4j.LoggerFactory.getLogger(TestBugFixes.class);
- private static final String WORKING_PATH = TestTools.getWorkingPath();
- private static final String TEST_RES_PATH = WORKING_PATH +
"/src/test/resources";
+
+ @BeforeClass
+ public static void setupTestFiles() {
+dirTestWatcher.copyResourceToRoot("/bugs/DRILL-4192");
--- End diff --
I have made all the path references relative in the tests now
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220968#comment-16220968
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147229671
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestCorruptParquetDateCorrection.java
---
@@ -76,43 +78,50 @@
//- detecting corrupt values must be deferred to actual data
page reading
//- one from 1.4, where there is a proper created-by, but the
corruption is present
private static final String MIXED_CORRUPTED_AND_CORRECT_DATES_PATH =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/mixed_drill_versions";
+ "/parquet/4203_corrupt_dates/mixed_drill_versions";
// partitioned with 1.2.0, no certain metadata that these were written
with Drill
// the value will be checked to see that they look corrupt and they will
be corrected
// by default. Users can use the format plugin option
autoCorrectCorruptDates to disable
// this behavior if they have foreign parquet files with valid rare date
values that are
// in the similar range as Drill's corrupt values
+ private static final String PARTITIONED_1_2_FOLDER =
"partitioned_with_corruption_4203_1_2";
private static final String CORRUPTED_PARTITIONED_DATES_1_2_PATH =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/partitioned_with_corruption_4203_1_2";
+ Paths.get("/parquet/4203_corrupt_dates",
PARTITIONED_1_2_FOLDER).toString();
// partitioned with 1.4.0, no certain metadata regarding the date
corruption status.
// The same detection approach of the corrupt date values as for the
files partitioned with 1.2.0
+ private static final String PARTITIONED_1_4_FOLDER =
"partitioned_with_corruption_4203";
private static final String CORRUPTED_PARTITIONED_DATES_1_4_0_PATH =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/partitioned_with_corruption_4203";
+ Paths.get("/parquet/4203_corrupt_dates",
PARTITIONED_1_4_FOLDER).toString();
private static final String PARQUET_DATE_FILE_WITH_NULL_FILLED_COLS =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/null_date_cols_with_corruption_4203.parquet";
+
"/parquet/4203_corrupt_dates/null_date_cols_with_corruption_4203.parquet";
+ private static final String PARTITIONED_1_9_FOLDER =
"1_9_0_partitioned_no_corruption";
private static final String CORRECT_PARTITIONED_DATES_1_9_PATH =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/1_9_0_partitioned_no_corruption";
+ Paths.get("/parquet/4203_corrupt_dates",
PARTITIONED_1_9_FOLDER).toString();
private static final String VARCHAR_PARTITIONED =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/fewtypes_varcharpartition";
+ "/parquet/4203_corrupt_dates/fewtypes_varcharpartition";
private static final String DATE_PARTITIONED =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/fewtypes_datepartition";
+ "/parquet/4203_corrupt_dates/fewtypes_datepartition";
private static final String EXCEPTION_WHILE_PARSING_CREATED_BY_META =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/hive1dot2_fewtypes_null";
+ "/parquet/4203_corrupt_dates/hive1dot2_fewtypes_null";
private static final String CORRECT_DATES_1_6_0_PATH =
-
"[WORKING_PATH]/src/test/resources/parquet/4203_corrupt_dates/correct_dates_and_old_drill_parquet_writer.parquet";
- private static final String PARTITIONED_1_2_FOLDER =
"partitioned_with_corruption_4203_1_2";
+
"/parquet/4203_corrupt_dates/correct_dates_and_old_drill_parquet_writer.parquet";
private static final String
MIXED_CORRUPTED_AND_CORRECT_PARTITIONED_FOLDER = "mixed_partitioned";
-
@BeforeClass
public static void initFs() throws Exception {
+dirTestWatcher.copyResourceToRoot("/parquet/4203_corrupt_dates");
--- End diff --
fixed
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221146#comment-16221146
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147255211
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/TestAltSortQueries.java ---
@@ -19,24 +19,33 @@
import org.apache.drill.categories.OperatorTest;
import org.apache.drill.categories.SqlTest;
+import org.apache.drill.test.BaseTestQuery;
+import org.junit.BeforeClass;
import org.junit.Test;
import org.junit.experimental.categories.Category;
@Category({SqlTest.class, OperatorTest.class})
-public class TestAltSortQueries extends BaseTestQuery{
+public class TestAltSortQueries extends BaseTestQuery {
static final org.slf4j.Logger logger =
org.slf4j.LoggerFactory.getLogger(TestAltSortQueries.class);
+ @BeforeClass
+ public static void setupTestFiles() {
+dirTestWatcher.copyFileToRoot("sample-data/region.parquet");
+dirTestWatcher.copyFileToRoot("sample-data/regionsSF");
+dirTestWatcher.copyFileToRoot("sample-data/nation.parquet");
+ }
+
@Test
public void testOrderBy() throws Exception{
test("select R_REGIONKEY " +
- "from dfs_test.`[WORKING_PATH]/../../sample-data/region.parquet`
" +
+ "from dfs_test.`/sample-data/region.parquet` " +
--- End diff --
Updated package-info.java and ExampleTest.java
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221157#comment-16221157
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147256621
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/xsort/TestSimpleExternalSort.java
---
@@ -147,7 +152,7 @@ public void sortOneKeyDescendingExternalSortLegacy()
throws Throwable {
}
private void sortOneKeyDescendingExternalSort(boolean testLegacy) throws
Throwable {
-FixtureBuilder builder = ClusterFixture.builder()
+FixtureBuilder builder = ClusterFixture.builder(dirTestWatcher)
--- End diff --
Is there a case where the tmp directories are optional? The Drillbit will
always have to be configured with a drill.tmp-dir at minimum, so I think
it should be required to use a BaseDirTestWatcher with a ClusterFixture. I
could move passing the dirTestWatcher to the build method instead of the
constructor. Let me know what you think.
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221167#comment-16221167
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147257244
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/test/BaseDirTestWatcher.java ---
@@ -0,0 +1,184 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.drill.test;
+
+import com.google.common.base.Charsets;
+import org.apache.commons.io.FileUtils;
+import org.apache.drill.common.util.TestTools;
+import org.apache.drill.exec.util.TestUtilities;
+import org.junit.runner.Description;
+
+import java.io.File;
+import java.io.IOException;
+
+public class BaseDirTestWatcher extends DirTestWatcher {
+ public enum DirType {
+ROOT,
+TEST_TMP;
+ }
+
+ private File tmpDir;
+ private File storeDir;
+ private File dfsTestTmpParentDir;
+ private File dfsTestTmpDir;
+ private File rootDir;
+
+ public BaseDirTestWatcher() {
+super();
+ }
+
+ @Override
+ protected void starting(Description description) {
+super.starting(description);
+
+rootDir = makeSubDir("root");
+tmpDir = new File(rootDir, "tmp");
+storeDir = new File(rootDir, "store");
+dfsTestTmpParentDir = new File(rootDir, "dfsTestTmp");
+
+tmpDir.mkdirs();
+storeDir.mkdirs();
+dfsTestTmpParentDir.mkdirs();
+ }
+
+ public File getTmpDir() {
+return tmpDir;
+ }
+
+ public File getStoreDir() {
+return storeDir;
+ }
+
+ public File getDfsTestTmpParentDir() {
+return dfsTestTmpParentDir;
+ }
+
+ public File getDfsTestTmpDir() {
+return dfsTestTmpDir;
+ }
+
+ public String getDfsTestTmpDirPath() {
+return dfsTestTmpDir.getAbsolutePath().replaceAll("/\\./", "/");
+ }
+
+ public File getRootDir() {
+return rootDir;
+ }
+
+ public String getRootDirPath() {
+return rootDir.getAbsolutePath().replaceAll("/\\./", "/");
+ }
+
+ public void newDfsTestTmpDir() {
+dfsTestTmpDir =
TestUtilities.createTempDir(BaseTestQuery.dirTestWatcher.getDfsTestTmpParentDir());
+ }
+
+ private File getDir(DirType type) {
+switch (type) {
+ case ROOT:
+return rootDir;
+ case TEST_TMP:
+return dfsTestTmpDir;
+ default:
+throw new IllegalArgumentException(String.format("Unsupported type
%s", type));
+}
+ }
+
+ public File makeRootSubDir(String relPath) {
--- End diff --
Fair enough. I would prefer to use File objects to represent concrete files
or directories. Java.nio.Path objects are useful because they can represent
relative paths, and provide a bunch of methods for manipulating paths. I'll
update the methods I introduced to use jva.io.Files and java.nio.Paths
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221180#comment-16221180
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147258230
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/test/ClusterFixture.java ---
@@ -213,7 +204,7 @@ private void configureZk(FixtureBuilder builder) {
}
}
- private void createConfig(FixtureBuilder builder) throws Exception {
+ private void createConfig() throws Exception {
--- End diff --
They should be. The only change I made is that I didn't require passing the
FixtureBuilder as an arg, because the class is already holding a reference to
it.
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221210#comment-16221210
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147261203
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/test/ClusterFixture.java ---
@@ -226,43 +217,16 @@ private void createConfig(FixtureBuilder builder)
throws Exception {
serviceSet = null;
usesZk = true;
- isLocal = false;
} else {
// Embedded Drillbit.
serviceSet = RemoteServiceSet.getLocalServiceSet();
- isLocal = true;
}
}
- private void startDrillbits(FixtureBuilder builder) throws Exception {
-//// Ensure that Drill uses the log directory determined here rather
than
-//// it's hard-coded defaults. WIP: seems to be needed some times but
-//// not others.
-//
-//String logDir = null;
-//if (builder.tempDir != null) {
-// logDir = builder.tempDir.getAbsolutePath();
-//}
-//if (logDir == null) {
-// logDir = config.getString(ExecConstants.DRILL_TMP_DIR);
-// if (logDir != null) {
-//logDir += "/drill/log";
-// }
-//}
-//if (logDir == null) {
-// logDir = "/tmp/drill";
-//}
-//new File(logDir).mkdirs();
-//System.setProperty("drill.log-dir", logDir);
-
-dfsTestTempDir = makeTempDir("dfs-test");
-
-// Clean up any files that may have been left from the
-// last run.
-
-preserveLocalFiles = builder.preserveLocalFiles;
-removeLocalFiles();
+ private void startDrillbits() throws Exception {
+dfsTestTempDir = new File(getRootDir(), "dfs-test");
+dfsTestTempDir.mkdirs();
--- End diff --
This is possible through the BaseDirTestWatcher. It is configured through
the BaseDireTestWatcher's constructor. If you pass it false it will not delete
your directories at the end of each test.
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-5783) Make code generation in the TopN operator more modular and test it
[
https://issues.apache.org/jira/browse/DRILL-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221221#comment-16221221
]
ASF GitHub Bot commented on DRILL-5783:
---
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/984#discussion_r147262655
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/test/ExampleTest.java ---
@@ -59,6 +59,9 @@
@Ignore
public class ExampleTest {
+ @Rule
+ public final DirTestWatcher dirTestWatcher = new DirTestWatcher();
--- End diff --
I added java doc, and added example of how it's used in secondTest
> Make code generation in the TopN operator more modular and test it
> --
>
> Key: DRILL-5783
> URL: https://issues.apache.org/jira/browse/DRILL-5783
> Project: Apache Drill
> Issue Type: Improvement
>Reporter: Timothy Farkas
>Assignee: Timothy Farkas
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Assigned] (DRILL-5822) The query with "SELECT *" with "ORDER BY" clause and `planner.slice_target`=1 doesn't preserve column order
[
https://issues.apache.org/jira/browse/DRILL-5822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vitalii Diravka reassigned DRILL-5822:
--
Assignee: Vitalii Diravka
> The query with "SELECT *" with "ORDER BY" clause and `planner.slice_target`=1
> doesn't preserve column order
> ---
>
> Key: DRILL-5822
> URL: https://issues.apache.org/jira/browse/DRILL-5822
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - JSON
>Affects Versions: 1.11.0
>Reporter: Prasad Nagaraj Subramanya
>Assignee: Vitalii Diravka
> Fix For: 1.12.0
>
>
> Repro steps:
> 1) {code}alter session set `planner.slice_target`=1;{code}
> 2) ORDER BY clause in the query.
> Scenarios:
> {code}
> 0: jdbc:drill:zk=local> alter session reset `planner.slice_target`;
> +---++
> | ok |summary |
> +---++
> | true | planner.slice_target updated. |
> +---++
> 1 row selected (0.082 seconds)
> 0: jdbc:drill:zk=local> select * from cp.`tpch/nation.parquet` order by
> n_name limit 1;
> +--+--+--+--+
> | n_nationkey | n_name | n_regionkey | n_comment
> |
> +--+--+--+--+
> | 0| ALGERIA | 0| haggle. carefully final deposits
> detect slyly agai |
> +--+--+--+--+
> 1 row selected (0.141 seconds)
> 0: jdbc:drill:zk=local> alter session set `planner.slice_target`=1;
> +---++
> | ok |summary |
> +---++
> | true | planner.slice_target updated. |
> +---++
> 1 row selected (0.091 seconds)
> 0: jdbc:drill:zk=local> select * from cp.`tpch/nation.parquet` order by
> n_name limit 1;
> +--+--+--+--+
> | n_comment | n_name |
> n_nationkey | n_regionkey |
> +--+--+--+--+
> | haggle. carefully final deposits detect slyly agai | ALGERIA | 0
>| 0|
> +--+--+--+--+
> 1 row selected (0.201 seconds)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (DRILL-4091) Support more functions in gis contrib module
[ https://issues.apache.org/jira/browse/DRILL-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221407#comment-16221407 ] ASF GitHub Bot commented on DRILL-4091: --- Github user joeauty commented on the issue: https://github.com/apache/drill/pull/258 I'm super excited about this! Just wondering, is there plans for ST_ASGeoJSON? > Support more functions in gis contrib module > > > Key: DRILL-4091 > URL: https://issues.apache.org/jira/browse/DRILL-4091 > Project: Apache Drill > Issue Type: Improvement > Components: Functions - Drill >Reporter: Karol Potocki > > Support for commonly used gis functions in gis contrib module: relate, > contains, crosses, intersects, touches, difference, disjoint, buffer, union > etc. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (DRILL-4091) Support more functions in gis contrib module
[ https://issues.apache.org/jira/browse/DRILL-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221455#comment-16221455 ] ASF GitHub Bot commented on DRILL-4091: --- Github user amansinha100 commented on the issue: https://github.com/apache/drill/pull/258 Somehow these extensions to the GIS module never got reviewed ! (the original GIS functions are in the contrib). @k255 would you be able to rebase your PR onto the latest master branch ? Hopefully someone familiar with the semantics of these functions can do a quick review and then we will merge it in. Thanks for your contribution ! > Support more functions in gis contrib module > > > Key: DRILL-4091 > URL: https://issues.apache.org/jira/browse/DRILL-4091 > Project: Apache Drill > Issue Type: Improvement > Components: Functions - Drill >Reporter: Karol Potocki > > Support for commonly used gis functions in gis contrib module: relate, > contains, crosses, intersects, touches, difference, disjoint, buffer, union > etc. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (DRILL-1170) YARN support for Drill
[ https://issues.apache.org/jira/browse/DRILL-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers reassigned DRILL-1170: -- Assignee: Paul Rogers (was: Paul Rogers) > YARN support for Drill > -- > > Key: DRILL-1170 > URL: https://issues.apache.org/jira/browse/DRILL-1170 > Project: Apache Drill > Issue Type: New Feature >Reporter: Neeraja >Assignee: Paul Rogers > Fix For: Future > > Attachments: Drill-on-YARNDesignOverview.pdf, > Drill-on-YARNUserGuide.pdf > > > This is a tracking item to make Drill work with YARN. > Below are few requirements/needs to consider. > - Drill should run as an YARN based application, side by side with other YARN > enabled applications (on same nodes or different nodes). Both memory and CPU > resources of Drill should be controlled in this mechanism. > - As an YARN enabled application, Drill resource consumption should be > adaptive to the load on the cluster. For ex: When there is no load on the > Drill , Drill should consume no resources on the cluster. As the load on > Drill increases, resources permitting, usage should grow proportionally. > - Low latency is a key requirement for Apache Drill along with support for > multiple users (concurrency in 100s-1000s). This should be supported when run > as YARN application as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
