[GitHub] drill issue #600: DRILL-4373: Drill and Hive have incompatible timestamp rep...

Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/600 @vdiravka Looks like the test TestHiveStorage.readAllSupportedHiveDataTypesNativeParquet:214 is also failing. (The timestamp_field value is not matching the baseline). Can you take a look? ---

[GitHub] drill issue #573: Drill 4858

Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/573 Oops. This change breaks a bunch of unit tests. -1 until we fix that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] drill issue #639: DRILL-4706: Fragment planning causes Drillbits to read rem...

Github user ppadma commented on the issue: https://github.com/apache/drill/pull/639 Updated the JIRA with details on how current algorithm works, why remote reads were happening and the new algorithm details. https://issues.apache.org/jira/browse/DRILL-4706 --- If your project

[GitHub] drill pull request #640: Merge pull request #2 from apache/master

Github user gparai closed the pull request at: https://github.com/apache/drill/pull/640 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] drill pull request #640: Merge pull request #2 from apache/master

GitHub user gparai reopened a pull request: https://github.com/apache/drill/pull/640 Merge pull request #2 from apache/master Sync with apache master You can merge this pull request into a Git repository by running: $ git pull https://github.com/gparai/drill master

[GitHub] drill pull request #640: Merge pull request #2 from apache/master

Github user gparai closed the pull request at: https://github.com/apache/drill/pull/640 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] drill pull request #640: Merge pull request #2 from apache/master

GitHub user gparai opened a pull request: https://github.com/apache/drill/pull/640 Merge pull request #2 from apache/master Sync with apache master You can merge this pull request into a Git repository by running: $ git pull https://github.com/gparai/drill master

Re: Limit the number of output parquet files in CTAS

You can try and set store.partition.hash_distribute to true, but it is still listed as an alpha feature. You can also add a sort operation (order by) to the CTAS statement to force a single data stream at output. I believe this was discussed a while back on the user list. Ideally you want to

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85803203 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/client/DrillClient.java --- @@ -603,33 +596,16 @@ public

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85800423 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85823003 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/user/UserServer.java --- @@ -328,44 +304,73 @@ protected void

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85800113 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85798971 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85806353 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/security/plain/PlainServer.java --- @@ -0,0 +1,175 @@ +/** + * Licensed to the

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85802232 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85800898 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.hpp --- @@ -564,6 +570,34 @@ class ZookeeperImpl{ std::string m_rootDir; };

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85819216 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/user/UserClient.java --- @@ -78,21 +101,241 @@ public void submitQuery(UserResultsListener

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85819718 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/user/UserServer.java --- @@ -299,6 +260,20 @@ public ChannelFuture

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85803810 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/security/AuthenticationMechanismFactory.java --- @@ -0,0 +1,169 @@ +/** + *

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85819136 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/user/UserClient.java --- @@ -78,21 +101,241 @@ public void submitQuery(UserResultsListener

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85802137 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85819519 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/user/UserServer.java --- @@ -246,28 +160,75 @@ protected void

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85800948 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.hpp --- @@ -564,6 +570,34 @@ class ZookeeperImpl{ std::string m_rootDir; };

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85804286 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/security/AuthenticationMechanismFactory.java --- @@ -0,0 +1,169 @@ +/** + *

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85798339 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85802665 --- Diff: contrib/native/client/src/include/drill/common.hpp --- @@ -34,7 +34,7 @@ #include #include -#define DRILL_RPC_VERSION 5

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85799157 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85802847 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/client/DrillClient.java --- @@ -224,19 +222,15 @@ public synchronized void connect(String

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85804609 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/rpc/security/AuthenticationMechanismFactory.java --- @@ -0,0 +1,169 @@ +/** + *

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85802018 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85798863 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85797710 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85802469 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85798619 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85798045 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85797062 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -427,6 +511,121 @@ connectionStatus_t

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85801077 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.hpp --- @@ -564,6 +570,34 @@ class ZookeeperImpl{ std::string m_rootDir; };

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85792599 --- Diff: common/src/main/java/org/apache/drill/common/KerberosUtil.java --- @@ -0,0 +1,40 @@ +/** + * Licensed to the Apache Software Foundation

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85795087 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -248,7 +267,7 @@ connectionStatus_t DrillClientImpl::recvHandshake(){ }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85646140 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/rpc/security/SimpleServer.java --- @@ -0,0 +1,138 @@ +/** + * Licensed to the Apache

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85645751 --- Diff: contrib/native/client/cmakeModules/FindSASL.cmake --- @@ -0,0 +1,55 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85792190 --- Diff: common/src/main/java/org/apache/drill/common/KerberosUtil.java --- @@ -0,0 +1,40 @@ +/** + * Licensed to the Apache Software Foundation

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85645840 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -1849,4 +2048,150 @@ void ZookeeperImpl:: debugPrint(){ } }

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85645966 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/client/DrillClient.java --- @@ -591,7 +584,7 @@ public void runQuery(QueryType type, String

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85794422 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -102,18 +106,33 @@ connectionStatus_t DrillClientImpl::connect(const char*

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85645935 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/client/DrillClient.java --- @@ -88,21 +84,22 @@ import

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85645696 --- Diff: contrib/native/client/cmakeModules/FindSASL.cmake --- @@ -0,0 +1,55 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85796563 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -427,6 +511,121 @@ connectionStatus_t

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85796780 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -427,6 +511,121 @@ connectionStatus_t

[GitHub] drill pull request #578: DRILL-4280: Kerberos Authentication

Github user laurentgo commented on a diff in the pull request: https://github.com/apache/drill/pull/578#discussion_r85645955 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/client/DrillClient.java --- @@ -285,9 +279,14 @@ public synchronized boolean reconnect() {

[GitHub] drill issue #573: Drill 4858

Github user parthchandra commented on the issue: https://github.com/apache/drill/pull/573 +1 for the fix. I'll add the unit test based on the examples in the JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

Limit the number of output parquet files in CTAS

Hi, Is there a way to limit the number of files produced by a CTAS query ? I would like the speed benefits of having hundreds of scanner fragment but don't want to deal with hundreds of output files. Our usecase right now is using 880 thread to scan and produce a report output spread over... 880

[GitHub] drill issue #635: DRILL-4927 (part 2): Add support for Null Equality Joins (...

Github user KulykRoman commented on the issue: https://github.com/apache/drill/pull/635 Added tests with t1.key = t2.key AND ((t1.data=t2.data) OR (t1.data IS NULL AND t2.data IS NULL)) pattern. --- If your project is set up for it, you can reply to this email and have your reply

Re: Jason's operator test framework?

Hey Paul, I included basic tests for a good portion of the operators with the framework itself. You can check out this class [1] for the examples. Feel free to send along any questions. A known limitation: - There is no way to currently declare assertions about where the outgoing batch

RE: [HANGOUT] Topics for 11/1/16

Hi Paul, Can we talk a bit about working to improve decimal type support? My related PR is waiting for review: https://issues.apache.org/jira/browse/DRILL-4834 Thanks, Dave Oshinsky -Original Message- From: Paul Rogers [mailto:prog...@maprtech.com] Sent: Monday, October 31, 2016 12:33

Jason's operator test framework?

Hi Jason & All, A couple months back Jason presented some very nice work where he was able to create a test framework for individual operators. Jason, is your framework documented anywhere? Or, can you point me to some tests that use the framework? Thanks! - Paul

[HANGOUT] Topics for 11/1/16

Hi All, Our bi-weekly hangout is tomorrow (11/01/16, 10 AM PT). Please respond with suggested topics. We will also ask for additional topics at the beginning of the hangout. See you then, - Paul

[GitHub] drill pull request #639: New fragment placement algorithm based on locality ...

GitHub user ppadma opened a pull request: https://github.com/apache/drill/pull/639 New fragment placement algorithm based on locality of data. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ppadma/drill DRILL-4706

Re: Time for a 1.9 Release?

+1. On Sun, Oct 30, 2016 at 10:23 PM, Paul Rogers wrote: > For release numbers, 1.10 (then 1.11, 1.12, …) seems like a good idea. > > At first it may seem odd to go to 1.10 from 1.9. Might people get confused > between 1.10 and 1.1.0? But, there is precedence. Tomcat’s

[jira] [Created] (DRILL-4984) Limit 0 raises NullPointerException on JDBC storage sources

Holger Kiel created DRILL-4984: -- Summary: Limit 0 raises NullPointerException on JDBC storage sources Key: DRILL-4984 URL: https://issues.apache.org/jira/browse/DRILL-4984 Project: Apache Drill

[jira] [Created] (DRILL-4983) Random failure while reading footer of hive generated parquet file

Rahul Challapalli created DRILL-4983: Summary: Random failure while reading footer of hive generated parquet file Key: DRILL-4983 URL: https://issues.apache.org/jira/browse/DRILL-4983 Project:

[GitHub] drill pull request #638: DRILL-4982: Separate Hive reader classes for differ...

GitHub user chunhui-shi opened a pull request: https://github.com/apache/drill/pull/638 DRILL-4982: Separate Hive reader classes for different data formats t… …o improve performance. 1, Separating Hive reader classes allows optimization to apply on different classes in