Re: The meaning/intent of the following methods - JSON storage format - part 1

2015-09-16 Thread Abdel Hakim Deneche
Hi Edmon, About Question 1, you can read the following page, that gives a pretty good explanation about major and minor fragments: https://drill.apache.org/docs/drill-query-execution/ On Wed, Sep 16, 2015 at 2:17 PM, Edmon Begoli wrote: > I am studying the JSON Storage plugin. > > Can someone

[jira] [Created] (DRILL-3795) TextReader can't read .tsv file contains multiple double quotes

2015-09-16 Thread Chun Chang (JIRA)
Chun Chang created DRILL-3795: - Summary: TextReader can't read .tsv file contains multiple double quotes Key: DRILL-3795 URL: https://issues.apache.org/jira/browse/DRILL-3795 Project: Apache Drill

[jira] [Created] (DRILL-3794) Fragments outlive query execution in certain out of memory cases

2015-09-16 Thread Rahul Challapalli (JIRA)
Rahul Challapalli created DRILL-3794: Summary: Fragments outlive query execution in certain out of memory cases Key: DRILL-3794 URL: https://issues.apache.org/jira/browse/DRILL-3794 Project: Apach

[jira] [Created] (DRILL-3793) Rewrite MergeJoinBatch using record batch iterator.

2015-09-16 Thread amit hadke (JIRA)
amit hadke created DRILL-3793: - Summary: Rewrite MergeJoinBatch using record batch iterator. Key: DRILL-3793 URL: https://issues.apache.org/jira/browse/DRILL-3793 Project: Apache Drill Issue Type

[GitHub] drill pull request: DRILL-1942-concurrency-test: new smoke test fo...

2015-09-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/105 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] drill pull request: DRILL-1942-concurrency-test: new smoke test fo...

2015-09-16 Thread parthchandra
Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/105#issuecomment-140926709 +1 looks like all comments are addressed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

The meaning/intent of the following methods - JSON storage format - part 1

2015-09-16 Thread Edmon Begoli
I am studying the JSON Storage plugin. Can someone please answer what is the meaning (or intent) of the following methods: # Question 1: # This is from inside the getter for RecordWriter. What is major/minor fragment id? String fragmentId = String.format("%d_%d", handle.getMajorFragmentId(), hand

[jira] [Created] (DRILL-3792) Improve documentation of the JSON plugin.

2015-09-16 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3792: --- Summary: Improve documentation of the JSON plugin. Key: DRILL-3792 URL: https://issues.apache.org/jira/browse/DRILL-3792 Project: Apache Drill Issue Type: Impr

filesystem pathnames or (file) URI references?

2015-09-16 Thread Daniel Barclay
For the file system plug-in, are Drill table name identifiers supposed to be taken as filesystem pathnames or as URI references? (Or is it sometimes one and sometimes the other, and, if so, when one and when the other?) For example, would the delimited identifier `10%20%30` refer to a file with

Re: Is anyone having issues with the jdbc unit tests (ITTestShadedJar)?

2015-09-16 Thread Daniel Barclay
> The level complexity of the build process to get a test to correctly test > the right thing means jumping through a bunch of hoops to clear the > classpath and then use a special classloader. Hey, do we know if using a Maven integration test would make testing the JDBC-all Jar file easier? Pr

[GitHub] drill pull request: DRILL-3732: Drill leaks memory if external sor...

2015-09-16 Thread adeneche
Github user adeneche commented on a diff in the pull request: https://github.com/apache/drill/pull/147#discussion_r39662668 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/xsort/ExternalSortBatch.java --- @@ -514,13 +516,20 @@ public BatchGroup mergeAnd

[GitHub] drill pull request: DRILL-3732: Drill leaks memory if external sor...

2015-09-16 Thread amansinha100
Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/147#discussion_r39662237 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/xsort/ExternalSortBatch.java --- @@ -514,13 +516,20 @@ public BatchGroup merg

[GitHub] drill pull request: DRILL-3732: Drill leaks memory if external sor...

2015-09-16 Thread amansinha100
Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/147#discussion_r39660969 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/xsort/ExternalSortBatch.java --- @@ -506,7 +508,7 @@ public BatchGroup mergeAn

Enhancement suggestions for the Drill JDBC Plugin

2015-09-16 Thread Magnus Pierre
Hello, I am not a developer, and don’t aim to become one either, even though I cheat by writing code now and then. I do however have lots of ideas for optimizations of the recently completed JDBC plugin. (DRILL-3180) Since JDBC is a single drill-bit operation, it would be good to utilize the fa

[jira] [Resolved] (DRILL-2332) Drill should be consistent with Implicit casting rules across data formats

2015-09-16 Thread Sean Hsuan-Yi Chu (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Hsuan-Yi Chu resolved DRILL-2332. -- Resolution: Fixed > Drill should be consistent with Implicit casting rules across data f

[jira] [Resolved] (DRILL-3783) Incorrect results : COUNT() over results returned by UNION ALL

2015-09-16 Thread Jason Altekruse (JIRA)
[ https://issues.apache.org/jira/browse/DRILL-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Altekruse resolved DRILL-3783. Resolution: Not A Problem > Incorrect results : COUNT() over results returned by UNION ALL

[jira] [Created] (DRILL-3791) Test JDBC plugin with MySQL

2015-09-16 Thread Andrew (JIRA)
Andrew created DRILL-3791: - Summary: Test JDBC plugin with MySQL Key: DRILL-3791 URL: https://issues.apache.org/jira/browse/DRILL-3791 Project: Apache Drill Issue Type: Test Components: Sto

[jira] [Created] (DRILL-3790) Support elasticsearch 1.x

2015-09-16 Thread Andrew (JIRA)
Andrew created DRILL-3790: - Summary: Support elasticsearch 1.x Key: DRILL-3790 URL: https://issues.apache.org/jira/browse/DRILL-3790 Project: Apache Drill Issue Type: Improvement Components

[GitHub] drill pull request: DRILL-3767: SchemaPath.getCompoundPath(String....

2015-09-16 Thread amansinha100
Github user amansinha100 commented on the pull request: https://github.com/apache/drill/pull/155#issuecomment-140782795 Updated PR looks good to me. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

Re: Derby address in use

2015-09-16 Thread Jacques Nadeau
It is run in a static @BeforeClass so it should only be started once [1] Does anyone else see this issue? [1] https://github.com/apache/drill/blob/master/contrib/storage-jdbc/src/test/java/org/apache/drill/exec/store/jdbc/TestJdbcPlugin.java#L41 -- Jacques Nadeau CTO and Co-Founder, Dremio On

[GitHub] drill pull request: DRILL-1065: Support for ALTER ... RESET statem...

2015-09-16 Thread sudheeshkatkam
Github user sudheeshkatkam commented on a diff in the pull request: https://github.com/apache/drill/pull/159#discussion_r39644014 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/handlers/SetOptionHandler.java --- @@ -49,45 +47,67 @@ public SetOptionHandler

Derby address in use

2015-09-16 Thread Aman Sinha
(Starting a separate thread on the TestJdbcPlugin failure): Regarding the derby issue..yet it is different. I did check using 'netstat' and 'lsof' commands that nothing was running on port 2. Also 'ps -aef | grep -i derby' does not show anything. I am going to reboot and see, but it seems

Re: Is anyone having issues with the jdbc unit tests (ITTestShadedJar)?

2015-09-16 Thread Jacques Nadeau
You can run a remote debugging session. However, given what you're describing, it sounds very much like an issue with the build rather than an issue with the Drill code or test. (Although a better error message would be nice for the situation where the app.class.path is missing.) As such, you would

Re: Is anyone having issues with the jdbc unit tests (ITTestShadedJar)?

2015-09-16 Thread Chris Westin
I only tried to run it from the IDE after it failed in mvn install (in order to figure out why it's failing). Great, so if it can't work in the IDE, how do we figure out why it's failing? On Sep 16, 2015 5:37 AM, "Jacques Nadeau" wrote: > Ah, you're focused on testing from within the IDE? > > The

Re: Is anyone having issues with the jdbc unit tests (ITTestShadedJar)?

2015-09-16 Thread Jacques Nadeau
Ah, you're focused on testing from within the IDE? The level complexity of the build process to get a test to correctly test the right thing means jumping through a bunch of hoops to clear the classpath and then use a special classloader. I can't imagine that you could get it to run correctly in a

Re: Is anyone having issues with the jdbc unit tests (ITTestShadedJar)?

2015-09-16 Thread Jacques Nadeau
Aman, your issue is different. Derby starts up on a particular port. If you have something else running on that port (including a paused version of a previous run) then the test would fail. Are you sure you don't have anything running on that port? On Sep 15, 2015 10:25 PM, "Aman Sinha" wrote: >

[jira] [Created] (DRILL-3789) Statement.cancel() does NOT CANCEL query.

2015-09-16 Thread Khurram Faraaz (JIRA)
Khurram Faraaz created DRILL-3789: - Summary: Statement.cancel() does NOT CANCEL query. Key: DRILL-3789 URL: https://issues.apache.org/jira/browse/DRILL-3789 Project: Apache Drill Issue Type:

Re: Review Request 38359: DRILL-3201: Add authentication and authorization to Drill Web client

2015-09-16 Thread Venki Korukanti
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38359/ --- (Updated Sept. 16, 2015, 12:06 a.m.) Review request for drill, Jacques Nadeau a