[jira] [Created] (DRILL-3503) Make PruneScanRule have a pluggable partitioning mechanism

2015-07-16 Thread Mehant Baid (JIRA)
Mehant Baid created DRILL-3503:
--

 Summary: Make PruneScanRule have a pluggable partitioning mechanism
 Key: DRILL-3503
 URL: https://issues.apache.org/jira/browse/DRILL-3503
 Project: Apache Drill
  Issue Type: Bug
Reporter: Mehant Baid
Assignee: Mehant Baid
 Fix For: 1.2.0


Currently PruneScanRule performs partition pruning for file system. Some of the 
code relies on certain aspects of how partitioning is done in DFS. This JIRA 
aims to abstract out the behavior of the underlying partition scheme and 
delegate to the specific storage plugin to get that information. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3504) Apache Drill Load Testing using Jmeter

2015-07-16 Thread Siva Gudavalli (JIRA)
Siva Gudavalli created DRILL-3504:
-

 Summary: Apache Drill Load Testing using Jmeter
 Key: DRILL-3504
 URL: https://issues.apache.org/jira/browse/DRILL-3504
 Project: Apache Drill
  Issue Type: Bug
  Components: Client - JDBC
Affects Versions: 1.0.0
 Environment: Windows
Reporter: Siva Gudavalli
Assignee: Daniel Barclay (Drill)
Priority: Blocker


Hi,

I am performing load tests using Apache Jmeter on Apache Drill Queries.

Using JDBC Request on Apache Jmeter to connect Apache Drill

This is how my connection looks like  

jdbc:drill:zk=bossxxx113059:5181,bossxxx113060:5181,bossxxx113061:5181/drill/my_cluster_com-drillbits

org.apache.drill.jdbc.Driver

Query:
select * from dfs.`/user/mapr/rsv2`

org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: 
java.lang.NumberFormatException: Y

org.apache.drill.common.exceptions.UserRemoteException: PARSE ERROR: 
Encountered and \ at line 1, column 73.
Was expecting one of:

Regards
Shiv





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [storage engine plugin] How to push down sort/order by to the storage engine?

2015-07-16 Thread Tugdual Grall

 Hi Tugdual,


Thanks for the response


  The only reason for removing _id field from select * is, in most of the
 cases value of _id field generated by Mongo system and users normally do
 not use.


It is not true, it is by default generated and use the timestamp that is
part of the ObjectID in many use case (this give me an idea on an UDF for
mongo)

Also developer can set it when needed, and since it is used as PK it is
often use for lookup in apps ( it is true in the context of analytics it is
less useful).




 However, if users select _id field (cases where users using _id as key)
 drill returns its value.


So yes I can do a projection
select _id 
but
select _id, *  ... does not work

so I  need to specify the full list of field. (Will see where it is coming
from)

Anyway it is not a blocking issue at all since we can access it, I was just
surprised that it was removed/hidden by default.

regards
Tug



 On Thu, Jul 16, 2015 at 5:53 PM, Tugdual Grall tugd...@gmail.com wrote:

 Hello,

 I would like to push down the ORDER BY to the MongoDB database itself (
 see
 https://issues.apache.org/jira/browse/DRILL-3165 )

 I have looked into the Optimizer, Record Reader and Scan, I do not see how
 I can get the Order by clause information from the context.

 I see how the filters and projection are used.

 Any clue?


 PS: another side question about Projection  MongoDB:
Any reason why the _id is by default removed from the select * from
 collection ?



 Regards
 Tug
 @tgrall




 --
 Kamesh.



[storage engine plugin] How to push down sort/order by to the storage engine?

2015-07-16 Thread Tugdual Grall
Hello,

I would like to push down the ORDER BY to the MongoDB database itself ( see
https://issues.apache.org/jira/browse/DRILL-3165 )

I have looked into the Optimizer, Record Reader and Scan, I do not see how
I can get the Order by clause information from the context.

I see how the filters and projection are used.

Any clue?


PS: another side question about Projection  MongoDB:
   Any reason why the _id is by default removed from the select * from
collection ?



Regards
Tug
@tgrall


netty 3.6.6 jar part of Drill dependencies

2015-07-16 Thread Abdel Hakim Deneche
I noticed when building Drill that we ship both netty 4.0.27 and 3.6.6 in
jars/3rdparty.

Thanks to Jason, we found that netty 3.6.6 is a dependency of hbase-client
0.98.7. Further looking into the jars, it seems that netty 3.6.6 and 4.0.27
are using different package names (org.jboss.netty vs io.netty)

I guess this is fine as Drill is only referencing io.netty, but wanted to
double check in the dev list to make sure this is not a potential source of
problems.

Thanks!

-- 

Abdelhakim Deneche

Software Engineer

  http://www.mapr.com/


Now Available - Free Hadoop On-Demand Training
http://www.mapr.com/training?utm_source=Emailutm_medium=Signatureutm_campaign=Free%20available


Re: netty 3.6.6 jar part of Drill dependencies

2015-07-16 Thread Jason Altekruse
Just to share the strategy for debugging future instances of problems like
this. Maven has a command that will show you the exploded dependency tree
of a project [0]. Just pipe this into a file and look for the version
number of any jars you found that look like they may be conflicting
transitive dependencies. Solving this problem can be done in two ways,
either excluding the unwanted dependency, or shading it [1]. As I
understand it, excluding that JAR will only work if we happen to be using a
subset of the direct dependency that does not reference the unwanted
transitive dependency.

[0] -
https://maven.apache.org/plugins/maven-dependency-plugin/examples/resolving-conflicts-using-the-dependency-tree.html

[1] -
http://stackoverflow.com/questions/13620281/what-is-the-maven-shade-plugin-used-for-and-why-would-you-want-to-relocate-java

On Thu, Jul 16, 2015 at 8:55 AM, Abdel Hakim Deneche adene...@maprtech.com
wrote:

 I noticed when building Drill that we ship both netty 4.0.27 and 3.6.6 in
 jars/3rdparty.

 Thanks to Jason, we found that netty 3.6.6 is a dependency of hbase-client
 0.98.7. Further looking into the jars, it seems that netty 3.6.6 and 4.0.27
 are using different package names (org.jboss.netty vs io.netty)

 I guess this is fine as Drill is only referencing io.netty, but wanted to
 double check in the dev list to make sure this is not a potential source of
 problems.

 Thanks!

 --

 Abdelhakim Deneche

 Software Engineer

   http://www.mapr.com/


 Now Available - Free Hadoop On-Demand Training
 
 http://www.mapr.com/training?utm_source=Emailutm_medium=Signatureutm_campaign=Free%20available
 



Re: Looking for a final review of package documentation Drill-1904

2015-07-16 Thread Jason Altekruse
This is mentioned in the discussion on this review, but I wanted to mention
it on the list here as well. As I was writing docs for the root level
package I started writing a reasonable large description of the Drill
architecture as a whole. I did not cover all of the topics that I wanted,
but I would like to encourage anyone with specific knowledge in the various
components in Drill to write up anything they can to contribute to this. I
am more than happy to edit the whole thing together, if you have limited
time feel free to just post a list of bullet points that are core concepts
that new developers should be aware of and I will work on filling out a
complete draft.

https://issues.apache.org/jira/browse/DRILL-2077

On Thu, Jul 16, 2015 at 11:58 AM, Jason Altekruse altekruseja...@gmail.com
wrote:

 Bump

 On Mon, Jul 6, 2015 at 2:45 PM, Jason Altekruse altekruseja...@gmail.com
 wrote:

 Hello Drill devs,

 A few months ago I submitted this patch for package level documentation
 in Drill. I received some comments and fixed a few reported issues with the
 patch, but I did not follow through to try to get a  +1 from another
 committer. With everything that was going on stabilizing Drill for 1.0, it
 just fell by the wayside.

 Would someone be willing to take a pass over these docs so I can get them
 merged? The actual changes aren't too large, the diff looks big mostly
 because I have the apache license header on a bunch of small files.

 https://reviews.apache.org/r/29278

 https://issues.apache.org/jira/browse/DRILL-1904





Re: Review Request 29278: Drill-1904 package level docs

2015-07-16 Thread Sudheesh Katkam

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29278/#review91945
---


LGTM!


common/src/main/java/org/apache/drill/common/expression/package-info.java (line 
22)
https://reviews.apache.org/r/29278/#comment145710

conditions, as well as



common/src/main/java/org/apache/drill/common/expression/package-info.java (line 
24)
https://reviews.apache.org/r/29278/#comment145711

logically as ASTs



common/src/main/java/org/apache/drill/common/logical/FormatPluginConfig.java 
(line 27)
https://reviews.apache.org/r/29278/#comment145713

such formats like as?


- Sudheesh Katkam


On Jan. 27, 2015, 1:36 a.m., Jason Altekruse wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/29278/
 ---
 
 (Updated Jan. 27, 2015, 1:36 a.m.)
 
 
 Review request for drill, Daniel Barclay and Jacques Nadeau.
 
 
 Bugs: Drill-1904
 https://issues.apache.org/jira/browse/Drill-1904
 
 
 Repository: drill-git
 
 
 Description
 ---
 
 Add package level documentation to the sources of Drill
 
 
 Diffs
 -
 
   common/src/main/java/org/apache/drill/common/config/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/exceptions/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/expression/aggregate/BasicAggregates.java
  5f18aaf 
   
 common/src/main/java/org/apache/drill/common/expression/fn/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/expression/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/expression/types/package-info.java
  PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/expression/visitors/package-info.java
  PRE-CREATION 
   common/src/main/java/org/apache/drill/common/graph/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/logical/FormatPluginConfig.java 
 936e4f2 
   
 common/src/main/java/org/apache/drill/common/logical/FormatPluginConfigBase.java
  0704085 
   common/src/main/java/org/apache/drill/common/logical/data/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/logical/data/visitors/package-info.java
  PRE-CREATION 
   common/src/main/java/org/apache/drill/common/logical/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/package-info.java PRE-CREATION 
   common/src/main/java/org/apache/drill/common/types/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/util/package-info.java 
 PRE-CREATION 
   
 contrib/storage-mongo/src/main/java/org/apache/drill/exec/store/mongo/package-info.java
  PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/cache/package-info.java 
 PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/client/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/compile/bytecode/package-info.java
  PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/compile/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/compile/sig/package-info.java
  PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/coord/local/package-info.java
  PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/coord/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/coord/zk/package-info.java 
 PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/disk/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/dotdrill/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/exception/package-info.java
  PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/package-info.java 
 PRE-CREATION 
 
 Diff: https://reviews.apache.org/r/29278/diff/
 
 
 Testing
 ---
 
 Just comments, no code changes
 
 
 Thanks,
 
 Jason Altekruse
 




Re: Review Request 29278: Drill-1904 package level docs

2015-07-16 Thread Parth Chandra

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29278/#review91947
---

Ship it!


Ship It!

- Parth Chandra


On Jan. 27, 2015, 1:36 a.m., Jason Altekruse wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/29278/
 ---
 
 (Updated Jan. 27, 2015, 1:36 a.m.)
 
 
 Review request for drill, Daniel Barclay and Jacques Nadeau.
 
 
 Bugs: Drill-1904
 https://issues.apache.org/jira/browse/Drill-1904
 
 
 Repository: drill-git
 
 
 Description
 ---
 
 Add package level documentation to the sources of Drill
 
 
 Diffs
 -
 
   common/src/main/java/org/apache/drill/common/config/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/exceptions/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/expression/aggregate/BasicAggregates.java
  5f18aaf 
   
 common/src/main/java/org/apache/drill/common/expression/fn/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/expression/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/expression/types/package-info.java
  PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/expression/visitors/package-info.java
  PRE-CREATION 
   common/src/main/java/org/apache/drill/common/graph/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/logical/FormatPluginConfig.java 
 936e4f2 
   
 common/src/main/java/org/apache/drill/common/logical/FormatPluginConfigBase.java
  0704085 
   common/src/main/java/org/apache/drill/common/logical/data/package-info.java 
 PRE-CREATION 
   
 common/src/main/java/org/apache/drill/common/logical/data/visitors/package-info.java
  PRE-CREATION 
   common/src/main/java/org/apache/drill/common/logical/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/package-info.java PRE-CREATION 
   common/src/main/java/org/apache/drill/common/types/package-info.java 
 PRE-CREATION 
   common/src/main/java/org/apache/drill/common/util/package-info.java 
 PRE-CREATION 
   
 contrib/storage-mongo/src/main/java/org/apache/drill/exec/store/mongo/package-info.java
  PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/cache/package-info.java 
 PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/client/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/compile/bytecode/package-info.java
  PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/compile/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/compile/sig/package-info.java
  PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/coord/local/package-info.java
  PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/coord/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/coord/zk/package-info.java 
 PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/disk/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/dotdrill/package-info.java 
 PRE-CREATION 
   
 exec/java-exec/src/main/java/org/apache/drill/exec/exception/package-info.java
  PRE-CREATION 
   exec/java-exec/src/main/java/org/apache/drill/exec/package-info.java 
 PRE-CREATION 
 
 Diff: https://reviews.apache.org/r/29278/diff/
 
 
 Testing
 ---
 
 Just comments, no code changes
 
 
 Thanks,
 
 Jason Altekruse
 




[jira] [Resolved] (DRILL-3348) NPE when two different window functions are used in projection list and order by clauses

2015-07-16 Thread Sean Hsuan-Yi Chu (JIRA)

 [ 
https://issues.apache.org/jira/browse/DRILL-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Hsuan-Yi Chu resolved DRILL-3348.
--
Resolution: Cannot Reproduce

I cannot reproduce this issue. And in your log, the calcite was a little bit 
outdated. The latest seems working fine.



 NPE when two different window functions are used in projection list and order 
 by clauses
 

 Key: DRILL-3348
 URL: https://issues.apache.org/jira/browse/DRILL-3348
 Project: Apache Drill
  Issue Type: Bug
  Components: Query Planning  Optimization
Affects Versions: 1.0.0
Reporter: Victoria Markman
Assignee: Sean Hsuan-Yi Chu
  Labels: window_function
 Fix For: 1.2.0


 {code:sql}
 select 
 a1, 
 rank() over(partition by b1 order by a1) 
 from 
 t1 
 order by 
 row_number() over(partition by b1 order by a1);
 {code}
 {code}
 0: jdbc:drill:schema=dfs select a1, rank() over(partition by b1 order by a1) 
 from t1 order by row_number() over(partition by b1 order by a1);
 Error: SYSTEM ERROR: org.apache.drill.exec.work.foreman.ForemanException: 
 Unexpected exception during fragment initialization: null
 [Error Id: ba3e0fda-cc78-4650-a49b-51e4fd7d625d on atsqa4-133.qa.lab:31010] 
 (state=,code=0)
 {code}
 drillbit.log
 {code}
 org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: 
 org.apache.drill.exec.work.foreman.ForemanException: Unexpected exception 
 during fragment initialization: null
 [Error Id: ba3e0fda-cc78-4650-a49b-51e4fd7d625d on atsqa4-133.qa.lab:31010]
 at 
 org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:523)
  ~[drill-common-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at 
 org.apache.drill.exec.work.foreman.Foreman$ForemanResult.close(Foreman.java:738)
  [drill-java-exec-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at 
 org.apache.drill.exec.work.foreman.Foreman$StateSwitch.processEvent(Foreman.java:840)
  [drill-java-exec-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at 
 org.apache.drill.exec.work.foreman.Foreman$StateSwitch.processEvent(Foreman.java:782)
  [drill-java-exec-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at 
 org.apache.drill.common.EventProcessor.sendEvent(EventProcessor.java:73) 
 [drill-common-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at 
 org.apache.drill.exec.work.foreman.Foreman$StateSwitch.moveToState(Foreman.java:784)
  [drill-java-exec-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at 
 org.apache.drill.exec.work.foreman.Foreman.moveToState(Foreman.java:893) 
 [drill-java-exec-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:253) 
 [drill-java-exec-1.1.0-SNAPSHOT-rebuffed.jar:1.1.0-SNAPSHOT]
 at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  [na:1.7.0_71]
 at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  [na:1.7.0_71]
 at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71]
 Caused by: org.apache.drill.exec.work.foreman.ForemanException: Unexpected 
 exception during fragment initialization: null
 ... 4 common frames omitted
 Caused by: java.lang.NullPointerException: null
 at org.apache.calcite.rex.RexBuilder.makeCast(RexBuilder.java:465) 
 ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at org.apache.calcite.rex.RexBuilder.ensureType(RexBuilder.java:955) 
 ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter.convertOver(SqlToRelConverter.java:1763)
  ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter.access$1000(SqlToRelConverter.java:180)
  ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter$Blackboard.convertExpression(SqlToRelConverter.java:3938)
  ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter.convertSelectList(SqlToRelConverter.java:3327)
  ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter.convertSelectImpl(SqlToRelConverter.java:609)
  ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter.convertSelect(SqlToRelConverter.java:564)
  ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter.convertQueryRecursive(SqlToRelConverter.java:2741)
  ~[calcite-core-1.1.0-drill-r8.jar:1.1.0-drill-r8]
 at 
 org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:522)
  

Review Request 36558: DRILL-3492: Add support for encoding/decoding of 'double' to/from OrderedBytes format

2015-07-16 Thread Smidth Panchamia

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/36558/
---

Review request for drill and Aditya Kishore.


Bugs: DRILL-3492
https://issues.apache.org/jira/browse/DRILL-3492


Repository: drill-git


Description
---

This change allows encoding/decoding of data from Double data type to 
OrderedBytes format.
The following JIRA added the OrderedBytes encoding to HBase: 
https://issues.apache.org/jira/browse/HBASE-8201

This encoding scheme will preserve the sort-order of the native data-type when 
it is stored as sorted byte arrays on disk.
Thus, it will help the HBase storage plugin if the row-keys have been encoded 
in OrderedBytes format.

This functionality allows us to prune the scan ranges, thus reading much lesser 
data from the server.


Diffs
-

  contrib/storage-hbase/pom.xml d027771 
  
contrib/storage-hbase/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/OrderedBytesDoubleConvertFrom.java
 PRE-CREATION 
  
contrib/storage-hbase/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/OrderedBytesDoubleConvertTo.java
 PRE-CREATION 
  
contrib/storage-hbase/src/main/java/org/apache/drill/exec/store/hbase/CompareFunctionsProcessor.java
 803f520 
  
contrib/storage-hbase/src/test/java/org/apache/drill/hbase/HBaseTestsSuite.java 
a77baba 
  
contrib/storage-hbase/src/test/java/org/apache/drill/hbase/TestHBaseFilterPushDown.java
 ca4c07c 
  
contrib/storage-hbase/src/test/java/org/apache/drill/hbase/TestOrderedBytesConvertFunctions.java
 PRE-CREATION 
  
contrib/storage-hbase/src/test/java/org/apache/drill/hbase/TestTableGenerator.java
 097947c 

Diff: https://reviews.apache.org/r/36558/diff/


Testing
---

Added a new unit-test class TestOrderedBytesConvertFunctions.java which derives 
from TestConvertFunctions.java class.
This tests the sanity of the OrderedBytesDoubleConvert{From|To}.java 
implementation.

Also, added a new test case to TestHBaseFilterPushDown.java class which checks 
if the we were able to prune the scan range of the table where the row-key was 
encoded as OrderedBytes.

All the added tests work as expected.


Thanks,

Smidth Panchamia



Build failed in Jenkins: drill-scm #466

2015-07-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/drill-scm/466/changes

Changes:

[altekrusejason] DRILL-1904 - Part 1: Package level docs for the common module 
and a few packages in exec.

--
[...truncated 271 lines...]
[INFO] Exclude: **/*.log
[INFO] Exclude: **/*.css
[INFO] Exclude: **/*.js
[INFO] Exclude: **/*.md
[INFO] Exclude: **/*.eps
[INFO] Exclude: **/*.json
[INFO] Exclude: **/*.parquet
[INFO] Exclude: **/*.sql
[INFO] Exclude: **/git.properties
[INFO] Exclude: **/*.csv
[INFO] Exclude: **/*.tsv
[INFO] Exclude: **/*.txt
[INFO] Exclude: **/drill-*.conf
[INFO] Exclude: **/.buildpath
[INFO] Exclude: **/*.proto
[INFO] Exclude: **/*.fmpp
[INFO] Exclude: **/target/**
[INFO] Exclude: **/*.iml
[INFO] Exclude: **/*.tdd
[INFO] Exclude: **/*.project
[INFO] Exclude: **/TAGS
[INFO] Exclude: **/*.checkstyle
[INFO] Exclude: **/.classpath
[INFO] Exclude: **/.settings/**
[INFO] Exclude: .*/**
[INFO] Exclude: **/*.patch
[INFO] Exclude: **/*.pb.cc
[INFO] Exclude: **/*.pb.h
[INFO] Exclude: **/*.linux
[INFO] Exclude: **/client/build/**
[INFO] Exclude: **/*.tbl
[INFO] 83 resources included (use -debug for more details)
Warning:  org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 
'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not 
recognized.
Compiler warnings:
  WARNING:  'org.apache.xerces.jaxp.SAXParserImpl: Property 
'http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.'
Warning:  org.apache.xerces.parsers.SAXParser: Feature 
'http://javax.xml.XMLConstants/feature/secure-processing' is not recognized.
Warning:  org.apache.xerces.parsers.SAXParser: Property 
'http://javax.xml.XMLConstants/property/accessExternalDTD' is not recognized.
Warning:  org.apache.xerces.parsers.SAXParser: Property 
'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not 
recognized.
[INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 
approved: 83 licence.
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.12.1:check (checkstyle-validation) @ 
drill-protocol ---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (avoid_bad_dependencies) @ 
drill-protocol ---
[INFO] 
[INFO] --- git-commit-id-plugin:2.1.9:revision (for-jars) @ drill-protocol ---
[info] dotGitDirectory /x1/jenkins/jenkins-slave/workspace/drill-scm/.git
[info] git.build.user.name Unknown
[info] git.build.user.email Unknown
[info] Using environment variable based branch name. GIT_BRANCH = origin/master
[info] git.branch origin/master
[info] --always = false
[info] --dirty = -dirty
[info] --abbrev = 7
[info] --long = %s true
[info] --match = 
[info] Tag refs [ 
[Ref[refs/tags/0.6.0-incubating=3daef7f553431c5aa76ff3074a8e00943de6dedd], 
Ref[refs/tags/0.9.0=78fd658d20767f8c627e29f58a6ede05a055bfdf], 
Ref[refs/tags/drill-1.0.0-m1=04020a8fca8b287874528d86dc7b8be0269ad788], 
Ref[refs/tags/drill-root-0.4.0-incubating=caa15e2629329cb56903189ff294bbd490a3fca8],
 Ref[refs/tags/drill-root-1.0.0-m1=ad638d9e41aa9efdb1e877cfe7e0a4b910f539fc], 
Ref[refs/tags/oscon_workshop=eaf95ed3c30d7bb147afe337e0e0477be6518d90], 
Ref[refs/tags/pre_exec_merge=a97a22b0a9547f8639e92258c0a3475b01742f15]] ]
[info] Resolved tag [ 0.6.0-incubating ] [ PersonIdent[Steven Phillips, 
sphill...@maprtech.com, Thu Oct 2 02:27:36 2014 -0700] ], points at [ commit 
5fa257b38df77dedf5609952e364ce0cfc7383d2 0 -- ] 
[info] Resolved tag [ 0.9.0 ] [ PersonIdent[Jacques Nadeau, jacq...@apache.org, 
Wed Apr 29 00:33:38 2015 -0700] ], points at [ commit 
c7cb36c8b45613bab299dfe6cafb36d4d2e00add 0 -- ] 
[info] Resolved tag [ drill-1.0.0-m1 ] [ PersonIdent[Jacques Nadeau, 
jacq...@apache.org, Fri Sep 6 13:05:42 2013 -0700] ], points at [ commit 
a0d3c6977820516983142c96d7f9374681529968 0 -- ] 
[info] Resolved tag [ drill-root-0.4.0-incubating ] [ PersonIdent[Jacques 
Nadeau, jacq...@apache.org, Wed Jul 30 22:21:41 2014 -0700] ], points at [ 
commit 98b208e262dd9b54988f5eeffacea7d0e83c958c 0 -- ] 
[info] Resolved tag [ drill-root-1.0.0-m1 ] [ PersonIdent[Jacques Nadeau, 
jacq...@apache.org, Wed Sep 4 04:23:47 2013 -0700] ], points at [ commit 
41c18197e3b8ae3c42d55089d641e9a0b68c6f29 0 -- ] 
[info] Resolved tag [ pre_exec_merge ] [ PersonIdent[Jacques Nadeau, 
jacq...@apache.org, Fri Jul 19 18:33:56 2013 -0700] ], points at [ commit 
5052b64d9953857575f8f40995b8da05160e5457 0 -- ] 
[info] key [ commit 41c18197e3b8ae3c42d55089d641e9a0b68c6f29 0 -- ], tags 
= [ [DatedRevTag{id=ad638d9e41aa9efdb1e877cfe7e0a4b910f539fc, 
tagName='drill-root-1.0.0-m1', date=September 4, 2013 11:23:47 AM UTC}] ] 
[info] key [ commit 5fa257b38df77dedf5609952e364ce0cfc7383d2 0 -- ], tags 
= [ [DatedRevTag{id=3daef7f553431c5aa76ff3074a8e00943de6dedd, 
tagName='0.6.0-incubating', date=October 2, 2014 9:27:36 AM UTC}] ] 
[info] key [ commit 5052b64d9953857575f8f40995b8da05160e5457 0 -- ], tags 
= [ [DatedRevTag{id=a97a22b0a9547f8639e92258c0a3475b01742f15, 
tagName='pre_exec_merge', date=July 20, 2013 1:33:56 AM 

[jira] [Created] (DRILL-3507) AbstractMapVector uses AbstractContainerVector's logger

2015-07-16 Thread Daniel Barclay (Drill) (JIRA)
Daniel Barclay (Drill) created DRILL-3507:
-

 Summary: AbstractMapVector uses AbstractContainerVector's logger
 Key: DRILL-3507
 URL: https://issues.apache.org/jira/browse/DRILL-3507
 Project: Apache Drill
  Issue Type: Bug
Reporter: Daniel Barclay (Drill)


{{AbstractMapVector}} uses {{AbstractContainerVector}}'s {{logger}} field, and 
that logger field is not private.

(There seems to be about 63 other cases of abnormally non-private logger 
fields.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3506) Remove logger fields from interfaces.

2015-07-16 Thread Daniel Barclay (Drill) (JIRA)
Daniel Barclay (Drill) created DRILL-3506:
-

 Summary: Remove logger fields from interfaces.
 Key: DRILL-3506
 URL: https://issues.apache.org/jira/browse/DRILL-3506
 Project: Apache Drill
  Issue Type: Bug
Reporter: Daniel Barclay (Drill)


About 29 Java interfaces have extraneous logger fields like this:

{noformat}
public interface Counter {
  static final org.slf4j.Logger logger = 
org.slf4j.LoggerFactory.getLogger(Counter.class);
...
{noformat}

See:
common/src/main/java/org/apache/drill/common/logical/data/visitors/LogicalVisitor.java
common/src/main/java/org/apache/drill/common/logical/FormatPluginConfig.java
common/src/main/java/org/apache/drill/common/expression/LogicalExpression.java
exec/java-exec/src/test/java/org/apache/drill/exec/compile/ExampleTemplate.java
exec/java-exec/src/main/java/org/apache/drill/exec/disk/Spool.java
exec/java-exec/src/main/java/org/apache/drill/exec/rpc/DrillRpcFuture.java
exec/java-exec/src/main/java/org/apache/drill/exec/rpc/RpcOutcome.java
exec/java-exec/src/main/java/org/apache/drill/exec/rpc/RpcConnectionHandler.java
exec/java-exec/src/main/java/org/apache/drill/exec/memory/BufferAllocator.java
exec/java-exec/src/main/java/org/apache/drill/exec/work/batch/DataCollector.java
exec/java-exec/src/main/java/org/apache/drill/exec/work/batch/RawBatchBuffer.java
exec/java-exec/src/main/java/org/apache/drill/exec/work/RootNodeDriver.java
exec/java-exec/src/main/java/org/apache/drill/exec/cache/DrillSerializable.java
exec/java-exec/src/main/java/org/apache/drill/exec/cache/Counter.java
exec/java-exec/src/main/java/org/apache/drill/exec/cache/DistributedMap.java
exec/java-exec/src/main/java/org/apache/drill/exec/cache/DistributedMultiMap.java
exec/java-exec/src/main/java/org/apache/drill/exec/cache/DistributedCache.java
exec/java-exec/src/main/java/org/apache/drill/exec/store/dfs/easy/FileWork.java
exec/java-exec/src/main/java/org/apache/drill/exec/store/SchemaFactory.java
exec/java-exec/src/main/java/org/apache/drill/exec/store/schedule/CompleteWork.java
exec/java-exec/src/main/java/org/apache/drill/exec/store/RecordRecorder.java
exec/java-exec/src/main/java/org/apache/drill/exec/physical/base/PhysicalVisitor.java
exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/BatchCreator.java
exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/RootCreator.java
exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/filter/Filterer.java
exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/aggregate/BatchIterator.java
exec/java-exec/src/main/java/org/apache/drill/exec/physical/WriteEntry.java
exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/Prel.java
exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/visitor/PrelVisitor.java





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (DRILL-3483) Clarify CommonConstants' constants.

2015-07-16 Thread Jason Altekruse (JIRA)

 [ 
https://issues.apache.org/jira/browse/DRILL-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Altekruse resolved DRILL-3483.

Resolution: Fixed

Fixed in 9b351c945b5f10d27cf07b9b5c1a435a029614b7

 Clarify CommonConstants' constants.
 ---

 Key: DRILL-3483
 URL: https://issues.apache.org/jira/browse/DRILL-3483
 Project: Apache Drill
  Issue Type: Bug
Reporter: Daniel Barclay (Drill)
Assignee: Jason Altekruse
 Fix For: 1.2.0


 Document, rename, and otherwise clean up CommonConstants' constants.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)