[jira] [Created] (DRILL-4094) Respect -DskipTests=true for JDBC plugin tests

2015-11-16 Thread Andrew (JIRA)
Andrew created DRILL-4094:
-

 Summary: Respect -DskipTests=true for JDBC plugin tests
 Key: DRILL-4094
 URL: https://issues.apache.org/jira/browse/DRILL-4094
 Project: Apache Drill
  Issue Type: Bug
  Components: Storage - Other
Reporter: Andrew
Assignee: Andrew
Priority: Trivial


The maven config for the JDBC storage plugin does not respect the -DskipTests 
option.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3967) Broken Test: TestDrillbitResilience.cancelAfterEverythingIsCompleted()

2015-10-22 Thread Andrew (JIRA)
Andrew created DRILL-3967:
-

 Summary: Broken Test: 
TestDrillbitResilience.cancelAfterEverythingIsCompleted()
 Key: DRILL-3967
 URL: https://issues.apache.org/jira/browse/DRILL-3967
 Project: Apache Drill
  Issue Type: Test
  Components: Execution - Flow, Execution - RPC
Affects Versions: 1.2.0
Reporter: Andrew
Assignee: Sudheesh Katkam
Priority: Minor


TestDrillbitResilience.cancelAfterEverythingIsCompleted() can sometimes fail. 
I've noticed that running this test on an m2.xlarge on AWS causes a 
reproducible failure when running against the patch for 
https://issues.apache.org/jira/browse/DRILL-3749 (Upgraded Hadoop and Curator 
libraries).

When running this test with the same patch on my laptop, this test passes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3956) TEXT MySQL type unsupported

2015-10-19 Thread Andrew (JIRA)
Andrew created DRILL-3956:
-

 Summary: TEXT MySQL type unsupported
 Key: DRILL-3956
 URL: https://issues.apache.org/jira/browse/DRILL-3956
 Project: Apache Drill
  Issue Type: Bug
  Components: Storage - Other
Affects Versions: 1.2.0
Reporter: Andrew
Assignee: Andrew


The JDBC storage plugin will fail with an NPE when querying a MySQL table that 
has a 'TEXT' column. The underlying problem appears to be that Calcite has no 
notion of this type.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3935) Modify VarCharWriter to allow passing byte[]

2015-10-14 Thread Andrew (JIRA)
Andrew created DRILL-3935:
-

 Summary: Modify VarCharWriter to allow passing byte[]
 Key: DRILL-3935
 URL: https://issues.apache.org/jira/browse/DRILL-3935
 Project: Apache Drill
  Issue Type: Bug
  Components: Execution - Data Types
Reporter: Andrew
Assignee: Andrew
Priority: Minor
 Fix For: 1.3.0


In RecordReader implementations, one sometimes has variable-length string data 
in the form of byte arrays. It is a cumbersome idiom to pack these into a 
DrillBuf, only to pass it on to the write. 

I propose adding this method to the VarCharWriter interface: public void 
writeVarChar(int start, int end, byte[] bytes);

Without this I currently have to do:
byte[] bytes = value.getBytes(Charsets.UTF_8);
buffer.reallocIfNeeded(bytes.length);
buffer.setBytes(0, bytes);
writer.varChar().writeVarChar(0, bytes.length, buffer);





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3916) Assembly for JDBC storage plugin missing

2015-10-08 Thread Andrew (JIRA)
Andrew created DRILL-3916:
-

 Summary: Assembly for JDBC storage plugin missing
 Key: DRILL-3916
 URL: https://issues.apache.org/jira/browse/DRILL-3916
 Project: Apache Drill
  Issue Type: Bug
  Components: Storage - Other
Affects Versions: 1.2.0
Reporter: Andrew
Assignee: Andrew


The JDBC storage plugin is missing from the assembly instructions, which means 
that the plugin fails to be loaded by the drill bit on start.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3911) Upgrade Hadoop from 2.4.1 to latest stable

2015-10-07 Thread Andrew (JIRA)
Andrew created DRILL-3911:
-

 Summary: Upgrade Hadoop from 2.4.1 to latest stable
 Key: DRILL-3911
 URL: https://issues.apache.org/jira/browse/DRILL-3911
 Project: Apache Drill
  Issue Type: Improvement
  Components: Storage - Other
Reporter: Andrew
Assignee: Andrew
 Fix For: 1.3.0


Later versions of Hadoop have improved S3 compatibility 
(https://issues.apache.org/jira/browse/HADOOP-10400). 

Since users are increasingly using Drill with S3, we should upgrade our Hadoop 
dependency so we can get the best integration possible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3882) Time and Timestamp vectors should not return timezone-based data

2015-10-01 Thread Andrew (JIRA)
Andrew created DRILL-3882:
-

 Summary: Time and Timestamp vectors should not return 
timezone-based data
 Key: DRILL-3882
 URL: https://issues.apache.org/jira/browse/DRILL-3882
 Project: Apache Drill
  Issue Type: Bug
  Components: Storage - Other
Affects Versions: 1.1.0
Reporter: Andrew
Assignee: Andrew
 Fix For: 1.2.0


TimeVector, NullableTimeVector, TimestampVector, and NullableTimestampVector 
should not return values that contain timezone information. Each of these 
classes implements:
{code}
public DateTime getObject()
{code}

I believe the correct method should be
{code}
public LocalTime getObject()
{code}

The rational for this change is that the "time" and "timestamp" types are not 
timezone-aware and therefore are more closely modeled by Joda's LocalTime class.

Additionally, the way it is now makes testing harder b/c 
{code}TestBuilder{code} wants to use {code}DateTime{code} objects to compare 
results from JDBC storage engines, but the storage engine's return no timezone 
information for such types.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (DRILL-3565) Add support for Avro UNION type

2015-10-01 Thread Andrew (JIRA)

 [ 
https://issues.apache.org/jira/browse/DRILL-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew resolved DRILL-3565.
---
Resolution: Fixed

> Add support for Avro UNION type
> ---
>
> Key: DRILL-3565
> URL: https://issues.apache.org/jira/browse/DRILL-3565
> Project: Apache Drill
>  Issue Type: Improvement
>  Components: Storage - Other
>Affects Versions: 1.1.0, 1.2.0
>Reporter: Abhishek Girish
> Fix For: Future
>
> Attachments: divolte.avro, drillbit.log.txt
>
>
> Running a simple select * from an avro file fails. 
> {code:sql}
> > select count(*) from `divolte.avro`;
> Error: SYSTEM ERROR: UnsupportedOperationException: Unimplemented type: UNION
> Fragment 0:0
> [Error Id: c7c1ed87-cd85-4146-844d-4addc227128b on abhi1:31010] 
> (state=,code=0)
> {code}
> Plan:
> {code}
> 00-00Screen
> 00-01  Project(*=[$0])
> 00-02Scan(groupscan=[EasyGroupScan 
> [selectionRoot=maprfs:/tmp/divolte.avro, numFiles=1, columns=[`*`], 
> files=[maprfs:///tmp/divolte.avro]]])
>  {code}
> Log & data file attached. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3869) Trailing semicolon causes web UI to fail

2015-09-30 Thread Andrew (JIRA)
Andrew created DRILL-3869:
-

 Summary: Trailing semicolon causes web UI to fail
 Key: DRILL-3869
 URL: https://issues.apache.org/jira/browse/DRILL-3869
 Project: Apache Drill
  Issue Type: Bug
Affects Versions: 1.1.0
Reporter: Andrew
Assignee: Andrew
 Fix For: 1.2.0


When submitting a query through the web UI, if the user types in a trailing ';' 
the query will fail. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3790) Support elasticsearch 1.x

2015-09-16 Thread Andrew (JIRA)
Andrew created DRILL-3790:
-

 Summary: Support elasticsearch 1.x
 Key: DRILL-3790
 URL: https://issues.apache.org/jira/browse/DRILL-3790
 Project: Apache Drill
  Issue Type: Improvement
  Components: Storage - ElasticSearch
Reporter: Andrew
Assignee: Andrew


Currently, the work being done on the elasticsearch storage plugin has focused 
on the soon-to-be-released 2.0 version of elasticsearch. However, we also need 
to support 1.x versions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3791) Test JDBC plugin with MySQL

2015-09-16 Thread Andrew (JIRA)
Andrew created DRILL-3791:
-

 Summary: Test JDBC plugin with MySQL
 Key: DRILL-3791
 URL: https://issues.apache.org/jira/browse/DRILL-3791
 Project: Apache Drill
  Issue Type: Test
  Components: Storage - Other
Reporter: Andrew
Assignee: Andrew
Priority: Blocker


Testing the new JDBC storage plugin against MySQL.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3782) Upgrade HPPC library to latest version

2015-09-14 Thread Andrew (JIRA)
Andrew created DRILL-3782:
-

 Summary: Upgrade HPPC library to latest version
 Key: DRILL-3782
 URL: https://issues.apache.org/jira/browse/DRILL-3782
 Project: Apache Drill
  Issue Type: Task
Reporter: Andrew
Assignee: Andrew
Priority: Minor


We should upgrade the carrot search HPPC library to 0.7.1, which is the latest 
version. There are some class renames, but otherwise it should be a 
straightforward change.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3723) RemoteServiceSet.getServiceSetWithFullCache() ignores arguments

2015-08-28 Thread Andrew (JIRA)
Andrew created DRILL-3723:
-

 Summary: RemoteServiceSet.getServiceSetWithFullCache() ignores 
arguments
 Key: DRILL-3723
 URL: https://issues.apache.org/jira/browse/DRILL-3723
 Project: Apache Drill
  Issue Type: Bug
  Components: Execution - RPC
Affects Versions: 1.1.0
Reporter: Andrew
Assignee: Jacques Nadeau
Priority: Minor
 Fix For: 1.2.0


RemoteServiceSet.getServiceSetWithFullCache() ignores both of its arguments and 
is therefore functionally equivalent to getLocalServiceSet().




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3706) Fix typos and formatting in StoragePluginRegistry

2015-08-25 Thread Andrew (JIRA)
Andrew created DRILL-3706:
-

 Summary: Fix typos and formatting in StoragePluginRegistry
 Key: DRILL-3706
 URL: https://issues.apache.org/jira/browse/DRILL-3706
 Project: Apache Drill
  Issue Type: Improvement
  Components: Documentation
Reporter: Andrew
Assignee: Andrew
Priority: Trivial






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3709) Memory Storage Plugin

2015-08-25 Thread Andrew (JIRA)
Andrew created DRILL-3709:
-

 Summary: Memory Storage Plugin
 Key: DRILL-3709
 URL: https://issues.apache.org/jira/browse/DRILL-3709
 Project: Apache Drill
  Issue Type: Improvement
  Components: Storage - Other
Reporter: Andrew
Assignee: Jacques Nadeau
 Fix For: 1.3.0


Create an in-memory storage plugin for rapid prototyping, testing, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3637) Elasticsearch storage plugin

2015-08-12 Thread Andrew (JIRA)
Andrew created DRILL-3637:
-

 Summary: Elasticsearch storage plugin
 Key: DRILL-3637
 URL: https://issues.apache.org/jira/browse/DRILL-3637
 Project: Apache Drill
  Issue Type: New Feature
  Components: Storage - Other
Reporter: Andrew
Assignee: Jacques Nadeau


Create a storage plugin for elasticsearch



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (DRILL-3300) Parameter never used in HBaseGroupScan

2015-06-15 Thread Andrew (JIRA)
Andrew created DRILL-3300:
-

 Summary: Parameter never used in HBaseGroupScan
 Key: DRILL-3300
 URL: https://issues.apache.org/jira/browse/DRILL-3300
 Project: Apache Drill
  Issue Type: Bug
  Components: Storage - HBase
Affects Versions: 1.0.0
Reporter: Andrew
Assignee: Aditya Kishore
Priority: Trivial



The method HBaseGroupScan.setFilterPushedDown(boolean) does not read it's 
parameter value.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)