[jira] [Resolved] (HIVE-14568) Hive Decimal Returns NULL

2019-03-05 Thread gurmukh singh (JIRA) 


 [ 
https://issues.apache.org/jira/browse/HIVE-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh resolved HIVE-14568.
--
  Resolution: Won't Fix
Release Note: Marking it resolved as per comment from @Xuefu Zhang

> Hive Decimal Returns NULL
> -
>
> Key: HIVE-14568
> URL: https://issues.apache.org/jira/browse/HIVE-14568
> Project: Hive
>  Issue Type: Bug
>  Components: Hive
>Affects Versions: 1.0.0, 1.2.0
> Environment: Centos 6.7, Hadoop 2.7.2,hive 1.0.0,2.0
>Reporter: gurmukh singh
>Assignee: Xuefu Zhang
>Priority: Major
>
> Hi
> I was under the impression that the bug: 
> https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the 
> same issue in Hive 1.0 and hive 1.2 as well.
> hive> desc mul_table;
> OK
> prc   decimal(38,28)
> vol   decimal(38,10)
> Time taken: 0.068 seconds, Fetched: 2 row(s)
> hive> select prc, vol, prc*vol as cost from mul_table;
> OK
> 1.2   200 NULL
> 1.44  200 NULL
> 2.14  100 NULL
> 3.004 50  NULL
> 1.2   200 NULL
> Time taken: 0.048 seconds, Fetched: 5 row(s)
> Rather then returning NULL, it should give error or round off.
> I understand that, I can use Double instead of decimal or can cast it, but 
> still returning "Null" will make many things go unnoticed.
> hive> desc mul_table2;
> OK
> prc   double
> vol   decimal(14,10)
> Time taken: 0.049 seconds, Fetched: 2 row(s)
> hive> select * from mul_table2;
> OK
> 1.4   200
> 1.34  200
> 7.34  100
> 7454533.354544100
> Time taken: 0.028 seconds, Fetched: 4 row(s)
> hive> select prc, vol, prc*vol  as cost from mul_table3;
> OK
> 7.34  100 734.0
> 7.34  10007340.0
> 1.000410001000.4
> 7454533.354544100 7.454533354544E8   <- Wrong result
> 7454533.35454410007.454533354544E9   <- Wrong result
> Time taken: 0.025 seconds, Fetched: 5 row(s)
> Casting:
> hive> select prc, vol, cast(prc*vol as decimal(38,38)) as cost from 
> mul_table3;
> OK
> 7.34  100 NULL
> 7.34  1000NULL
> 1.00041000NULL
> 7454533.354544100 NULL
> 7454533.3545441000NULL
> Time taken: 0.033 seconds, Fetched: 5 row(s)
> hive> select prc, vol, cast(prc*vol as decimal(38,10)) as cost from 
> mul_table3;
> OK
> 7.34  100 734
> 7.34  10007340
> 1.000410001000.4
> 7454533.354544100 745453335.4544
> 7454533.35454410007454533354.544
> Time taken: 0.026 seconds, Fetched: 5 row(s) 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-18572) The record readers; InputFormat needs to be fixed for Tez as it generates 1 split

2019-03-05 Thread gurmukh singh (JIRA) 


[ 
https://issues.apache.org/jira/browse/HIVE-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785221#comment-16785221
 ] 

gurmukh singh commented on HIVE-18572:
--

Opened an internal ticket to fix it.

> The record readers; InputFormat needs to be fixed for Tez as it generates 1 
> split
> -
>
> Key: HIVE-18572
> URL: https://issues.apache.org/jira/browse/HIVE-18572
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 2.1.0
>Reporter: gurmukh singh
>Priority: Major
>
> The record reader needs to be fixed for tez, as it generates only 1 split due 
> to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.
> This has been fixed in MR but not Tez.
> == Issue 
> Closing it as invalid, will create a new ticket with tests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (HIVE-18572) The record readers; InputFormat needs to be fixed for Tez as it generates 1 split

2018-01-29 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh resolved HIVE-18572.
--
  Resolution: Invalid
Release Note: closing it as invalid, will create a new one with tests.

> The record readers; InputFormat needs to be fixed for Tez as it generates 1 
> split
> -
>
> Key: HIVE-18572
> URL: https://issues.apache.org/jira/browse/HIVE-18572
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 2.1.0
>Reporter: gurmukh singh
>Priority: Major
>
> The record reader needs to be fixed for tez, as it generates only 1 split due 
> to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.
> This has been fixed in MR but not Tez.
> == Issue 
> Closing it as invalid, will create a new ticket with tests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (HIVE-18572) The record readers; InputFormat needs to be fixed for Tez as it generates 1 split

2018-01-29 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh updated HIVE-18572:
-
Description: 
The record reader needs to be fixed for tez, as it generates only 1 split due 
to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.

This has been fixed in MR but not Tez.

== Issue 

Closing it as invalid, will create a new ticket with tests.

  was:
The record reader needs to be fixed for tez, as it generates only 1 split due 
to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.

This has been fixed in MR but not Tez.

== Issue 

I am seeing a strange behaviour in tez; it is seeing all data as a single split 
under hive, where as MR see all 79 files. This is causing all the data to go to 
a single map

TEZ Processing
 INFO  : Partition trusted.usage\{ds=20180126, periode=1200} stats: 
[numFiles=1, numRows=79575067, totalSize=3.164.605.993, 
rawDataSize=112439569671]
 ELAPSED TIME: 1958.99 s

MR Processing
 Partition trusted.usage\{ds=20180126, periode=1200} stats: [numFiles=79, 
numRows=79575067, totalSize=3172280778, rawDataSize=112418416260]
 ELAPSED TIME: 65 s

Log Tez
 2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0|#0] 
|split.TezMapredSplitsGrouper|: Desired splits: 381 too large.  Desired 
splitLength: 8311476 Min splitLength: 50331648 New desired splits: 381 Final 
desired splits: 381 All splits have localhost: false Total length: 19166265870 
Original splits: 1
 2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0|#0] 
|split.TezMapredSplitsGrouper|: Using original number of splits: 1 desired 
splits: 381
 2018-01-29 16:50:04,826 [INFO] [InputInitializer \{Map 1} #0|#0] 
|tez.SplitGrouper|: Original split size is 1 grouped split size is 1, for 
bucket: 1
 2018-01-29 16:50:04,827 [INFO] [InputInitializer \{Map 1} #0|#0] 
|tez.HiveSplitGenerator|: Number of grouped splits: 1
 2018-01-29 16:50:04,846 [INFO] [InputInitializer \{Map 1} #0|#0] 
|dag.RootInputInitializerManager|: Succeeded InputInitializer for Input: usage 
on vertex vertex_1517207496169_0085_1_00 [Map 1]
 2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0|#0] |impl.VertexImpl|: 
Cannot init vertex: vertex_1517207496169_0085_1_00 [Map 1] numTasks: -1 
numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: 
true
 2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0|#0] |impl.VertexImpl|: 
Got updated RootInputsSpecs: {usage=forAllWorkUnits=true, update=[1]}
 2018-01-29 16:50:04,859 [INFO] [App Shared Pool - #0|#0] |impl.VertexImpl|: 
Vertex vertex_1517207496169_0085_1_00 [Map 1] parallelism set to 1

As per discussion with Gopal Vijayaraghavan:

[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java#L494]
  that line, right there MRv2 CombineInputFormat broke that rule, so the record 
readers had to be fixed to handle it 
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java#L312]


> The record readers; InputFormat needs to be fixed for Tez as it generates 1 
> split
> -
>
> Key: HIVE-18572
> URL: https://issues.apache.org/jira/browse/HIVE-18572
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 2.1.0
>Reporter: gurmukh singh
>Priority: Major
>
> The record reader needs to be fixed for tez, as it generates only 1 split due 
> to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.
> This has been fixed in MR but not Tez.
> == Issue 
> Closing it as invalid, will create a new ticket with tests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (HIVE-18572) The record readers; InputFormat needs to be fixed for Tez as it generates 1 split

2018-01-29 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh updated HIVE-18572:
-
Description: 
The record reader needs to be fixed for tez, as it generates only 1 split due 
to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.

This has been fixed in MR but not Tez.

== Issue 

I am seeing a strange behaviour in tez; it is seeing all data as a single split 
under hive, where as MR see all 79 files. This is causing all the data to go to 
a single map

TEZ Processing
 INFO  : Partition trusted.usage\{ds=20180126, periode=1200} stats: 
[numFiles=1, numRows=79575067, totalSize=3.164.605.993, 
rawDataSize=112439569671]
 ELAPSED TIME: 1958.99 s

MR Processing
 Partition trusted.usage\{ds=20180126, periode=1200} stats: [numFiles=79, 
numRows=79575067, totalSize=3172280778, rawDataSize=112418416260]
 ELAPSED TIME: 65 s

Log Tez
 2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0|#0] 
|split.TezMapredSplitsGrouper|: Desired splits: 381 too large.  Desired 
splitLength: 8311476 Min splitLength: 50331648 New desired splits: 381 Final 
desired splits: 381 All splits have localhost: false Total length: 19166265870 
Original splits: 1
 2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0|#0] 
|split.TezMapredSplitsGrouper|: Using original number of splits: 1 desired 
splits: 381
 2018-01-29 16:50:04,826 [INFO] [InputInitializer \{Map 1} #0|#0] 
|tez.SplitGrouper|: Original split size is 1 grouped split size is 1, for 
bucket: 1
 2018-01-29 16:50:04,827 [INFO] [InputInitializer \{Map 1} #0|#0] 
|tez.HiveSplitGenerator|: Number of grouped splits: 1
 2018-01-29 16:50:04,846 [INFO] [InputInitializer \{Map 1} #0|#0] 
|dag.RootInputInitializerManager|: Succeeded InputInitializer for Input: usage 
on vertex vertex_1517207496169_0085_1_00 [Map 1]
 2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0|#0] |impl.VertexImpl|: 
Cannot init vertex: vertex_1517207496169_0085_1_00 [Map 1] numTasks: -1 
numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: 
true
 2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0|#0] |impl.VertexImpl|: 
Got updated RootInputsSpecs: {usage=forAllWorkUnits=true, update=[1]}
 2018-01-29 16:50:04,859 [INFO] [App Shared Pool - #0|#0] |impl.VertexImpl|: 
Vertex vertex_1517207496169_0085_1_00 [Map 1] parallelism set to 1

As per discussion with Gopal Vijayaraghavan:

[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java#L494]
  that line, right there MRv2 CombineInputFormat broke that rule, so the record 
readers had to be fixed to handle it 
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java#L312]

  was:
The record reader needs to be fixed for tez, as it generates only 1 split due 
to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.

This has been fixed in MR but not Tez.

I am seeing a strange behaviour in tez; it is seeing all data as a single split 
under hive, where as MR see all 79 files. This is causing all the data to go to 
a single map

TEZ Processing
INFO  : Partition trusted.usage\{ds=20180126, periode=1200} stats: [numFiles=1, 
numRows=79575067, totalSize=3.164.605.993, rawDataSize=112439569671]
ELAPSED TIME: 1958.99 s

MR Processing
Partition trusted.usage\{ds=20180126, periode=1200} stats: [numFiles=79, 
numRows=79575067, totalSize=3172280778, rawDataSize=112418416260]
ELAPSED TIME: 65 s

Log Tez
2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0] 
|split.TezMapredSplitsGrouper|: Desired splits: 381 too large.  Desired 
splitLength: 8311476 Min splitLength: 50331648 New desired splits: 381 Final 
desired splits: 381 All splits have localhost: false Total length: 19166265870 
Original splits: 1
2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0] 
|split.TezMapredSplitsGrouper|: Using original number of splits: 1 desired 
splits: 381
2018-01-29 16:50:04,826 [INFO] [InputInitializer \{Map 1} #0] 
|tez.SplitGrouper|: Original split size is 1 grouped split size is 1, for 
bucket: 1
2018-01-29 16:50:04,827 [INFO] [InputInitializer \{Map 1} #0] 
|tez.HiveSplitGenerator|: Number of grouped splits: 1
2018-01-29 16:50:04,846 [INFO] [InputInitializer \{Map 1} #0] 
|dag.RootInputInitializerManager|: Succeeded InputInitializer for Input: usage 
on vertex vertex_1517207496169_0085_1_00 [Map 1]
2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0] |impl.VertexImpl|: Cannot 
init vertex: vertex_1517207496169_0085_1_00 [Map 1] numTasks: -1 
numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: 
true
2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0] |impl.VertexImpl|: Got 
updated RootInputsSpecs: \{usage=forAllWorkUnits=true, update=[1]}
2018-01-29 16:50:04,859 [INFO] [App Shared Pool - #0] |impl.VertexImpl|: Vertex

[jira] [Updated] (HIVE-18572) The record readers; InputFormat needs to be fixed for Tez as it generates 1 split

2018-01-29 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh updated HIVE-18572:
-
Component/s: Tez

> The record readers; InputFormat needs to be fixed for Tez as it generates 1 
> split
> -
>
> Key: HIVE-18572
> URL: https://issues.apache.org/jira/browse/HIVE-18572
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 2.1.0
>Reporter: gurmukh singh
>Priority: Major
>
> The record reader needs to be fixed for tez, as it generates only 1 split due 
> to the {color:#33}MRv2 CombineInputFormat broke that rule{color}.
> This has been fixed in MR but not Tez.
> I am seeing a strange behaviour in tez; it is seeing all data as a single 
> split under hive, where as MR see all 79 files. This is causing all the data 
> to go to a single map
> TEZ Processing
> INFO  : Partition trusted.usage\{ds=20180126, periode=1200} stats: 
> [numFiles=1, numRows=79575067, totalSize=3.164.605.993, 
> rawDataSize=112439569671]
> ELAPSED TIME: 1958.99 s
> MR Processing
> Partition trusted.usage\{ds=20180126, periode=1200} stats: [numFiles=79, 
> numRows=79575067, totalSize=3172280778, rawDataSize=112418416260]
> ELAPSED TIME: 65 s
> Log Tez
> 2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0] 
> |split.TezMapredSplitsGrouper|: Desired splits: 381 too large.  Desired 
> splitLength: 8311476 Min splitLength: 50331648 New desired splits: 381 Final 
> desired splits: 381 All splits have localhost: false Total length: 
> 19166265870 Original splits: 1
> 2018-01-29 16:50:04,825 [INFO] [InputInitializer \{Map 1} #0] 
> |split.TezMapredSplitsGrouper|: Using original number of splits: 1 desired 
> splits: 381
> 2018-01-29 16:50:04,826 [INFO] [InputInitializer \{Map 1} #0] 
> |tez.SplitGrouper|: Original split size is 1 grouped split size is 1, for 
> bucket: 1
> 2018-01-29 16:50:04,827 [INFO] [InputInitializer \{Map 1} #0] 
> |tez.HiveSplitGenerator|: Number of grouped splits: 1
> 2018-01-29 16:50:04,846 [INFO] [InputInitializer \{Map 1} #0] 
> |dag.RootInputInitializerManager|: Succeeded InputInitializer for Input: 
> usage on vertex vertex_1517207496169_0085_1_00 [Map 1]
> 2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0] |impl.VertexImpl|: 
> Cannot init vertex: vertex_1517207496169_0085_1_00 [Map 1] numTasks: -1 
> numUnitializedEdges: 0 numInitializedInputs: 1 initWaitsForRootInitializers: 
> true
> 2018-01-29 16:50:04,848 [INFO] [App Shared Pool - #0] |impl.VertexImpl|: Got 
> updated RootInputsSpecs: \{usage=forAllWorkUnits=true, update=[1]}
> 2018-01-29 16:50:04,859 [INFO] [App Shared Pool - #0] |impl.VertexImpl|: 
> Vertex vertex_1517207496169_0085_1_00 [Map 1] parallelism set to 1
> As per discussion with Gopal Vijayaraghavan:
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java#L494
>  that line, right there MRv2 CombineInputFormat broke that rule, so the 
> record readers had to be fixed to handle it 
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java#L312



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-13415) Decouple Sessions from thrift binary transport

2016-09-30 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537601#comment-15537601
 ] 

gurmukh singh commented on HIVE-13415:
--

I see this behavior in hive 2.1.0.

Could not find the property recommended 
"hive.server2.close.session.on.disconnect" in the release notes or docs.

> Decouple Sessions from thrift binary transport
> --
>
> Key: HIVE-13415
> URL: https://issues.apache.org/jira/browse/HIVE-13415
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 1.2.0
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
>  Labels: TODOC2.1
> Fix For: 2.1.0
>
> Attachments: HIVE-13415.01.patch, HIVE-13415.04.patch, 
> HIVE-13415.05.patch
>
>
> Current behaviour is:
> * Open a thrift binary transport
> * create a session
> * close the transport
> Then the session gets closed. Consequently, all the operations running in the 
> session also get killed.
> Whereas, if you open an HTTP transport, and close, the enclosing sessions are 
> not closed. 
> This seems like a bad design, having transport and sessions tightly coupled. 
> I'd like to fix this. 
> The issue that introduced it is 
> [HIVE-9601|https://github.com/apache/hive/commit/48bea00c48853459af64b4ca9bfdc3e821c4ed82]
>  Relevant discussions at 
> [here|https://issues.apache.org/jira/browse/HIVE-11485?focusedCommentId=15223546=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15223546],
>  
> [here|https://issues.apache.org/jira/browse/HIVE-11485?focusedCommentId=15223827=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15223827]
>  and mentioned links on those comments. 
> Another thing that seems like a slightly bad design is this line of code in 
> ThriftBinaryCLIService:
> {noformat}
> server.setServerEventHandler(serverEventHandler);
> {noformat}
> Whereas serverEventHandler is defined by the base class, with no users except 
> one sub-class(ThriftBinaryCLIService), violating the separation of concerns. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-14568) Hive Decimal Returns NULL

2016-08-31 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454201#comment-15454201
 ] 

gurmukh singh commented on HIVE-14568:
--

Thanks Xuefu Zhang 

> Hive Decimal Returns NULL
> -
>
> Key: HIVE-14568
> URL: https://issues.apache.org/jira/browse/HIVE-14568
> Project: Hive
>  Issue Type: Bug
>  Components: Hive
>Affects Versions: 1.0.0, 1.2.0
> Environment: Centos 6.7, Hadoop 2.7.2,hive 1.0.0,2.0
>Reporter: gurmukh singh
>Assignee: Xuefu Zhang
>
> Hi
> I was under the impression that the bug: 
> https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the 
> same issue in Hive 1.0 and hive 1.2 as well.
> hive> desc mul_table;
> OK
> prc   decimal(38,28)
> vol   decimal(38,10)
> Time taken: 0.068 seconds, Fetched: 2 row(s)
> hive> select prc, vol, prc*vol as cost from mul_table;
> OK
> 1.2   200 NULL
> 1.44  200 NULL
> 2.14  100 NULL
> 3.004 50  NULL
> 1.2   200 NULL
> Time taken: 0.048 seconds, Fetched: 5 row(s)
> Rather then returning NULL, it should give error or round off.
> I understand that, I can use Double instead of decimal or can cast it, but 
> still returning "Null" will make many things go unnoticed.
> hive> desc mul_table2;
> OK
> prc   double
> vol   decimal(14,10)
> Time taken: 0.049 seconds, Fetched: 2 row(s)
> hive> select * from mul_table2;
> OK
> 1.4   200
> 1.34  200
> 7.34  100
> 7454533.354544100
> Time taken: 0.028 seconds, Fetched: 4 row(s)
> hive> select prc, vol, prc*vol  as cost from mul_table3;
> OK
> 7.34  100 734.0
> 7.34  10007340.0
> 1.000410001000.4
> 7454533.354544100 7.454533354544E8   <- Wrong result
> 7454533.35454410007.454533354544E9   <- Wrong result
> Time taken: 0.025 seconds, Fetched: 5 row(s)
> Casting:
> hive> select prc, vol, cast(prc*vol as decimal(38,38)) as cost from 
> mul_table3;
> OK
> 7.34  100 NULL
> 7.34  1000NULL
> 1.00041000NULL
> 7454533.354544100 NULL
> 7454533.3545441000NULL
> Time taken: 0.033 seconds, Fetched: 5 row(s)
> hive> select prc, vol, cast(prc*vol as decimal(38,10)) as cost from 
> mul_table3;
> OK
> 7.34  100 734
> 7.34  10007340
> 1.000410001000.4
> 7454533.354544100 745453335.4544
> 7454533.35454410007454533354.544
> Time taken: 0.026 seconds, Fetched: 5 row(s) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-14568) Hive Decimal Returns NULL

2016-08-31 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh updated HIVE-14568:
-
Component/s: Hive

> Hive Decimal Returns NULL
> -
>
> Key: HIVE-14568
> URL: https://issues.apache.org/jira/browse/HIVE-14568
> Project: Hive
>  Issue Type: Bug
>  Components: Hive
>Affects Versions: 1.0.0, 1.2.0
> Environment: Centos 6.7, Hadoop 2.7.2,hive 1.0.0,2.0
>Reporter: gurmukh singh
>Assignee: Xuefu Zhang
>
> Hi
> I was under the impression that the bug: 
> https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the 
> same issue in Hive 1.0 and hive 1.2 as well.
> hive> desc mul_table;
> OK
> prc   decimal(38,28)
> vol   decimal(38,10)
> Time taken: 0.068 seconds, Fetched: 2 row(s)
> hive> select prc, vol, prc*vol as cost from mul_table;
> OK
> 1.2   200 NULL
> 1.44  200 NULL
> 2.14  100 NULL
> 3.004 50  NULL
> 1.2   200 NULL
> Time taken: 0.048 seconds, Fetched: 5 row(s)
> Rather then returning NULL, it should give error or round off.
> I understand that, I can use Double instead of decimal or can cast it, but 
> still returning "Null" will make many things go unnoticed.
> hive> desc mul_table2;
> OK
> prc   double
> vol   decimal(14,10)
> Time taken: 0.049 seconds, Fetched: 2 row(s)
> hive> select * from mul_table2;
> OK
> 1.4   200
> 1.34  200
> 7.34  100
> 7454533.354544100
> Time taken: 0.028 seconds, Fetched: 4 row(s)
> hive> select prc, vol, prc*vol  as cost from mul_table3;
> OK
> 7.34  100 734.0
> 7.34  10007340.0
> 1.000410001000.4
> 7454533.354544100 7.454533354544E8   <- Wrong result
> 7454533.35454410007.454533354544E9   <- Wrong result
> Time taken: 0.025 seconds, Fetched: 5 row(s)
> Casting:
> hive> select prc, vol, cast(prc*vol as decimal(38,38)) as cost from 
> mul_table3;
> OK
> 7.34  100 NULL
> 7.34  1000NULL
> 1.00041000NULL
> 7454533.354544100 NULL
> 7454533.3545441000NULL
> Time taken: 0.033 seconds, Fetched: 5 row(s)
> hive> select prc, vol, cast(prc*vol as decimal(38,10)) as cost from 
> mul_table3;
> OK
> 7.34  100 734
> 7.34  10007340
> 1.000410001000.4
> 7454533.354544100 745453335.4544
> 7454533.35454410007454533354.544
> Time taken: 0.026 seconds, Fetched: 5 row(s) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-14568) Hive Decimal Returns NULL

2016-08-23 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh updated HIVE-14568:
-
Assignee: Xuefu Zhang

> Hive Decimal Returns NULL
> -
>
> Key: HIVE-14568
> URL: https://issues.apache.org/jira/browse/HIVE-14568
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 1.0.0, 1.2.0
> Environment: Centos 6.7, Hadoop 2.7.2,hive 1.0.0,2.0
>Reporter: gurmukh singh
>Assignee: Xuefu Zhang
>
> Hi
> I was under the impression that the bug: 
> https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the 
> same issue in Hive 1.0 and hive 1.2 as well.
> hive> desc mul_table;
> OK
> prc   decimal(38,28)
> vol   decimal(38,10)
> Time taken: 0.068 seconds, Fetched: 2 row(s)
> hive> select prc, vol, prc*vol as cost from mul_table;
> OK
> 1.2   200 NULL
> 1.44  200 NULL
> 2.14  100 NULL
> 3.004 50  NULL
> 1.2   200 NULL
> Time taken: 0.048 seconds, Fetched: 5 row(s)
> Rather then returning NULL, it should give error or round off.
> I understand that, I can use Double instead of decimal or can cast it, but 
> still returning "Null" will make many things go unnoticed.
> hive> desc mul_table2;
> OK
> prc   double
> vol   decimal(14,10)
> Time taken: 0.049 seconds, Fetched: 2 row(s)
> hive> select * from mul_table2;
> OK
> 1.4   200
> 1.34  200
> 7.34  100
> 7454533.354544100
> Time taken: 0.028 seconds, Fetched: 4 row(s)
> hive> select prc, vol, prc*vol  as cost from mul_table3;
> OK
> 7.34  100 734.0
> 7.34  10007340.0
> 1.000410001000.4
> 7454533.354544100 7.454533354544E8   <- Wrong result
> 7454533.35454410007.454533354544E9   <- Wrong result
> Time taken: 0.025 seconds, Fetched: 5 row(s)
> Casting:
> hive> select prc, vol, cast(prc*vol as decimal(38,38)) as cost from 
> mul_table3;
> OK
> 7.34  100 NULL
> 7.34  1000NULL
> 1.00041000NULL
> 7454533.354544100 NULL
> 7454533.3545441000NULL
> Time taken: 0.033 seconds, Fetched: 5 row(s)
> hive> select prc, vol, cast(prc*vol as decimal(38,10)) as cost from 
> mul_table3;
> OK
> 7.34  100 734
> 7.34  10007340
> 1.000410001000.4
> 7454533.354544100 745453335.4544
> 7454533.35454410007454533354.544
> Time taken: 0.026 seconds, Fetched: 5 row(s) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-14568) Hive Decimal Returns NULL

2016-08-17 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh updated HIVE-14568:
-
Description: 
Hi

I was under the impression that the bug: 
https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the same 
issue in Hive 1.0 and hive 1.2 as well.

hive> desc mul_table;
OK
prc decimal(38,28)
vol decimal(38,10)
Time taken: 0.068 seconds, Fetched: 2 row(s)

hive> select prc, vol, prc*vol as cost from mul_table;
OK
1.2 200 NULL
1.44200 NULL
2.14100 NULL
3.004   50  NULL
1.2 200 NULL
Time taken: 0.048 seconds, Fetched: 5 row(s)

Rather then returning NULL, it should give error or round off.

I understand that, I can use Double instead of decimal or can cast it, but 
still returning "Null" will make many things go unnoticed.

hive> desc mul_table2;
OK
prc double
vol decimal(14,10)
Time taken: 0.049 seconds, Fetched: 2 row(s)

hive> select * from mul_table2;
OK
1.4 200
1.34200
7.34100
7454533.354544  100
Time taken: 0.028 seconds, Fetched: 4 row(s)


hive> select prc, vol, prc*vol  as cost from mul_table3;
OK
7.34100 734.0
7.3410007340.0
1.0004  10001000.4
7454533.354544  100 7.454533354544E8   <- Wrong result
7454533.354544  10007.454533354544E9   <- Wrong result
Time taken: 0.025 seconds, Fetched: 5 row(s)


Casting:

hive> select prc, vol, cast(prc*vol as decimal(38,38)) as cost from mul_table3;
OK
7.34100 NULL
7.341000NULL
1.0004  1000NULL
7454533.354544  100 NULL
7454533.354544  1000NULL
Time taken: 0.033 seconds, Fetched: 5 row(s)

hive> select prc, vol, cast(prc*vol as decimal(38,10)) as cost from mul_table3;
OK
7.34100 734
7.3410007340
1.0004  10001000.4
7454533.354544  100 745453335.4544
7454533.354544  10007454533354.544
Time taken: 0.026 seconds, Fetched: 5 row(s) 

  was:
Hi

I was under the impression that the bug: 
https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the same 
issue in Hive 1.0 and hive 1.2 as well.

hive> desc mul_table;
OK
prc decimal(38,28)
vol decimal(38,10)
Time taken: 0.068 seconds, Fetched: 2 row(s)

hive> select prc, vol, prc*vol as cost from mul_table;
OK
1.2 200 NULL
1.44200 NULL
2.14100 NULL
3.004   50  NULL
1.2 200 NULL
Time taken: 0.048 seconds, Fetched: 5 row(s)

Rather then returning NULL, it should give error or round off.

I understand that, I can use Double instead of decimal or can cast it, but 
still returning "Null" will make many things go unnoticed.

hive> desc mul_table2;
OK
prc double
vol decimal(14,10)
Time taken: 0.049 seconds, Fetched: 2 row(s)

hive> select * from mul_table2;
OK
1.4 200
1.34200
7.34100
7454533.354544  100
Time taken: 0.028 seconds, Fetched: 4 row(s)


hive> select prc, vol, prc*vol  as cost from mul_table2;
OK
7.34100 734.0
7.3410007340.0
1.0004  10001000.4
7454533.354544  100 7.454533354544E8   <- Wrong result
7454533.354544  10007.454533354544E9   <- Wrong result
Time taken: 0.025 seconds, Fetched: 5 row(s)


Casting:

hive> select prc, vol, cast(prc*vol as decimal(38,10)) as cost from mul_table2;
OK
7.34100 734
7.3410007340
1.0004  10001000.4
7454533.354544  100 745453335.4544
7454533.354544  10007454533354.544
Time taken: 0.026 seconds, Fetched: 5 row(s) 


> Hive Decimal Returns NULL
> -
>
> Key: HIVE-14568
> URL: https://issues.apache.org/jira/browse/HIVE-14568
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 1.0.0, 1.2.0
> Environment: Centos 6.7, Hadoop 2.7.2,hive 1.0.0,2.0
>Reporter: gurmukh singh
>
> Hi
> I was under the impression that the bug: 
> https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the 
> same issue in Hive 1.0 and hive 1.2 as well.
> hive> desc mul_table;
> OK
> prc   decimal(38,28)
> vol   decimal(38,10)
> Time taken: 0.068 seconds, Fetched: 2 row(s)
> hive> select prc, vol, prc*vol as cost from mul_table;
> OK
> 1.2   200 NULL
> 1.44  200 NULL
> 2.14  100 NULL
> 3.004 50  NULL
> 1.2   200 NULL
> Time taken: 0.048 seconds, Fetched: 5 row(s)
> Rather then returning NULL, it should give error or round off.
> I understand that, I can use Double instead of decimal or can cast it, but 
> still returning "Null" will make many things go unnoticed.
> hive> desc mul_table2;
> OK
> prc   double
> vol   decimal(14,10)
> Time taken: 0.049 seconds, Fetched: 2 row(s)
> hive>

[jira] [Updated] (HIVE-14568) Hive Decimal Returns NULL

2016-08-17 Thread gurmukh singh (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

gurmukh singh updated HIVE-14568:
-
Environment: Centos 6.7, Hadoop 2.7.2,hive 1.0.0,2.0  (was: Centos 6.7, 
Hadoop 2.7.2)

> Hive Decimal Returns NULL
> -
>
> Key: HIVE-14568
> URL: https://issues.apache.org/jira/browse/HIVE-14568
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 1.0.0, 1.2.0
> Environment: Centos 6.7, Hadoop 2.7.2,hive 1.0.0,2.0
>Reporter: gurmukh singh
>
> Hi
> I was under the impression that the bug: 
> https://issues.apache.org/jira/browse/HIVE-5022 got fixed. But, I see the 
> same issue in Hive 1.0 and hive 1.2 as well.
> hive> desc mul_table;
> OK
> prc   decimal(38,28)
> vol   decimal(38,10)
> Time taken: 0.068 seconds, Fetched: 2 row(s)
> hive> select prc, vol, prc*vol as cost from mul_table;
> OK
> 1.2   200 NULL
> 1.44  200 NULL
> 2.14  100 NULL
> 3.004 50  NULL
> 1.2   200 NULL
> Time taken: 0.048 seconds, Fetched: 5 row(s)
> Rather then returning NULL, it should give error or round off.
> I understand that, I can use Double instead of decimal or can cast it, but 
> still returning "Null" will make many things go unnoticed.
> hive> desc mul_table2;
> OK
> prc   double
> vol   decimal(14,10)
> Time taken: 0.049 seconds, Fetched: 2 row(s)
> hive> select * from mul_table2;
> OK
> 1.4   200
> 1.34  200
> 7.34  100
> 7454533.354544100
> Time taken: 0.028 seconds, Fetched: 4 row(s)
> hive> select prc, vol, prc*vol  as cost from mul_table2;
> OK
> 7.34  100 734.0
> 7.34  10007340.0
> 1.000410001000.4
> 7454533.354544100 7.454533354544E8   <- Wrong result
> 7454533.35454410007.454533354544E9   <- Wrong result
> Time taken: 0.025 seconds, Fetched: 5 row(s)
> Casting:
> hive> select prc, vol, cast(prc*vol as decimal(38,10)) as cost from 
> mul_table2;
> OK
> 7.34  100 734
> 7.34  10007340
> 1.000410001000.4
> 7454533.354544100 745453335.4544
> 7454533.35454410007454533354.544
> Time taken: 0.026 seconds, Fetched: 5 row(s) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10990) Compatibility Hive-1.2 an hbase-1.0.1.1

2015-08-26 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712733#comment-14712733
 ] 

gurmukh singh commented on HIVE-10990:
--

it is working fine on hive 1.1 and hbase 1.0 but not on hive 1.2 and 
hbase-1.0.1.1

 Compatibility Hive-1.2 an hbase-1.0.1.1
 ---

 Key: HIVE-10990
 URL: https://issues.apache.org/jira/browse/HIVE-10990
 Project: Hive
  Issue Type: Bug
  Components: Beeline, HBase Handler, HiveServer2
Affects Versions: 1.2.0
Reporter: gurmukh singh
Assignee: Swarnim Kulkarni

 Hive external table works fine with Hbase.
 Hive-1.2 and hbase-1.0.1.1, hadoop-2.5.2
 Not able to create a table from hive in hbase.
 1: jdbc:hive2://edge1.dilithium.com:1/def TBLPROPERTIES 
 (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 Error: Error while processing statement: FAILED: Execution Error, return code 
 1 from org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
  (state=08S01,code=1)
 [hdfs@edge1 cluster]$ hive
 2015-06-12 17:56:49,952 WARN  [main] conf.HiveConf: HiveConf of name 
 hive.metastore.local does not exist
 Logging initialized using configuration in 
 jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/lib/hive-common-1.2.0.jar!/hive-log4j.properties
 SLF4J: Class path contains multiple SLF4J bindings.
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/auxlib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
 explanation.
 SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
 hive CREATE TABLE hbase_table_1(key int, value string)
  STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
  WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf1:val)
  TBLPROPERTIES (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 ===
 scan complete in 1535ms
 14 driver classes found
 Compliant Version Driver Class
 no5.1 com.mysql.jdbc.Driver
 no5.1 com.mysql.jdbc.NonRegisteringDriver
 no5.1 com.mysql.jdbc.NonRegisteringReplicationDriver
 no5.1 com.mysql.jdbc.ReplicationDriver
 yes   1.2 org.apache.calcite.avatica.remote.Driver
 yes   1.2 org.apache.calcite.jdbc.Driver
 yes   1.0 org.apache.commons.dbcp.PoolingDriver
 yes   10.11   org.apache.derby.jdbc.AutoloadedDriver
 yes   10.11   org.apache.derby.jdbc.Driver42
 yes   10.11   org.apache.derby.jdbc.EmbeddedDriver
 yes   10.11   org.apache.derby.jdbc.InternalDriver
 no1.2 org.apache.hive.jdbc.HiveDriver
 yes   1.0 org.datanucleus.store.rdbms.datasource.dbcp.PoolingDriver
 no5.1 org.gjt.mm.mysql.Driver



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10990) Compatibility Hive-1.2 an hbase-1.0.1.1

2015-08-26 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712744#comment-14712744
 ] 

gurmukh singh commented on HIVE-10990:
--

I have tested this on hadoop 2.6.0 as well. Getting the same error.
Hive-1.2.0 and hbase-1.0.1.1



 Compatibility Hive-1.2 an hbase-1.0.1.1
 ---

 Key: HIVE-10990
 URL: https://issues.apache.org/jira/browse/HIVE-10990
 Project: Hive
  Issue Type: Bug
  Components: Beeline, HBase Handler, HiveServer2
Affects Versions: 1.2.0
Reporter: gurmukh singh
Assignee: Swarnim Kulkarni

 Hive external table works fine with Hbase.
 Hive-1.2 and hbase-1.0.1.1, hadoop-2.5.2
 Not able to create a table from hive in hbase.
 1: jdbc:hive2://edge1.dilithium.com:1/def TBLPROPERTIES 
 (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 Error: Error while processing statement: FAILED: Execution Error, return code 
 1 from org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
  (state=08S01,code=1)
 [hdfs@edge1 cluster]$ hive
 2015-06-12 17:56:49,952 WARN  [main] conf.HiveConf: HiveConf of name 
 hive.metastore.local does not exist
 Logging initialized using configuration in 
 jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/lib/hive-common-1.2.0.jar!/hive-log4j.properties
 SLF4J: Class path contains multiple SLF4J bindings.
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/auxlib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
 explanation.
 SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
 hive CREATE TABLE hbase_table_1(key int, value string)
  STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
  WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf1:val)
  TBLPROPERTIES (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 ===
 scan complete in 1535ms
 14 driver classes found
 Compliant Version Driver Class
 no5.1 com.mysql.jdbc.Driver
 no5.1 com.mysql.jdbc.NonRegisteringDriver
 no5.1 com.mysql.jdbc.NonRegisteringReplicationDriver
 no5.1 com.mysql.jdbc.ReplicationDriver
 yes   1.2 org.apache.calcite.avatica.remote.Driver
 yes   1.2 org.apache.calcite.jdbc.Driver
 yes   1.0 org.apache.commons.dbcp.PoolingDriver
 yes   10.11   org.apache.derby.jdbc.AutoloadedDriver
 yes   10.11   org.apache.derby.jdbc.Driver42
 yes   10.11   org.apache.derby.jdbc.EmbeddedDriver
 yes   10.11   org.apache.derby.jdbc.InternalDriver
 no1.2 org.apache.hive.jdbc.HiveDriver
 yes   1.0 org.datanucleus.store.rdbms.datasource.dbcp.PoolingDriver
 no5.1 org.gjt.mm.mysql.Driver



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10990) Compatibility Hive-1.2 an hbase-1.0.1.1

2015-08-26 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712933#comment-14712933
 ] 

gurmukh singh commented on HIVE-10990:
--

hive CREATE TABLE hbase_table_1(key int, value string)
 STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
 WITH SERDEPROPERTIES
 (hbase.columns.mapping = :key,cf1:val)
 TBLPROPERTIES (hbase.table.name = xyz);
FAILED: Execution Error, return code 1 from 
org.apache.hadoop.hive.ql.exec.DDLTask. 
org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V




2015-08-26 19:58:58,095 ERROR [main]: exec.DDLTask (DDLTask.java:failed(520)) - 
java.lang.NoSuchMethodError: 
org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
at 
org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:214)
at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:664)
at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:657)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at 
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156)
at com.sun.proxy.$Proxy9.createTable(Unknown Source)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:714)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4135)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:306)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
at 
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

2015-08-26 19:58:58,096 ERROR [main]: ql.Driver 
(SessionState.java:printError(957)) - FAILED: Execution Error, return code 1 
from org.apache.hadoop.hive.ql.exec.DDLTask. 
org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
2015-08-26 19:58:58,096 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogEnd(148)) - /PERFLOG method=Driver.execute 
start=1440599336948 end=1440599338096 duration=1148 
from=org.apache.hadoop.hive.ql.Driver
2015-08-26 19:58:58,096 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogBegin(121)) - PERFLOG method=releaseLocks 
from=org.apache.hadoop.hive.ql.Driver
2015-08-26 19:58:58,097 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogEnd(148)) - /PERFLOG method=releaseLocks 
start=1440599338096 end=1440599338097 duration=1 
from=org.apache.hadoop.hive.ql.Driver
2015-08-26 19:58:58,098 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogBegin(121)) - PERFLOG method=releaseLocks 
from=org.apache.hadoop.hive.ql.Driver
2015-08-26 19:58:58,098 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogEnd(148)) - /PERFLOG method=releaseLocks 
start=1440599338098 end=1440599338098 duration=0 
from=org.apache.hadoop.hive.ql.Driver

 Compatibility Hive-1.2 an hbase-1.0.1.1
 ---

 Key: HIVE-10990
 URL: https://issues.apache.org/jira/browse/HIVE-10990
 Project: Hive
  Issue Type: Bug
  Components: Beeline, HBase Handler, HiveServer2
Affects Versions: 1.2.0
Reporter: gurmukh singh
Assignee: Swarnim

[jira] [Commented] (HIVE-10990) Compatibility Hive-1.2 an hbase-1.0.1.1

2015-08-26 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713483#comment-14713483
 ] 

gurmukh singh commented on HIVE-10990:
--

I have to test that again, as it was long back. I might be missing something. 

Will test and update.

 Compatibility Hive-1.2 an hbase-1.0.1.1
 ---

 Key: HIVE-10990
 URL: https://issues.apache.org/jira/browse/HIVE-10990
 Project: Hive
  Issue Type: Bug
  Components: Beeline, HBase Handler, HiveServer2
Affects Versions: 1.2.0
Reporter: gurmukh singh
Assignee: Swarnim Kulkarni

 Hive external table works fine with Hbase.
 Hive-1.2 and hbase-1.0.1.1, hadoop-2.5.2
 Not able to create a table from hive in hbase.
 1: jdbc:hive2://edge1.dilithium.com:1/def TBLPROPERTIES 
 (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 Error: Error while processing statement: FAILED: Execution Error, return code 
 1 from org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
  (state=08S01,code=1)
 [hdfs@edge1 cluster]$ hive
 2015-06-12 17:56:49,952 WARN  [main] conf.HiveConf: HiveConf of name 
 hive.metastore.local does not exist
 Logging initialized using configuration in 
 jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/lib/hive-common-1.2.0.jar!/hive-log4j.properties
 SLF4J: Class path contains multiple SLF4J bindings.
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/auxlib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
 explanation.
 SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
 hive CREATE TABLE hbase_table_1(key int, value string)
  STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
  WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf1:val)
  TBLPROPERTIES (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 ===
 scan complete in 1535ms
 14 driver classes found
 Compliant Version Driver Class
 no5.1 com.mysql.jdbc.Driver
 no5.1 com.mysql.jdbc.NonRegisteringDriver
 no5.1 com.mysql.jdbc.NonRegisteringReplicationDriver
 no5.1 com.mysql.jdbc.ReplicationDriver
 yes   1.2 org.apache.calcite.avatica.remote.Driver
 yes   1.2 org.apache.calcite.jdbc.Driver
 yes   1.0 org.apache.commons.dbcp.PoolingDriver
 yes   10.11   org.apache.derby.jdbc.AutoloadedDriver
 yes   10.11   org.apache.derby.jdbc.Driver42
 yes   10.11   org.apache.derby.jdbc.EmbeddedDriver
 yes   10.11   org.apache.derby.jdbc.InternalDriver
 no1.2 org.apache.hive.jdbc.HiveDriver
 yes   1.0 org.datanucleus.store.rdbms.datasource.dbcp.PoolingDriver
 no5.1 org.gjt.mm.mysql.Driver



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10990) Compatibility Hive-1.2 an hbase-1.0.1.1

2015-08-22 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707960#comment-14707960
 ] 

gurmukh singh commented on HIVE-10990:
--

Sorry, for the delay in response. Will update this details in the next 4 hrs.

 Compatibility Hive-1.2 an hbase-1.0.1.1
 ---

 Key: HIVE-10990
 URL: https://issues.apache.org/jira/browse/HIVE-10990
 Project: Hive
  Issue Type: Bug
  Components: Beeline, HBase Handler, HiveServer2
Affects Versions: 1.2.0
Reporter: gurmukh singh
Assignee: Swarnim Kulkarni

 Hive external table works fine with Hbase.
 Hive-1.2 and hbase-1.0.1.1, hadoop-2.5.2
 Not able to create a table from hive in hbase.
 1: jdbc:hive2://edge1.dilithium.com:1/def TBLPROPERTIES 
 (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 Error: Error while processing statement: FAILED: Execution Error, return code 
 1 from org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
  (state=08S01,code=1)
 [hdfs@edge1 cluster]$ hive
 2015-06-12 17:56:49,952 WARN  [main] conf.HiveConf: HiveConf of name 
 hive.metastore.local does not exist
 Logging initialized using configuration in 
 jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/lib/hive-common-1.2.0.jar!/hive-log4j.properties
 SLF4J: Class path contains multiple SLF4J bindings.
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/auxlib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
 explanation.
 SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
 hive CREATE TABLE hbase_table_1(key int, value string)
  STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
  WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf1:val)
  TBLPROPERTIES (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 ===
 scan complete in 1535ms
 14 driver classes found
 Compliant Version Driver Class
 no5.1 com.mysql.jdbc.Driver
 no5.1 com.mysql.jdbc.NonRegisteringDriver
 no5.1 com.mysql.jdbc.NonRegisteringReplicationDriver
 no5.1 com.mysql.jdbc.ReplicationDriver
 yes   1.2 org.apache.calcite.avatica.remote.Driver
 yes   1.2 org.apache.calcite.jdbc.Driver
 yes   1.0 org.apache.commons.dbcp.PoolingDriver
 yes   10.11   org.apache.derby.jdbc.AutoloadedDriver
 yes   10.11   org.apache.derby.jdbc.Driver42
 yes   10.11   org.apache.derby.jdbc.EmbeddedDriver
 yes   10.11   org.apache.derby.jdbc.InternalDriver
 no1.2 org.apache.hive.jdbc.HiveDriver
 yes   1.0 org.datanucleus.store.rdbms.datasource.dbcp.PoolingDriver
 no5.1 org.gjt.mm.mysql.Driver



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10990) Compatibility Hive-1.2 an hbase-1.0.1.1

2015-06-12 Thread gurmukh singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-10990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583334#comment-14583334
 ] 

gurmukh singh commented on HIVE-10990:
--

hive CREATE TABLE hbase_table_1(key int, value string)
 STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
 WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf1:val)
 TBLPROPERTIES (hbase.table.name = xyz);
FAILED: Execution Error, return code 1 from 
org.apache.hadoop.hive.ql.exec.DDLTask. 
org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V

 Compatibility Hive-1.2 an hbase-1.0.1.1
 ---

 Key: HIVE-10990
 URL: https://issues.apache.org/jira/browse/HIVE-10990
 Project: Hive
  Issue Type: Bug
  Components: Beeline, HBase Handler, HiveServer2
Affects Versions: 1.2.0
Reporter: gurmukh singh

 Hive external table works fine with Hbase.
 Hive-1.2 and hbase-1.0.1.1, hadoop-2.5.2
 Not able to create a table from hive in hbase.
 1: jdbc:hive2://edge1.dilithium.com:1/def TBLPROPERTIES 
 (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 Error: Error while processing statement: FAILED: Execution Error, return code 
 1 from org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
  (state=08S01,code=1)
 [hdfs@edge1 cluster]$ hive
 2015-06-12 17:56:49,952 WARN  [main] conf.HiveConf: HiveConf of name 
 hive.metastore.local does not exist
 Logging initialized using configuration in 
 jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/lib/hive-common-1.2.0.jar!/hive-log4j.properties
 SLF4J: Class path contains multiple SLF4J bindings.
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/apache-hive-1.2.0-bin/auxlib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: Found binding in 
 [jar:file:/usr/local/cluster/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
 explanation.
 SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
 hive CREATE TABLE hbase_table_1(key int, value string)
  STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
  WITH SERDEPROPERTIES (hbase.columns.mapping = :key,cf1:val)
  TBLPROPERTIES (hbase.table.name = xyz);
 FAILED: Execution Error, return code 1 from 
 org.apache.hadoop.hive.ql.exec.DDLTask. 
 org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)V
 ===
 scan complete in 1535ms
 14 driver classes found
 Compliant Version Driver Class
 no5.1 com.mysql.jdbc.Driver
 no5.1 com.mysql.jdbc.NonRegisteringDriver
 no5.1 com.mysql.jdbc.NonRegisteringReplicationDriver
 no5.1 com.mysql.jdbc.ReplicationDriver
 yes   1.2 org.apache.calcite.avatica.remote.Driver
 yes   1.2 org.apache.calcite.jdbc.Driver
 yes   1.0 org.apache.commons.dbcp.PoolingDriver
 yes   10.11   org.apache.derby.jdbc.AutoloadedDriver
 yes   10.11   org.apache.derby.jdbc.Driver42
 yes   10.11   org.apache.derby.jdbc.EmbeddedDriver
 yes   10.11   org.apache.derby.jdbc.InternalDriver
 no1.2 org.apache.hive.jdbc.HiveDriver
 yes   1.0 org.datanucleus.store.rdbms.datasource.dbcp.PoolingDriver
 no5.1 org.gjt.mm.mysql.Driver



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)