[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-27 Thread Steven Wong (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12915452#action_12915452
 ] 

Steven Wong commented on HIVE-1378:
---

Thanks, Ning/Zheng/John!

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.7.patch, 
 HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-24 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914346#action_12914346
 ] 

Ning Zhang commented on HIVE-1378:
--

@john, should we run a survey on hive-user mailing list to see how many people 
are still using pre-0.20 hadoop before dropping the support? 

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-24 Thread John Sichi (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914509#action_12914509
 ] 

John Sichi commented on HIVE-1378:
--

We did already, and no one responded, so I think Facebook was probably the last 
holdout.

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-24 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914598#action_12914598
 ] 

Ning Zhang commented on HIVE-1378:
--

Before we decided to drop support for pre-0.20, we should have a separate JIRA 
to have a list of things that need to clean up: e.g., exclude downloading 
building hadoop 0.17. 

In the mean time, the change in the patch to be pre-0.20 compatible should be 
minimum. Steven, can you take a look the code and see how much it required to 
be done to be compatible with 0.17?

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-24 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914756#action_12914756
 ] 

Ning Zhang commented on HIVE-1378:
--

+1. testing.

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.7.patch, 
 HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914236#action_12914236
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Steven Wong skwsl...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/
---

(Updated 2010-09-23 14:06:40.052031)


Review request for Hive Developers.


Changes
---

New patch moves ArrayList construction and adds back schema mismatch check.


Summary
---

HIVE-1606 is also fixed as a side effect.


This addresses bug HIVE-1378.
http://issues.apache.org/jira/browse/HIVE-1378


Diffs (updated)
-

  trunk/build.xml 999712 
  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 999712 
  trunk/conf/hive-default.xml 999712 
  trunk/data/files/datatypes.txt PRE-CREATION 
  trunk/data/scripts/input20_script 999712 
  trunk/eclipse-templates/.classpath 999712 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java 999712 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java 999712 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java 
999712 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveResultSetMetaData.java 
999712 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcColumn.java 999712 
  trunk/jdbc/src/test/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java 999712 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchTask.java 999712 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
999712 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java 999712 
  trunk/ql/src/test/results/clientpositive/binary_output_format.q.out 999712 
  trunk/ql/src/test/results/compiler/plan/input20.q.xml 999712 
  trunk/ql/src/test/results/compiler/plan/input4.q.xml 999712 
  trunk/ql/src/test/results/compiler/plan/input5.q.xml 999712 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java 
PRE-CREATION 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java 
999712 

Diff: http://review.cloudera.org/r/828/diff


Testing
---


Thanks,

Steven




 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914282#action_12914282
 ] 

Ning Zhang commented on HIVE-1378:
--

Changes look good. However there are conflicts when applying to the latest 
trunk. Can you generate a new one against the latest trunk? I'll start testing 
once I got the new patch. 

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914305#action_12914305
 ] 

Ning Zhang commented on HIVE-1378:
--

OK. This one applied cleanly. I'm starting testing. 

I think 'svn up' may be able to do more merging than 'patch'. I got the 
conflict on eclipse-templates/.classpath (it asked me whether I want to reverse 
apply) and another file. 

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914335#action_12914335
 ] 

Ning Zhang commented on HIVE-1378:
--

Steven, tests passed for hadoop 0.20, but it failed to compile on hadoop 0.17 
(ant clean package -Dhadoop.version=0.17.2.1). Can you take a look?

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-23 Thread John Sichi (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914341#action_12914341
 ] 

John Sichi commented on HIVE-1378:
--

We're supposed to drop support for pre-0.20 Hadoop versions anyway...maybe now 
is a good time?


 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.5.patch, HIVE-1378.6.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-22 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913725#action_12913725
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Ning Zhang n.nin...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/#review1296
---



trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java
http://review.cloudera.org/r/828/#comment4365

constructing an ArrayList for every row is very expensive. Do you need a 
separate copy every row or can share a cache among rows?



trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java
http://review.cloudera.org/r/828/#comment4364

Removing this changes the behavior: previously it throws an exception and 
schema mismatch, not it tolerate it. It would be good to remain backward 
compatibility.


- Ning





 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.4.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-21 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913164#action_12913164
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Steven Wong skwsl...@gmail.com


bq.  On 2010-09-20 18:14:21, Zheng Shao wrote:
bq.  

Thanks for taking the time to review it! See my comments below.


bq.  On 2010-09-20 18:14:21, Zheng Shao wrote:
bq.   trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java, 
line 179
bq.   http://review.cloudera.org/r/828/diff/3/?file=12162#file12162line179
bq.  
bq.   While this function works for most cases, there is no guarantee that 
it will work for nested map/array/struct, because toString() is not required to 
be implemented correctly for Objects in hive.
bq.   
bq.   The preferred way would be to use 
ObjectInspectorUtils/ObjectInspectorConvertors to copy/convert Object, 
ObjectInspector to Standard Object, and then convert to JDBC objects.
bq.  

It is a good point regarding toString. I didn't try nested container types; I'm 
trying nested map for the first time now and it doesn't work. Will fix. Will 
see how ObjectInspector* can help.


bq.  On 2010-09-20 18:14:21, Zheng Shao wrote:
bq.   
trunk/serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java, 
line 54
bq.   http://review.cloudera.org/r/828/diff/3/?file=12173#file12173line54
bq.  
bq.   Can we change the name to serializeField (here and in 
LazySimpleSerDe)?
bq.  

OK.


- Steven


---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/#review1273
---





 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-21 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913336#action_12913336
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Steven Wong skwsl...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/
---

(Updated 2010-09-21 17:55:31.694691)


Review request for Hive Developers.


Changes
---

Fixed nested map/array/struct.


Summary
---

HIVE-1606 is also fixed as a side effect.


This addresses bug HIVE-1378.
http://issues.apache.org/jira/browse/HIVE-1378


Diffs (updated)
-

  trunk/build.xml 997983 
  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 997983 
  trunk/conf/hive-default.xml 997983 
  trunk/data/files/datatypes.txt PRE-CREATION 
  trunk/data/scripts/input20_script 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java 
997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveResultSetMetaData.java 
997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcColumn.java 997983 
  trunk/jdbc/src/test/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java 997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchTask.java 997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java 997983 
  trunk/ql/src/test/results/clientpositive/binary_output_format.q.out 997983 
  trunk/ql/src/test/results/compiler/plan/input20.q.xml 997983 
  trunk/ql/src/test/results/compiler/plan/input4.q.xml 997983 
  trunk/ql/src/test/results/compiler/plan/input5.q.xml 997983 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java 
PRE-CREATION 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java 
997983 

Diff: http://review.cloudera.org/r/828/diff


Testing
---


Thanks,

Steven




 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-21 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913338#action_12913338
 ] 

Ning Zhang commented on HIVE-1378:
--

Steven, there are conflicts when applying to the latest trunk. Can you 
regenerate the patch?

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.3.patch, 
 HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-20 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912652#action_12912652
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Steven Wong skwsl...@gmail.com


bq.  On 2010-09-17 23:09:15, Ning Zhang wrote:
bq.   Looks good in general. Some minor comments. I'll also ask Zheng to 
review it.

Thanks for taking the time to review it! See my comments below.


bq.  On 2010-09-17 23:09:15, Ning Zhang wrote:
bq.   trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java, line 288
bq.   http://review.cloudera.org/r/828/diff/2/?file=11939#file11939line288
bq.  
bq.   Can you also add this parameter to conf/hive-default.xml? This file 
should contain all user-tunable parameters in HiveConf.java.

Will add.


bq.  On 2010-09-17 23:09:15, Ning Zhang wrote:
bq.   trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java, 
line 158
bq.   http://review.cloudera.org/r/828/diff/2/?file=11942#file11942line158
bq.  
bq.   check null first?

Ditto.


bq.  On 2010-09-17 23:09:15, Ning Zhang wrote:
bq.   trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java, 
line 140
bq.   http://review.cloudera.org/r/828/diff/2/?file=11942#file11942line140
bq.  
bq.   should null be checked first?

This is copied from the existing code of getInt/getDouble/etc. Null doesn't 
have to be checked first because X.class.isInstance(obj) handles null obj 
correctly, i.e. X.class.isInstance(null) is false. My guess is, 
X.class.isInstance(obj) is checked first because the original coder assumes obj 
is more likely to be non-null.


- Steven


---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/#review1269
---





 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-20 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912682#action_12912682
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Steven Wong skwsl...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/
---

(Updated 2010-09-20 12:55:10.315466)


Review request for Hive Developers.


Changes
---

Add config to hive-default.xml.


Summary
---

HIVE-1606 is also fixed as a side effect.


This addresses bug HIVE-1378.
http://issues.apache.org/jira/browse/HIVE-1378


Diffs (updated)
-

  trunk/build.xml 997983 
  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 997983 
  trunk/conf/hive-default.xml 997983 
  trunk/data/files/datatypes.txt PRE-CREATION 
  trunk/data/scripts/input20_script 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java 
997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveResultSetMetaData.java 
997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcColumn.java 997983 
  trunk/jdbc/src/test/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java 997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchTask.java 997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java 997983 
  trunk/ql/src/test/results/clientpositive/binary_output_format.q.out 997983 
  trunk/ql/src/test/results/compiler/plan/input20.q.xml 997983 
  trunk/ql/src/test/results/compiler/plan/input4.q.xml 997983 
  trunk/ql/src/test/results/compiler/plan/input5.q.xml 997983 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java 
PRE-CREATION 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java 
997983 

Diff: http://review.cloudera.org/r/828/diff


Testing
---


Thanks,

Steven




 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-20 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912805#action_12912805
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Zheng Shao zsh...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/#review1273
---



trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java
http://review.cloudera.org/r/828/#comment4326

While this function works for most cases, there is no guarantee that it 
will work for nested map/array/struct, because toString() is not required to be 
implemented correctly for Objects in hive.

The preferred way would be to use 
ObjectInspectorUtils/ObjectInspectorConvertors to copy/convert Object, 
ObjectInspector to Standard Object, and then convert to JDBC objects.




trunk/serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java
http://review.cloudera.org/r/828/#comment4325

Can we change the name to serializeField (here and in LazySimpleSerDe)?



- Zheng





 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.2.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-18 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910899#action_12910899
 ] 

Ning Zhang commented on HIVE-1378:
--

Looks good in general. I've left some minor comments in the cloudera's review 
board. I'm not sure if it could be replicated here, but if not, I'll copy them 
manually.

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-18 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910900#action_12910900
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Ning Zhang n.nin...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/#review1269
---


Looks good in general. Some minor comments. I'll also ask Zheng to review it. 


trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
http://review.cloudera.org/r/828/#comment4317

Can you also add this parameter to conf/hive-default.xml? This file should 
contain all user-tunable parameters in HiveConf.java.



trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java
http://review.cloudera.org/r/828/#comment4318

should null be checked first?



trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java
http://review.cloudera.org/r/828/#comment4319

check null first?


- Ning





 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-17 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910716#action_12910716
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Steven Wong skwsl...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/
---

(Updated 2010-09-17 11:00:43.924384)


Review request for Hive Developers.


Summary
---

HIVE-1606 is also fixed as a side effect.


This addresses bug HIVE-1378.
http://issues.apache.org/jira/browse/HIVE-1378


Diffs (updated)
-

  trunk/build.xml 997983 
  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 997983 
  trunk/data/files/datatypes.txt PRE-CREATION 
  trunk/data/scripts/input20_script 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java 997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java 
997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveResultSetMetaData.java 
997983 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcColumn.java 997983 
  trunk/jdbc/src/test/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java 997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchTask.java 997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
997983 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java 997983 
  trunk/ql/src/test/results/clientpositive/binary_output_format.q.out 997983 
  trunk/ql/src/test/results/compiler/plan/input20.q.xml 997983 
  trunk/ql/src/test/results/compiler/plan/input4.q.xml 997983 
  trunk/ql/src/test/results/compiler/plan/input5.q.xml 997983 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java 
PRE-CREATION 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java 
997983 

Diff: http://review.cloudera.org/r/828/diff


Testing
---


Thanks,

Steven




 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-17 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910758#action_12910758
 ] 

Ning Zhang commented on HIVE-1378:
--

Taking a look now. 

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.1.patch, HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-16 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910444#action_12910444
 ] 

Ning Zhang commented on HIVE-1378:
--

Will take a look.

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-16 Thread Ning Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910455#action_12910455
 ] 

Ning Zhang commented on HIVE-1378:
--

Steven, there are conflicts when applying this patch. Can you regenerate it?

 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong
 Fix For: 0.7.0

 Attachments: HIVE-1378.patch


 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (HIVE-1378) Return value for map, array, and struct needs to return a string

2010-09-13 Thread HBase Review Board (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12909057#action_12909057
 ] 

HBase Review Board commented on HIVE-1378:
--

Message from: Steven Wong skwsl...@gmail.com

---
This is an automatically generated e-mail. To reply, visit:
http://review.cloudera.org/r/828/
---

Review request for Hive Developers.


Summary
---

HIVE-1606 is also fixed as a side effect.


This addresses bug HIVE-1378.
http://issues.apache.org/jira/browse/HIVE-1378


Diffs
-

  trunk/build.xml 984947 
  trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 984947 
  trunk/data/files/datatypes.txt PRE-CREATION 
  trunk/data/scripts/input20_script 984947 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java 984947 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java 984947 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java 
984947 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveResultSetMetaData.java 
984947 
  trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcColumn.java 984947 
  trunk/jdbc/src/test/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java 984947 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchTask.java 984947 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 
984947 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java 984947 
  trunk/ql/src/test/results/clientpositive/binary_output_format.q.out 984947 
  trunk/ql/src/test/results/compiler/plan/input20.q.xml 984947 
  trunk/ql/src/test/results/compiler/plan/input4.q.xml 984947 
  trunk/ql/src/test/results/compiler/plan/input5.q.xml 984947 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java 
PRE-CREATION 
  trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java 
984947 

Diff: http://review.cloudera.org/r/828/diff


Testing
---


Thanks,

Steven




 Return value for map, array, and struct needs to return a string 
 -

 Key: HIVE-1378
 URL: https://issues.apache.org/jira/browse/HIVE-1378
 Project: Hadoop Hive
  Issue Type: Improvement
  Components: Drivers
Reporter: Jerome Boulon
Assignee: Steven Wong

 In order to be able to select/display any data from JDBC Hive driver, return 
 value for map, array, and struct needs to return a string

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.