[jira] Updated: (HIVE-777) CREATE TABLE with STRUCT type

2009-08-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-777: -- Attachment: hive-777-2009-8-29.patch struct table example: create table abc(strct struct); i think we sh

[jira] Commented: (HIVE-773) remove lzocodec import from FileSinkOperator

2009-08-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744989#action_12744989 ] He Yongqiang commented on HIVE-773: --- Thanks, Johan. Actually it is contributed by Samuel G

[jira] Created: (HIVE-773) remove lzocodec import from FileSinkOperator

2009-08-18 Thread He Yongqiang (JIRA)
remove lzocodec import from FileSinkOperator Key: HIVE-773 URL: https://issues.apache.org/jira/browse/HIVE-773 Project: Hadoop Hive Issue Type: Bug Reporter: He Yongqiang P

[jira] Commented: (HIVE-756) performance improvement for RCFile and ColumnarSerDe in Hive

2009-08-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744804#action_12744804 ] He Yongqiang commented on HIVE-756: --- +1 > performance improvement for RCFile and ColumnarS

[jira] Commented: (HIVE-756) performance improvement for RCFile and ColumnarSerDe in Hive

2009-08-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744801#action_12744801 ] He Yongqiang commented on HIVE-756: --- 15% - 20% overall query performance is great. Keep it

[jira] Commented: (HIVE-756) performance improvement for RCFile and ColumnarSerDe in Hive

2009-08-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744456#action_12744456 ] He Yongqiang commented on HIVE-756: --- The new patch looks good for me. Remove "set(.., Byt

[jira] Updated: (HIVE-759) add hive.intermediate.compression.codec option

2009-08-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-759: -- Attachment: hive-759-2009-08-18-2.patch talked with Zheng offline, and attached a new patch. Use hadoop's

[jira] Updated: (HIVE-759) add hive.intermediate.compression.codec option

2009-08-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-759: -- Attachment: hive-759-2009-08-18.patch Attached a new patch integrates Zheng's suggestions (Thanks Zheng!)

[jira] Commented: (HIVE-759) add hive.intermediate.compression.codec option

2009-08-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744344#action_12744344 ] He Yongqiang commented on HIVE-759: --- bq. I think the check of "if(LzoCodec.class.isAssignab

[jira] Commented: (HIVE-645) A UDF that can export data to JDBC databases.

2009-08-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744340#action_12744340 ] He Yongqiang commented on HIVE-645: --- Hi Edward, How do you deal with db connections. I saw

[jira] Commented: (HIVE-756) performance improvement for RCFile and ColumnarSerDe in Hive

2009-08-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744035#action_12744035 ] He Yongqiang commented on HIVE-756: --- {noformat} if (!currentValue.inited) {

[jira] Commented: (HIVE-756) performance improvement for RCFile and ColumnarSerDe in Hive

2009-08-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744029#action_12744029 ] He Yongqiang commented on HIVE-756: --- Changes for ColumnarStruct is good. @hive-756.patch: l

[jira] Commented: (HIVE-718) Load data inpath into a new partition without overwrite does not move the file

2009-08-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12743911#action_12743911 ] He Yongqiang commented on HIVE-718: --- I think this should be merged into 0.4 release. > Loa

[jira] Updated: (HIVE-759) add hive.intermediate.compression.codec option

2009-08-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-759: -- Attachment: hive-759-2009-08-17.patch Only tested on my mac (lzo not loaded), should test on a Linux box.

[jira] Commented: (HIVE-705) Let Hive can analyse hbase's tables

2009-08-10 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12741655#action_12741655 ] He Yongqiang commented on HIVE-705: --- Samuel, i am now in ShangHai attending a meeting. I wi

[jira] Created: (HIVE-735) Queries should be optimized with pre-ordered column

2009-08-06 Thread He Yongqiang (JIRA)
Queries should be optimized with pre-ordered column --- Key: HIVE-735 URL: https://issues.apache.org/jira/browse/HIVE-735 Project: Hadoop Hive Issue Type: Improvement Components: Quer

[jira] Updated: (HIVE-720) Improve ByteStream by removing all synchronized method calls

2009-08-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-720: -- Attachment: HIVE-720.2.patch > Improve ByteStream by removing all synchronized method calls > ---

[jira] Commented: (HIVE-718) Load data inpath into a new partition without overwrite does not move the file

2009-08-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12739352#action_12739352 ] He Yongqiang commented on HIVE-718: --- Todd's patch looks good (at least better than mine).

[jira] Commented: (HIVE-720) Improve ByteStream by removing all synchronized method calls

2009-08-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12739343#action_12739343 ] He Yongqiang commented on HIVE-720: --- Will do 1 and 2, and move the two classes into common.

[jira] Updated: (HIVE-720) Improve ByteStream by removing all synchronized method calls

2009-08-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-720: -- Attachment: HIVE-720.1.patch HIVE-720.1.patch tries to reuse some io code. It passed tests in my local.

[jira] Updated: (HIVE-718) Load data inpath into a new partition without overwrite does not move the file

2009-08-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-718: -- Attachment: HIVE-718.2.patch the patch that passed tests in my local. Added the code to undo the copy ope

[jira] Commented: (HIVE-720) Improve ByteStream by removing all synchronized method calls

2009-08-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12738919#action_12738919 ] He Yongqiang commented on HIVE-720: --- Hive has its own HiveDataInputBuffer and HiveDataOutpu

[jira] Updated: (HIVE-718) Load data inpath into a new partition without overwrite does not move the file

2009-08-03 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-718: -- Attachment: HIVE-718.1.patch patch. I will check and test it late tonight. > Load data inpath into a n

[jira] Commented: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-29 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736948#action_12736948 ] He Yongqiang commented on HIVE-667: --- They are the same, only try to compatible with mysql.

[jira] Commented: (HIVE-705) Let Hive can analyse hbase's tables

2009-07-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736467#action_12736467 ] He Yongqiang commented on HIVE-705: --- Do we need to add a new serde for this? can you add mo

[jira] Updated: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-667: -- Attachment: hive-667-2009-07-28-2.patch hive-667-2009-07-28-2.patch changes the command "show table statu

[jira] Commented: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736411#action_12736411 ] He Yongqiang commented on HIVE-667: --- HIVE-280 is committed and adds the key word "IN". So

[jira] Commented: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736377#action_12736377 ] He Yongqiang commented on HIVE-667: --- The patch added two key words: STATUS and IN. Has the

[jira] Assigned: (HIVE-678) Add support for building index table

2009-07-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-678: - Assignee: He Yongqiang Thanks for the detailed review, Prasad. Will work a new one. > Add support

[jira] Updated: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-667: -- Attachment: hive-667-2009-07-28.patch Upload another patch according to offline talk with Zheng, the diff

[jira] Updated: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-667: -- Attachment: hive-667-2009-07-27.patch Added a new command "SHOW TABLE STATUS [IN|FROM db_name] LIKE 'tabl

[jira] Commented: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735462#action_12735462 ] He Yongqiang commented on HIVE-667: --- can you list the information for the new command? bq.

[jira] Commented: (HIVE-580) command to list available UDF names

2009-07-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735379#action_12735379 ] He Yongqiang commented on HIVE-580: --- The patch looks good. Can you use hadoop conversion f

[jira] Updated: (HIVE-678) Add support for building index table

2009-07-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-678: -- Attachment: hive-678-2009-07-25.patch Added three types: projection, summary, compact. Now the create in

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-07-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735271#action_12735271 ] He Yongqiang commented on HIVE-417: --- Created HIVE-678 for add support for building index. s

[jira] Updated: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-667: -- Attachment: hive-667-2009-07-25-3.patch Incorporated Zheng and Hao's suggestions. It passed tests in my l

[jira] Updated: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-24 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-667: -- Attachment: hive-667-2009-07-25.patch It is easy to indent file system information. But it is not very ea

[jira] Updated: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-24 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-667: -- Attachment: localtest-2009-07-24.txt hive-667-2009-07-24.patch does not inclue new testca

[jira] Commented: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734899#action_12734899 ] He Yongqiang commented on HIVE-667: --- How about adding the file system info to the output of

[jira] Commented: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734881#action_12734881 ] He Yongqiang commented on HIVE-667: --- >From the source code, it seems the 'describe extended

[jira] Commented: (HIVE-667) Provide hive ql to check table/partition status, including size, creation and access timestamp

2009-07-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734876#action_12734876 ] He Yongqiang commented on HIVE-667: --- It seems 'describe extended' command does not output i

[jira] Commented: (HIVE-678) Add support for building index table

2009-07-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734734#action_12734734 ] He Yongqiang commented on HIVE-678: --- We published a document on hive-417 before. And after

[jira] Created: (HIVE-678) Add support for building index table

2009-07-22 Thread He Yongqiang (JIRA)
Add support for building index table Key: HIVE-678 URL: https://issues.apache.org/jira/browse/HIVE-678 Project: Hadoop Hive Issue Type: Sub-task Components: Metastore, Query Processor Affect

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-07-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734473#action_12734473 ] He Yongqiang commented on HIVE-417: --- This jira page is a bit too long to follow. With discu

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-07-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734440#action_12734440 ] He Yongqiang commented on HIVE-417: --- I am about to update it. And making some modifications

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-07-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12734405#action_12734405 ] He Yongqiang commented on HIVE-417: --- 1) For a given key, we are using a sorted set for each

[jira] Commented: (HIVE-599) Embedded Hive SQL into Python

2009-07-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732907#action_12732907 ] He Yongqiang commented on HIVE-599: --- BaconSnake is a gorgeous feature that hive should also

[jira] Updated: (HIVE-417) Implement Indexing in Hive

2009-07-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-417: -- Attachment: hive-417-2009-07-18.patch A Draft version of buiding(create/update) index. Still needs: 1) r

[jira] Commented: (HIVE-571) add ability to rename a column.

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731284#action_12731284 ] He Yongqiang commented on HIVE-571: --- so the syntax should be: alter table change [column]

[jira] Commented: (HIVE-588) LIMIT n is slower than it needs to be

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731277#action_12731277 ] He Yongqiang commented on HIVE-588: --- >>when any mapper has printed 10 rows, Hive should pri

[jira] Commented: (HIVE-588) LIMIT n is slower than it needs to be

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731253#action_12731253 ] He Yongqiang commented on HIVE-588: --- >>SELECT a FROM t LIMIT 10; >>...simply prints the out

[jira] Commented: (HIVE-580) command to list available UDF names

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12730953#action_12730953 ] He Yongqiang commented on HIVE-580: --- That's good. We should avoid adding all command proce

[jira] Updated: (HIVE-580) command to list available UDF names

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-580: -- Attachment: hive-580-2009-07-15.patch > command to list available UDF names > ---

[jira] Updated: (HIVE-580) command to list available UDF names

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-580: -- Status: Patch Available (was: Open) > command to list available UDF names >

[jira] Commented: (HIVE-571) add ability to rename a column.

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12730833#action_12730833 ] He Yongqiang commented on HIVE-571: --- I would like to let the syntax looks like: alter table

[jira] Resolved: (HIVE-618) More human-readable error prompt of FunctionTask

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang resolved HIVE-618. --- Resolution: Duplicate duplicate of 619. > More human-readable error prompt of FunctionTask > -

[jira] Commented: (HIVE-627) Optimizer should only access RowSchema (and not RowResolver)

2009-07-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12730758#action_12730758 ] He Yongqiang commented on HIVE-627: --- So this issue intends to remove all the usages of RowR

[jira] Updated: (HIVE-626) Typecast bug in Join operator

2009-07-13 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-626: -- Attachment: hive-626-2009-07-13-2.patch Added a new testcase and removed keyinfor and valueinfo from expl

[jira] Updated: (HIVE-472) HiveFileFormatUtils's checkInputFormat does not include RCFile

2009-06-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-472: -- Attachment: hive-472-2009-06-15.patch Update a new patch, which passed tests in my local. The previous on

[jira] Updated: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-13 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-460: -- Attachment: hive-460-2009-06-13.patch Namit, Thanks for correction. Upload a new patch. I guess the diffs

[jira] Updated: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-12 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-460: -- Attachment: hive-460-2009-06-12.patch Added the new testcase, but join32 does not get diff in my local.

[jira] Commented: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718742#action_12718742 ] He Yongqiang commented on HIVE-460: --- working on it right now. please wait a minute. > Impr

[jira] Updated: (HIVE-527) Inserting into a partitioned table without specifying the partition field should fail

2009-06-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-527: -- Attachment: hive-527-2009-06-12.patch hive-527-2009-06-12.patch integrates Namit's suggestions. > Inser

[jira] Updated: (HIVE-527) Inserting into a partitioned table without specifying the partition field should fail

2009-06-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-527: -- Attachment: hive-527-2009-06-11-2.patch > Inserting into a partitioned table without specifying the parti

[jira] Commented: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718349#action_12718349 ] He Yongqiang commented on HIVE-460: --- One comment to the results of input20.q: the output da

[jira] Commented: (HIVE-527) Inserting into a partitioned table without specifying the partition field should fail

2009-06-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718329#action_12718329 ] He Yongqiang commented on HIVE-527: --- Then what about the load overwrite data statement? Sho

[jira] Commented: (HIVE-549) UNION ALL statements should be run in parallel

2009-06-10 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718074#action_12718074 ] He Yongqiang commented on HIVE-549: --- Shoud we edit this issue to "parallel execution mechan

[jira] Updated: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-10 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-460: -- Attachment: hive-460-2009-06-10-2.patch A new patch against trunk code(hive-460-2009-06-10-2.patch) and i

[jira] Commented: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-09 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717893#action_12717893 ] He Yongqiang commented on HIVE-460: --- >>When I ran the tests, all TestParse tests failed sor

[jira] Commented: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-09 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717877#action_12717877 ] He Yongqiang commented on HIVE-460: --- Namit, which patch you applied? hive-460-2009-06-06-2.

[jira] Commented: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717510#action_12717510 ] He Yongqiang commented on HIVE-460: --- >>the assumption is that it is always a subset of the

[jira] Commented: (HIVE-549) UNION ALL statements should be run in parallel

2009-06-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717338#action_12717338 ] He Yongqiang commented on HIVE-549: --- Since the generated tasks plan/task stages is a DAG, t

[jira] Updated: (HIVE-472) HiveFileFormatUtils's checkInputFormat does not include RCFile

2009-06-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-472: -- Attachment: hive-472-2009-06-08.patch 1) added a new interface InputFormatChecker 2) added a new Sequence

[jira] Commented: (HIVE-549) UNION ALL statements should be run in parallel

2009-06-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717189#action_12717189 ] He Yongqiang commented on HIVE-549: --- Will hive consider replace its queue exection with a p

[jira] Commented: (HIVE-472) HiveFileFormatUtils's checkInputFormat does not include RCFile

2009-06-07 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717117#action_12717117 ] He Yongqiang commented on HIVE-472: --- Yes. It will be better if we can move this method out.

[jira] Updated: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-06 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-460: -- Attachment: hive-460-2009-06-06-2.patch A new patch(hive-460-2009-06-06-2.patch) according to Namit's fee

[jira] Commented: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-05 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716831#action_12716831 ] He Yongqiang commented on HIVE-460: --- Namit, thanks very much for the valueble feedbacks. W

[jira] Updated: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-460: -- Attachment: hive-460-2009-06-04-2-195mapjoin.patch Sorry for delay. hive-460-2009-06-04-2-195mapjoin.patc

[jira] Updated: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-06-03 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-460: -- Attachment: hive-460-2009-06-04-testcli-passed.patch hive-460-2009-06-04-testcli-passed.patch now works.

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-06-01 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715345#action_12715345 ] He Yongqiang commented on HIVE-417: --- Joydeep, Thanks for the concern. >>are we going to hav

[jira] Commented: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-05-30 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714815#action_12714815 ] He Yongqiang commented on HIVE-460: --- Currently 'a+b' is used whether there an alias or not.

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-05-30 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714730#action_12714730 ] He Yongqiang commented on HIVE-417: --- Thanks for the suggestions, Seymour. I have also thoug

[jira] Updated: (HIVE-460) Improve ColumnPruner to prune more aggressively and keep column information for input tables

2009-05-29 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-460: -- Attachment: hive-460-2009-05-29-noaliasallowed.patch hive-460-2009-05-29-noaliasallowed.patch is not a fi

[jira] Updated: (HIVE-506) MoveTask was not reporting errors

2009-05-29 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-506: -- Attachment: patch-506-2009-05-29.patch An update against trunk. > MoveTask was not reporting errors > --

[jira] Commented: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml

2009-05-29 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714370#action_12714370 ] He Yongqiang commented on HIVE-490: --- It seems one of the attached files is committed to tru

[jira] Updated: (HIVE-451) Support ORDER BY xxx DESC

2009-05-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-451: -- Attachment: HIVE-451-2009-05-28.patch Added a testcase in orderby.q, and updated several .out files. Than

[jira] Updated: (HIVE-451) Support ORDER BY xxx DESC

2009-05-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-451: -- Attachment: HIVE-451-2009-05-27.patch A quick fix, only changes a few lines in Hive.g, and lets order by

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-05-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713003#action_12713003 ] He Yongqiang commented on HIVE-417: --- Checked how Mysql does with index and found mysql eith

[jira] Updated: (HIVE-461) Optimize RCFile reading by using column pruning results

2009-05-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-461: -- Attachment: hive-461-2009-05-26.patch A first try. The main modifications lie in ColumnPruner, HiveInputF

[jira] Updated: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml

2009-05-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-490: -- Attachment: hive-490-2009-05-26.patch Checked the code and found what i suspected in previous comment is

[jira] Commented: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml

2009-05-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712403#action_12712403 ] He Yongqiang commented on HIVE-490: --- It seems there are some misunderstanding on the config

[jira] Updated: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml

2009-05-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-490: -- Attachment: hive-490-2009-05-23-3.patch hive-490-2009-05-23-3.patch includes parameters added in Hive-105

[jira] Updated: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml

2009-05-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-490: -- Attachment: hive-490-2009-05-23-2.patch Added a comment to explain that hive will automatically find out

[jira] Updated: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml

2009-05-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-490: -- Attachment: hive-490-2009-05-23.patch > set mapred.reduce.tasks to -1 in hive-default.xml > -

[jira] Updated: (HIVE-506) MoveTask was not reporting errors

2009-05-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-506: -- Attachment: patch-506-2009-05-23.patch > MoveTask was not reporting errors >

[jira] Commented: (HIVE-500) select from newly created table will fail

2009-05-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712359#action_12712359 ] He Yongqiang commented on HIVE-500: --- Namit, I think HIVE-507 does not resolve this issue. T

[jira] Updated: (HIVE-500) select from newly created table will fail

2009-05-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-500: -- Attachment: hive-500-2009-05-23.patch Namit did a patch for HIVE-507, which includes the codes for fixing

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2009-05-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712352#action_12712352 ] He Yongqiang commented on HIVE-417: --- Thanks a lot, Prasad. I will put questions on the jira

[jira] Updated: (HIVE-502) Optimize RCFile's performance by removeing all synchronized modifiers

2009-05-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-502: -- Attachment: hive-502-2009-05-22.patch Fix a typo in class HiveDataInputBuffer's comment. Thanks, Zheng.

[jira] Updated: (HIVE-500) select from newly created table will fail

2009-05-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-500: -- Attachment: hive-500-2009-05-21.patch It is caused by inputting nonexist files > select from newly creat

<    2   3   4   5   6   7   8   >