[jira] Commented: (HIVE-259) Add PERCENTILE aggregate function

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839391#action_12839391 ] He Yongqiang commented on HIVE-259: --- The code looks very good. Thanks for the code work,

[jira] Commented: (HIVE-259) Add PERCENTILE aggregate function

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839394#action_12839394 ] He Yongqiang commented on HIVE-259: --- looks good, will test and commit. Add PERCENTILE

[jira] Updated: (HIVE-259) Add PERCENTILE aggregate function

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-259: -- Resolution: Fixed Fix Version/s: 0.6.0 Release Note: Add PERCENTILE aggregate function

[jira] Updated: (HIVE-1204) typedbytes: writing to stderr kills the mapper

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1204: --- Resolution: Fixed Release Note: typedbytes: writing to stderr kills the mapper Hadoop Flags:

[jira] Commented: (HIVE-1202) Unknown exception : null while join

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839546#action_12839546 ] He Yongqiang commented on HIVE-1202: {quote} But when I changed one of them to

[jira] Commented: (HIVE-1202) Unknown exception : null while join

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839551#action_12839551 ] He Yongqiang commented on HIVE-1202: I tried this query with the trunk code. it works

[jira] Commented: (HIVE-1202) Unknown exception : null while join

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839555#action_12839555 ] He Yongqiang commented on HIVE-1202: Please try

[jira] Commented: (HIVE-1197) create a new input format where a mapper spans a file

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839575#action_12839575 ] He Yongqiang commented on HIVE-1197: Looks very good overall, congrats! just few minor

[jira] Commented: (HIVE-1197) create a new input format where a mapper spans a file

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839576#action_12839576 ] He Yongqiang commented on HIVE-1197: Correction about 5.1, it should be ((number of

[jira] Updated: (HIVE-1194) sorted merge join

2010-02-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1194: --- Attachment: hive-1194-2010-02-28.patch for early review only. I will test it more and add more

[jira] Commented: (HIVE-1204) typedbytes: writing to stderr kills the mapper

2010-02-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12839278#action_12839278 ] He Yongqiang commented on HIVE-1204: Compile error after applying this patch.

[jira] Created: (HIVE-1205) RowContainer should flush out dummy rows when the table desc is null

2010-02-27 Thread He Yongqiang (JIRA)
RowContainer should flush out dummy rows when the table desc is null - Key: HIVE-1205 URL: https://issues.apache.org/jira/browse/HIVE-1205 Project: Hadoop Hive Issue Type:

[jira] Assigned: (HIVE-1203) HiveInputFormat.getInputFormatFromCache swallows cause exception when trowing IOExcpetion

2010-02-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1203: -- Assignee: Vikram Chandrasekhar HiveInputFormat.getInputFormatFromCache swallows cause

[jira] Assigned: (HIVE-1203) HiveInputFormat.getInputFormatFromCache swallows cause exception when trowing IOExcpetion

2010-02-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1203: -- Assignee: (was: Vikram Chandrasekhar) Vladimir Klimontovich, please assign this issue to

[jira] Commented: (HIVE-1202) Unknown exception : null while join

2010-02-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838946#action_12838946 ] He Yongqiang commented on HIVE-1202: Actually hive does not support this kind of join.

[jira] Commented: (HIVE-1203) HiveInputFormat.getInputFormatFromCache swallows cause exception when trowing IOExcpetion

2010-02-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838953#action_12838953 ] He Yongqiang commented on HIVE-1203: Vladimir, in this case, do we really need a stack

[jira] Commented: (HIVE-1193) ensure sorting properties for a table

2010-02-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838958#action_12838958 ] He Yongqiang commented on HIVE-1193: @Zheng, 1. How do we make sure that the data is

[jira] Commented: (HIVE-1203) HiveInputFormat.getInputFormatFromCache swallows cause exception when trowing IOExcpetion

2010-02-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838968#action_12838968 ] He Yongqiang commented on HIVE-1203: Thanks for the explanation. Yes, there is no harm

[jira] Commented: (HIVE-1193) ensure sorting properties for a table

2010-02-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838628#action_12838628 ] He Yongqiang commented on HIVE-1193: Looks good. Will test. ensure sorting properties

[jira] Updated: (HIVE-1193) ensure sorting properties for a table

2010-02-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1193: --- Resolution: Fixed Release Note: HIVE-1193. ensure sorting properties for a table. Hadoop

[jira] Commented: (HIVE-1194) sorted merge join

2010-02-24 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838122#action_12838122 ] He Yongqiang commented on HIVE-1194: Yes. It does not need those storage. The main

[jira] Commented: (HIVE-1194) sorted merge join

2010-02-24 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838191#action_12838191 ] He Yongqiang commented on HIVE-1194: Thanks Zheng. Yes, we should do that. sorted

[jira] Updated: (HIVE-1185) Fix RCFile resource leak when opening a non-RCFile

2010-02-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1185: --- Status: Patch Available (was: Open) Fix RCFile resource leak when opening a non-RCFile

[jira] Updated: (HIVE-1185) Fix RCFile resource leak when opening a non-RCFile

2010-02-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1185: --- Attachment: hive-1185.2.patch we need to close that stream no matter what the current hadoop version

[jira] Updated: (HIVE-1185) Fix RCFile resource leak when opening a non-RCFile

2010-02-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1185: --- Attachment: hive-1185.1.patch adopted the patch from hadoop-5476 Fix RCFile resource leak when

[jira] Updated: (HIVE-1134) bucketing mapjoin where the big table contains more than 1 big partition

2010-02-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1134: --- Attachment: hive-1134-2010-02-20.patch Thanks Namit. Updated the patch. bucketing mapjoin where

[jira] Updated: (HIVE-1181) Make it optional to check file format

2010-02-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1181: --- Attachment: hive-1181-trunk-1.patch hive-1181-branch0.5-2.patch Make it optional to

[jira] Updated: (HIVE-1181) Make it optional to check file format

2010-02-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1181: --- Attachment: (was: hive-1181-trunk-1.patch) Make it optional to check file format

[jira] Updated: (HIVE-1134) bucketing mapjoin where the big table contains more than 1 big partition

2010-02-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1134: --- Attachment: hive-1134-2010-02-19.patch Integrated Namit's comments. Thanks Namit. bucketing mapjoin

[jira] Updated: (HIVE-1181) Make it optional to check file format

2010-02-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1181: --- Attachment: hive-1181-trunk-1.patch hive-1181-branch0.5-2.patch Make it optional to

[jira] Updated: (HIVE-1181) Make it optional to check file format

2010-02-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1181: --- Attachment: hive-1181-trunk-3.patch hive-1181-branch0.5-3.patch Make it optional to

[jira] Updated: (HIVE-1181) Make it optional to check file format

2010-02-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1181: --- Attachment: hive-1181-trunk-4.patch Make it optional to check file format

[jira] Commented: (HIVE-1178) enforce bucketing for a table

2010-02-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12835374#action_12835374 ] He Yongqiang commented on HIVE-1178: Sorry. Reviewed it with Namit this morning offline.

[jira] Commented: (HIVE-1178) enforce bucketing for a table

2010-02-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12835397#action_12835397 ] He Yongqiang commented on HIVE-1178: bucket1, bucket2, bucket3, and input2 tests failed.

[jira] Commented: (HIVE-1181) Make it optional to check file format

2010-02-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12835515#action_12835515 ] He Yongqiang commented on HIVE-1181: This is 0.5 specific issue, or we also need to

[jira] Updated: (HIVE-1181) Make it optional to check file format

2010-02-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1181: --- Attachment: hive-1181-branch0.5-1.patch Make it optional to check file format

[jira] Updated: (HIVE-1178) enforce bucketing for a table

2010-02-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1178: --- Resolution: Fixed Release Note: HIVE-1178. enforce bucketing for a table. Hadoop Flags:

[jira] Updated: (HIVE-1134) bucketing mapjoin where the big table contains more than 1 big partition

2010-02-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1134: --- Attachment: hive-1134-2010-02-18.patch Fixed some diff. Thanks Namit. bucketing mapjoin where the

[jira] Commented: (HIVE-417) Implement Indexing in Hive

2010-02-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12835569#action_12835569 ] He Yongqiang commented on HIVE-417: --- Got talked with Prasad about this issue today. I may

[jira] Updated: (HIVE-1134) bucketing mapjoin where the big table contains more than 1 big partition

2010-02-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1134: --- Attachment: hive-1134-2010-02-17.patch The attached patch also fixed a bug in Hive-917 's patch

[jira] Updated: (HIVE-917) Bucketed Map Join

2010-02-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-917: -- Attachment: hive-917-2010-2-16.patch A new patch: 1) added explain extended 2) break the test to 4

[jira] Created: (HIVE-1174) Job counter error if hive.merge.mapfiles equals true

2010-02-16 Thread He Yongqiang (JIRA)
Job counter error if hive.merge.mapfiles equals true -- Key: HIVE-1174 URL: https://issues.apache.org/jira/browse/HIVE-1174 Project: Hadoop Hive Issue Type: Bug Reporter: He

[jira] Updated: (HIVE-1174) Job counter error if hive.merge.mapfiles equals true

2010-02-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1174: --- Status: Patch Available (was: Open) Job counter error if hive.merge.mapfiles equals true

[jira] Updated: (HIVE-1174) Job counter error if hive.merge.mapfiles equals true

2010-02-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1174: --- Attachment: hive-1174.1.patch Job counter error if hive.merge.mapfiles equals true

[jira] Updated: (HIVE-1174) Job counter error if hive.merge.mapfiles equals true

2010-02-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1174: --- Attachment: hive-1174.2.patch Job counter error if hive.merge.mapfiles equals true

[jira] Commented: (HIVE-1174) Job counter error if hive.merge.mapfiles equals true

2010-02-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12834536#action_12834536 ] He Yongqiang commented on HIVE-1174: The problem in this jira is: 1) countJobs in Driver

[jira] Updated: (HIVE-1134) bucketing mapjoin where the big table contains more than 1 big partition

2010-02-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1134: --- Summary: bucketing mapjoin where the big table contains more than 1 big partition (was: bucketing

[jira] Updated: (HIVE-917) Bucketed Map Join

2010-02-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-917: -- Attachment: hive-917-2010-2-15.patch Regenerated the patch against trunk. see hive-917...2-15.patch

[jira] Commented: (HIVE-1122) Make ql/metadata/Table and Partition serializable

2010-02-10 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12832349#action_12832349 ] He Yongqiang commented on HIVE-1122: Will test and commit Make ql/metadata/Table and

[jira] Updated: (HIVE-1122) Make ql/metadata/Table and Partition serializable

2010-02-10 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1122: --- Resolution: Fixed Release Note: HIVE-1122. Make ql/metadata/Table and Partition serializable

[jira] Commented: (HIVE-1138) Hive using lzo comporession returns unexpected results.

2010-02-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12831043#action_12831043 ] He Yongqiang commented on HIVE-1138: Hi Bennie Are you seeing this on rcfile table or

[jira] Commented: (HIVE-1133) Refactor InputFormat and OutputFormat for Hive

2010-02-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12831054#action_12831054 ] He Yongqiang commented on HIVE-1133: Add another possible requirement: add support for

[jira] Commented: (HIVE-1138) Hive using lzo comporession returns unexpected results.

2010-02-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12831112#action_12831112 ] He Yongqiang commented on HIVE-1138: 1) Can you check if LzoCodec is loaded/installed

[jira] Commented: (HIVE-1141) Remove recursive call in FetchOperator.getNextRow

2010-02-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12831173#action_12831173 ] He Yongqiang commented on HIVE-1141: Zheng, does your change work with

[jira] Commented: (HIVE-1141) Remove recursive call in FetchOperator.getNextRow

2010-02-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12831182#action_12831182 ] He Yongqiang commented on HIVE-1141: Discussed with Zheng, this kind of recursive call

[jira] Updated: (HIVE-1141) Remove recursive call in FetchOperator.getNextRow

2010-02-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1141: --- Resolution: Fixed Release Note: Remove recursive call in FetchOperator.getNextRow Hadoop

[jira] Updated: (HIVE-917) Bucketed Map Join

2010-02-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-917: -- Attachment: hive-917-2010-2-8.patch A new patch integrated with Namit's comments. Thanks Namit.

[jira] Updated: (HIVE-917) Bucketed Map Join

2010-02-03 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-917: -- Attachment: hive-917-2010-2-3.patch Bucketed Map Join - Key:

[jira] Commented: (HIVE-894) add udaf max_n, min_n to contrib

2010-02-03 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12829481#action_12829481 ] He Yongqiang commented on HIVE-894: --- Test passed. Will commit. add udaf max_n, min_n to

[jira] Commented: (HIVE-1110) add counters to show that skew join triggered

2010-01-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12806047#action_12806047 ] He Yongqiang commented on HIVE-1110: By introducing an boolean vector to keep track of

[jira] Updated: (HIVE-1110) add counters to show that skew join triggered

2010-01-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1110: --- Attachment: hive-1110.2.patch update a new patch integrating Namit's suggestions. I did not know

[jira] Updated: (HIVE-1092) Conditional task does not increase finished job counter when filter job out.

2010-01-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1092: --- Attachment: hive-1092.patch Conditional task does not increase finished job counter when filter job

[jira] Updated: (HIVE-1092) Conditional task does not increase finished job counter when filter job out.

2010-01-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1092: --- Fix Version/s: 0.6.0 Status: Patch Available (was: Open) Conditional task does not

[jira] Commented: (HIVE-1093) Add a skew join map join size variable to control the input size of skew join's following map join job.

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12805629#action_12805629 ] He Yongqiang commented on HIVE-1093: does it work for combinehiveinputsplit also ? No.

[jira] Updated: (HIVE-1093) Add a skew join map join size variable to control the input size of skew join's following map join job.

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1093: --- Fix Version/s: 0.6.0 Status: Patch Available (was: Open) Add a skew join map join size

[jira] Updated: (HIVE-1093) Add a skew join map join size variable to control the input size of skew join's following map join job.

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1093: --- Attachment: hive-1093.2.patch Add a skew join map join size variable to control the input size of

[jira] Updated: (HIVE-1110) add counters to show that skew join triggered

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1110: --- Attachment: hive-1110.patch add counters to show that skew join triggered

[jira] Updated: (HIVE-1110) add counters to show that skew join triggered

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1110: --- Attachment: (was: hive-1110.patch) add counters to show that skew join triggered

[jira] Updated: (HIVE-1110) add counters to show that skew join triggered

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1110: --- Attachment: hive-1110.patch add counters to show that skew join triggered

[jira] Updated: (HIVE-1102) make number of concurrent tasks configurable

2010-01-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1102: --- Status: Patch Available (was: Open) make number of concurrent tasks configurable

[jira] Updated: (HIVE-1102) make number of concurrent tasks configurable

2010-01-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1102: --- Attachment: hive-1102.patch make number of concurrent tasks configurable

[jira] Updated: (HIVE-1093) Add a skew join map join size variable to control the input size of skew join's following map join job.

2010-01-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1093: --- Attachment: hive-1093.patch Add a skew join map join size variable to control the input size of skew

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-rcfile-reader-trunk.2.patch Added a testcase in the patch for trunk.

[jira] Updated: (HIVE-1094) Disable streaming last table if there is a skew key in previous tables.

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1094: --- Attachment: hive.1094.patch hive.1094.patch contains a fix for both hive-1094 and hive-1090 Disable

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-1088-trunk-2010-1-25.patch hive-1088-branch0.5-2010-1-25.patch

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-1088-trunk-2010-1-25.2.patch hive-1088-branch0.5-2010-1-25.2.patch

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: (was: hive-1088-branch0.5-2010-1-25.2.patch) RCFile RecordReader's first split will

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: (was: hive-1088-trunk-2010-1-25.2.patch) RCFile RecordReader's first split will read

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-1088-trunk-2010-1-25.2.patch hive-1088-branch0.5-2010-1-25.2.patch

[jira] Created: (HIVE-1090) Skew Join does not work in distributed env.

2010-01-24 Thread He Yongqiang (JIRA)
Skew Join does not work in distributed env. --- Key: HIVE-1090 URL: https://issues.apache.org/jira/browse/HIVE-1090 Project: Hadoop Hive Issue Type: Bug Reporter: He Yongqiang This is

[jira] Created: (HIVE-1091) Enable skew join for the last table

2010-01-24 Thread He Yongqiang (JIRA)
Enable skew join for the last table --- Key: HIVE-1091 URL: https://issues.apache.org/jira/browse/HIVE-1091 Project: Hadoop Hive Issue Type: Improvement Reporter: He Yongqiang In my test, even

[jira] Created: (HIVE-1092) Conditional task does not increase finished job counter when filter job out.

2010-01-24 Thread He Yongqiang (JIRA)
Conditional task does not increase finished job counter when filter job out. Key: HIVE-1092 URL: https://issues.apache.org/jira/browse/HIVE-1092 Project: Hadoop Hive

[jira] Created: (HIVE-1093) Add a skew join map join size variable to control the input size of skew join's following map join job.

2010-01-24 Thread He Yongqiang (JIRA)
Add a skew join map join size variable to control the input size of skew join's following map join job. - Key: HIVE-1093 URL:

[jira] Commented: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-24 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12804434#action_12804434 ] He Yongqiang commented on HIVE-1088: Will add a testcase. Also, do you think it is a

[jira] Created: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-23 Thread He Yongqiang (JIRA)
RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark Key: HIVE-1088 URL:

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is the first SYNC mark

2010-01-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-rcfile-reader-trunk.patch hive-rcfile-reader-branch-0.5.patch

[jira] Created: (HIVE-1085) ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'.

2010-01-22 Thread He Yongqiang (JIRA)
ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'. - Key: HIVE-1085 URL:

[jira] Updated: (HIVE-1085) ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'.

2010-01-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1085: --- Attachment: (was: hive-1080.patch) ColumnarSerde should not be the default Serde when user

[jira] Commented: (HIVE-1071) Making RCFile concatenatable to reduce the number of files of the output

2010-01-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12803479#action_12803479 ] He Yongqiang commented on HIVE-1071: Concating files to a single file has 2 problems to

[jira] Updated: (HIVE-1072) show table extended like table partition(xxx) will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1072: --- Attachment: hive-1072.patch show table extended like table partition(xxx) will show the result of

[jira] Updated: (HIVE-1072) show table extended like table partition(xxx) will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1072: --- Status: Patch Available (was: Open) show table extended like table partition(xxx) will show the

[jira] Commented: (HIVE-1072) show table extended like table partition(xxx) will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12803052#action_12803052 ] He Yongqiang commented on HIVE-1072: np. i can add that. But it seems many other

[jira] Updated: (HIVE-1072) show table extended like table partition(xxx) will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1072: --- Attachment: hive-1072.2.patch hive-1072.2.patch fails query when the given partition does not exist.

[jira] Commented: (HIVE-1054) CHANGE COLUMN does not support changing partition column types.

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800620#action_12800620 ] He Yongqiang commented on HIVE-1054: Right now, it seems hive meta data does not support

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12800867#action_12800867 ] He Yongqiang commented on HIVE-964: --- {quote} The output of child tasks of condition tasks

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Status: Patch Available (was: Open) handle skewed keys for a join in a separate job

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2010-01-15-4.patch handle skewed keys for a join in a separate job

[jira] Created: (HIVE-1058) Mapjoin operator need to clean up rowcainters used in HashMapWrapper

2010-01-15 Thread He Yongqiang (JIRA)
Mapjoin operator need to clean up rowcainters used in HashMapWrapper Key: HIVE-1058 URL: https://issues.apache.org/jira/browse/HIVE-1058 Project: Hadoop Hive Issue Type:

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12801059#action_12801059 ] He Yongqiang commented on HIVE-964: --- Also i just filed new followup jira hive-1058. Namit

[jira] Resolved: (HIVE-1054) CHANGE COLUMN does not support changing partition column types.

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang resolved HIVE-1054. Resolution: Won't Fix Talked with Prasad today, this should not be supported. CHANGE COLUMN does

<    1   2   3   4   5   6   7   >