[jira] Updated: (HIVE-1093) Add a "skew join map join size" variable to control the input size of skew join's following map join job.

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1093: --- Attachment: hive-1093.2.patch > Add a "skew join map join size" variable to control the input size of

[jira] Commented: (HIVE-1093) Add a "skew join map join size" variable to control the input size of skew join's following map join job.

2010-01-27 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805629#action_12805629 ] He Yongqiang commented on HIVE-1093: >>does it work for combinehiveinputsplit also ? No.

[jira] Updated: (HIVE-1093) Add a "skew join map join size" variable to control the input size of skew join's following map join job.

2010-01-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1093: --- Attachment: hive-1093.patch > Add a "skew join map join size" variable to control the input size of sk

[jira] Updated: (HIVE-1102) make number of concurrent tasks configurable

2010-01-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1102: --- Attachment: hive-1102.patch > make number of concurrent tasks configurable > -

[jira] Updated: (HIVE-1102) make number of concurrent tasks configurable

2010-01-26 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1102: --- Status: Patch Available (was: Open) > make number of concurrent tasks configurable >

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-1088-trunk-2010-1-25.2.patch hive-1088-branch0.5-2010-1-25.2.patch >

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: (was: hive-1088-trunk-2010-1-25.2.patch) > RCFile RecordReader's first split will read

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: (was: hive-1088-branch0.5-2010-1-25.2.patch) > RCFile RecordReader's first split will

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-1088-trunk-2010-1-25.2.patch hive-1088-branch0.5-2010-1-25.2.patch >

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-1088-trunk-2010-1-25.patch hive-1088-branch0.5-2010-1-25.patch Attach

[jira] Updated: (HIVE-1094) Disable streaming last table if there is a skew key in previous tables.

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1094: --- Attachment: hive.1094.patch hive.1094.patch contains a fix for both hive-1094 and hive-1090 > Disable

[jira] Assigned: (HIVE-1090) Skew Join does not work in distributed env.

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1090: -- Assignee: He Yongqiang > Skew Join does not work in distributed env. > -

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-rcfile-reader-trunk.2.patch Added a testcase in the patch for trunk. (hive-rcfile-rea

[jira] Created: (HIVE-1094) Disable streaming last table if there is a skew key in previous tables.

2010-01-25 Thread He Yongqiang (JIRA)
Disable streaming last table if there is a skew key in previous tables. --- Key: HIVE-1094 URL: https://issues.apache.org/jira/browse/HIVE-1094 Project: Hadoop Hive Issue Ty

[jira] Commented: (HIVE-1093) Add a "skew join map join size" variable to control the input size of skew join's following map join job.

2010-01-25 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804438#action_12804438 ] He Yongqiang commented on HIVE-1093: >>Do you have performance numbers for the testcase

[jira] Commented: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-24 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804434#action_12804434 ] He Yongqiang commented on HIVE-1088: Will add a testcase. >>Also, do you think it is a

[jira] Created: (HIVE-1093) Add a "skew join map join size" variable to control the input size of skew join's following map join job.

2010-01-24 Thread He Yongqiang (JIRA)
Add a "skew join map join size" variable to control the input size of skew join's following map join job. - Key: HIVE-1093 URL: https://issues.apache.org/jira/

[jira] Created: (HIVE-1092) Conditional task does not increase finished job counter when filter job out.

2010-01-24 Thread He Yongqiang (JIRA)
Conditional task does not increase finished job counter when filter job out. Key: HIVE-1092 URL: https://issues.apache.org/jira/browse/HIVE-1092 Project: Hadoop Hive

[jira] Created: (HIVE-1091) Enable skew join for the last table

2010-01-24 Thread He Yongqiang (JIRA)
Enable skew join for the last table --- Key: HIVE-1091 URL: https://issues.apache.org/jira/browse/HIVE-1091 Project: Hadoop Hive Issue Type: Improvement Reporter: He Yongqiang In my test, even by

[jira] Created: (HIVE-1090) Skew Join does not work in distributed env.

2010-01-24 Thread He Yongqiang (JIRA)
Skew Join does not work in distributed env. --- Key: HIVE-1090 URL: https://issues.apache.org/jira/browse/HIVE-1090 Project: Hadoop Hive Issue Type: Bug Reporter: He Yongqiang This is due

[jira] Updated: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-23 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1088: --- Attachment: hive-rcfile-reader-trunk.patch hive-rcfile-reader-branch-0.5.patch > RCFil

[jira] Created: (HIVE-1088) RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark

2010-01-23 Thread He Yongqiang (JIRA)
RCFile RecordReader's first split will read duplicate rows if the split end is < the first SYNC mark Key: HIVE-1088 URL: https://issues.apache.org/jira/browse/HIV

[jira] Updated: (HIVE-1085) ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'.

2010-01-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1085: --- Attachment: hive-1085.2.patch hive-1085.2.patch integrates Ning's offline comments. hive-1085.2.patch

[jira] Updated: (HIVE-1085) ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'.

2010-01-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1085: --- Attachment: hive-1080.patch > ColumnarSerde should not be the default Serde when user specified a > f

[jira] Updated: (HIVE-1085) ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'.

2010-01-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1085: --- Attachment: (was: hive-1080.patch) > ColumnarSerde should not be the default Serde when user speci

[jira] Updated: (HIVE-1085) ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'.

2010-01-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1085: --- Attachment: hive-1085.patch > ColumnarSerde should not be the default Serde when user specified a > f

[jira] Created: (HIVE-1085) ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'.

2010-01-22 Thread He Yongqiang (JIRA)
ColumnarSerde should not be the default Serde when user specified a fileformat using 'stored as'. - Key: HIVE-1085 URL: https://issues.apache.org/jira/browse/HIVE-1085

[jira] Commented: (HIVE-1071) Making RCFile "concatenatable" to reduce the number of files of the output

2010-01-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803479#action_12803479 ] He Yongqiang commented on HIVE-1071: Concating files to a single file has 2 problems to

[jira] Updated: (HIVE-1072) "show table extended like table partition(xxx) " will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1072: --- Attachment: hive-1072.2.patch hive-1072.2.patch fails query when the given partition does not exist.

[jira] Commented: (HIVE-1072) "show table extended like table partition(xxx) " will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803052#action_12803052 ] He Yongqiang commented on HIVE-1072: np. i can add that. But it seems many other command

[jira] Updated: (HIVE-1072) "show table extended like table partition(xxx) " will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1072: --- Attachment: hive-1072.patch > "show table extended like table partition(xxx) " will show the result of

[jira] Updated: (HIVE-1072) "show table extended like table partition(xxx) " will show the result of the whole table if the partition does not exist

2010-01-20 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1072: --- Status: Patch Available (was: Open) > "show table extended like table partition(xxx) " will show the

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12801081#action_12801081 ] He Yongqiang commented on HIVE-964: --- Hi Namit, can you resolve that diff manually? I just t

[jira] Commented: (HIVE-1055) chaning datatype of a partitioning column should be allowed

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12801063#action_12801063 ] He Yongqiang commented on HIVE-1055: Talked with Prasad today, this should not be suppor

[jira] Resolved: (HIVE-1054) "CHANGE COLUMN" does not support changing partition column types.

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang resolved HIVE-1054. Resolution: Won't Fix Talked with Prasad today, this should not be supported. > "CHANGE COLUMN" doe

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12801059#action_12801059 ] He Yongqiang commented on HIVE-964: --- Also i just filed new followup jira hive-1058. Namit

[jira] Created: (HIVE-1058) Mapjoin operator need to clean up rowcainters used in HashMapWrapper

2010-01-15 Thread He Yongqiang (JIRA)
Mapjoin operator need to clean up rowcainters used in HashMapWrapper Key: HIVE-1058 URL: https://issues.apache.org/jira/browse/HIVE-1058 Project: Hadoop Hive Issue Type: Bu

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2010-01-15-4.patch > handle skewed keys for a join in a separate job > -

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Status: Patch Available (was: Open) > handle skewed keys for a join in a separate job >

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800990#action_12800990 ] He Yongqiang commented on HIVE-964: --- These are finished and passed all tests. Will upload a

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800867#action_12800867 ] He Yongqiang commented on HIVE-964: --- {quote} The output of child tasks of condition tasks i

[jira] Commented: (HIVE-1054) "CHANGE COLUMN" does not support changing partition column types.

2010-01-15 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800620#action_12800620 ] He Yongqiang commented on HIVE-1054: Right now, it seems hive meta data does not support

[jira] Created: (HIVE-1054) "CHANGE COLUMN" does not support changing partition column types.

2010-01-14 Thread He Yongqiang (JIRA)
"CHANGE COLUMN" does not support changing partition column types. - Key: HIVE-1054 URL: https://issues.apache.org/jira/browse/HIVE-1054 Project: Hadoop Hive Issue Type: Bug

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2010-01-14-3.patch > handle skewed keys for a join in a separate job > -

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: (was: hive-964-2010-01-14-3.patch) > handle skewed keys for a join in a separate job > --

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2010-01-14-3.patch Incorporated comments, and attached the patch. Thanks for the det

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-13 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2010-01-13-2.patch hive-964-2010-01-13-2.patch is not the final patch, and just for

[jira] Resolved: (HIVE-1044) Data output order is incorrect for map join

2010-01-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang resolved HIVE-1044. Resolution: Invalid actually this join query is wrong. close this issue. > Data output order is inc

[jira] Commented: (HIVE-1044) Data output order is incorrect for map join

2010-01-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12799079#action_12799079 ] He Yongqiang commented on HIVE-1044: this is also true for stream table. > Data output

[jira] Updated: (HIVE-1044) Data output order is incorrect for map join

2010-01-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1044: --- Description: For query: select /* + mapjoin(a, c) * / * from T1 a join T12 b join T1 c on a.key = b

[jira] Created: (HIVE-1044) Data output order is incorrect for map join

2010-01-11 Thread He Yongqiang (JIRA)
Data output order is incorrect for map join --- Key: HIVE-1044 URL: https://issues.apache.org/jira/browse/HIVE-1044 Project: Hadoop Hive Issue Type: Bug Reporter: He Yongqiang For query:

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798742#action_12798742 ] He Yongqiang commented on HIVE-964: --- {quote} if (alias == numAliases - 1 && !(this.handleSk

[jira] Updated: (HIVE-1038) mapjoin dies if the join prunes all the columns

2010-01-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1038: --- Resolution: Fixed Release Note: mapjoin dies if the join prunes all the columns Hadoop Flags

[jira] Commented: (HIVE-1038) mapjoin dies if the join prunes all the columns

2010-01-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798169#action_12798169 ] He Yongqiang commented on HIVE-1038: +1. Will commit if test pass. > mapjoin dies if th

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798165#action_12798165 ] He Yongqiang commented on HIVE-964: --- hive-964-2010-01-08.patch is just for review, will upd

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2010-01-08.patch CHANGES: 1) let row container use hadoop fileformat 2) let row cont

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2010-01-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798159#action_12798159 ] He Yongqiang commented on HIVE-964: --- Had an offline discussion with Namit and Ning days ago

[jira] Commented: (HIVE-675) add database/scheme support Hive QL

2010-01-06 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797238#action_12797238 ] He Yongqiang commented on HIVE-675: --- Hi Jeff, Sorry for the delay. Actually it is now hold

[jira] Updated: (HIVE-1023) typedbytes: datatypes should be derived from data

2009-12-31 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1023: --- Resolution: Fixed Release Note: typedbytes: datatypes should be derived from data Hadoop Flag

[jira] Commented: (HIVE-1023) typedbytes: datatypes should be derived from data

2009-12-31 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795734#action_12795734 ] He Yongqiang commented on HIVE-1023: +1, running tests now. > typedbytes: datatypes sho

[jira] Updated: (HIVE-916) typedbytes: changes

2009-12-30 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-916: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I jus

[jira] Commented: (HIVE-916) typedbytes: changes

2009-12-30 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795479#action_12795479 ] He Yongqiang commented on HIVE-916: --- +1, running tests now. > typedbytes: changes > --

[jira] Updated: (HIVE-1020) create a confifuration variable to control speculative execution for reducers in hive

2009-12-30 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1020: --- Resolution: Fixed Release Note: create a confifuration variable to control speculative executio

[jira] Commented: (HIVE-1020) create a confifuration variable to control speculative execution for reducers in hive

2009-12-30 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795362#action_12795362 ] He Yongqiang commented on HIVE-1020: +1 looks good. Will commit if tests pass. > create

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2009-12-29 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2009-12-29-4.patch Attache a new patch. Changes include: 1) update patch against tr

[jira] Commented: (HIVE-1018) pushing down group-by before joins

2009-12-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794995#action_12794995 ] He Yongqiang commented on HIVE-1018: For some situations( for example, join keys equal t

[jira] Commented: (HIVE-1018) pushing down group-by before joins

2009-12-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794993#action_12794993 ] He Yongqiang commented on HIVE-1018: there is one paper "Including Group-By in Query Opt

[jira] Commented: (HIVE-1001) CombinedHiveInputFormat should parse the inputpath correctly

2009-12-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794968#action_12794968 ] He Yongqiang commented on HIVE-1001: Hi Dave, How many mappers in the map-reduce job be

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2009-12-28 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2009-12-28-2.patch > handle skewed keys for a join in a separate job > -

[jira] Commented: (HIVE-571) add ability to rename a column.

2009-12-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793873#action_12793873 ] He Yongqiang commented on HIVE-571: --- no problem. Will update wiki after it is committed. >

[jira] Updated: (HIVE-571) add ability to rename a column.

2009-12-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-571: -- Attachment: hive-571-2009-12-22-2.patch Integrates Prasad's comment. Thanks, Prasad. > add ability to re

[jira] Updated: (HIVE-571) add ability to rename a column.

2009-12-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-571: -- Attachment: hive-571-2009-12-22.patch > add ability to rename a column. > ---

[jira] Assigned: (HIVE-1007) CombinedHiveInputFormat fails with empty input

2009-12-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1007: -- Assignee: Dave Lerman > CombinedHiveInputFormat fails with empty input > ---

[jira] Updated: (HIVE-927) input41.q should fail

2009-12-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-927: -- Attachment: hive-927-2009-12-22.patch > input41.q should fail > - > >

[jira] Updated: (HIVE-927) input41.q should fail

2009-12-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-927: -- Status: Patch Available (was: Open) > input41.q should fail > - > >

[jira] Updated: (HIVE-977) NullPointerException when operating on a non-existing partition

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-977: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed. Thanks Namit! > Nul

[jira] Commented: (HIVE-977) NullPointerException when operating on a non-existing partition

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793465#action_12793465 ] He Yongqiang commented on HIVE-977: --- +1. Will commit if tests pass. > NullPointerException

[jira] Commented: (HIVE-302) Implement "LINES TERMINATED BY"

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793464#action_12793464 ] He Yongqiang commented on HIVE-302: --- oh, sorry, ignore my previous comment. > Implement "L

[jira] Commented: (HIVE-302) Implement "LINES TERMINATED BY"

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793457#action_12793457 ] He Yongqiang commented on HIVE-302: --- +1. Looks good. Will commit if tests pass. > Implemen

[jira] Updated: (HIVE-913) no error if user specifies same output table mutliple times

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-913: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I jus

[jira] Commented: (HIVE-913) no error if user specifies same output table mutliple times

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793443#action_12793443 ] He Yongqiang commented on HIVE-913: --- +1. looks good. will commit if tests pass. > no error

[jira] Resolved: (HIVE-1001) CombinedHiveInputFormat should parse the inputpath correctly

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang resolved HIVE-1001. Resolution: Fixed Hadoop Flags: [Reviewed] I just committed. Thanks Namit! > CombinedHiveInpu

[jira] Commented: (HIVE-1001) CombinedHiveInputFormat should parse the inputpath correctly

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793389#action_12793389 ] He Yongqiang commented on HIVE-1001: +1. Looks good. Will commit if tests pass. > Combi

[jira] Updated: (HIVE-1000) compile error when sampleing an empty bucketed table ( it should return nothing instead of compile error)

2009-12-21 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1000: --- Attachment: hive-1000-2009-12-21.patch > compile error when sampleing an empty bucketed table ( it sho

[jira] Created: (HIVE-1000) compile error when sampleing an empty bucketed table ( it should return nothing instead of compile error)

2009-12-19 Thread He Yongqiang (JIRA)
compile error when sampleing an empty bucketed table ( it should return nothing instead of compile error) - Key: HIVE-1000 URL: https://issues.apache.org/jira/

[jira] Commented: (HIVE-999) sample pruning not working if denominator is not same as number of buckets

2009-12-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792914#action_12792914 ] He Yongqiang commented on HIVE-999: --- Also it seems sampling an empty bucketed table will ge

[jira] Updated: (HIVE-999) sample pruning not working if denominator is not same as number of buckets

2009-12-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-999: -- Attachment: hive-999-2009-12-19.patch new patch. Thanks Namit. > sample pruning not working if denominat

[jira] Commented: (HIVE-999) sample pruning not working if denominator is not same as number of buckets

2009-12-19 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792892#action_12792892 ] He Yongqiang commented on HIVE-999: --- Hi Namit, Let's do it in this jira. I will add this te

[jira] Updated: (HIVE-999) sample pruning not working if denominator is not same as number of buckets

2009-12-18 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-999: -- Attachment: hive-999-2009-12-18.patch > sample pruning not working if denominator is not same as number o

[jira] Updated: (HIVE-964) handle skewed keys for a join in a separate job

2009-12-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-964: -- Attachment: hive-964-2009-12-17.txt first version for comments. > handle skewed keys for a join in a sep

[jira] Updated: (HIVE-993) type conversion not working for map-joins

2009-12-16 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-993: -- Attachment: hive-993-2009-12-16.patch Removed the type conversion code in MapJoinProcessor. The removed l

[jira] Updated: (HIVE-991) union with 200 kids fail

2009-12-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-991: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I jus

[jira] Commented: (HIVE-991) union with 200 kids fail

2009-12-14 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12790471#action_12790471 ] He Yongqiang commented on HIVE-991: --- looks good. Will commit once tests pass. > union with

[jira] Commented: (HIVE-964) handle skewed keys for a join in a separate job

2009-12-11 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789586#action_12789586 ] He Yongqiang commented on HIVE-964: --- Here is the idea, according to offline discussions wit

[jira] Created: (HIVE-977) NullPointerException when operating on a non-existing partition

2009-12-09 Thread He Yongqiang (JIRA)
NullPointerException when operating on a non-existing partition --- Key: HIVE-977 URL: https://issues.apache.org/jira/browse/HIVE-977 Project: Hadoop Hive Issue Type: Bug

[jira] Assigned: (HIVE-964) handle skewed keys for a join in a separate job

2009-12-08 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-964: - Assignee: He Yongqiang > handle skewed keys for a join in a separate job >

[jira] Updated: (HIVE-638) fix sampling in subquery for real

2009-12-04 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-638: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I jus

[jira] Commented: (HIVE-931) Sorted Group By

2009-12-03 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785796#action_12785796 ] He Yongqiang commented on HIVE-931: --- Hi Zheng, bq. Is the "sorted by" property always the s

[jira] Updated: (HIVE-931) Sorted Group By

2009-12-03 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-931: -- Attachment: hive-931-2009-12-03.patch Attached a new patch. Had a lot of offline discussions with Namit.

[jira] Commented: (HIVE-963) no out of memory errors for skewed join

2009-12-03 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785447#action_12785447 ] He Yongqiang commented on HIVE-963: --- no, i haven't start working on it. Please feel free to

<    1   2   3   4   5   6   7   8   >