[jira] Created: (HIVE-70) provide option to limit standard error output by user scripts

2008-11-18 Thread Joydeep Sen Sarma (JIRA)
provide option to limit standard error output by user scripts - Key: HIVE-70 URL: https://issues.apache.org/jira/browse/HIVE-70 Project: Hadoop Hive Issue Type: Bug

[jira] Commented: (HIVE-30) Hive web interface

2008-11-19 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12649213#action_12649213 ] Joydeep Sen Sarma commented on HIVE-30: --- @Ashish - i think what u are saying makes total

[jira] Created: (HIVE-77) thread safe query execution

2008-11-21 Thread Joydeep Sen Sarma (JIRA)
thread safe query execution --- Key: HIVE-77 URL: https://issues.apache.org/jira/browse/HIVE-77 Project: Hadoop Hive Issue Type: Bug Reporter: Joydeep Sen Sarma this came up in hive-30 where there's a

[jira] Created: (HIVE-84) MetaStore Client is not thread safe

2008-11-27 Thread Joydeep Sen Sarma (JIRA)
MetaStore Client is not thread safe --- Key: HIVE-84 URL: https://issues.apache.org/jira/browse/HIVE-84 Project: Hadoop Hive Issue Type: Bug Environment: with patch for hive-77 - run: ant -lib

[jira] Updated: (HIVE-77) thread safe query execution

2008-11-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-77?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-77: -- Attachment: hive-77.patch.1 thread safe query execution ---

[jira] Updated: (HIVE-85) separate compression options for different output types

2008-11-30 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-85?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-85: -- Status: Patch Available (was: Open) two new options are provided: hive.exec.compress.output and

[jira] Commented: (HIVE-30) Hive web interface

2008-12-01 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12652166#action_12652166 ] Joydeep Sen Sarma commented on HIVE-30: --- regarding the bin/hive changes, couple of

[jira] Commented: (HIVE-65) Implict conversion from integer to long broken for Dynamic Serde tables

2008-12-01 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12652182#action_12652182 ] Joydeep Sen Sarma commented on HIVE-65: --- if u can go both ways (string - number and

[jira] Assigned: (HIVE-88) hadoop doesn't use conf/hive-log4j.properties

2008-12-01 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma reassigned HIVE-88: - Assignee: Joydeep Sen Sarma hadoop doesn't use conf/hive-log4j.properties

[jira] Commented: (HIVE-77) thread safe query execution

2008-12-01 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12652195#action_12652195 ] Joydeep Sen Sarma commented on HIVE-77: --- thx - will fix the inline comments. static

[jira] Commented: (HIVE-73) Thrift Server and Client for Hive

2008-12-01 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-73?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12652246#action_12652246 ] Joydeep Sen Sarma commented on HIVE-73: --- regarding the silent mode - we simply followed

[jira] Commented: (HIVE-81) Make forrest docs for Hive web site along the lines of http://hadoop.apache.org/core/

2008-12-01 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-81?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12652258#action_12652258 ] Joydeep Sen Sarma commented on HIVE-81: --- depends a lot on the query. don't remember what

[jira] Updated: (HIVE-77) thread safe query execution

2008-12-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-77?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-77: -- Attachment: hive-77.patch.2 thread safe query execution ---

[jira] Updated: (HIVE-77) thread safe query execution

2008-12-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-77?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-77: -- Attachment: hive-77.patch.3 thread safe query execution ---

[jira] Commented: (HIVE-77) thread safe query execution

2008-12-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12652448#action_12652448 ] Joydeep Sen Sarma commented on HIVE-77: --- fixed all the inline comments and moved

[jira] Updated: (HIVE-85) separate compression options for different output types

2008-12-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-85?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-85: -- Attachment: lt100.txt.deflate this should go in data/files/lt100.txt.deflate separate

[jira] Created: (HIVE-105) estimate number of required reducers and other map-reduce parameters automatically

2008-12-02 Thread Joydeep Sen Sarma (JIRA)
estimate number of required reducers and other map-reduce parameters automatically -- Key: HIVE-105 URL: https://issues.apache.org/jira/browse/HIVE-105 Project: Hadoop

[jira] Updated: (HIVE-85) separate compression options for different output types

2008-12-03 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-85?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-85: -- Attachment: hive-85.patch.3 separate compression options for different output types

[jira] Commented: (HIVE-85) separate compression options for different output types

2008-12-03 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12652980#action_12652980 ] Joydeep Sen Sarma commented on HIVE-85: --- attached new version of the last patch that

[jira] Commented: (HIVE-65) Implict conversion from integer to long broken for Dynamic Serde tables

2008-12-03 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12653005#action_12653005 ] Joydeep Sen Sarma commented on HIVE-65: --- @Zheng - i don't follow. i thought we discussed

[jira] Created: (HIVE-109) 'location' clause for table creation should only be allowed for external tables

2008-12-03 Thread Joydeep Sen Sarma (JIRA)
'location' clause for table creation should only be allowed for external tables --- Key: HIVE-109 URL: https://issues.apache.org/jira/browse/HIVE-109 Project: Hadoop Hive

[jira] Created: (HIVE-110) table/partition compaction utility

2008-12-03 Thread Joydeep Sen Sarma (JIRA)
table/partition compaction utility -- Key: HIVE-110 URL: https://issues.apache.org/jira/browse/HIVE-110 Project: Hadoop Hive Issue Type: Bug Reporter: Joydeep Sen Sarma in many cases, we cannot

[jira] Created: (HIVE-117) hive regression tests should also execute jobs in non-local mode

2008-12-04 Thread Joydeep Sen Sarma (JIRA)
hive regression tests should also execute jobs in non-local mode Key: HIVE-117 URL: https://issues.apache.org/jira/browse/HIVE-117 Project: Hadoop Hive Issue Type: Bug

[jira] Commented: (HIVE-131) insert overwrite directory leaves behind uncommitted/tmp files from failed tasks

2008-12-07 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654321#action_12654321 ] Joydeep Sen Sarma commented on HIVE-131: i quickly glanced at the doc mentioned.

[jira] Commented: (HIVE-131) insert overwrite directory leaves behind uncommitted/tmp files from failed tasks

2008-12-07 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654322#action_12654322 ] Joydeep Sen Sarma commented on HIVE-131: btw - if we can solve a problem at the

[jira] Commented: (HIVE-131) insert overwrite directory leaves behind uncommitted/tmp files from failed tasks

2008-12-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654504#action_12654504 ] Joydeep Sen Sarma commented on HIVE-131: no - no failures here (from hive

[jira] Commented: (HIVE-126) Don't fetch information on Partitions from HDFS instead of MetaStore

2008-12-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654533#action_12654533 ] Joydeep Sen Sarma commented on HIVE-126: yes - the code was put in there as a

[jira] Commented: (HIVE-134) job conf being passed to serde (initialize)

2008-12-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654538#action_12654538 ] Joydeep Sen Sarma commented on HIVE-134: why is this a concern? i vaguely remember

[jira] Created: (HIVE-135) need more accurate way of tracking memory consumption on map side aggregates

2008-12-08 Thread Joydeep Sen Sarma (JIRA)
need more accurate way of tracking memory consumption on map side aggregates Key: HIVE-135 URL: https://issues.apache.org/jira/browse/HIVE-135 Project: Hadoop Hive

[jira] Commented: (HIVE-134) job conf being passed to serde (initialize)

2008-12-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654552#action_12654552 ] Joydeep Sen Sarma commented on HIVE-134: i disagree. the whole idea with serde is

[jira] Commented: (HIVE-134) job conf being passed to serde (initialize)

2008-12-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12654615#action_12654615 ] Joydeep Sen Sarma commented on HIVE-134: of course it makes it harder. it's one more

[jira] Commented: (HIVE-107) Case structure for bin hive

2008-12-10 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12655296#action_12655296 ] Joydeep Sen Sarma commented on HIVE-107: looks great. i think Raghu's concerns are

[jira] Commented: (HIVE-142) Create a metastore check command

2008-12-10 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12655335#action_12655335 ] Joydeep Sen Sarma commented on HIVE-142: i was thinking that inferring of the URI

[jira] Commented: (HIVE-91) Allow external tables with different partition directory structure

2008-12-10 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12655354#action_12655354 ] Joydeep Sen Sarma commented on HIVE-91: --- one thing is not clear to me: when an external

[jira] Commented: (HIVE-126) Don't fetch information on Partitions from HDFS instead of MetaStore

2008-12-10 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12655384#action_12655384 ] Joydeep Sen Sarma commented on HIVE-126: let's hold onto this while we figure out

[jira] Commented: (HIVE-47) [Hive] CLI not supporting multiline queries from an input file

2008-12-10 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12655391#action_12655391 ] Joydeep Sen Sarma commented on HIVE-47: --- +1 [Hive] CLI not supporting multiline

[jira] Reopened: (HIVE-98) Dependency management with hadoop core using either maven or ivy

2008-12-10 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-98?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma reopened HIVE-98: --- [ivy:retrieve] :: Ivy 2.0.0-rc2 - 20081028224207 :: http://ant.apache.org/ivy/ :: :: loading

[jira] Updated: (HIVE-129) Fix aux.jar packaging to work properly with 0.17 and 0.18 versions of hadoop

2008-12-11 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-129: --- Status: Patch Available (was: Open) fixes test runs on 17 and 18 we don't have non-localmode

[jira] Commented: (HIVE-142) Create a metastore check command

2008-12-11 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12655813#action_12655813 ] Joydeep Sen Sarma commented on HIVE-142: +1 on a new hive subcommand. msck sounds

[jira] Created: (HIVE-175) support for member fields of Java type 'Set' in ReflectionObjectInspector

2008-12-13 Thread Joydeep Sen Sarma (JIRA)
support for member fields of Java type 'Set' in ReflectionObjectInspector - Key: HIVE-175 URL: https://issues.apache.org/jira/browse/HIVE-175 Project: Hadoop Hive Issue

[jira] Assigned: (HIVE-175) support for member fields of Java type 'Set' in ReflectionObjectInspector

2008-12-13 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma reassigned HIVE-175: -- Assignee: Joydeep Sen Sarma support for member fields of Java type 'Set' in

[jira] Updated: (HIVE-176) structured log for obtaining query stats/info

2008-12-15 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-176: --- Component/s: Logging structured log for obtaining query stats/info

[jira] Created: (HIVE-176) structured log for obtaining query stats/info

2008-12-15 Thread Joydeep Sen Sarma (JIRA)
structured log for obtaining query stats/info - Key: HIVE-176 URL: https://issues.apache.org/jira/browse/HIVE-176 Project: Hadoop Hive Issue Type: Bug Reporter: Joydeep Sen Sarma

[jira] Updated: (HIVE-79) Print number of raws inserted to table(s) when the query is finished.

2008-12-15 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-79?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-79: -- Component/s: (was: Clients) Logging Print number of raws inserted to

[jira] Resolved: (HIVE-135) need more accurate way of tracking memory consumption on map side aggregates

2008-12-15 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma resolved HIVE-135. Resolution: Duplicate need more accurate way of tracking memory consumption on map side

[jira] Commented: (HIVE-180) Data Generator for thrift-serialized sequence files

2008-12-15 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12656853#action_12656853 ] Joydeep Sen Sarma commented on HIVE-180: +1 Data Generator for thrift-serialized

[jira] Commented: (HIVE-188) hive CLI should quit when stdout is closed

2008-12-18 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12657989#action_12657989 ] Joydeep Sen Sarma commented on HIVE-188: +1 interesting bug. i guess this affects

[jira] Commented: (HIVE-30) Hive web interface

2008-12-18 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12658031#action_12658031 ] Joydeep Sen Sarma commented on HIVE-30: --- sounds pretty good to me. i don't think Hive

[jira] Commented: (HIVE-195) map-side joins are not supported

2008-12-29 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12659733#action_12659733 ] Joydeep Sen Sarma commented on HIVE-195: here's the ticket for the jdbm enhancement

[jira] Commented: (HIVE-176) structured log for obtaining query stats/info

2008-12-30 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12659901#action_12659901 ] Joydeep Sen Sarma commented on HIVE-176: still reviewing this. one problem is that

[jira] Commented: (HIVE-204) Provide option to run hadoop via TestMiniMR

2009-01-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12660427#action_12660427 ] Joydeep Sen Sarma commented on HIVE-204: ok. i am not sure why exactly - but we had

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-05 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12660832#action_12660832 ] Joydeep Sen Sarma commented on HIVE-207: the deserializer api does get one column at

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-05 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12660950#action_12660950 ] Joydeep Sen Sarma commented on HIVE-207: one thing about the SerDe/Objectinspector

[jira] Created: (HIVE-218) predicate on partitioning column is ignored in many places

2009-01-07 Thread Joydeep Sen Sarma (JIRA)
predicate on partitioning column is ignored in many places -- Key: HIVE-218 URL: https://issues.apache.org/jira/browse/HIVE-218 Project: Hadoop Hive Issue Type: Bug

[jira] Commented: (HIVE-217) Stream closed exception

2009-01-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12662078#action_12662078 ] Joydeep Sen Sarma commented on HIVE-217: one question - which side was the big table

[jira] Commented: (HIVE-217) Stream closed exception

2009-01-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12662111#action_12662111 ] Joydeep Sen Sarma commented on HIVE-217: ok - got it. hadoop is ok - it's already

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12662175#action_12662175 ] Joydeep Sen Sarma commented on HIVE-207: I like Zheng's proposal. The only thing

[jira] Commented: (HIVE-219) Map-side aggregates output one row per reducer when not grouping

2009-01-09 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12662453#action_12662453 ] Joydeep Sen Sarma commented on HIVE-219: yeah - definitely need to use miniMR -

[jira] Created: (HIVE-223) when using map-side aggregates - perform single map-reduce group-by

2009-01-11 Thread Joydeep Sen Sarma (JIRA)
when using map-side aggregates - perform single map-reduce group-by --- Key: HIVE-223 URL: https://issues.apache.org/jira/browse/HIVE-223 Project: Hadoop Hive Issue Type:

[jira] Created: (HIVE-224) implement lfu based flushing policy for map side aggregates

2009-01-11 Thread Joydeep Sen Sarma (JIRA)
implement lfu based flushing policy for map side aggregates --- Key: HIVE-224 URL: https://issues.apache.org/jira/browse/HIVE-224 Project: Hadoop Hive Issue Type: Improvement

[jira] Created: (HIVE-225) incorrect reducer count reported on some group bys

2009-01-11 Thread Joydeep Sen Sarma (JIRA)
incorrect reducer count reported on some group bys -- Key: HIVE-225 URL: https://issues.apache.org/jira/browse/HIVE-225 Project: Hadoop Hive Issue Type: Bug Reporter: Joydeep Sen

[jira] Commented: (HIVE-210) Refactor HiveConf variables into two categories (global and session level) so that sharing HiveConf object across multiple sessions becomes easier

2009-01-11 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12662855#action_12662855 ] Joydeep Sen Sarma commented on HIVE-210: i presume u are asking to distinguishing

[jira] Updated: (HIVE-219) Map-side aggregates output one row per reducer when not grouping

2009-01-11 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-219: --- Priority: Blocker (was: Critical) this is absolutely broken. i am trying count(1) with

[jira] Commented: (HIVE-176) structured log for obtaining query stats/info

2009-01-12 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12663027#action_12663027 ] Joydeep Sen Sarma commented on HIVE-176: - inferNumReducers(): instead of two calls

[jira] Commented: (HIVE-228) Make ql.metadata.Partition constructor public

2009-01-12 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12663205#action_12663205 ] Joydeep Sen Sarma commented on HIVE-228: +1 Make ql.metadata.Partition constructor

[jira] Updated: (HIVE-217) Stream closed exception

2009-01-13 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-217: --- Component/s: (was: Serializers/Deserializers) Query Processor Stream

[jira] Commented: (HIVE-217) Stream closed exception

2009-01-14 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12663788#action_12663788 ] Joydeep Sen Sarma commented on HIVE-217: +1 thanks Johan! Stream closed exception

[jira] Issue Comment Edited: (HIVE-232) metastore.warehouse configuration should use inherited hadoop configuration

2009-01-14 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12664000#action_12664000 ] jsensarma edited comment on HIVE-232 at 1/14/09 9:23 PM: - hmm

[jira] Commented: (HIVE-232) metastore.warehouse configuration should use inherited hadoop configuration

2009-01-14 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12664000#action_12664000 ] Joydeep Sen Sarma commented on HIVE-232: hmm - i don't understand this. maybe we need

[jira] Commented: (HIVE-232) metastore.warehouse configuration should use inherited hadoop configuration

2009-01-14 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12664002#action_12664002 ] Joydeep Sen Sarma commented on HIVE-232: it can't default to local file system

[jira] Commented: (HIVE-232) metastore.warehouse configuration should use inherited hadoop configuration

2009-01-15 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12664298#action_12664298 ] Joydeep Sen Sarma commented on HIVE-232: +1 do we have a good explanation for what

[jira] Commented: (HIVE-176) structured log for obtaining query stats/info

2009-01-17 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12664809#action_12664809 ] Joydeep Sen Sarma commented on HIVE-176: looks good for most part. let's get this

[jira] Commented: (HIVE-105) estimate number of required reducers and other map-reduce parameters automatically

2009-01-20 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12665651#action_12665651 ] Joydeep Sen Sarma commented on HIVE-105: 1. If mapred.reduce.tasks is set and not

[jira] Commented: (HIVE-105) estimate number of required reducers and other map-reduce parameters automatically

2009-01-20 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12665668#action_12665668 ] Joydeep Sen Sarma commented on HIVE-105: user would need to override this value in

[jira] Created: (HIVE-241) insert overwrite to directory does not use FileSystem specified by destination URI

2009-01-21 Thread Joydeep Sen Sarma (JIRA)
insert overwrite to directory does not use FileSystem specified by destination URI -- Key: HIVE-241 URL: https://issues.apache.org/jira/browse/HIVE-241 Project: Hadoop

[jira] Commented: (HIVE-248) load data local is not defaulting to 'file' as schema for source path

2009-01-23 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12666832#action_12666832 ] Joydeep Sen Sarma commented on HIVE-248: +1 load data local is not defaulting to

[jira] Updated: (HIVE-248) load data local is not defaulting to 'file' as schema for source path

2009-01-24 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-248: --- Assignee: Prasad Chakka (was: Joydeep Sen Sarma) hey - can u also add a more informative

[jira] Commented: (HIVE-105) estimate number of required reducers and other map-reduce parameters automatically

2009-01-24 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12667051#action_12667051 ] Joydeep Sen Sarma commented on HIVE-105: a few things: - seems like we are missing

[jira] Commented: (HIVE-250) shared memory java dbm for map-side joins

2009-01-25 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12667056#action_12667056 ] Joydeep Sen Sarma commented on HIVE-250: i think we had looked at berkeley db as well

[jira] Commented: (HIVE-250) shared memory java dbm for map-side joins

2009-01-26 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12667351#action_12667351 ] Joydeep Sen Sarma commented on HIVE-250: ok - i guess i was quite off on this. These

[jira] Commented: (HIVE-248) load data local is not defaulting to 'file' as schema for source path

2009-01-26 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12667390#action_12667390 ] Joydeep Sen Sarma commented on HIVE-248: +1 load data local is not defaulting to

[jira] Commented: (HIVE-105) estimate number of required reducers and other map-reduce parameters automatically

2009-01-26 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12667569#action_12667569 ] Joydeep Sen Sarma commented on HIVE-105: i believe we are overriding the

[jira] Commented: (HIVE-252) Automatically add CLUSTER BY and set the number of reducers if the target table is declared with CLUSTERED BY (xxx) INTO yyy BUCKETS

2009-01-26 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12667571#action_12667571 ] Joydeep Sen Sarma commented on HIVE-252: if we are going down this line - this should

[jira] Commented: (HIVE-252) Automatically add CLUSTER BY and set the number of reducers if the target table is declared with CLUSTERED BY (xxx) INTO yyy BUCKETS

2009-01-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12667954#action_12667954 ] Joydeep Sen Sarma commented on HIVE-252: suppose i have ... cluster by a.x insert

[jira] Commented: (HIVE-105) estimate number of required reducers and other map-reduce parameters automatically

2009-01-28 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12668250#action_12668250 ] Joydeep Sen Sarma commented on HIVE-105: still some debug prints in Driver.java?

[jira] Commented: (HIVE-105) estimate number of required reducers and other map-reduce parameters automatically

2009-01-28 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12668299#action_12668299 ] Joydeep Sen Sarma commented on HIVE-105: too late, small nit: the informational

[jira] Commented: (HIVE-256) map side aggregation : number of output rows is same as number of input rows

2009-01-28 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12668310#action_12668310 ] Joydeep Sen Sarma commented on HIVE-256: is this the source of the count(1) issue?

[jira] Commented: (HIVE-256) map side aggregation : number of output rows is same as number of input rows

2009-01-28 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12668334#action_12668334 ] Joydeep Sen Sarma commented on HIVE-256: man - the commits are fast! i had some

[jira] Commented: (HIVE-256) map side aggregation : number of output rows is same as number of input rows

2009-01-28 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12668341#action_12668341 ] Joydeep Sen Sarma commented on HIVE-256: the getSize() call ignores the field

[jira] Commented: (HIVE-263) TCTLSeparatedProtocol should use UTF-8 to decode the data

2009-02-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12669779#action_12669779 ] Joydeep Sen Sarma commented on HIVE-263: we also need to encode using Text i think.

[jira] Commented: (HIVE-263) TCTLSeparatedProtocol should use UTF-8 to decode the data

2009-02-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12669825#action_12669825 ] Joydeep Sen Sarma commented on HIVE-263: +1 the only thing that concerns me is that

[jira] Commented: (HIVE-136) SerDe should escape some special characters

2009-02-05 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670887#action_12670887 ] Joydeep Sen Sarma commented on HIVE-136: sorry for dropping the ball on this: the

[jira] Commented: (HIVE-223) when using map-side aggregates - perform single map-reduce group-by

2009-02-06 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12671052#action_12671052 ] Joydeep Sen Sarma commented on HIVE-223: the parameters make a lot of sense. for #1

[jira] Assigned: (HIVE-131) insert overwrite directory leaves behind uncommitted/tmp files from failed tasks

2009-02-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma reassigned HIVE-131: -- Assignee: Joydeep Sen Sarma insert overwrite directory leaves behind uncommitted/tmp

[jira] Updated: (HIVE-131) insert overwrite directory leaves behind uncommitted/tmp files from failed tasks

2009-02-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-131: --- Status: Patch Available (was: Open) insert overwrite directory leaves behind uncommitted/tmp

[jira] Commented: (HIVE-79) Print number of raws inserted to table(s) when the query is finished.

2009-02-09 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12672035#action_12672035 ] Joydeep Sen Sarma commented on HIVE-79: --- Hey Namit - isn't there a new SemanticAnalyzer

[jira] Commented: (HIVE-79) Print number of raws inserted to table(s) when the query is finished.

2009-02-09 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12672040#action_12672040 ] Joydeep Sen Sarma commented on HIVE-79: --- we should also do this for insert overwrite

[jira] Commented: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-11 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12672764#action_12672764 ] Joydeep Sen Sarma commented on HIVE-270: looks pretty good! for the LazyString

[jira] Updated: (HIVE-131) insert overwrite directory leaves behind uncommitted/tmp files from failed tasks

2009-02-11 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-131: --- Attachment: hive-131.patch.2 Dhruba said: 1. I see that execute returns values 1, 2, and 3.

[jira] Commented: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-15 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12673776#action_12673776 ] Joydeep Sen Sarma commented on HIVE-270: a couple of things i missed in first review:

  1   2   3   4   >