RE: better caching for UDF states in map-side group bys

2009-02-03 Thread Joydeep Sen Sarma
Currently the flush can only flush part of the hashmap (under memory pressure). This makes sense (especially combined with a lfu replacement strategy). So based on this - the free slot management would be necessary. If we can make the serialization fast enough - key serialization could a big

[jira] Commented: (HIVE-30) Hive web interface

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670071#action_12670071 ] Ashish Thusoo commented on HIVE-30: --- looks good to me.. There is one minor thing though

RE: Eclipse run fails !!

2009-02-03 Thread Ashish Thusoo
Hi Shyam, We have not really tried the eclipse stuff for 0.19.0. Is it possible for you to use 0.17.0 for now, while we figure this out... Ashish -Original Message- From: Shyam Sarkar [mailto:shyam_sar...@yahoo.com] Sent: Tuesday, February 03, 2009 11:26 AM To:

RE: Eclipse run fails !!

2009-02-03 Thread Shyam Sarkar
Dear Ashish, For the last few days I tried eclipse 3.4.1 with 0.17.2.1 version and got the same errors with run-run. Then I looked into bin/hive command and found that it could not create table in HDFS. The reason was that I could not create /user/hive/warehouse directory inside HDFS. It was

[jira] Commented: (HIVE-30) Hive web interface

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670184#action_12670184 ] Ashish Thusoo commented on HIVE-30: --- +1 Looks good. All the tests run clean. I am going to

[jira] Updated: (HIVE-189) Various TestCliDriver tests fail

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-189: --- Attachment: patch-189_6.txt Ok. This one should work. The problem was the ordering the sample queries

[jira] Updated: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-262: Attachment: patch.262.4.txt outer join gets some duplicate rows in some scenarios

*UNIT TEST FAILURE for apache HIVE* Hadoop.Version=0.17.1 based on SVN Rev# 740524.42

2009-02-03 Thread Murli Varadachari
[ivy:retrieve] :: resolution report :: resolve 51ms :: artifacts dl 2ms - | |modules|| artifacts | | conf | number| search|dwnlded|evicted||

Build fails for eclipse-templates

2009-02-03 Thread Shyam Sarkar
Hello, I am a new developer for hive and hadoop. I downloaded hive and hadoop 0.17.2.1 version to test inside eclipse but my test failed. I could not create directory inside HDFS of 0.17.2.1 version but I could do so using 0.19.0 version. So I wanted to try eclipse compile/test with 0.19.0 and

[jira] Updated: (HIVE-30) Hive web interface

2009-02-03 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-30: Attachment: hive-30-11.patch This patch properly cleans up files in the test case. Tested with two

[jira] Commented: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670185#action_12670185 ] Namit Jain commented on HIVE-262: - added explains to test outer join gets some duplicate

[jira] Updated: (HIVE-30) Hive web interface

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-30: -- Resolution: Fixed Fix Version/s: (was: 0.2.0) Hadoop Flags: [Reviewed] Status:

RE: Eclipse run fails !!

2009-02-03 Thread Shyam Sarkar
Dear Ashish, I downloaded hadoop 0.17.0 and tried bin/start-all.sh script. I got one error :: == [ssar...@ayush2 hadoop-0.17.0]$ bin/start-all.sh starting namenode, logging to

[jira] Commented: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670207#action_12670207 ] Ashish Thusoo commented on HIVE-262: +1 looks good to me. I am running the tests right

RE: *UNIT TEST FAILURE for apache HIVE* Hadoop.Version=0.17.1 based on SVN Rev# 740524.42

2009-02-03 Thread Ashish Thusoo
looks like this broke with HIVE-30 or that uncovered a latent bug with 0.17. Checking it now... Ashish -Original Message- From: Murli Varadachari [mailto:mvaradach...@facebook.com] Sent: Tuesday, February 03, 2009 4:09 PM To: hive-dev@hadoop.apache.org Subject: *UNIT TEST FAILURE for

*UNIT TEST FAILURE for apache HIVE* Hadoop.Version=0.17.1 based on SVN Rev# 740573.43

2009-02-03 Thread Murli Varadachari
[ivy:retrieve] :: resolution report :: resolve 39ms :: artifacts dl 3ms - | |modules|| artifacts | | conf | number| search|dwnlded|evicted||

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: HIVE-264.1.patch TBinarySortable Protocol should support null characters

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: string.txt string.txt that contains ^@ and ^A TBinarySortable Protocol should support null

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: HIVE-264.1.patch including a testcase with both ^@ and ^A characters. TBinarySortable Protocol

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: (was: HIVE-264.1.patch) TBinarySortable Protocol should support null characters

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: (was: HIVE-264.1.patch) TBinarySortable Protocol should support null characters

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: HIVE-264.1.patch Replaced special characters in the query output with normal characters.

[jira] Commented: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Prasad Chakka (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670250#action_12670250 ] Prasad Chakka commented on HIVE-264: logging is set to debug TBinarySortable Protocol

[jira] Updated: (HIVE-269) Add log/exp UDF functions to Hive

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-269: Attachment: HIVE-269.1.patch Although this functionality is new, there is little chance that this

[jira] Updated: (HIVE-269) Add log/exp UDF functions to Hive

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-269: Description: See http://dev.mysql.com/doc/refman/5.0/en/mathematical-functions.html {code} EXP() Raise to

[jira] Commented: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670257#action_12670257 ] Zheng Shao commented on HIVE-270: - This SerDe should support the quoting (ENCLOSED BY) and

[jira] Updated: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-270: Description: We want to add a lazy-deserialized SerDe for space and cpu efficient serialization of rows

[jira] Issue Comment Edited: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12670257#action_12670257 ] zshao edited comment on HIVE-270 at 2/3/09 10:29 PM: -- This SerDe