[jira] Issue Comment Edited: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670257#action_12670257 ] zshao edited comment on HIVE-270 at 2/3/09 10:29 PM: -- This SerDe sho

[jira] Updated: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-270: Description: We want to add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with

[jira] Commented: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670257#action_12670257 ] Zheng Shao commented on HIVE-270: - This SerDe should support the quoting (ENCLOSED BY) and es

[jira] Created: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-03 Thread Zheng Shao (JIRA)
Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types Key: HIVE-270 URL: https://issues.apache.org/jira/browse/HIVE

[jira] Updated: (HIVE-269) Add log/exp UDF functions to Hive

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-269: Attachment: HIVE-269.1.patch Although this functionality is new, there is little chance that this transactio

[jira] Updated: (HIVE-269) Add log/exp UDF functions to Hive

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-269: Description: See http://dev.mysql.com/doc/refman/5.0/en/mathematical-functions.html {code} EXP() Raise to

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: HIVE-264.2.patch Reverted logging change. > TBinarySortable Protocol should support null charact

[jira] Commented: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Prasad Chakka (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670250#action_12670250 ] Prasad Chakka commented on HIVE-264: logging is set to debug > TBinarySortable Protocol

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: (was: HIVE-264.1.patch) > TBinarySortable Protocol should support null characters > -

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: HIVE-264.1.patch Replaced special characters in the query output with normal characters. > TBina

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: HIVE-264.1.patch including a testcase with both ^@ and ^A characters. > TBinarySortable Protocol

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: (was: HIVE-264.1.patch) > TBinarySortable Protocol should support null characters > -

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: string.txt string.txt that contains ^@ and ^A > TBinarySortable Protocol should support null cha

[jira] Updated: (HIVE-264) TBinarySortable Protocol should support null characters

2009-02-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-264: Attachment: HIVE-264.1.patch > TBinarySortable Protocol should support null characters >

[jira] Created: (HIVE-269) Add log/exp UDF functions to Hive

2009-02-03 Thread Zheng Shao (JIRA)
Add log/exp UDF functions to Hive - Key: HIVE-269 URL: https://issues.apache.org/jira/browse/HIVE-269 Project: Hadoop Hive Issue Type: New Feature Components: Query Processor Affects Versions: 0.

*UNIT TEST FAILURE for apache HIVE* Hadoop.Version=0.17.1 based on SVN Rev# 740573.43

2009-02-03 Thread Murli Varadachari
[ivy:retrieve] :: resolution report :: resolve 39ms :: artifacts dl 3ms - | |modules|| artifacts | | conf | number| search|dwnlded|evicted|| number|dw

RE: *UNIT TEST FAILURE for apache HIVE* Hadoop.Version=0.17.1 based on SVN Rev# 740524.42

2009-02-03 Thread Ashish Thusoo
looks like this broke with HIVE-30 or that uncovered a latent bug with 0.17. Checking it now... Ashish -Original Message- From: Murli Varadachari [mailto:mvaradach...@facebook.com] Sent: Tuesday, February 03, 2009 4:09 PM To: hive-dev@hadoop.apache.org Subject: *UNIT TEST FAILURE for apa

[jira] Updated: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-262: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) com

[jira] Commented: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670207#action_12670207 ] Ashish Thusoo commented on HIVE-262: +1 looks good to me. I am running the tests right

[jira] Updated: (HIVE-30) Hive web interface

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-30: -- Resolution: Fixed Fix Version/s: (was: 0.2.0) Hadoop Flags: [Reviewed] Status: R

*UNIT TEST FAILURE for apache HIVE* Hadoop.Version=0.17.1 based on SVN Rev# 740524.42

2009-02-03 Thread Murli Varadachari
[ivy:retrieve] :: resolution report :: resolve 51ms :: artifacts dl 2ms - | |modules|| artifacts | | conf | number| search|dwnlded|evicted|| number|dw

[jira] Updated: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-262: Status: Patch Available (was: Open) > outer join gets some duplicate rows in some scenarios > --

[jira] Commented: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670185#action_12670185 ] Namit Jain commented on HIVE-262: - added explains to test > outer join gets some duplicate r

[jira] Updated: (HIVE-189) Various TestCliDriver tests fail

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-189: --- Attachment: patch-189_6.txt Ok. This one should work. The problem was the ordering the sample queries a

[jira] Updated: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-262: Attachment: patch.262.4.txt > outer join gets some duplicate rows in some scenarios > ---

[jira] Updated: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-262: Status: Open (was: Patch Available) > outer join gets some duplicate rows in some scenarios > --

[jira] Commented: (HIVE-30) Hive web interface

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670184#action_12670184 ] Ashish Thusoo commented on HIVE-30: --- +1 Looks good. All the tests run clean. I am going to

[jira] Updated: (HIVE-30) Hive web interface

2009-02-03 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-30: Attachment: hive-30-11.patch This patch properly cleans up files in the test case. Tested with two suc

Re: Eclipse run fails !!

2009-02-03 Thread Prasad Chakka
I think there are multiple issues. Please do the following 1. 'ant clean' in hive directory 2. delete project in eclipse 3. Don't change any config values in hive-site.xml (revert your changes to fs.default.name etc) and don't start HDFS cluster since in unit tests we are working on local

RE: Eclipse run fails !!

2009-02-03 Thread Ashish Thusoo
Actually for running hive through eclipse you don't need to download and start hadoop. Hive tests automatically create a local instance of hdfs and map/reduce and are able to run it. The errors that you are getting seem to indicate some jpox plugins missing in eclipse. Prasad is an expert in th

RE: Eclipse run fails !!

2009-02-03 Thread Shyam Sarkar
Dear Ashish, I downloaded hadoop 0.17.0 and tried bin/start-all.sh script. I got one error :: == [ssar...@ayush2 hadoop-0.17.0]$ bin/start-all.sh starting namenode, logging to /home/ssarkar/hadoop/hadoop-0.17.0/bin/../logs/hadoop-ssarkar

RE: Eclipse run fails !!

2009-02-03 Thread Ashish Thusoo
Hi Shyam, I can certainly say that 0.17.0 should work with eclipse. I have been doing that for a while. Maybe we can concentrate on fixing why you are not able to create a table in hdfs. I am not sure why you could not create the /user/hive/warehouse directory in 0.17. Are you saying that had

[jira] Commented: (HIVE-262) outer join gets some duplicate rows in some scenarios

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670085#action_12670085 ] Ashish Thusoo commented on HIVE-262: can you add explain plans for the new test cases. Ot

RE: Eclipse run fails !!

2009-02-03 Thread Shyam Sarkar
Dear Ashish, For the last few days I tried eclipse 3.4.1 with 0.17.2.1 version and got the same errors with run->run. Then I looked into bin/hive command and found that it could not create table in HDFS. The reason was that I could not create /user/hive/warehouse directory inside HDFS. It was u

[jira] Created: (HIVE-268) "Insert Overwrite Directory" to accept configurable table row format

2009-02-03 Thread Zheng Shao (JIRA)
"Insert Overwrite Directory" to accept configurable table row format Key: HIVE-268 URL: https://issues.apache.org/jira/browse/HIVE-268 Project: Hadoop Hive Issue Type: New

Re: You are now a Hive committer

2009-02-03 Thread Jeff Hammerbacher
Congratulations Prasad! On Tue, Feb 3, 2009 at 10:45 AM, Dhruba Borthakur wrote: > Hello Prasad, > > The Hadoop PMC has voted to make you a committer for the Apache Hive > subproject of Hadoop. To get an account at apache, you have to sign the > ICLA > (http://www.apache.org/licenses/icla.txt)

RE: Eclipse run fails !!

2009-02-03 Thread Ashish Thusoo
Hi Shyam, We have not really tried the eclipse stuff for 0.19.0. Is it possible for you to use 0.17.0 for now, while we figure this out... Ashish -Original Message- From: Shyam Sarkar [mailto:shyam_sar...@yahoo.com] Sent: Tuesday, February 03, 2009 11:26 AM To: hive-dev@hadoop.apache.

[jira] Commented: (HIVE-30) Hive web interface

2009-02-03 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670071#action_12670071 ] Ashish Thusoo commented on HIVE-30: --- looks good to me.. There is one minor thing though tha

Eclipse run fails !!

2009-02-03 Thread Shyam Sarkar
Hello, I have hive project loaded inside eclipse 3.4.1 and hadoop 0.19.0 is running in the background. I could create tables from bin/hive command. But when I try to run->run inside eclipse it says:: "Errors exist with required project(s): hive Proceed with launch ?" and then it gives many er

RE: Build fails for eclipse-templates

2009-02-03 Thread Ashish Thusoo
you need to say eclipse-files that is the ant target.. eclipse-templates is just a directory... Ashish -Original Message- From: Shyam Sarkar [mailto:shyam_sar...@yahoo.com] Sent: Tuesday, February 03, 2009 10:54 AM To: hive-dev@hadoop.apache.org Subject: Build fails for eclipse-templa

Build fails for eclipse-templates

2009-02-03 Thread Shyam Sarkar
Hello, I am a new developer for hive and hadoop. I downloaded hive and hadoop 0.17.2.1 version to test inside eclipse but my test failed. I could not create directory inside HDFS of 0.17.2.1 version but I could do so using 0.19.0 version. So I wanted to try eclipse compile/test with 0.19.0 and

You are now a Hive committer

2009-02-03 Thread Dhruba Borthakur
Hello Prasad, The Hadoop PMC has voted to make you a committer for the Apache Hive subproject of Hadoop. To get an account at apache, you have to sign the ICLA (http://www.apache.org/licenses/icla.txt) and fax it back to the number specified in that document. Congratulations, dhruba

RE: better caching for UDF states in map-side group bys

2009-02-03 Thread Joydeep Sen Sarma
Currently the flush can only flush part of the hashmap (under memory pressure). This makes sense (especially combined with a lfu replacement strategy). So based on this - the free slot management would be necessary. If we can make the serialization fast enough - key serialization could a big wi