Some wish after serious consideration

Hi all, Having focused on hive for several month, here is some wish of me after serious consideration 1. All auto-gen code for hive was under the facebook commercial version of thrift, which is older than the open source one, would lead to lots of compatible problems and stop from all

Re: Some wish after serious consideration

On 09-7-9 下午2:14, Min Zhou coderp...@gmail.com wrote: Hi all, Having focused on hive for several month, here is some wish of me after serious consideration 1. All auto-gen code for hive was under the facebook commercial version of thrift, which is older than the open source one,

Re: Some wish after serious consideration

But I think no conflicts can be guaranteed, since conflicts are not raised by one patch. If no conflict appears to this patch, then there will be conflicts for other patches. I mean But I think no conflicts can NOT be guaranteed, since conflicts are not raised by one patch. If no conflict

Re: how to write a SerDe

Hi Robert, Hive does support customized file input/output format other than SequenceFile/TextFile. Please take a look at Hive.g which contains the grammar for specifying InputFileFormat and OutputFileFormat. You probably only need a InputFileFormat if you only plan to read from this kind of file.

[jira] Created: (HIVE-618) More human-readable error prompt of FunctionTask

More human-readable error prompt of FunctionTask Key: HIVE-618 URL: https://issues.apache.org/jira/browse/HIVE-618 Project: Hadoop Hive Issue Type: Improvement Reporter: Min Zhou

Re: Some wish after serious consideration

I have been watching HIVE-438 for so long a time, you know that's a critical change almost impact the whole hive source tree, a quick resolve is need. It's understandable human resources of facebook are very nervous, developers there always join several projects at the same time. Therefore, we

Build failed in Hudson: Hive-trunk-h0.17 #148

See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/148/changes Changes: [prasadc] HIVE-593, remove zeroed out file -- [...truncated 14465 lines...] [junit] OK [junit] Loading data to table src_sequencefile [junit] OK [junit]

Build failed in Hudson: Hive-trunk-h0.19 #149

See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/149/changes Changes: [prasadc] HIVE-593, remove zeroed out file -- [...truncated 15825 lines...] [junit] Loading data to table src1 [junit] OK [junit] Loading data to table

[jira] Assigned: (HIVE-527) Inserting into a partitioned table without specifying the partition field should fail

[ https://issues.apache.org/jira/browse/HIVE-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-527: --- Assignee: Yongqiang He Inserting into a partitioned table without specifying the partition field

[jira] Commented: (HIVE-527) Inserting into a partitioned table without specifying the partition field should fail

[ https://issues.apache.org/jira/browse/HIVE-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729298#action_12729298 ] Namit Jain commented on HIVE-527: - The changes looks good - I will commit it if the tests

[jira] Updated: (HIVE-527) Inserting into a partitioned table without specifying the partition field should fail

[ https://issues.apache.org/jira/browse/HIVE-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-527: Status: Patch Available (was: Open) Inserting into a partitioned table without specifying the partition

[jira] Created: (HIVE-619) Change the error messages to something like Class xxxx not found or Class xxxx does not implement UDF, GenericUDF, or UDAF

Change the error messages to something like Class not found or Class does not implement UDF, GenericUDF, or UDAF --- Key: HIVE-619

[jira] Assigned: (HIVE-619) Change the error messages to something like Class xxxx not found or Class xxxx does not implement UDF, GenericUDF, or UDAF

[ https://issues.apache.org/jira/browse/HIVE-619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-619: --- Assignee: Min Zhou Change the error messages to something like Class not found or Class

[jira] Commented: (HIVE-555) create temporary function support not only udf, but also udaf, genericudf, etc.

[ https://issues.apache.org/jira/browse/HIVE-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729305#action_12729305 ] Namit Jain commented on HIVE-555: - Agreed, that is a separate problem which also exists

[jira] Commented: (HIVE-615) new user functions needed for HIVE

[ https://issues.apache.org/jira/browse/HIVE-615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729317#action_12729317 ] Namit Jain commented on HIVE-615: - From the list, it would be useful to support the

[jira] Updated: (HIVE-527) Inserting into a partitioned table without specifying the partition field should fail

[ https://issues.apache.org/jira/browse/HIVE-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-527: Resolution: Fixed Fix Version/s: 0.4.0 Hadoop Flags: [Reviewed] Status: Resolved

[jira] Commented: (HIVE-555) create temporary function support not only udf, but also udaf, genericudf, etc.

[ https://issues.apache.org/jira/browse/HIVE-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729322#action_12729322 ] Namit Jain commented on HIVE-555: - The tests fail right now. In the new test create_udaf.q,

[jira] Created: (HIVE-620) resolver does not pick the right function when more than one function points at it

resolver does not pick the right function when more than one function points at it -- Key: HIVE-620 URL: https://issues.apache.org/jira/browse/HIVE-620 Project: Hadoop

[jira] Commented: (HIVE-555) create temporary function support not only udf, but also udaf, genericudf, etc.

[ https://issues.apache.org/jira/browse/HIVE-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729332#action_12729332 ] Namit Jain commented on HIVE-555: - Confirmed the issue above: filed a new jira for that

[jira] Commented: (HIVE-553) Add BinarySortableSerDe to Hive

[ https://issues.apache.org/jira/browse/HIVE-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729345#action_12729345 ] Namit Jain commented on HIVE-553: - Thats fine. The code changes look good, but the tests are

[jira] Commented: (HIVE-553) Add BinarySortableSerDe to Hive

[ https://issues.apache.org/jira/browse/HIVE-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729346#action_12729346 ] Namit Jain commented on HIVE-553: - Can you add some constants ? like 1/2 for boolean

[jira] Commented: (HIVE-607) Create statistical UDFs.

[ https://issues.apache.org/jira/browse/HIVE-607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729349#action_12729349 ] Namit Jain commented on HIVE-607: - sum() us already supported - we should also add

[jira] Created: (HIVE-621) Inconsistent reporting of null and delimiter across access types

Inconsistent reporting of null and delimiter across access types -- Key: HIVE-621 URL: https://issues.apache.org/jira/browse/HIVE-621 Project: Hadoop Hive Issue Type: Wish

[jira] Updated: (HIVE-553) Add BinarySortableSerDe to Hive

[ https://issues.apache.org/jira/browse/HIVE-553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-553: Attachment: HIVE-553.5.patch The test error was caused by two inner classes inside the new test class. This

[jira] Commented: (HIVE-621) Inconsistent reporting of null and delimiter across access types

[ https://issues.apache.org/jira/browse/HIVE-621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729376#action_12729376 ] Adam Kramer commented on HIVE-621: -- Actually, this behavior appears to have just changed

RE: Some wish after serious consideration

Min, Your feedback is well taken. However, in defence of the team at FB - we have tried to keep the communication as open as possible through the JIRA. Most of the thoughts and design issues are documented there. It is also used a lot as a conversational tool around specific issues. If you are

[jira] Commented: (HIVE-576) complete jdbc driver

[ https://issues.apache.org/jira/browse/HIVE-576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729398#action_12729398 ] Namit Jain commented on HIVE-576: - There are some fundamental issues with this patch. We are

[jira] Updated: (HIVE-553) Add BinarySortableSerDe to Hive

[ https://issues.apache.org/jira/browse/HIVE-553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-553: Attachment: HIVE-553.6.patch This patch fixes all test failures in TestParse. Add BinarySortableSerDe to

[jira] Created: (HIVE-622) Implement reverse UDF

Implement reverse UDF - Key: HIVE-622 URL: https://issues.apache.org/jira/browse/HIVE-622 Project: Hadoop Hive Issue Type: New Feature Components: Query Processor Reporter: Emil Ibrishimov

[jira] Updated: (HIVE-622) Implement reverse UDF

[ https://issues.apache.org/jira/browse/HIVE-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ibrishimov updated HIVE-622: - Attachment: HIVE-622.1.patch This patch adds the reverse UDF and a test for it. Implement

[jira] Created: (HIVE-623) Optimize length and reverse UDFs

Optimize length and reverse UDFs Key: HIVE-623 URL: https://issues.apache.org/jira/browse/HIVE-623 Project: Hadoop Hive Issue Type: Improvement Components: Query Processor Reporter:

[jira] Commented: (HIVE-622) Implement reverse UDF

[ https://issues.apache.org/jira/browse/HIVE-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729449#action_12729449 ] Namit Jain commented on HIVE-622: - can you drop dest1 at the end of the test otherwise, it

[jira] Updated: (HIVE-622) Implement reverse UDF

[ https://issues.apache.org/jira/browse/HIVE-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ibrishimov updated HIVE-622: - Attachment: HIVE-622.2.patch Added drop to udf_reverse.q and to udf_length.q and also changed src

[jira] Updated: (HIVE-553) Add BinarySortableSerDe to Hive

[ https://issues.apache.org/jira/browse/HIVE-553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-553: Resolution: Fixed Fix Version/s: 0.4.0 Hadoop Flags: [Reviewed] Status: Resolved

[jira] Resolved: (HIVE-622) Implement reverse UDF

[ https://issues.apache.org/jira/browse/HIVE-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain resolved HIVE-622. - Resolution: Fixed Fix Version/s: 0.4.0 Hadoop Flags: [Reviewed] Committed. Thanks Emil

[jira] Work started: (HIVE-512) [GenericUDF] new string function ELT(N,str1,str2,str3,...)

[ https://issues.apache.org/jira/browse/HIVE-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-512 started by Min Zhou. [GenericUDF] new string function ELT(N,str1,str2,str3,...) ---

Re: Some wish after serious consideration

It's understandable human resources of facebook are very nervous, very true, they nervous all the time, just kidding :) You are making a good point, that said the Hive facebook team is really one of the better teams out there in terms of progressing the project. -- amr Min Zhou wrote: I