[jira] Updated: (HIVE-1600) need to sort hook input/output lists for test result determinism

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1600: - Status: Patch Available (was: Open) Tests passed. > need to sort hook input/output lists for test result

[jira] Assigned: (HIVE-1016) Ability to access DistributedCache from UDFs

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned HIVE-1016: Assignee: Carl Steinbach (was: Namit Jain) > Ability to access DistributedCache from UDFs >

[jira] Commented: (HIVE-1016) Ability to access DistributedCache from UDFs

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903748#action_12903748 ] Carl Steinbach commented on HIVE-1016: -- Yes, I'm working on it. I'll have a patch ready

[jira] Commented: (HIVE-1546) Ability to plug custom Semantic Analyzers for Hive Grammar

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903746#action_12903746 ] John Sichi commented on HIVE-1546: -- More specifically, for the last suggestion, where we cu

[jira] Commented: (HIVE-1546) Ability to plug custom Semantic Analyzers for Hive Grammar

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903738#action_12903738 ] John Sichi commented on HIVE-1546: -- Yes, that is what I was envisioning. I think the inter

[jira] Updated: (HIVE-1600) need to sort hook input/output lists for test result determinism

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1600: - Attachment: HIVE-1600.2.patch Still running through tests on this one. > need to sort hook input/output l

[jira] Assigned: (HIVE-1016) Ability to access DistributedCache from UDFs

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-1016: Assignee: Namit Jain (was: Carl Steinbach) > Ability to access DistributedCache from UDFs > ---

[jira] Updated: (HIVE-1492) FileSinkOperator should remove duplicated files from the same task based on file sizes

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1492: - Fix Version/s: (was: 0.7.0) Affects Version/s: (was: 0.7.0) Component/s:

[jira] Updated: (HIVE-1411) DataNucleus throws NucleusException if core-3.1.1 JAR appears more than once on CLASSPATH

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1411: - Fix Version/s: (was: 0.7.0) > DataNucleus throws NucleusException if core-3.1.1 JAR appears mo

[jira] Updated: (HIVE-1531) Make Hive build work with Ivy versions < 2.1.0

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1531: - Fix Version/s: (was: 0.7.0) > Make Hive build work with Ivy versions < 2.1.0 > ---

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903708#action_12903708 ] Ning Zhang commented on HIVE-1602: -- I agree this will be a big change and we are tossing th

[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1543: - Component/s: Query Processor > set abort in ExecMapper when Hive's record reader got an IOExceptio

[jira] Updated: (HIVE-1307) More generic and efficient merge method

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1307: - Fix Version/s: 0.6.0 (was: 0.7.0) Affects Version/s: (was: 0

[jira] Commented: (HIVE-1016) Ability to access DistributedCache from UDFs

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903707#action_12903707 ] Namit Jain commented on HIVE-1016: -- Carl, are you working on this ? We need this pretty ur

[jira] Updated: (HIVE-1401) Web Interface can ony browse default

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1401: - Fix Version/s: (was: 0.7.0) > Web Interface can ony browse default > -

[jira] Updated: (HIVE-1594) Typo of hive.merge.size.smallfiles.avgsize prevents change of value

2010-08-27 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1594: - Fix Version/s: (was: 0.7.0) Affects Version/s: (was: 0.6.0)

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903692#action_12903692 ] Joydeep Sen Sarma commented on HIVE-1602: - yeah. but i have been asking how you are

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903686#action_12903686 ] Ning Zhang commented on HIVE-1602: -- > insert overwrite table xxx partition (event_class) se

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903672#action_12903672 ] Joydeep Sen Sarma commented on HIVE-1602: - > combining small partitions into one lar

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903664#action_12903664 ] Ning Zhang commented on HIVE-1602: -- @joydeep, this is intended to be an open ended discussi

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903662#action_12903662 ] Namit Jain commented on HIVE-1602: -- I don't think it has anything to do with dynamic partit

[jira] Commented: (HIVE-1546) Ability to plug custom Semantic Analyzers for Hive Grammar

2010-08-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903660#action_12903660 ] Ashutosh Chauhan commented on HIVE-1546: bq. What I was thinking in my previous comm

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903655#action_12903655 ] Joydeep Sen Sarma commented on HIVE-1602: - how will this be made transparent from qu

RE: Deserializing map column via JDBC (HIVE-1378)

2010-08-27 Thread Steven Wong
A related jira is HIVE-1606 (For a null value in a string column, JDBC driver returns the string "NULL"). What happens is the sever-side serde already turns the null into "NULL". Both null and "NULL" are serialized as "NULL"; the client-side serde has no hope. I bring this jira up to point out t

[jira] Commented: (HIVE-1604) Patch to allow variables in Hive

2010-08-27 Thread Vaibhav Aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903645#action_12903645 ] Vaibhav Aggarwal commented on HIVE-1604: I think that introducing a new option '-d'

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903642#action_12903642 ] Namit Jain commented on HIVE-1602: -- For the user to do this today, he will have to duplicat

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903630#action_12903630 ] Joydeep Sen Sarma commented on HIVE-1602: - yikes. how is this queried afterwards? t

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903610#action_12903610 ] Namit Jain commented on HIVE-1602: -- .. we have to generate one directory per distinct DP co

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903608#action_12903608 ] Namit Jain commented on HIVE-1602: -- To clarify more, this is not list partitioning in the t

[jira] Commented: (HIVE-1602) List Partitioning

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903606#action_12903606 ] Joydeep Sen Sarma commented on HIVE-1602: - hmmm - not sure i understand. how can we

[jira] Commented: (HIVE-1600) need to sort hook input/output lists for test result determinism

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903605#action_12903605 ] Namit Jain commented on HIVE-1600: -- ok > need to sort hook input/output lists for test res

[jira] Created: (HIVE-1606) For a null value in a string column, JDBC driver returns the string "NULL"

2010-08-27 Thread Steven Wong (JIRA)
For a null value in a string column, JDBC driver returns the string "NULL" -- Key: HIVE-1606 URL: https://issues.apache.org/jira/browse/HIVE-1606 Project: Hadoop Hive Is

[jira] Commented: (HIVE-1605) regression and improvements in handling NULLs in joins

2010-08-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903584#action_12903584 ] Ning Zhang commented on HIVE-1605: -- Came up with a patch along with some other performance

[jira] Created: (HIVE-1605) regression and improvements in handling NULLs in joins

2010-08-27 Thread Ning Zhang (JIRA)
regression and improvements in handling NULLs in joins -- Key: HIVE-1605 URL: https://issues.apache.org/jira/browse/HIVE-1605 Project: Hadoop Hive Issue Type: Improvement Report

[jira] Commented: (HIVE-1600) need to sort hook input/output lists for test result determinism

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903580#action_12903580 ] John Sichi commented on HIVE-1600: -- Actually it's a pain to change that since a lot of plac

[jira] Commented: (HIVE-1604) Patch to allow variables in Hive

2010-08-27 Thread Vaibhav Aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903570#action_12903570 ] Vaibhav Aggarwal commented on HIVE-1604: Hi I have submitted a patch which allows u

[jira] Updated: (HIVE-1604) Patch to allow variables in Hive

2010-08-27 Thread Vaibhav Aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Aggarwal updated HIVE-1604: --- Attachment: HIVE-1604.patch > Patch to allow variables in Hive > -

[jira] Commented: (HIVE-1467) dynamic partitioning should cluster by partitions

2010-08-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903565#action_12903565 ] Ning Zhang commented on HIVE-1467: -- @Joydeep, I filed HIVE-1602 for the list partitioning.

[jira] Created: (HIVE-1604) Patch to allow variables in Hive

2010-08-27 Thread Vaibhav Aggarwal (JIRA)
Patch to allow variables in Hive Key: HIVE-1604 URL: https://issues.apache.org/jira/browse/HIVE-1604 Project: Hadoop Hive Issue Type: Improvement Components: CLI Reporter: Vaibhav Aggarw

[jira] Updated: (HIVE-1603) support CSV text file format

2010-08-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1603: - Description: Comma Separated Values (CSV) text format are commonly used in exchanging relational data bet

[jira] Created: (HIVE-1603) support CSV text file format

2010-08-27 Thread Ning Zhang (JIRA)
support CSV text file format Key: HIVE-1603 URL: https://issues.apache.org/jira/browse/HIVE-1603 Project: Hadoop Hive Issue Type: New Feature Affects Versions: 0.7.0 Reporter: Ning Zhang Comma S

[jira] Commented: (HIVE-1467) dynamic partitioning should cluster by partitions

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903562#action_12903562 ] Joydeep Sen Sarma commented on HIVE-1467: - @Ning - what about skew? > dynamic parti

[jira] Commented: (HIVE-1600) need to sort hook input/output lists for test result determinism

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903554#action_12903554 ] John Sichi commented on HIVE-1600: -- Will do. I'll keep the sorting during rendering (even

[jira] Updated: (HIVE-1601) Hadoop 0.17 ant test broken by HIVE-1523

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1601: - Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Commit

[jira] Commented: (HIVE-1427) Provide metastore schema migration scripts (0.5 -> 0.6)

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903547#action_12903547 ] John Sichi commented on HIVE-1427: -- Also need script corresponding to this change from HIVE

[jira] Created: (HIVE-1602) List Partitioning

2010-08-27 Thread Ning Zhang (JIRA)
List Partitioning - Key: HIVE-1602 URL: https://issues.apache.org/jira/browse/HIVE-1602 Project: Hadoop Hive Issue Type: New Feature Affects Versions: 0.7.0 Reporter: Ning Zhang Dynamic partition inserts cre

[jira] Commented: (HIVE-1467) dynamic partitioning should cluster by partitions

2010-08-27 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903533#action_12903533 ] Ning Zhang commented on HIVE-1467: -- As discussed with Ashish offline. It seems appropriate

[jira] Updated: (HIVE-1591) Lock the database also as part of locking a table/partition

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1591: - Affects Version/s: 0.7.0 > Lock the database also as part of locking a table/partition > -

[jira] Updated: (HIVE-1591) Lock the database also as part of locking a table/partition

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1591: - Status: Open (was: Patch Available) > Lock the database also as part of locking a table/partition > -

[jira] Commented: (HIVE-1591) Lock the database also as part of locking a table/partition

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903517#action_12903517 ] John Sichi commented on HIVE-1591: -- I applied this patch and tried the following scenario.

Re: Deserializing map column via JDBC (HIVE-1378)

2010-08-27 Thread John Sichi
I don't know enough about the serdes to say whether that's a problem...maybe someone else does? It seems like as long as the JSON form doesn't include the delimiter unescaped, it might work? JVS On Aug 26, 2010, at 6:29 PM, Steven Wong wrote: That sounds like it’ll work, at least conceptually

[jira] Assigned: (HIVE-1570) referencing an added file by it's name in a transform script does not work in hive local mode

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi reassigned HIVE-1570: Assignee: Joydeep Sen Sarma > referencing an added file by it's name in a transform script does not

[jira] Assigned: (HIVE-1467) dynamic partitioning should cluster by partitions

2010-08-27 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-1467: Assignee: Namit Jain > dynamic partitioning should cluster by partitions > -

[jira] Commented: (HIVE-1601) Hadoop 0.17 ant test broken by HIVE-1523

2010-08-27 Thread John Sichi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903484#action_12903484 ] John Sichi commented on HIVE-1601: -- +1. Will commit when tests pass. > Hadoop 0.17 ant t

[jira] Updated: (HIVE-1601) Hadoop 0.17 ant test broken by HIVE-1523

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1601: Attachment: 1601.1.patch ant-contrib-1.0b3.jar - fix the jsp include - don't

[jira] Updated: (HIVE-1601) Hadoop 0.17 ant test broken by HIVE-1523

2010-08-27 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1601: Status: Patch Available (was: Open) > Hadoop 0.17 ant test broken by HIVE-1523 > --