[jira] [Created] (HIVE-3652) Join optimization for star schema

2012-11-01 Thread Amareshwari Sriramadasu (JIRA)
Amareshwari Sriramadasu created HIVE-3652: - Summary: Join optimization for star schema Key: HIVE-3652 URL: https://issues.apache.org/jira/browse/HIVE-3652 Project: Hive Issue Type: Im

Re: Issues building hive

2012-11-01 Thread amareshwari sriramdasu
On which machine, are you building hive? When I built in mac and tried to execute, i got the same problem. It works fine in Linux. On Wed, Oct 31, 2012 at 11:29 PM, Arnab Guin wrote: > Hi, > > I executed the following command on the root directory of the installation > (checked out from SVN). >

[jira] [Commented] (HIVE-1362) column level statistics

2012-11-01 Thread Shreepadma Venugopalan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489276#comment-13489276 ] Shreepadma Venugopalan commented on HIVE-1362: -- @Namit: Thanks for your commen

[jira] [Commented] (HIVE-1362) column level statistics

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489275#comment-13489275 ] Phabricator commented on HIVE-1362: --- shreepadma has commented on the revision "HIVE-1362

[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic

2012-11-01 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3554: --- Attachment: HIVE-3554.patch.11 > Hive List Bucketing - Query logic > -

[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic

2012-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489261#comment-13489261 ] Namit Jain commented on HIVE-3554: -- +1 will commit if tests pass > Hive

[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table

2012-11-01 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: HIVE-3392.Test Case - with_trunk_version.txt Hi Edward Capriolo, I checked the latest versi

[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table

2012-11-01 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: (was: HIVE-3392.Test Case - After Patch.txt) > Hive unnecessarily validates table Se

[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table

2012-11-01 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: (was: HIVE-3392.Test Case - Before Patch.txt) > Hive unnecessarily validates table S

[jira] [Updated] (HIVE-3646) Add 'IGNORE PROTECTION' predicate for dropping partitions

2012-11-01 Thread Andrew Chalfant (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Chalfant updated HIVE-3646: -- Attachment: HIVE-3646.1.patch.txt Patch file > Add 'IGNORE PROTECTION' predicat

[jira] [Updated] (HIVE-3646) Add 'IGNORE PROTECTION' predicate for dropping partitions

2012-11-01 Thread Andrew Chalfant (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Chalfant updated HIVE-3646: -- Release Note: This is a feature which enables us to ignore protection for partitions when droppi

[jira] [Updated] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

2012-11-01 Thread Chris Drome (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Drome updated HIVE-3384: -- Assignee: (was: Chris Drome) > HIVE JDBC module won't compile under JDK1.7 as new methods added

[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic

2012-11-01 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3554: --- Status: Patch Available (was: Open) patch available in attachment and D5955 > Hive L

[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic

2012-11-01 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3554: --- Attachment: HIVE-3554.patch.10 > Hive List Bucketing - Query logic > -

[jira] [Updated] (HIVE-3651) bucketmapjoin?.q tests fail with hadoop 0.23

2012-11-01 Thread Prasad Mujumdar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad Mujumdar updated HIVE-3651: -- Attachment: HIVE-3651-1.patch > bucketmapjoin?.q tests fail with hadoop 0.23 >

[jira] [Updated] (HIVE-3651) bucketmapjoin?.q tests fail with hadoop 0.23

2012-11-01 Thread Prasad Mujumdar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad Mujumdar updated HIVE-3651: -- Status: Patch Available (was: Open) Review request on https://reviews.apache.org/r/7829/

[jira] [Commented] (HIVE-3651) bucketmapjoin? tests fail with hadoop 0.23

2012-11-01 Thread Prasad Mujumdar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489146#comment-13489146 ] Prasad Mujumdar commented on HIVE-3651: --- The problem is similar to HIVE-3257. The has

[jira] [Updated] (HIVE-3651) bucketmapjoin?.q tests fail with hadoop 0.23

2012-11-01 Thread Prasad Mujumdar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad Mujumdar updated HIVE-3651: -- Summary: bucketmapjoin?.q tests fail with hadoop 0.23 (was: bucketmapjoin? tests fail with had

[jira] [Created] (HIVE-3651) bucketmapjoin? tests fail with hadoop 0.23

2012-11-01 Thread Prasad Mujumdar (JIRA)
Prasad Mujumdar created HIVE-3651: - Summary: bucketmapjoin? tests fail with hadoop 0.23 Key: HIVE-3651 URL: https://issues.apache.org/jira/browse/HIVE-3651 Project: Hive Issue Type: Bug A

[jira] [Updated] (HIVE-3649) Hive List Bucketing - enhance DDL to specify list bucketing table

2012-11-01 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3649: --- Affects Version/s: 0.10.0 Summary: Hive List Bucketing - enhance DDL to specify list buc

Hive-trunk-h0.21 - Build # 1769 - Still Failing

2012-11-01 Thread Apache Jenkins Server
Changes for Build #1764 [kevinwilfong] HIVE-3610. Add a command "Explain dependency ..." (Sambavi Muthukrishnan via kevinwilfong) Changes for Build #1765 Changes for Build #1766 [hashutosh] HIVE-3441 : testcases escape1,escape2 fail on windows (Thejas Nair via Ashutosh Chauhan) [kevinwilfong]

[jira] [Created] (HIVE-3650) Hive List Bucketing - validation

2012-11-01 Thread Gang Tim Liu (JIRA)
Gang Tim Liu created HIVE-3650: -- Summary: Hive List Bucketing - validation Key: HIVE-3650 URL: https://issues.apache.org/jira/browse/HIVE-3650 Project: Hive Issue Type: New Feature Affects V

[jira] [Created] (HIVE-3649) Hive List Bucketing - specify list bucketing table

2012-11-01 Thread Gang Tim Liu (JIRA)
Gang Tim Liu created HIVE-3649: -- Summary: Hive List Bucketing - specify list bucketing table Key: HIVE-3649 URL: https://issues.apache.org/jira/browse/HIVE-3649 Project: Hive Issue Type: New Fea

[jira] [Updated] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

2012-11-01 Thread Chris Drome (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Drome updated HIVE-3384: -- Assignee: Chris Drome > HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC >

[jira] [Updated] (HIVE-3640) Reducer allocation is incorrect if enforce bucketing and mapred.reduce.tasks are both set

2012-11-01 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3640: Affects Version/s: 0.10.0 > Reducer allocation is incorrect if enforce bucketing and mapred.redu

[jira] [Updated] (HIVE-3640) Reducer allocation is incorrect if enforce bucketing and mapred.reduce.tasks are both set

2012-11-01 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3640: Component/s: Query Processor > Reducer allocation is incorrect if enforce bucketing and mapred.r

[jira] [Updated] (HIVE-3640) Reducer allocation is incorrect if enforce bucketing and mapred.reduce.tasks are both set

2012-11-01 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-3640: Fix Version/s: 0.10.0 > Reducer allocation is incorrect if enforce bucketing and mapred.reduce.t

[jira] [Commented] (HIVE-3640) Reducer allocation is incorrect if enforce bucketing and mapred.reduce.tasks are both set

2012-11-01 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488962#comment-13488962 ] Kevin Wilfong commented on HIVE-3640: - +1 > Reducer allocation is inco

[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic

2012-11-01 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488954#comment-13488954 ] Gang Tim Liu commented on HIVE-3554: @Mark, It's also not allowed to change skewed col

[jira] [Commented] (HIVE-2693) Add DECIMAL data type

2012-11-01 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488946#comment-13488946 ] Vikram Dixit K commented on HIVE-2693: -- Ok. I will look into this error.

[jira] [Updated] (HIVE-3621) Make prompt in Hive CLI configurable

2012-11-01 Thread Jingwei Lu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingwei Lu updated HIVE-3621: - Attachment: HIVE-3621.patch.1.txt > Make prompt in Hive CLI configurable > ---

[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic

2012-11-01 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488920#comment-13488920 ] Gang Tim Liu commented on HIVE-3554: @Mark, It's not allowed to rename skewed column.

[jira] [Updated] (HIVE-3640) Reducer allocation is incorrect if enforce bucketing and mapred.reduce.tasks are both set

2012-11-01 Thread Vighnesh Avadhani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vighnesh Avadhani updated HIVE-3640: Status: Patch Available (was: Open) > Reducer allocation is incorrect if enforce bucket

[jira] [Commented] (HIVE-3640) Reducer allocation is incorrect if enforce bucketing and mapred.reduce.tasks are both set

2012-11-01 Thread Kevin Wilfong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488862#comment-13488862 ] Kevin Wilfong commented on HIVE-3640: - Couple minor comments on the diff. Could you al

[jira] [Updated] (HIVE-3613) Implement grouping_id function

2012-11-01 Thread Ivan Gorbachev (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Gorbachev updated HIVE-3613: - Status: Patch Available (was: Open) > Implement grouping_id function > --

[jira] [Updated] (HIVE-3613) Implement grouping_id function

2012-11-01 Thread Ivan Gorbachev (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Gorbachev updated HIVE-3613: - Attachment: jira-3613.0.patch > Implement grouping_id function > -

[jira] [Commented] (HIVE-3613) Implement grouping_id function

2012-11-01 Thread Ivan Gorbachev (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488850#comment-13488850 ] Ivan Gorbachev commented on HIVE-3613: -- https://reviews.facebook.net/D6375

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #185

2012-11-01 Thread Apache Jenkins Server
See -- [...truncated 10125 lines...] [echo] Project: odbc [copy] Warning:

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21 #185

2012-11-01 Thread Apache Jenkins Server
See -- [...truncated 10092 lines...] compile-test: [echo] Project: metastore [javac] Compiling 18 source files to

[jira] [Updated] (HIVE-33) [Hive]: Add ability to compute statistics on hive tables

2012-11-01 Thread Tianxu Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianxu Wang updated HIVE-33: Summary: [Hive]: Add ability to compute statistics on hive tables (was: [Hive]: Add ability to compute statis

[jira] [Updated] (HIVE-33) [Hive]: Add ability to compute statistics on hive table

2012-11-01 Thread Tianxu Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianxu Wang updated HIVE-33: Summary: [Hive]: Add ability to compute statistics on hive table (was: [Hive]: Add ability to compute statist

[jira] [Created] (HIVE-3648) HiveMetaStoreFsImpl is not compatible with hadoop viewfs

2012-11-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HIVE-3648: Summary: HiveMetaStoreFsImpl is not compatible with hadoop viewfs Key: HIVE-3648 URL: https://issues.apache.org/jira/browse/HIVE-3648 Project: Hive Issue Type: Bug

Re: number of buckets in bucket map join

2012-11-01 Thread Mark Grover
Hi Mahsa, Just to elaborate a little further. Bucket joins are quicker than regular joins because they lessen the number of logical multiplications that need to happen between the records from two tables being joined. A regular bucket join would logically multiply each row from one table with each

[jira] [Updated] (HIVE-3647) map-side groupby wrongly due to HIVE-3432

2012-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3647: - Status: Patch Available (was: Open) > map-side groupby wrongly due to HIVE-3432 > ---

[jira] [Updated] (HIVE-3570) Add/fix facility to collect operator specific statisticsin hive + add hash-in/hash-out counter for GroupBy Optr

2012-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3570: - Status: Open (was: Patch Available) minor comments > Add/fix facility to collect operato

[jira] [Commented] (HIVE-3570) Add/fix facility to collect operator specific statisticsin hive + add hash-in/hash-out counter for GroupBy Optr

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488552#comment-13488552 ] Phabricator commented on HIVE-3570: --- njain has requested changes to the revision "HIVE-35

[jira] [Commented] (HIVE-3570) Add/fix facility to collect operator specific statisticsin hive + add hash-in/hash-out counter for GroupBy Optr

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488550#comment-13488550 ] Phabricator commented on HIVE-3570: --- njain has accepted the revision "HIVE-3570 [jira] Hi

[jira] [Updated] (HIVE-1362) column level statistics

2012-11-01 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1362: - Status: Open (was: Patch Available) minor comments on phabricator > column level statist

[jira] [Commented] (HIVE-1362) column level statistics

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488546#comment-13488546 ] Phabricator commented on HIVE-1362: --- njain has commented on the revision "HIVE-1362 [jira

[jira] [Commented] (HIVE-1362) column level statistics

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488543#comment-13488543 ] Phabricator commented on HIVE-1362: --- njain has commented on the revision "HIVE-1362 [jira

[jira] [Commented] (HIVE-3570) Add/fix facility to collect operator specific statisticsin hive + add hash-in/hash-out counter for GroupBy Optr

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488530#comment-13488530 ] Phabricator commented on HIVE-3570: --- satadru has commented on the revision "HIVE-3570 [ji

[jira] [Updated] (HIVE-3570) Add/fix facility to collect operator specific statisticsin hive + add hash-in/hash-out counter for GroupBy Optr

2012-11-01 Thread Satadru Pan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satadru Pan updated HIVE-3570: -- Status: Patch Available (was: Open) > Add/fix facility to collect operator specific statisticsin hi

[jira] [Updated] (HIVE-3570) Add/fix facility to collect operator specific statisticsin hive + add hash-in/hash-out counter for GroupBy Optr

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-3570: -- Attachment: HIVE-3570.D5985.7.patch satadru updated the revision "HIVE-3570 [jira] Hive changes for Optr

[jira] [Updated] (HIVE-3570) Add/fix facility to collect operator specific statisticsin hive + add hash-in/hash-out counter for GroupBy Optr

2012-11-01 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-3570: -- Attachment: HIVE-3570.D5985.6.patch satadru updated the revision "HIVE-3570 [jira] Hive changes for Optr