[jira] [Commented] (HIVE-2634) revert HIVE-2566
[ https://issues.apache.org/jira/browse/HIVE-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165884#comment-13165884 ] Hudson commented on HIVE-2634: -- Integrated in Hive-trunk-h0.21 #1133 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1133/]) HIVE-2634 [jira] revert HIVE-2566 (Namit Jain via Yongqiang He) Summary: HIVE-2634 This is leading to some problems. I will upload the offending testcase in a new jira. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 651 heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1212182 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRProcContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/union25.q * /hive/trunk/ql/src/test/results/clientpositive/auto_join27.q.out * /hive/trunk/ql/src/test/results/clientpositive/input25.q.out * /hive/trunk/ql/src/test/results/clientpositive/input26.q.out * /hive/trunk/ql/src/test/results/clientpositive/join35.q.out * /hive/trunk/ql/src/test/results/clientpositive/lineage1.q.out * /hive/trunk/ql/src/test/results/clientpositive/load_dyn_part14.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge4.q.out * /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats1.q.out * /hive/trunk/ql/src/test/results/clientpositive/union10.q.out * /hive/trunk/ql/src/test/results/clientpositive/union11.q.out * /hive/trunk/ql/src/test/results/clientpositive/union12.q.out * /hive/trunk/ql/src/test/results/clientpositive/union14.q.out * /hive/trunk/ql/src/test/results/clientpositive/union15.q.out * /hive/trunk/ql/src/test/results/clientpositive/union17.q.out * /hive/trunk/ql/src/test/results/clientpositive/union18.q.out * /hive/trunk/ql/src/test/results/clientpositive/union19.q.out * /hive/trunk/ql/src/test/results/clientpositive/union20.q.out * /hive/trunk/ql/src/test/results/clientpositive/union24.q.out * /hive/trunk/ql/src/test/results/clientpositive/union25.q.out * /hive/trunk/ql/src/test/results/clientpositive/union3.q.out * /hive/trunk/ql/src/test/results/clientpositive/union4.q.out * /hive/trunk/ql/src/test/results/clientpositive/union5.q.out * /hive/trunk/ql/src/test/results/clientpositive/union6.q.out * /hive/trunk/ql/src/test/results/clientpositive/union7.q.out > revert HIVE-2566 > > > Key: HIVE-2634 > URL: https://issues.apache.org/jira/browse/HIVE-2634 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Fix For: 0.8.0, 0.9.0 > > Attachments: HIVE-2634.D651.1.patch, HIVE-2634.D651.2.patch > > > This is leading to some problems. > I will upload the offending testcase in a new jira. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2632) ignore exception for external jars via reflection
[ https://issues.apache.org/jira/browse/HIVE-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165845#comment-13165845 ] Hudson commented on HIVE-2632: -- Integrated in Hive-trunk-h0.23.0 #10 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/10/]) HIVE-2632 [jira] ignore exception for external jars via reflection (Namit Jain via Yongqiang He) Summary: HIVE-2632 Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 639 heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1212231 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java > ignore exception for external jars via reflection > - > > Key: HIVE-2632 > URL: https://issues.apache.org/jira/browse/HIVE-2632 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2632.D639.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2566) reduce the number map-reduce jobs for union all
[ https://issues.apache.org/jira/browse/HIVE-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165797#comment-13165797 ] Hudson commented on HIVE-2566: -- Integrated in Hive-trunk-h0.23.0 #9 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/9/]) HIVE-2634 [jira] revert HIVE-2566 (Namit Jain via Yongqiang He) Summary: HIVE-2634 This is leading to some problems. I will upload the offending testcase in a new jira. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 651 heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1212182 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRProcContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/union25.q * /hive/trunk/ql/src/test/results/clientpositive/auto_join27.q.out * /hive/trunk/ql/src/test/results/clientpositive/input25.q.out * /hive/trunk/ql/src/test/results/clientpositive/input26.q.out * /hive/trunk/ql/src/test/results/clientpositive/join35.q.out * /hive/trunk/ql/src/test/results/clientpositive/lineage1.q.out * /hive/trunk/ql/src/test/results/clientpositive/load_dyn_part14.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge4.q.out * /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats1.q.out * /hive/trunk/ql/src/test/results/clientpositive/union10.q.out * /hive/trunk/ql/src/test/results/clientpositive/union11.q.out * /hive/trunk/ql/src/test/results/clientpositive/union12.q.out * /hive/trunk/ql/src/test/results/clientpositive/union14.q.out * /hive/trunk/ql/src/test/results/clientpositive/union15.q.out * /hive/trunk/ql/src/test/results/clientpositive/union17.q.out * /hive/trunk/ql/src/test/results/clientpositive/union18.q.out * /hive/trunk/ql/src/test/results/clientpositive/union19.q.out * /hive/trunk/ql/src/test/results/clientpositive/union20.q.out * /hive/trunk/ql/src/test/results/clientpositive/union24.q.out * /hive/trunk/ql/src/test/results/clientpositive/union25.q.out * /hive/trunk/ql/src/test/results/clientpositive/union3.q.out * /hive/trunk/ql/src/test/results/clientpositive/union4.q.out * /hive/trunk/ql/src/test/results/clientpositive/union5.q.out * /hive/trunk/ql/src/test/results/clientpositive/union6.q.out * /hive/trunk/ql/src/test/results/clientpositive/union7.q.out > reduce the number map-reduce jobs for union all > --- > > Key: HIVE-2566 > URL: https://issues.apache.org/jira/browse/HIVE-2566 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Namit Jain > Fix For: 0.8.0, 0.9.0 > > Attachments: HIVE-2566.D405.1.patch, HIVE-2566.D405.2.patch, > HIVE-2566.D405.3.patch > > > A query like: > select s.key, s.value from ( > select key, value from src2 where key < 10 > union all > select key, value from src3 where key < 10 > union all > select key, value from src4 where key < 10 > union all > select key, count(1) as value from src5 group by key > )s; > should run the last sub-query > 'select key, count(1) as value from src5 group by key' > as a map-reduce job. > And then the union should be a map-only job reading from the first 3 map-only > subqueries > and the output of the last map-reduce job. > The current plan is very inefficient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2634) revert HIVE-2566
[ https://issues.apache.org/jira/browse/HIVE-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165796#comment-13165796 ] Hudson commented on HIVE-2634: -- Integrated in Hive-trunk-h0.23.0 #9 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/9/]) HIVE-2634 [jira] revert HIVE-2566 (Namit Jain via Yongqiang He) Summary: HIVE-2634 This is leading to some problems. I will upload the offending testcase in a new jira. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 651 heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1212182 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRProcContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/union25.q * /hive/trunk/ql/src/test/results/clientpositive/auto_join27.q.out * /hive/trunk/ql/src/test/results/clientpositive/input25.q.out * /hive/trunk/ql/src/test/results/clientpositive/input26.q.out * /hive/trunk/ql/src/test/results/clientpositive/join35.q.out * /hive/trunk/ql/src/test/results/clientpositive/lineage1.q.out * /hive/trunk/ql/src/test/results/clientpositive/load_dyn_part14.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge4.q.out * /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats1.q.out * /hive/trunk/ql/src/test/results/clientpositive/union10.q.out * /hive/trunk/ql/src/test/results/clientpositive/union11.q.out * /hive/trunk/ql/src/test/results/clientpositive/union12.q.out * /hive/trunk/ql/src/test/results/clientpositive/union14.q.out * /hive/trunk/ql/src/test/results/clientpositive/union15.q.out * /hive/trunk/ql/src/test/results/clientpositive/union17.q.out * /hive/trunk/ql/src/test/results/clientpositive/union18.q.out * /hive/trunk/ql/src/test/results/clientpositive/union19.q.out * /hive/trunk/ql/src/test/results/clientpositive/union20.q.out * /hive/trunk/ql/src/test/results/clientpositive/union24.q.out * /hive/trunk/ql/src/test/results/clientpositive/union25.q.out * /hive/trunk/ql/src/test/results/clientpositive/union3.q.out * /hive/trunk/ql/src/test/results/clientpositive/union4.q.out * /hive/trunk/ql/src/test/results/clientpositive/union5.q.out * /hive/trunk/ql/src/test/results/clientpositive/union6.q.out * /hive/trunk/ql/src/test/results/clientpositive/union7.q.out > revert HIVE-2566 > > > Key: HIVE-2634 > URL: https://issues.apache.org/jira/browse/HIVE-2634 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Fix For: 0.8.0, 0.9.0 > > Attachments: HIVE-2634.D651.1.patch, HIVE-2634.D651.2.patch > > > This is leading to some problems. > I will upload the offending testcase in a new jira. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1003) optimize metadata only queries
[ https://issues.apache.org/jira/browse/HIVE-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165153#comment-13165153 ] Hudson commented on HIVE-1003: -- Integrated in Hive-trunk-h0.21 #1131 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1131/]) HIVE-1003 [jira] optimize metadata only queries (Namit Jain via Yongqiang He) Summary: testing Queries like: select max(ds) from T where ds is a partitioning column should be optimized. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: njain, heyongqiang Differential Revision: 105 heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211767 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/MetaDataFormatUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/partition_schema1.q * /hive/trunk/ql/src/test/results/clientpositive/alter_table_serde.q.out * /hive/trunk/ql/src/test/results/clientpositive/exim_04_evolved_parts.q.out * /hive/trunk/ql/src/test/results/clientpositive/partition_schema1.q.out > optimize metadata only queries > -- > > Key: HIVE-1003 > URL: https://issues.apache.org/jira/browse/HIVE-1003 > Project: Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Namit Jain >Assignee: Marcin Kurczych > Fix For: 0.8.0, 0.9.0 > > Attachments: D105.1.patch, D105.2.patch, HIVE-1003.1.patch, > HIVE-1003.D105.3.patch, hive.1003.2.patch, hive.1003.3.patch, > hive.1003.4.patch > > > Queries like: > select max(ds) from T > where ds is a partitioning column should be optimized. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1003) optimize metadata only queries
[ https://issues.apache.org/jira/browse/HIVE-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165068#comment-13165068 ] Hudson commented on HIVE-1003: -- Integrated in Hive-trunk-h0.23.0 #7 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/7/]) HIVE-1003 [jira] optimize metadata only queries (Namit Jain via Yongqiang He) Summary: testing Queries like: select max(ds) from T where ds is a partitioning column should be optimized. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: njain, heyongqiang Differential Revision: 105 heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211767 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/MetaDataFormatUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/partition_schema1.q * /hive/trunk/ql/src/test/results/clientpositive/alter_table_serde.q.out * /hive/trunk/ql/src/test/results/clientpositive/exim_04_evolved_parts.q.out * /hive/trunk/ql/src/test/results/clientpositive/partition_schema1.q.out > optimize metadata only queries > -- > > Key: HIVE-1003 > URL: https://issues.apache.org/jira/browse/HIVE-1003 > Project: Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Namit Jain >Assignee: Marcin Kurczych > Fix For: 0.8.0, 0.9.0 > > Attachments: D105.1.patch, D105.2.patch, HIVE-1003.1.patch, > HIVE-1003.D105.3.patch, hive.1003.2.patch, hive.1003.3.patch, > hive.1003.4.patch > > > Queries like: > select max(ds) from T > where ds is a partitioning column should be optimized. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2467) HA Support for Metastore Server
[ https://issues.apache.org/jira/browse/HIVE-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164268#comment-13164268 ] Hudson commented on HIVE-2467: -- Integrated in Hive-trunk-h0.21 #1129 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1129/]) HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan) hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211275 Files : * /hive/trunk/shims/ivy.xml * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java * /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java > HA Support for Metastore Server > > > Key: HIVE-2467 > URL: https://issues.apache.org/jira/browse/HIVE-2467 > Project: Hive > Issue Type: Improvement > Components: Metastore, Security, Server Infrastructure >Affects Versions: 0.8.0, 0.9.0 >Reporter: Thomas Weise >Assignee: Thomas Weise > Fix For: 0.9.0 > > Attachments: HIVE-2467.2.patch, HIVE-2467.patch > > > We require HA deployment for metastore server for HCatalog: > * Multiple server instances run behind VIP > * Database provides HA > Metastore server instances will need to be able to share any state required > for VIP outside RDBMS. As of Hive 0.8 affected conversational state that > needs to support VIP/HA setup is limited to current delegation tokens. Is > this correct? > We are planning to use ZooKeeper to share current delegation tokens and > master keys between nodes of the VIP. ZK is already (optionally) used by Hive > for concurrency control. Access to ZK would be limited on the network level > or in the future, when ZooKeeper supports security, through Kerberos, similar > to NN access. > Currently Hive taps into Hadoop core security delegation token support > through extension of > org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager > A solution could amend the Hive specific extension to support: > * Pluggable delegation token and master key store (ZooKeeper as alternative > for in-memory AbstractDelegationTokenSecretManager) > * Delegation token retrieval from token store when not found in memory > (wrap/extend retrievePassword(...)) > * Cancellation of token in token store > * Purging of expired tokens from token store > http://www.mail-archive.com/hcatalog-user@incubator.apache.org/msg00053.html -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2622) Hive POMs reference the wrong Hadoop artifacts
[ https://issues.apache.org/jira/browse/HIVE-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164269#comment-13164269 ] Hudson commented on HIVE-2622: -- Integrated in Hive-trunk-h0.21 #1129 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1129/]) HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan) hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211271 Files : * /hive/trunk/cli/ivy.xml * /hive/trunk/common/ivy.xml * /hive/trunk/contrib/ivy.xml * /hive/trunk/hbase-handler/ivy.xml * /hive/trunk/hwi/ivy.xml * /hive/trunk/metastore/ivy.xml * /hive/trunk/ql/ivy.xml * /hive/trunk/serde/ivy.xml * /hive/trunk/shims/ivy.xml > Hive POMs reference the wrong Hadoop artifacts > -- > > Key: HIVE-2622 > URL: https://issues.apache.org/jira/browse/HIVE-2622 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2622.1.patch.txt, HIVE-2622.D633.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2362) HiveConf properties not appearing in the output of 'set' or 'set -v'
[ https://issues.apache.org/jira/browse/HIVE-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164171#comment-13164171 ] Hudson commented on HIVE-2362: -- Integrated in Hive-trunk-h0.21 #1128 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1128/]) HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v' (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211261 Files : * /hive/trunk/build-common.xml * /hive/trunk/common/build.xml * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/common/src/test * /hive/trunk/common/src/test/org * /hive/trunk/common/src/test/org/apache * /hive/trunk/common/src/test/org/apache/hadoop * /hive/trunk/common/src/test/org/apache/hadoop/hive * /hive/trunk/common/src/test/org/apache/hadoop/hive/conf * /hive/trunk/common/src/test/org/apache/hadoop/hive/conf/TestHiveConf.java * /hive/trunk/common/src/test/resources * /hive/trunk/common/src/test/resources/hive-site.xml * /hive/trunk/conf/hive-default.xml * /hive/trunk/eclipse-templates/.classpath > HiveConf properties not appearing in the output of 'set' or 'set -v' > > > Key: HIVE-2362 > URL: https://issues.apache.org/jira/browse/HIVE-2362 > Project: Hive > Issue Type: Bug > Components: CLI, Configuration >Reporter: Carl Steinbach >Assignee: Carl Steinbach >Priority: Blocker > Fix For: 0.9.0 > > Attachments: HIVE-2362.1.patch.txt, HIVE-2362.2.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2630) TestHiveServer doesn't produce a JUnit report file
[ https://issues.apache.org/jira/browse/HIVE-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164172#comment-13164172 ] Hudson commented on HIVE-2630: -- Integrated in Hive-trunk-h0.21 #1128 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1128/]) HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file (Marek Sapota via John Sichi) Summary: Remove property overrides Run `ant test Dtestcase=TestHiveServer && ant testreport`, the test report will be empty because not 'TEST*.xml' file was produced by JUnit. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 621 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211265 Files : * /hive/trunk/service/build.xml > TestHiveServer doesn't produce a JUnit report file > -- > > Key: HIVE-2630 > URL: https://issues.apache.org/jira/browse/HIVE-2630 > Project: Hive > Issue Type: Bug >Reporter: Marek Sapota >Assignee: Marek Sapota > Fix For: 0.9.0 > > Attachments: HIVE-2630.D621.1.patch > > > Run `ant test --Dtestcase=TestHiveServer && ant testreport`, the test report > will be empty because not 'TEST--*.xml' file was produced by JUnit. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2622) Hive POMs reference the wrong Hadoop artifacts
[ https://issues.apache.org/jira/browse/HIVE-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164114#comment-13164114 ] Hudson commented on HIVE-2622: -- Integrated in Hive-trunk-h0.23.0 #5 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/5/]) HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan) hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211271 Files : * /hive/trunk/cli/ivy.xml * /hive/trunk/common/ivy.xml * /hive/trunk/contrib/ivy.xml * /hive/trunk/hbase-handler/ivy.xml * /hive/trunk/hwi/ivy.xml * /hive/trunk/metastore/ivy.xml * /hive/trunk/ql/ivy.xml * /hive/trunk/serde/ivy.xml * /hive/trunk/shims/ivy.xml > Hive POMs reference the wrong Hadoop artifacts > -- > > Key: HIVE-2622 > URL: https://issues.apache.org/jira/browse/HIVE-2622 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2622.1.patch.txt, HIVE-2622.D633.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2467) HA Support for Metastore Server
[ https://issues.apache.org/jira/browse/HIVE-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164113#comment-13164113 ] Hudson commented on HIVE-2467: -- Integrated in Hive-trunk-h0.23.0 #5 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/5/]) HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan) hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211275 Files : * /hive/trunk/shims/ivy.xml * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/security/token/delegation/HiveDelegationTokenSupport.java * /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java > HA Support for Metastore Server > > > Key: HIVE-2467 > URL: https://issues.apache.org/jira/browse/HIVE-2467 > Project: Hive > Issue Type: Improvement > Components: Metastore, Security, Server Infrastructure >Affects Versions: 0.8.0, 0.9.0 >Reporter: Thomas Weise >Assignee: Thomas Weise > Fix For: 0.9.0 > > Attachments: HIVE-2467.2.patch, HIVE-2467.patch > > > We require HA deployment for metastore server for HCatalog: > * Multiple server instances run behind VIP > * Database provides HA > Metastore server instances will need to be able to share any state required > for VIP outside RDBMS. As of Hive 0.8 affected conversational state that > needs to support VIP/HA setup is limited to current delegation tokens. Is > this correct? > We are planning to use ZooKeeper to share current delegation tokens and > master keys between nodes of the VIP. ZK is already (optionally) used by Hive > for concurrency control. Access to ZK would be limited on the network level > or in the future, when ZooKeeper supports security, through Kerberos, similar > to NN access. > Currently Hive taps into Hadoop core security delegation token support > through extension of > org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager > A solution could amend the Hive specific extension to support: > * Pluggable delegation token and master key store (ZooKeeper as alternative > for in-memory AbstractDelegationTokenSecretManager) > * Delegation token retrieval from token store when not found in memory > (wrap/extend retrievePassword(...)) > * Cancellation of token in token store > * Purging of expired tokens from token store > http://www.mail-archive.com/hcatalog-user@incubator.apache.org/msg00053.html -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2362) HiveConf properties not appearing in the output of 'set' or 'set -v'
[ https://issues.apache.org/jira/browse/HIVE-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164081#comment-13164081 ] Hudson commented on HIVE-2362: -- Integrated in Hive-trunk-h0.23.0 #4 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/4/]) HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v' (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211261 Files : * /hive/trunk/build-common.xml * /hive/trunk/common/build.xml * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/common/src/test * /hive/trunk/common/src/test/org * /hive/trunk/common/src/test/org/apache * /hive/trunk/common/src/test/org/apache/hadoop * /hive/trunk/common/src/test/org/apache/hadoop/hive * /hive/trunk/common/src/test/org/apache/hadoop/hive/conf * /hive/trunk/common/src/test/org/apache/hadoop/hive/conf/TestHiveConf.java * /hive/trunk/common/src/test/resources * /hive/trunk/common/src/test/resources/hive-site.xml * /hive/trunk/conf/hive-default.xml * /hive/trunk/eclipse-templates/.classpath > HiveConf properties not appearing in the output of 'set' or 'set -v' > > > Key: HIVE-2362 > URL: https://issues.apache.org/jira/browse/HIVE-2362 > Project: Hive > Issue Type: Bug > Components: CLI, Configuration >Reporter: Carl Steinbach >Assignee: Carl Steinbach >Priority: Blocker > Fix For: 0.9.0 > > Attachments: HIVE-2362.1.patch.txt, HIVE-2362.2.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2630) TestHiveServer doesn't produce a JUnit report file
[ https://issues.apache.org/jira/browse/HIVE-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164082#comment-13164082 ] Hudson commented on HIVE-2630: -- Integrated in Hive-trunk-h0.23.0 #4 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/4/]) HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file (Marek Sapota via John Sichi) Summary: Remove property overrides Run `ant test Dtestcase=TestHiveServer && ant testreport`, the test report will be empty because not 'TEST*.xml' file was produced by JUnit. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 621 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1211265 Files : * /hive/trunk/service/build.xml > TestHiveServer doesn't produce a JUnit report file > -- > > Key: HIVE-2630 > URL: https://issues.apache.org/jira/browse/HIVE-2630 > Project: Hive > Issue Type: Bug >Reporter: Marek Sapota >Assignee: Marek Sapota > Fix For: 0.9.0 > > Attachments: HIVE-2630.D621.1.patch > > > Run `ant test --Dtestcase=TestHiveServer && ant testreport`, the test report > will be empty because not 'TEST--*.xml' file was produced by JUnit. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2625) Fix maven-build Ant target
[ https://issues.apache.org/jira/browse/HIVE-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163353#comment-13163353 ] Hudson commented on HIVE-2625: -- Integrated in Hive-trunk-h0.21 #1126 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1126/]) HIVE-2625. Fix maven-build Ant target (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1210665 Files : * /hive/trunk/build.xml > Fix maven-build Ant target > -- > > Key: HIVE-2625 > URL: https://issues.apache.org/jira/browse/HIVE-2625 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Attachments: HIVE-2625.1.patch.txt > > > This was broken by HIVE-2523. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2523) add a new builtins subproject
[ https://issues.apache.org/jira/browse/HIVE-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163234#comment-13163234 ] Hudson commented on HIVE-2523: -- Integrated in Hive-trunk-h0.21 #1125 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1125/]) Fix eclipse classpath template broken in HIVE-2523. (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1210599 Files : * /hive/trunk/eclipse-templates/.classpath > add a new builtins subproject > - > > Key: HIVE-2523 > URL: https://issues.apache.org/jira/browse/HIVE-2523 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: John Sichi >Assignee: John Sichi > Fix For: 0.9.0 > > Attachments: D267.1.patch, D267.2.patch, HIVE-2523.D267.3.patch, > HIVE-2523.D267.4.patch > > > Now that we have a PDK, we can make it easier to add builtin functions to > Hive by putting them in a plugin which automatically gets loaded by Hive. > This issue will add the necessary framework and one example function; then > new functions can be added here, and over time we could migrate old ones here > if desired. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2625) Fix maven-build Ant target
[ https://issues.apache.org/jira/browse/HIVE-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163171#comment-13163171 ] Hudson commented on HIVE-2625: -- Integrated in Hive-trunk-h0.23.0 #2 (See [https://builds.apache.org/job/Hive-trunk-h0.23.0/2/]) HIVE-2625. Fix maven-build Ant target (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1210665 Files : * /hive/trunk/build.xml > Fix maven-build Ant target > -- > > Key: HIVE-2625 > URL: https://issues.apache.org/jira/browse/HIVE-2625 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Attachments: HIVE-2625.1.patch.txt > > > This was broken by HIVE-2523. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2607) Add caching to json_tuple
[ https://issues.apache.org/jira/browse/HIVE-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162020#comment-13162020 ] Hudson commented on HIVE-2607: -- Integrated in Hive-trunk-h0.21 #1121 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1121/]) Hive-2607: Add caching to json_tuple (Kevin Wilfong via He Yongqiang) > Add caching to json_tuple > - > > Key: HIVE-2607 > URL: https://issues.apache.org/jira/browse/HIVE-2607 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2607.1.patch.txt, HIVE-2607.D543.1.patch > > > get_json_object uses a variety of caches to improve its performance. > json_tuple could benefit from having a similar cache from JSON string to > JSONObject. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2523) add a new builtins subproject
[ https://issues.apache.org/jira/browse/HIVE-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161642#comment-13161642 ] Hudson commented on HIVE-2523: -- Integrated in Hive-trunk-h0.21 #1119 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1119/]) HIVE-2523. Add a new builtins subproject (John Sichi via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209384 Files : * /hive/trunk/bin/hive * /hive/trunk/build.xml * /hive/trunk/builtins * /hive/trunk/builtins/build-plugin.xml * /hive/trunk/builtins/build.xml * /hive/trunk/builtins/ivy.xml * /hive/trunk/builtins/src * /hive/trunk/builtins/src/org * /hive/trunk/builtins/src/org/apache * /hive/trunk/builtins/src/org/apache/hive * /hive/trunk/builtins/src/org/apache/hive/builtins * /hive/trunk/builtins/src/org/apache/hive/builtins/BuiltinUtils.java * /hive/trunk/builtins/src/org/apache/hive/builtins/UDAFUnionMap.java * /hive/trunk/builtins/test * /hive/trunk/builtins/test/cleanup.sql * /hive/trunk/builtins/test/iris.txt * /hive/trunk/builtins/test/onerow.txt * /hive/trunk/builtins/test/setup.sql * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/pdk/scripts/build-plugin.xml * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java * /hive/trunk/ql/src/test/results/clientpositive/show_functions.q.out > add a new builtins subproject > - > > Key: HIVE-2523 > URL: https://issues.apache.org/jira/browse/HIVE-2523 > Project: Hive > Issue Type: Improvement > Components: UDF >Reporter: John Sichi >Assignee: John Sichi > Fix For: 0.9.0 > > Attachments: D267.1.patch, D267.2.patch, HIVE-2523.D267.3.patch, > HIVE-2523.D267.4.patch > > > Now that we have a PDK, we can make it easier to add builtin functions to > Hive by putting them in a plugin which automatically gets loaded by Hive. > This issue will add the necessary framework and one example function; then > new functions can be added here, and over time we could migrate old ones here > if desired. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2619) Add hook to run in metastore's endFunction which can collect more fb303 counters
[ https://issues.apache.org/jira/browse/HIVE-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161453#comment-13161453 ] Hudson commented on HIVE-2619: -- Integrated in Hive-trunk-h0.21 #1118 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1118/]) HIVE-2619 Add hook to run in metastore's endFunction which can collect more fb303 counters (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209368 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEndFunctionContext.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEndFunctionListener.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java > Add hook to run in metastore's endFunction which can collect more fb303 > counters > > > Key: HIVE-2619 > URL: https://issues.apache.org/jira/browse/HIVE-2619 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2619.1.patch.txt, HIVE-2619.D555.1.patch, > HIVE-2619.D555.2.patch, HIVE-2619.D561.1.patch > > > Create the potential for hooks to run in the endFunction method of HMSHandler > which take the name of a function and whether or not it succeeded. Also, > override getCounters from fb303 to allow these hooks to add counters which > they collect, should this be desired. These hooks can be similar to > EventListeners, but they should be more generic. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2253) Merge failing of join tree in exceptional case
[ https://issues.apache.org/jira/browse/HIVE-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161334#comment-13161334 ] Hudson commented on HIVE-2253: -- Integrated in Hive-trunk-h0.21 #1117 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1117/]) HIVE-2253. Merge failing of join tree in exceptional case (Navis Ryu via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1209226 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientpositive/mergejoins.q * /hive/trunk/ql/src/test/results/clientpositive/mergejoins.q.out > Merge failing of join tree in exceptional case > -- > > Key: HIVE-2253 > URL: https://issues.apache.org/jira/browse/HIVE-2253 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.9.0 > Environment: hadoop 0.20.2, hive 0.7.0 >Reporter: Navis >Assignee: Navis >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2253-0.8.0.patch, HIVE-2253.1.patch.txt > > > In some very exceptional cases, SemanticAnayzer fails to merge join tree. > Example is below. > create table a (val1 int, val2 int) > create table b (val1 int, val2 int) > create table c (val1 int, val2 int) > create table d (val1 int, val2 int) > create table e (val1 int, val2 int) > 1. all same(single) join key --> one MR, good > select * from a join b on a.val1=b.val1 join c on a.val1=c.val1 join d on > a.val1=d.val1 join e on a.val1=e.val1 > 2. two join keys --> expected to have two MR, but resulted to three MR > select * from a join b on a.val1=b.val1 join c on a.val1=c.val1 join d on > a.val1=d.val1 join e on a.val2=e.val2 > 3. by changing the join order, we could attain two MR as first-expectation. > select * from a join e on a.val2=e.val2 join c on a.val1=c.val1 join d on > a.val1=d.val1 join b on a.val1=b.val1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2468) Make Hive compile against Hadoop 0.23
[ https://issues.apache.org/jira/browse/HIVE-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13160712#comment-13160712 ] Hudson commented on HIVE-2468: -- Integrated in Hive-trunk-h0.21 #1115 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1115/]) HIVE-2468. Make Hive compile against Hadoop 0.23 (Tom White via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1208940 Files : * /hive/trunk/bin/hive * /hive/trunk/build-common.xml * /hive/trunk/build.properties * /hive/trunk/build.xml * /hive/trunk/conf/hive-default.xml * /hive/trunk/contrib/build.xml * /hive/trunk/hbase-handler/build.xml * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableOutputFormat.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHFileOutputFormat.java * /hive/trunk/hwi/build.xml * /hive/trunk/jdbc/build.xml * /hive/trunk/ql/build.xml * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JobTrackerURLResolver.java * /hive/trunk/service/build.xml * /hive/trunk/service/src/java/org/apache/hadoop/hive/service/HiveServer.java * /hive/trunk/shims/build.xml * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java * /hive/trunk/shims/src/0.23 * /hive/trunk/shims/src/0.23/java * /hive/trunk/shims/src/0.23/java/org * /hive/trunk/shims/src/0.23/java/org/apache * /hive/trunk/shims/src/0.23/java/org/apache/hadoop * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Jetty23Shims.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier23.java * /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/thrift/DelegationTokenSelector23.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/fs * /hive/trunk/shims/src/common/java/org/apache/hadoop/fs/ProxyFileSystem.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/ShimLoader.java > Make Hive compile against Hadoop 0.23 > - > > Key: HIVE-2468 > URL: https://issues.apache.org/jira/browse/HIVE-2468 > Project: Hive > Issue Type: Task >Reporter: Konstantin Shvachko >Assignee: Carl Steinbach > Fix For: 0.8.0, 0.9.0 > > Attachments: HIVE-2468.patch, HIVE-2468.patch, HIVE-2468.patch, > HIVE-2468.patch, HIVE-2468.patch > > > Due to restructure of Hadoop 0.22 branch compared to Hadoop 0.20 Hive does > not compile against 0.22 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2613) HiveCli eclipse launch configuration hangs
[ https://issues.apache.org/jira/browse/HIVE-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159896#comment-13159896 ] Hudson commented on HIVE-2613: -- Integrated in Hive-trunk-h0.21 #1113 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1113/]) HIVE-2613. HiveCli eclipse launch configuration hangs (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1208228 Files : * /hive/trunk/common/src/java/conf/hive-log4j.properties * /hive/trunk/eclipse-templates/HiveCLI.launchtemplate > HiveCli eclipse launch configuration hangs > -- > > Key: HIVE-2613 > URL: https://issues.apache.org/jira/browse/HIVE-2613 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2613.1.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2561) Allow UDFs to specify additional FILE/JAR resources necessary for execution
[ https://issues.apache.org/jira/browse/HIVE-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159806#comment-13159806 ] Hudson commented on HIVE-2561: -- Integrated in Hive-trunk-h0.21 #1112 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1112/]) HIVE-2561 [jira] Add an annotation to UDFs to allow them to specify additional FILE/JAR resources necessary for execution Summary: Add requirements. Often times UDFs will have dependencies to external JARs/FILEs. It makes sense for these to be encoded by the UDF (rather than having the caller remember the set of files that need to be ADDed). Let's add an annotation to UDFs which will cause these resources to be auto-added. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: jsichi, jonchang, atfiore Differential Revision: 507 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1208075 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/UDF.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFBridge.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFInFile.java * /hive/trunk/ql/src/test/queries/clientpositive/udf_in_file.q * /hive/trunk/ql/src/test/results/clientpositive/show_functions.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_in_file.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorUtils.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorUtils.java > Allow UDFs to specify additional FILE/JAR resources necessary for execution > --- > > Key: HIVE-2561 > URL: https://issues.apache.org/jira/browse/HIVE-2561 > Project: Hive > Issue Type: New Feature >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Fix For: 0.9.0 > > Attachments: HIVE-2561.D507.1.patch, HIVE-2561.D507.2.patch, > HIVE-2561.D507.2.patch, HIVE-2561.D507.3.patch > > > Often times UDFs will have dependencies to external JARs/FILEs. It makes > sense for these to be encoded by the UDF (rather than having the caller > remember the set of files that need to be ADDed). Let's add an annotation to > UDFs which will cause these resources to be auto-added. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2571) eclipse template .classpath is broken
[ https://issues.apache.org/jira/browse/HIVE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159126#comment-13159126 ] Hudson commented on HIVE-2571: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #114 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/114/]) HIVE-2571. eclipse template .classpath is broken (Robert Surówka via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1207734 Files : * /hive/branches/branch-0.8/eclipse-templates/.classpath > eclipse template .classpath is broken > - > > Key: HIVE-2571 > URL: https://issues.apache.org/jira/browse/HIVE-2571 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Minor > Fix For: 0.8.0 > > Attachments: HIVE-2571.1.patch, HIVE-2571.2.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2605) Setting no_drop on a table should cascade to child partitions
[ https://issues.apache.org/jira/browse/HIVE-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159104#comment-13159104 ] Hudson commented on HIVE-2605: -- Integrated in Hive-trunk-h0.21 #1110 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1110/]) HIVE-2605: Setting no_drop on a table should cascade to child partitions (namit via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1207701 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ProtectMode.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Partition.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java * /hive/trunk/ql/src/test/queries/clientnegative/protectmode_tbl6.q * /hive/trunk/ql/src/test/queries/clientnegative/protectmode_tbl7.q * /hive/trunk/ql/src/test/queries/clientnegative/protectmode_tbl8.q * /hive/trunk/ql/src/test/queries/clientpositive/protectmode2.q * /hive/trunk/ql/src/test/results/clientnegative/protectmode_tbl6.q.out * /hive/trunk/ql/src/test/results/clientnegative/protectmode_tbl7.q.out * /hive/trunk/ql/src/test/results/clientnegative/protectmode_tbl8.q.out * /hive/trunk/ql/src/test/results/clientpositive/protectmode2.q.out > Setting no_drop on a table should cascade to child partitions > - > > Key: HIVE-2605 > URL: https://issues.apache.org/jira/browse/HIVE-2605 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2605.D525.1.patch > > > When NO_DROP is set on a table, it does not cascade to the partitions of the > table. There should be an option to do so. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2593) avoid referencing /tmp in tests
[
https://issues.apache.org/jira/browse/HIVE-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155752#comment-13155752
]
Hudson commented on HIVE-2593:
--
Integrated in Hive-trunk-h0.21 #1103 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1103/])
HIVE-2593 [jira] avoid referencing /tmp in tests
Summary:
Replaced '/tmp' with '${system:test.tmp.dir}' in all q files.
This is what is causing parallel tests to fail when multiple instances run on
the same node. I grepped for "/tmp" in ql/src/test/queries/clientpositive and
the results match the test failures I'm getting.
Test Plan: EMPTY
Reviewers: JIRA, jsichi
Reviewed By: jsichi
CC: mareksapotafb, jsichi
Differential Revision: 501
jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1205285
Files :
* /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java
*
/hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyContentSummaryCacheHook.java
* /hive/trunk/ql/src/test/queries/clientnegative/archive_multi7.q
* /hive/trunk/ql/src/test/queries/clientnegative/duplicate_insert3.q
* /hive/trunk/ql/src/test/queries/clientnegative/index_compact_entry_limit.q
* /hive/trunk/ql/src/test/queries/clientnegative/index_compact_size_limit.q
* /hive/trunk/ql/src/test/queries/clientpositive/hook_context_cs.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_auto.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_bitmap.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_bitmap1.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_bitmap2.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_bitmap3.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_bitmap_auto.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_bitmap_rc.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_compact.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_compact_1.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_compact_2.q
* /hive/trunk/ql/src/test/queries/clientpositive/index_compact_3.q
* /hive/trunk/ql/src/test/queries/clientpositive/insertexternal1.q
* /hive/trunk/ql/src/test/queries/clientpositive/load_fs.q
* /hive/trunk/ql/src/test/queries/clientpositive/multi_insert.q
> avoid referencing /tmp in tests
> ---
>
> Key: HIVE-2593
> URL: https://issues.apache.org/jira/browse/HIVE-2593
> Project: Hive
> Issue Type: Improvement
> Components: Testing Infrastructure
>Reporter: John Sichi
>Assignee: Marek Sapota
> Fix For: 0.9.0
>
> Attachments: HIVE-2593.D501.1.patch, HIVE-2593.D501.2.patch,
> HIVE-2593.D501.3.patch, HIVE-2593.D501.4.patch, HIVE-2593.D501.5.patch,
> HIVE-2593.D501.6.patch, HIVE-2593.D501.7.patch, HIVE-2593.D501.8.patch,
> HIVE-2593.D501.8.patch
>
>
> This is what is causing parallel tests to fail when multiple instances run on
> the same node. I grepped for "/tmp" in ql/src/test/queries/clientpositive
> and the results match the test failures I'm getting.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2598) Update README.txt file to use description from wiki
[ https://issues.apache.org/jira/browse/HIVE-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153416#comment-13153416 ] Hudson commented on HIVE-2598: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #103 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/103/]) HIVE-2598. Update README.txt file to use description from wiki (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203886 Files : * /hive/branches/branch-0.8/README.txt > Update README.txt file to use description from wiki > --- > > Key: HIVE-2598 > URL: https://issues.apache.org/jira/browse/HIVE-2598 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.8.0 > > Attachments: HIVE-2598.1.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2552) Omit incomplete Postgres upgrade scripts from release tarball
[ https://issues.apache.org/jira/browse/HIVE-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153400#comment-13153400 ] Hudson commented on HIVE-2552: -- Integrated in Hive-trunk-h0.21 #1098 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1098/]) HIVE-2552. Omit incomplete Postgres upgrade scripts from release tarball (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203843 Files : * /hive/trunk/build.xml > Omit incomplete Postgres upgrade scripts from release tarball > - > > Key: HIVE-2552 > URL: https://issues.apache.org/jira/browse/HIVE-2552 > Project: Hive > Issue Type: Task > Components: Build Infrastructure, Metastore >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.8.0 > > Attachments: HIVE-2552.1.patch.txt > > > The Postgres metastore upgrade scripts are not officially supported, and at > this point are incomplete. We should not include them in the release > artifacts. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2598) Update README.txt file to use description from wiki
[ https://issues.apache.org/jira/browse/HIVE-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153399#comment-13153399 ] Hudson commented on HIVE-2598: -- Integrated in Hive-trunk-h0.21 #1098 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1098/]) HIVE-2598. Update README.txt file to use description from wiki (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203885 Files : * /hive/trunk/README.txt > Update README.txt file to use description from wiki > --- > > Key: HIVE-2598 > URL: https://issues.apache.org/jira/browse/HIVE-2598 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.8.0 > > Attachments: HIVE-2598.1.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2552) Omit incomplete Postgres upgrade scripts from release tarball
[ https://issues.apache.org/jira/browse/HIVE-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153360#comment-13153360 ] Hudson commented on HIVE-2552: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #102 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/102/]) HIVE-2552. Omit incomplete Postgres upgrade scripts from release tarball (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203844 Files : * /hive/branches/branch-0.8/build.xml > Omit incomplete Postgres upgrade scripts from release tarball > - > > Key: HIVE-2552 > URL: https://issues.apache.org/jira/browse/HIVE-2552 > Project: Hive > Issue Type: Task > Components: Build Infrastructure, Metastore >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.8.0 > > Attachments: HIVE-2552.1.patch.txt > > > The Postgres metastore upgrade scripts are not officially supported, and at > this point are incomplete. We should not include them in the release > artifacts. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2569) Too much debugging info on console if a job failed
[ https://issues.apache.org/jira/browse/HIVE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153298#comment-13153298 ] Hudson commented on HIVE-2569: -- Integrated in Hive-trunk-h0.21 #1097 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1097/]) HIVE-2569 [jira] Too much debugging info on console if a job failed (Ning Zhang via John Sichi) Summary: Too much debugging info on console if a job failed When a job failed and Hive client tries to get the error message from failed task, it printed the following info on console for each task: Examining task ID: task_201110112120_773499_m_37 from job job_201110112120_773499 This should be shorten significantly. Test Plan: EMPTY Reviewers: JIRA, njain, jsichi Reviewed By: jsichi CC: jsichi Differential Revision: 375 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203819 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java > Too much debugging info on console if a job failed > -- > > Key: HIVE-2569 > URL: https://issues.apache.org/jira/browse/HIVE-2569 > Project: Hive > Issue Type: Improvement > Components: Diagnosability >Reporter: Ning Zhang >Assignee: Ning Zhang >Priority: Minor > Fix For: 0.9.0 > > Attachments: D375.1.patch > > > When a job failed and Hive client tries to get the error message from failed > task, it printed the following info on console for each task: > Examining task ID: task_201110112120_773499_m_37 from job > job_201110112120_773499 > This should be shorten significantly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2574) ivy offline mode broken by changingPattern and checkmodified attributes
[ https://issues.apache.org/jira/browse/HIVE-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152710#comment-13152710 ] Hudson commented on HIVE-2574: -- Integrated in Hive-trunk-h0.21 #1095 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1095/]) HIVE-2574. Ivy offline mode broken by changingPattern and checkmodified attributes (John Sichi via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203477 Files : * /hive/trunk/build-common.xml * /hive/trunk/build-offline.xml * /hive/trunk/build.xml * /hive/trunk/ivy/ivysettings.xml > ivy offline mode broken by changingPattern and checkmodified attributes > --- > > Key: HIVE-2574 > URL: https://issues.apache.org/jira/browse/HIVE-2574 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: John Sichi >Assignee: John Sichi > Fix For: 0.9.0 > > Attachments: HIVE-2574.D435.1.patch, HIVE-2574.D435.2.patch, > HIVE-2574.D435.3.patch, HIVE-2574.D435.3.patch > > > As described here: > http://www.mail-archive.com/ivy-user@ant.apache.org/msg03534.html > This wasn't the case formerly (maybe the upgrade to ivy 1.2?) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2580) Hive build fails with error "java.io.IOException: Not in GZIP format"
[ https://issues.apache.org/jira/browse/HIVE-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152691#comment-13152691 ] Hudson commented on HIVE-2580: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #100 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/100/]) HIVE-2580. Hive build fails with error 'java.io.IOException: Not in GZIP format' (Carl Steinbach via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203464 Files : * /hive/branches/branch-0.8/build.properties > Hive build fails with error "java.io.IOException: Not in GZIP format" > - > > Key: HIVE-2580 > URL: https://issues.apache.org/jira/browse/HIVE-2580 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 0.8.0 >Reporter: Carl Steinbach >Assignee: Carl Steinbach >Priority: Blocker > Fix For: 0.8.0 > > Attachments: HIVE-2580.1.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2391) published POMs in Maven repo are incorrect
[ https://issues.apache.org/jira/browse/HIVE-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152692#comment-13152692 ] Hudson commented on HIVE-2391: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #100 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/100/]) HIVE-2391. Published POMs in Maven repo are incorrect (Carl Steinbach via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203462 Files : * /hive/branches/branch-0.8/ant/build.xml * /hive/branches/branch-0.8/ant/ivy.xml * /hive/branches/branch-0.8/build-common.xml * /hive/branches/branch-0.8/build.properties * /hive/branches/branch-0.8/build.xml * /hive/branches/branch-0.8/cli/build.xml * /hive/branches/branch-0.8/cli/ivy.xml * /hive/branches/branch-0.8/cli/lib * /hive/branches/branch-0.8/common/build.xml * /hive/branches/branch-0.8/common/ivy.xml * /hive/branches/branch-0.8/contrib/build.xml * /hive/branches/branch-0.8/contrib/ivy.xml * /hive/branches/branch-0.8/contrib/src/test/queries/clientpositive/dboutput.q * /hive/branches/branch-0.8/eclipse-templates/.classpath * /hive/branches/branch-0.8/hbase-handler/build.xml * /hive/branches/branch-0.8/hbase-handler/ivy.xml * /hive/branches/branch-0.8/hwi/build.xml * /hive/branches/branch-0.8/hwi/ivy.xml * /hive/branches/branch-0.8/ivy.xml * /hive/branches/branch-0.8/ivy/common-configurations.xml * /hive/branches/branch-0.8/ivy/ivysettings.xml * /hive/branches/branch-0.8/ivy/libraries.properties * /hive/branches/branch-0.8/jdbc/build.xml * /hive/branches/branch-0.8/jdbc/ivy.xml * /hive/branches/branch-0.8/lib/README * /hive/branches/branch-0.8/lib/asm-3.1.LICENSE * /hive/branches/branch-0.8/lib/asm-3.1.jar * /hive/branches/branch-0.8/lib/commons-collections-3.2.1.LICENSE * /hive/branches/branch-0.8/lib/commons-collections-3.2.1.jar * /hive/branches/branch-0.8/lib/commons-lang-2.4.LICENSE * /hive/branches/branch-0.8/lib/commons-lang-2.4.jar * /hive/branches/branch-0.8/lib/commons-logging-1.0.4.jar * /hive/branches/branch-0.8/lib/commons-logging-api-1.0.4.jar * /hive/branches/branch-0.8/lib/derby.LICENSE * /hive/branches/branch-0.8/lib/derby.jar * /hive/branches/branch-0.8/lib/json-LICENSE.txt * /hive/branches/branch-0.8/lib/json-README.txt * /hive/branches/branch-0.8/lib/json.jar * /hive/branches/branch-0.8/lib/velocity-1.5.jar * /hive/branches/branch-0.8/lib/velocity.LICENSE * /hive/branches/branch-0.8/metastore/build.xml * /hive/branches/branch-0.8/metastore/ivy.xml * /hive/branches/branch-0.8/odbc/ivy.xml * /hive/branches/branch-0.8/pdk/build.xml * /hive/branches/branch-0.8/pdk/ivy.xml * /hive/branches/branch-0.8/ql/build.xml * /hive/branches/branch-0.8/ql/ivy.xml * /hive/branches/branch-0.8/ql/lib * /hive/branches/branch-0.8/ql/src/test/queries/clientpositive/set_processor_namespaces.q * /hive/branches/branch-0.8/ql/src/test/results/clientpositive/set_processor_namespaces.q.out * /hive/branches/branch-0.8/serde/build.xml * /hive/branches/branch-0.8/serde/ivy.xml * /hive/branches/branch-0.8/service/build.xml * /hive/branches/branch-0.8/service/ivy.xml * /hive/branches/branch-0.8/shims/build.xml * /hive/branches/branch-0.8/shims/ivy.xml > published POMs in Maven repo are incorrect > -- > > Key: HIVE-2391 > URL: https://issues.apache.org/jira/browse/HIVE-2391 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 0.7.1 >Reporter: Alejandro Abdelnur >Assignee: Carl Steinbach >Priority: Critical > Fix For: 0.8.0 > > Attachments: HIVE-2391.1.patch.txt, HIVE-2391.2.patch.txt, > HIVE-2391.3.patch.txt, HIVE-2391.4.patch.txt, HIVE-2391.5.patch.txt, > HIVE-2391.wip.1.patch.txt > > > The Hive artifacts published in Apache Maven SNAPSHOTS repo are incorrect. > Dependencies are not complete. > Even after adding as dependencies ALL the Hive artifacts it is not possible > to compile a project using Hive JARs (I'm trying to integrate Oozie Hive > Action using Apache Hive). > As a reference the Hive CDH POMs dependencies could be used (Using those > artifacts I'm able to compile/test/run Hive from within Oozie). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2588) Update arcconfig to include commit listener
[ https://issues.apache.org/jira/browse/HIVE-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151934#comment-13151934 ] Hudson commented on HIVE-2588: -- Integrated in Hive-trunk-h0.21 #1093 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1093/]) HIVE-2588 [jira] Update arcconfig to include commit listener (Marek Sapota via John Sichi) Summary: Add CommitListener as an event listener. Use CommitListener from Arc-JIRA to modify commit message and include `(author via committer)` when running `arc commit`. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: jsichi Differential Revision: 477 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203046 Files : * /hive/trunk/.arcconfig > Update arcconfig to include commit listener > --- > > Key: HIVE-2588 > URL: https://issues.apache.org/jira/browse/HIVE-2588 > Project: Hive > Issue Type: Bug >Reporter: Marek Sapota >Assignee: Marek Sapota > Fix For: 0.9.0 > > Attachments: HIVE-2588.D477.1.patch > > > Use CommitListener from Arc-JIRA to modify commit message and include > `(author via committer)` when running `arc commit`. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2572) HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length
[ https://issues.apache.org/jira/browse/HIVE-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151814#comment-13151814 ] Hudson commented on HIVE-2572: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #98 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/98/]) backporting HIVE-2572 (rev. 1201470) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202946 Files : * /hive/branches/branch-0.8 * /hive/branches/branch-0.8/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length > -- > > Key: HIVE-2572 > URL: https://issues.apache.org/jira/browse/HIVE-2572 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.8.0 >Reporter: Ning Zhang >Assignee: Ning Zhang >Priority: Blocker > Fix For: 0.8.0, 0.9.0 > > Attachments: D381.1.patch > > > This changes from varchar(4000) to varchar(128) is backward incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2568) HIVE-2246 upgrade script needs to drop foreign key in COLUMNS_OLD
[ https://issues.apache.org/jira/browse/HIVE-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151815#comment-13151815 ] Hudson commented on HIVE-2568: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #98 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/98/]) backporting HIVE-2568 (rev. 1201091) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202945 Files : * /hive/branches/branch-0.8 * /hive/branches/branch-0.8/README.txt * /hive/branches/branch-0.8/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMax.java * /hive/branches/branch-0.8/contrib/src/java/org/apache/hadoop/hive/contrib/udaf/example/UDAFExampleMin.java * /hive/branches/branch-0.8/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataInputBuffer.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/io/NonSyncDataOutputBuffer.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultGraphWalker.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/Dispatcher.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/GraphWalker.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessor.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/NodeProcessorCtx.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/Rule.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinCond.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/parse/JoinType.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/AggregationDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/CollectDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/CopyWork.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateFunctionDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableLikeDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateViewDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/DDLDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/DescFunctionDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/DescTableDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/DropFunctionDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/DropTableDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/Explain.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplosionDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeColumnDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeConstantDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeFieldDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeNullDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ExtractDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/FetchWork.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/ForwardDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinCondDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/LateralViewJoinDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/LimitDesc.java * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadDesc.java * /hive/branches/branch-0.8/ql/src/java/org/a
[jira] [Commented] (HIVE-2578) Debug mode in some situations doesn't work properly when child JVM is started from MapRedLocalTask
[ https://issues.apache.org/jira/browse/HIVE-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151812#comment-13151812 ] Hudson commented on HIVE-2578: -- Integrated in Hive-trunk-h0.21 #1092 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1092/]) HIVE-2578: Debug mode doesn't work properly with MapRedLocalTask (Robert Surówka via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202942 Files : * /hive/trunk/bin/ext/debug.sh * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java > Debug mode in some situations doesn't work properly when child JVM is > started from MapRedLocalTask > --- > > Key: HIVE-2578 > URL: https://issues.apache.org/jira/browse/HIVE-2578 > Project: Hive > Issue Type: Bug >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Minor > Attachments: HIVE-2578.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2571) eclipse template .classpath is broken
[ https://issues.apache.org/jira/browse/HIVE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151811#comment-13151811 ] Hudson commented on HIVE-2571: -- Integrated in Hive-trunk-h0.21 #1092 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1092/]) HIVE-2571: eclipse template .classpath is broken (Robert Surówka via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202943 Files : * /hive/trunk/eclipse-templates/.classpath > eclipse template .classpath is broken > - > > Key: HIVE-2571 > URL: https://issues.apache.org/jira/browse/HIVE-2571 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2571.1.patch, HIVE-2571.2.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2581) explain task: getJSONPlan throws a NPE if the ast is null
[ https://issues.apache.org/jira/browse/HIVE-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151694#comment-13151694 ] Hudson commented on HIVE-2581: -- Integrated in Hive-trunk-h0.21 #1091 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1091/]) HIVE-2581: explain task: getJSONPlan throws a NPE if the ast is null (namit via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202820 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java > explain task: getJSONPlan throws a NPE if the ast is null > - > > Key: HIVE-2581 > URL: https://issues.apache.org/jira/browse/HIVE-2581 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2581.D453.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2535) Use sorted nature of compact indexes
[ https://issues.apache.org/jira/browse/HIVE-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151100#comment-13151100 ] Hudson commented on HIVE-2535: -- Integrated in Hive-trunk-h0.21 #1089 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1089/]) HIVE-2535: Use sorted nature of compact indexes (Kevin Wilfong via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202525 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeGenericFuncEvaluator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FilterOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/compact/CompactIndexHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/BucketizedHiveRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/IOContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFileRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeGenericFuncDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFBaseCompare.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHiveSortedInputFormatUsedHook.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveBinarySearchRecordReader.java * /hive/trunk/ql/src/test/queries/clientpositive/index_compact_binary_search.q * /hive/trunk/ql/src/test/results/clientpositive/index_compact_binary_search.q.out > Use sorted nature of compact indexes > > > Key: HIVE-2535 > URL: https://issues.apache.org/jira/browse/HIVE-2535 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2535.1.patch.txt, HIVE-2535.2.patch.txt, > HIVE-2535.3.patch.txt, HIVE-2535.4.patch.txt > > > Compact indexes are sorted based on the indexed columns, but we are not using > this fact when we access the index. > To start with, if the index is stored as an RC file, and if the predicate > being used to access the index consists of only one non-partition condition > using one of the operators >,>=,<,<=,= we could use a binary search (if > necessary) to find the block to begin scanning for unfiltered rows, and we > could use the result of comparing the value in the column with the constant > (this is necessarily the form of a predicate which is optimized using an > index) to determine when we have found all the rows which will be unfiltered. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2411) Metastore server tries to connect to NN without authenticating itself
[ https://issues.apache.org/jira/browse/HIVE-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151005#comment-13151005 ] Hudson commented on HIVE-2411: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #96 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/96/]) HIVE-2411. Metastore server tries to connect to NN without authenticating itself (Ashutosh Chauhan via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202444 Files : * /hive/branches/branch-0.8/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java > Metastore server tries to connect to NN without authenticating itself > - > > Key: HIVE-2411 > URL: https://issues.apache.org/jira/browse/HIVE-2411 > Project: Hive > Issue Type: Bug > Components: Metastore, Security >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 0.8.0 > > Attachments: hive-2411.patch > > > When metastore server is launching it first calls new HMSHandler() even > before it has done a login. That results in createDefaultDB() gets called > which then results in getFileSystem() calls which tries to create a > connection to NN and then it fails since NN cannot authenticate metastore. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2411) Metastore server tries to connect to NN without authenticating itself
[ https://issues.apache.org/jira/browse/HIVE-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151002#comment-13151002 ] Hudson commented on HIVE-2411: -- Integrated in Hive-trunk-h0.21 #1088 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1088/]) HIVE-2411. Metastore server tries to connect to NN without authenticating itself (Ashutosh Chauhan via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202443 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java > Metastore server tries to connect to NN without authenticating itself > - > > Key: HIVE-2411 > URL: https://issues.apache.org/jira/browse/HIVE-2411 > Project: Hive > Issue Type: Bug > Components: Metastore, Security >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 0.8.0 > > Attachments: hive-2411.patch > > > When metastore server is launching it first calls new HMSHandler() even > before it has done a login. That results in createDefaultDB() gets called > which then results in getFileSystem() calls which tries to create a > connection to NN and then it fails since NN cannot authenticate metastore. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2566) reduce the number map-reduce jobs for union all
[ https://issues.apache.org/jira/browse/HIVE-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151003#comment-13151003 ] Hudson commented on HIVE-2566: -- Integrated in Hive-trunk-h0.21 #1088 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1088/]) HIVE-2566: reduce the number map-reduce jobs for union all (namit via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202405 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRProcContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/union24.q * /hive/trunk/ql/src/test/results/clientpositive/auto_join27.q.out * /hive/trunk/ql/src/test/results/clientpositive/create_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/input25.q.out * /hive/trunk/ql/src/test/results/clientpositive/input26.q.out * /hive/trunk/ql/src/test/results/clientpositive/join35.q.out * /hive/trunk/ql/src/test/results/clientpositive/lineage1.q.out * /hive/trunk/ql/src/test/results/clientpositive/load_dyn_part14.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge4.q.out * /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats1.q.out * /hive/trunk/ql/src/test/results/clientpositive/union10.q.out * /hive/trunk/ql/src/test/results/clientpositive/union11.q.out * /hive/trunk/ql/src/test/results/clientpositive/union12.q.out * /hive/trunk/ql/src/test/results/clientpositive/union14.q.out * /hive/trunk/ql/src/test/results/clientpositive/union15.q.out * /hive/trunk/ql/src/test/results/clientpositive/union17.q.out * /hive/trunk/ql/src/test/results/clientpositive/union18.q.out * /hive/trunk/ql/src/test/results/clientpositive/union19.q.out * /hive/trunk/ql/src/test/results/clientpositive/union20.q.out * /hive/trunk/ql/src/test/results/clientpositive/union24.q.out * /hive/trunk/ql/src/test/results/clientpositive/union3.q.out * /hive/trunk/ql/src/test/results/clientpositive/union4.q.out * /hive/trunk/ql/src/test/results/clientpositive/union5.q.out * /hive/trunk/ql/src/test/results/clientpositive/union6.q.out * /hive/trunk/ql/src/test/results/clientpositive/union7.q.out > reduce the number map-reduce jobs for union all > --- > > Key: HIVE-2566 > URL: https://issues.apache.org/jira/browse/HIVE-2566 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2566.D405.1.patch, HIVE-2566.D405.2.patch, > HIVE-2566.D405.3.patch > > > A query like: > select s.key, s.value from ( > select key, value from src2 where key < 10 > union all > select key, value from src3 where key < 10 > union all > select key, value from src4 where key < 10 > union all > select key, count(1) as value from src5 group by key > )s; > should run the last sub-query > 'select key, count(1) as value from src5 group by key' > as a map-reduce job. > And then the union should be a map-only job reading from the first 3 map-only > subqueries > and the output of the last map-reduce job. > The current plan is very inefficient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2580) Hive build fails with error "java.io.IOException: Not in GZIP format"
[ https://issues.apache.org/jira/browse/HIVE-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150907#comment-13150907 ] Hudson commented on HIVE-2580: -- Integrated in Hive-trunk-h0.21 #1087 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1087/]) HIVE-2580. Hive build fails with error "java.io.IOException: Not in GZIP format" (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202393 Files : * /hive/trunk/build.properties > Hive build fails with error "java.io.IOException: Not in GZIP format" > - > > Key: HIVE-2580 > URL: https://issues.apache.org/jira/browse/HIVE-2580 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 0.8.0 >Reporter: Carl Steinbach >Assignee: Carl Steinbach >Priority: Blocker > Fix For: 0.8.0 > > Attachments: HIVE-2580.1.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2196) Ensure HiveConf includes all properties defined in hive-default.xml
[ https://issues.apache.org/jira/browse/HIVE-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150187#comment-13150187 ] Hudson commented on HIVE-2196: -- Integrated in Hive-trunk-h0.21 #1085 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1085/]) HIVE-2196 Ensure HiveConf includes all properties defined in hive-default.xml (Chinna Rao Lalam via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201872 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java > Ensure HiveConf includes all properties defined in hive-default.xml > --- > > Key: HIVE-2196 > URL: https://issues.apache.org/jira/browse/HIVE-2196 > Project: Hive > Issue Type: Bug > Components: Configuration >Affects Versions: 0.8.0 >Reporter: Carl Steinbach >Assignee: Chinna Rao Lalam > Attachments: HIVE-2196.1.patch, HIVE-2196.2.patch, HIVE-2196.3.patch, > HIVE-2196.4.patch, HIVE-2196.5.patch, HIVE-2196.6.patch, HIVE-2196.build.log, > HIVE-2196.patch > > > There are a bunch of properties that are defined in hive-default.xml but not > in HiveConf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2553) Use hashing instead of list traversal for IN operator for primitive types
[ https://issues.apache.org/jira/browse/HIVE-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149505#comment-13149505 ] Hudson commented on HIVE-2553: -- Integrated in Hive-trunk-h0.21 #1083 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1083/]) HIVE-2553. Introduction of Hashing for IN operator for constant values (Robert Surówka via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201600 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TableScanOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFIn.java * /hive/trunk/ql/src/test/queries/clientpositive/input49.q * /hive/trunk/ql/src/test/results/clientpositive/input49.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/StructTypeInfo.java > Use hashing instead of list traversal for IN operator for primitive types > - > > Key: HIVE-2553 > URL: https://issues.apache.org/jira/browse/HIVE-2553 > Project: Hive > Issue Type: Improvement >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2553.1.patch, HIVE-2553.2.patch, HIVE-2553.3.patch, > HIVE-2553.4.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2246) Dedupe tables' column schemas from partitions in the metastore db
[ https://issues.apache.org/jira/browse/HIVE-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149397#comment-13149397 ] Hudson commented on HIVE-2246: -- Integrated in Hive-trunk-h0.21 #1082 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1082/]) HIVE-2572 HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length (Ning Zhang via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201470 Files : * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Dedupe tables' column schemas from partitions in the metastore db > - > > Key: HIVE-2246 > URL: https://issues.apache.org/jira/browse/HIVE-2246 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0 > > Attachments: HIVE-2246.2.patch, HIVE-2246.3.patch, HIVE-2246.4.patch, > HIVE-2246.8.patch > > > Note: this patch proposes a schema change, and is therefore incompatible with > the current metastore. > We can re-organize the JDO models to reduce space usage to keep the metastore > scalable for the future. Currently, partitions are the fastest growing > objects in the metastore, and the metastore keeps a separate copy of the > columns list for each partition. We can normalize the metastore db by > decoupling Columns from Storage Descriptors and not storing duplicate lists > of the columns for each partition. > An idea is to create an additional level of indirection with a "Column > Descriptor" that has a list of columns. A table has a reference to its > latest Column Descriptor (note: a table may have more than one Column > Descriptor in the case of schema evolution). Partitions and Indexes can > reference the same Column Descriptors as their parent table. > Currently, the COLUMNS table in the metastore has roughly (number of > partitions + number of tables) * (average number of columns pertable) rows. > We can reduce this to (number of tables) * (average number of columns per > table) rows, while incurring a small cost proportional to the number of > tables to store the Column Descriptors. > Please see the latest review board for additional implementation details. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2572) HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length
[ https://issues.apache.org/jira/browse/HIVE-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149396#comment-13149396 ] Hudson commented on HIVE-2572: -- Integrated in Hive-trunk-h0.21 #1082 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1082/]) HIVE-2572 HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length (Ning Zhang via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201470 Files : * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > HIVE-2246 upgrade script changed the COLUMNS_V2.COMMENT length > -- > > Key: HIVE-2572 > URL: https://issues.apache.org/jira/browse/HIVE-2572 > Project: Hive > Issue Type: Bug >Affects Versions: 0.8.0 >Reporter: Ning Zhang >Assignee: Ning Zhang > Fix For: 0.8.0, 0.9.0 > > Attachments: D381.1.patch > > > This changes from varchar(4000) to varchar(128) is backward incompatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2568) HIVE-2246 upgrade script needs to drop foreign key in COLUMNS_OLD
[ https://issues.apache.org/jira/browse/HIVE-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148986#comment-13148986 ] Hudson commented on HIVE-2568: -- Integrated in Hive-trunk-h0.21 #1079 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1079/]) HIVE-2568 HIVE-2246 upgrade script needs to drop foreign key in COLUMNS_OLD (Ning Zhang via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201091 Files : * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > HIVE-2246 upgrade script needs to drop foreign key in COLUMNS_OLD > - > > Key: HIVE-2568 > URL: https://issues.apache.org/jira/browse/HIVE-2568 > Project: Hive > Issue Type: Bug >Affects Versions: 0.8.0 >Reporter: Ning Zhang >Assignee: Ning Zhang > Fix For: 0.8.0, 0.9.0 > > Attachments: D369.1.patch > > > One more bug in the MySQL metastore upgrade script: the foreign key in > COLUMNS needs to be dropped, otherwise drop_partition will fail because the > SDS row cannot be deleted due to the foreign key constraint. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2246) Dedupe tables' column schemas from partitions in the metastore db
[ https://issues.apache.org/jira/browse/HIVE-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148987#comment-13148987 ] Hudson commented on HIVE-2246: -- Integrated in Hive-trunk-h0.21 #1079 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1079/]) HIVE-2568 HIVE-2246 upgrade script needs to drop foreign key in COLUMNS_OLD (Ning Zhang via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201091 Files : * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Dedupe tables' column schemas from partitions in the metastore db > - > > Key: HIVE-2246 > URL: https://issues.apache.org/jira/browse/HIVE-2246 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0 > > Attachments: HIVE-2246.2.patch, HIVE-2246.3.patch, HIVE-2246.4.patch, > HIVE-2246.8.patch > > > Note: this patch proposes a schema change, and is therefore incompatible with > the current metastore. > We can re-organize the JDO models to reduce space usage to keep the metastore > scalable for the future. Currently, partitions are the fastest growing > objects in the metastore, and the metastore keeps a separate copy of the > columns list for each partition. We can normalize the metastore db by > decoupling Columns from Storage Descriptors and not storing duplicate lists > of the columns for each partition. > An idea is to create an additional level of indirection with a "Column > Descriptor" that has a list of columns. A table has a reference to its > latest Column Descriptor (note: a table may have more than one Column > Descriptor in the case of schema evolution). Partitions and Indexes can > reference the same Column Descriptors as their parent table. > Currently, the COLUMNS table in the metastore has roughly (number of > partitions + number of tables) * (average number of columns pertable) rows. > We can reduce this to (number of tables) * (average number of columns per > table) rows, while incurring a small cost proportional to the number of > tables to store the Column Descriptors. > Please see the latest review board for additional implementation details. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2532) Evaluation of non-deterministic/stateful UDFs should not be skipped even if constant oi is returned.
[ https://issues.apache.org/jira/browse/HIVE-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148861#comment-13148861 ] Hudson commented on HIVE-2532: -- Integrated in Hive-trunk-h0.21 #1078 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1078/]) HIVE-2532 [jira] Evaluation of non-deterministic/stateful UDFs should not be skipped even if constant oi is returned. (Jonathan Chang via jvs) Summary: HIVE-2532 Even if constant oi is returned, these may have stateful/side-effect behavior and hence need to be called each cycle. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: ikabiljo, jonchang, jsichi Differential Revision: 273 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1201035 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeEvaluator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeGenericFuncEvaluator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAssertTrue.java * /hive/trunk/ql/src/test/queries/clientnegative/udf_assert_true.q * /hive/trunk/ql/src/test/queries/clientnegative/udf_assert_true2.q * /hive/trunk/ql/src/test/results/clientnegative/udf_assert_true.q.out * /hive/trunk/ql/src/test/results/clientnegative/udf_assert_true2.q.out * /hive/trunk/ql/src/test/results/clientpositive/show_functions.q.out > Evaluation of non-deterministic/stateful UDFs should not be skipped even if > constant oi is returned. > > > Key: HIVE-2532 > URL: https://issues.apache.org/jira/browse/HIVE-2532 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Fix For: 0.9.0 > > Attachments: D273.1.patch, D273.2.patch, D273.3.patch, D273.4.patch, > D273.4.patch, D273.4.patch > > > Even if constant oi is returned, these may have stateful/side-effect behavior > and hence need to be called each cycle. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2472) Metastore statistics are not being updated for CTAS queries.
[ https://issues.apache.org/jira/browse/HIVE-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148421#comment-13148421 ] Hudson commented on HIVE-2472: -- Integrated in Hive-trunk-h0.21 #1076 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1076/]) HIVE-2472. Metastore statistics are not being updated for CTAS queries. (Robert Surowka via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1200744 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/StatsWork.java * /hive/trunk/ql/src/test/queries/clientpositive/ctas.q * /hive/trunk/ql/src/test/queries/clientpositive/merge3.q * /hive/trunk/ql/src/test/results/clientpositive/ctas.q.out * /hive/trunk/ql/src/test/results/clientpositive/database.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge3.q.out * /hive/trunk/ql/src/test/results/clientpositive/rcfile_createas1.q.out * /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin9.q.out > Metastore statistics are not being updated for CTAS queries. > > > Key: HIVE-2472 > URL: https://issues.apache.org/jira/browse/HIVE-2472 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Robert Surówka > Fix For: 0.9.0 > > Attachments: HIVE-2472.1.patch.txt, HIVE-2472.2.patch, > HIVE-2472.3.patch, HIVE-2472.4.patch, HIVE-2472.5.patch > > > We need to add a Statistics task at the end of a CTAS query in order to > update the metastore statistics for the table being created. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2562) HIVE-2247 Changed the Thrift API causing compatibility issues.
[ https://issues.apache.org/jira/browse/HIVE-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148119#comment-13148119 ] Hudson commented on HIVE-2562: -- Integrated in Hive-trunk-h0.21 #1075 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1075/]) HIVE-2562. HIVE-2247 Changed the Thrift API causing compatibility issues. (Weiyan Wang via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1200442 Files : * /hive/trunk/metastore/if/hive_metastore.thrift * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.h * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore_server.skeleton.cpp * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore-remote * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py * /hive/trunk/metastore/src/gen/thrift/gen-rb/thrift_hive_metastore.rb * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java > HIVE-2247 Changed the Thrift API causing compatibility issues. > -- > > Key: HIVE-2562 > URL: https://issues.apache.org/jira/browse/HIVE-2562 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Weiyan Wang > Fix For: 0.9.0 > > Attachments: HIVE-2562-1.patch, HIVE-2562-2.patch, HIVE-2562.patch > > > HIVE-2247 Added a parameter to alter_partition in the Metastore Thrift API > which has been causing compatibility issues with some scripts. We would like > to change this to have two methods, one called alter_partition which takes > the old parameters, and one called something else (I'll leave the naming up > to you) which has the new parameters. The implementation of the old method > should just call the new method with null for the new parameter. > This will fix the compatibility issues. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2247) ALTER TABLE RENAME PARTITION
[ https://issues.apache.org/jira/browse/HIVE-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148118#comment-13148118 ] Hudson commented on HIVE-2247: -- Integrated in Hive-trunk-h0.21 #1075 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1075/]) HIVE-2562. HIVE-2247 Changed the Thrift API causing compatibility issues. (Weiyan Wang via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1200442 Files : * /hive/trunk/metastore/if/hive_metastore.thrift * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.h * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore_server.skeleton.cpp * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore-remote * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py * /hive/trunk/metastore/src/gen/thrift/gen-rb/thrift_hive_metastore.rb * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java > ALTER TABLE RENAME PARTITION > > > Key: HIVE-2247 > URL: https://issues.apache.org/jira/browse/HIVE-2247 > Project: Hive > Issue Type: New Feature >Reporter: Siying Dong >Assignee: Weiyan Wang > Attachments: HIVE-2247.10.patch.txt, HIVE-2247.11.patch.txt, > HIVE-2247.3.patch.txt, HIVE-2247.4.patch.txt, HIVE-2247.5.patch.txt, > HIVE-2247.6.patch.txt, HIVE-2247.7.patch.txt, HIVE-2247.8.patch.txt, > HIVE-2247.9.patch.txt, HIVE-2247.9.patch.txt > > > We need a ALTER TABLE TABLE RENAME PARTITIONfunction that is similar t ALTER > TABLE RENAME. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2546) add explain formatted
[ https://issues.apache.org/jira/browse/HIVE-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147554#comment-13147554 ] Hudson commented on HIVE-2546: -- Integrated in Hive-trunk-h0.21 #1073 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1073/]) HIVE-2546 add explain formatted (namit via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1200098 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ExplainSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java * /hive/trunk/ql/src/test/queries/clientpositive/input4.q * /hive/trunk/ql/src/test/queries/clientpositive/join0.q * /hive/trunk/ql/src/test/results/clientpositive/input4.q.out * /hive/trunk/ql/src/test/results/clientpositive/join0.q.out > add explain formatted > - > > Key: HIVE-2546 > URL: https://issues.apache.org/jira/browse/HIVE-2546 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: D261.1.patch, D261.2.patch, hive.2546.1.patch > > > The output can be a json string. > This can be easily parsed by some program that way. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2565) Add Java linter to Hive
[ https://issues.apache.org/jira/browse/HIVE-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147487#comment-13147487 ] Hudson commented on HIVE-2565: -- Integrated in Hive-trunk-h0.21 #1072 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1072/]) HIVE-2565 [jira] Add Java linter to Hive (Marek Sapota via jvs) Summary: Alter .arcconfig to use JavaLintEngine Add a linter that will be run at `arc diff` and will check for too long lines, trailing whitespace, etc. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 345 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1200031 Files : * /hive/trunk/.arcconfig > Add Java linter to Hive > --- > > Key: HIVE-2565 > URL: https://issues.apache.org/jira/browse/HIVE-2565 > Project: Hive > Issue Type: Bug >Reporter: Marek Sapota >Assignee: Marek Sapota > Attachments: D345.1.patch > > > Add a linter that will be run at `arc diff` and will check for too long > lines, trailing whitespace, etc. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2368) Slow dropping of partitions caused by full listing of storage descriptors
[ https://issues.apache.org/jira/browse/HIVE-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147389#comment-13147389 ] Hudson commented on HIVE-2368: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #89 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/89/]) HIVE-2368. Slow dropping of partitions caused by full listing of storage descriptors (Sohan Jain via pauly) pauly : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199915 Files : * /hive/branches/branch-0.8/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java > Slow dropping of partitions caused by full listing of storage descriptors > - > > Key: HIVE-2368 > URL: https://issues.apache.org/jira/browse/HIVE-2368 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.9.0 > > Attachments: HIVE-2368.1.patch > > > To determine if a column descriptor is unused, we call > listStorageDescriptorsWithCD(), which may return a big list of SDs. This can > severely slow down dropping partitions. > We can add a maximum number of SDs to return, and just ask for 1 SD, since we > are just doing an existential check. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2556) upgrade script 008-HIVE-2246.mysql.sql contains syntax errors
[ https://issues.apache.org/jira/browse/HIVE-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146793#comment-13146793 ] Hudson commented on HIVE-2556: -- Integrated in Hive-trunk-h0.21 #1070 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1070/]) HIVE-2556. upgrade script 008-HIVE-2246.mysql.sql contains syntax errors. (Ning Zhang via pauly) pauly : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199593 Files : * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > upgrade script 008-HIVE-2246.mysql.sql contains syntax errors > - > > Key: HIVE-2556 > URL: https://issues.apache.org/jira/browse/HIVE-2556 > Project: Hive > Issue Type: Bug >Affects Versions: 0.8.0 >Reporter: Ning Zhang >Assignee: Ning Zhang > Fix For: 0.8.0, 0.9.0 > > Attachments: D309.1.patch, HIVE-2556.patch > > > source gives syntax errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2246) Dedupe tables' column schemas from partitions in the metastore db
[ https://issues.apache.org/jira/browse/HIVE-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146794#comment-13146794 ] Hudson commented on HIVE-2246: -- Integrated in Hive-trunk-h0.21 #1070 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1070/]) HIVE-2556. upgrade script 008-HIVE-2246.mysql.sql contains syntax errors. (Ning Zhang via pauly) pauly : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199593 Files : * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Dedupe tables' column schemas from partitions in the metastore db > - > > Key: HIVE-2246 > URL: https://issues.apache.org/jira/browse/HIVE-2246 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0 > > Attachments: HIVE-2246.2.patch, HIVE-2246.3.patch, HIVE-2246.4.patch, > HIVE-2246.8.patch > > > Note: this patch proposes a schema change, and is therefore incompatible with > the current metastore. > We can re-organize the JDO models to reduce space usage to keep the metastore > scalable for the future. Currently, partitions are the fastest growing > objects in the metastore, and the metastore keeps a separate copy of the > columns list for each partition. We can normalize the metastore db by > decoupling Columns from Storage Descriptors and not storing duplicate lists > of the columns for each partition. > An idea is to create an additional level of indirection with a "Column > Descriptor" that has a list of columns. A table has a reference to its > latest Column Descriptor (note: a table may have more than one Column > Descriptor in the case of schema evolution). Partitions and Indexes can > reference the same Column Descriptors as their parent table. > Currently, the COLUMNS table in the metastore has roughly (number of > partitions + number of tables) * (average number of columns pertable) rows. > We can reduce this to (number of tables) * (average number of columns per > table) rows, while incurring a small cost proportional to the number of > tables to store the Column Descriptors. > Please see the latest review board for additional implementation details. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2556) upgrade script 008-HIVE-2246.mysql.sql contains syntax errors
[ https://issues.apache.org/jira/browse/HIVE-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146786#comment-13146786 ] Hudson commented on HIVE-2556: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #87 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/87/]) HIVE-2556. upgrade script 008-HIVE-2246.mysql.sql contains syntax errors. (Ning Zhang via pauly) - begin *PUBLIC* platform impact section - Bugzilla: # - end platform impact - pauly : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199595 Files : * /hive/branches/branch-0.8/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > upgrade script 008-HIVE-2246.mysql.sql contains syntax errors > - > > Key: HIVE-2556 > URL: https://issues.apache.org/jira/browse/HIVE-2556 > Project: Hive > Issue Type: Bug >Affects Versions: 0.8.0 >Reporter: Ning Zhang >Assignee: Ning Zhang > Fix For: 0.8.0, 0.9.0 > > Attachments: D309.1.patch, HIVE-2556.patch > > > source gives syntax errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2246) Dedupe tables' column schemas from partitions in the metastore db
[ https://issues.apache.org/jira/browse/HIVE-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146787#comment-13146787 ] Hudson commented on HIVE-2246: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #87 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/87/]) HIVE-2556. upgrade script 008-HIVE-2246.mysql.sql contains syntax errors. (Ning Zhang via pauly) - begin *PUBLIC* platform impact section - Bugzilla: # - end platform impact - pauly : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199595 Files : * /hive/branches/branch-0.8/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Dedupe tables' column schemas from partitions in the metastore db > - > > Key: HIVE-2246 > URL: https://issues.apache.org/jira/browse/HIVE-2246 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0 > > Attachments: HIVE-2246.2.patch, HIVE-2246.3.patch, HIVE-2246.4.patch, > HIVE-2246.8.patch > > > Note: this patch proposes a schema change, and is therefore incompatible with > the current metastore. > We can re-organize the JDO models to reduce space usage to keep the metastore > scalable for the future. Currently, partitions are the fastest growing > objects in the metastore, and the metastore keeps a separate copy of the > columns list for each partition. We can normalize the metastore db by > decoupling Columns from Storage Descriptors and not storing duplicate lists > of the columns for each partition. > An idea is to create an additional level of indirection with a "Column > Descriptor" that has a list of columns. A table has a reference to its > latest Column Descriptor (note: a table may have more than one Column > Descriptor in the case of schema evolution). Partitions and Indexes can > reference the same Column Descriptors as their parent table. > Currently, the COLUMNS table in the metastore has roughly (number of > partitions + number of tables) * (average number of columns pertable) rows. > We can reduce this to (number of tables) * (average number of columns per > table) rows, while incurring a small cost proportional to the number of > tables to store the Column Descriptors. > Please see the latest review board for additional implementation details. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2391) published POMs in Maven repo are incorrect
[ https://issues.apache.org/jira/browse/HIVE-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146669#comment-13146669 ] Hudson commented on HIVE-2391: -- Integrated in Hive-trunk-h0.21 #1069 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1069/]) HIVE-2391. Published POMs in Maven repo are incorrect (Carl Steinbach via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199399 Files : * /hive/trunk/ant/build.xml * /hive/trunk/ant/ivy.xml * /hive/trunk/build-common.xml * /hive/trunk/build.properties * /hive/trunk/build.xml * /hive/trunk/cli/build.xml * /hive/trunk/cli/ivy.xml * /hive/trunk/cli/lib/README * /hive/trunk/cli/lib/jline-0.9.94.LICENSE * /hive/trunk/cli/lib/jline-0.9.94.jar * /hive/trunk/common/build.xml * /hive/trunk/common/ivy.xml * /hive/trunk/contrib/build.xml * /hive/trunk/contrib/ivy.xml * /hive/trunk/contrib/src/test/queries/clientpositive/dboutput.q * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/hbase-handler/build.xml * /hive/trunk/hbase-handler/ivy.xml * /hive/trunk/hwi/build.xml * /hive/trunk/hwi/ivy.xml * /hive/trunk/ivy.xml * /hive/trunk/ivy/common-configurations.xml * /hive/trunk/ivy/ivysettings.xml * /hive/trunk/ivy/libraries.properties * /hive/trunk/jdbc/build.xml * /hive/trunk/jdbc/ivy.xml * /hive/trunk/lib/README * /hive/trunk/lib/asm-3.1.LICENSE * /hive/trunk/lib/asm-3.1.jar * /hive/trunk/lib/commons-collections-3.2.1.LICENSE * /hive/trunk/lib/commons-collections-3.2.1.jar * /hive/trunk/lib/commons-lang-2.4.LICENSE * /hive/trunk/lib/commons-lang-2.4.jar * /hive/trunk/lib/commons-logging-1.0.4.jar * /hive/trunk/lib/commons-logging-api-1.0.4.jar * /hive/trunk/lib/derby.LICENSE * /hive/trunk/lib/derby.jar * /hive/trunk/lib/json-LICENSE.txt * /hive/trunk/lib/json-README.txt * /hive/trunk/lib/json.jar * /hive/trunk/lib/velocity-1.5.jar * /hive/trunk/lib/velocity.LICENSE * /hive/trunk/metastore/build.xml * /hive/trunk/metastore/ivy.xml * /hive/trunk/odbc/ivy.xml * /hive/trunk/pdk/build.xml * /hive/trunk/pdk/ivy.xml * /hive/trunk/ql/build.xml * /hive/trunk/ql/ivy.xml * /hive/trunk/ql/lib/README * /hive/trunk/ql/lib/antlr-2.7.7.LICENSE * /hive/trunk/ql/lib/antlr-2.7.7.jar * /hive/trunk/ql/lib/antlr-3.0.1.LICENSE * /hive/trunk/ql/lib/antlr-3.0.1.jar * /hive/trunk/ql/lib/antlr-runtime-3.0.1.LICENSE * /hive/trunk/ql/lib/antlr-runtime-3.0.1.jar * /hive/trunk/ql/lib/stringtemplate-3.1b1.LICENSE * /hive/trunk/ql/lib/stringtemplate-3.1b1.jar * /hive/trunk/ql/src/test/queries/clientpositive/set_processor_namespaces.q * /hive/trunk/ql/src/test/results/clientpositive/set_processor_namespaces.q.out * /hive/trunk/serde/build.xml * /hive/trunk/serde/ivy.xml * /hive/trunk/service/build.xml * /hive/trunk/service/ivy.xml * /hive/trunk/shims/build.xml * /hive/trunk/shims/ivy.xml > published POMs in Maven repo are incorrect > -- > > Key: HIVE-2391 > URL: https://issues.apache.org/jira/browse/HIVE-2391 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 0.7.1 >Reporter: Alejandro Abdelnur >Assignee: Carl Steinbach >Priority: Critical > Fix For: 0.8.0 > > Attachments: HIVE-2391.1.patch.txt, HIVE-2391.2.patch.txt, > HIVE-2391.3.patch.txt, HIVE-2391.4.patch.txt, HIVE-2391.5.patch.txt, > HIVE-2391.wip.1.patch.txt > > > The Hive artifacts published in Apache Maven SNAPSHOTS repo are incorrect. > Dependencies are not complete. > Even after adding as dependencies ALL the Hive artifacts it is not possible > to compile a project using Hive JARs (I'm trying to integrate Oozie Hive > Action using Apache Hive). > As a reference the Hive CDH POMs dependencies could be used (Using those > artifacts I'm able to compile/test/run Hive from within Oozie). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2466) mapjoin_subquery dump small table (mapjoin table) to the same file
[ https://issues.apache.org/jira/browse/HIVE-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146227#comment-13146227 ] Hudson commented on HIVE-2466: -- Integrated in Hive-trunk-h0.21 #1067 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1067/]) HIVE-2466 mapjoin_subquery dump small table (mapjoin table) to the same file (binlijin via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199117 Files : * /hive/trunk/data/files/x.txt * /hive/trunk/data/files/y.txt * /hive/trunk/data/files/z.txt * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HashTableSinkOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/GenMRSkewJoinProcessor.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/HashTableSinkDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/mapjoin_subquery2.q * /hive/trunk/ql/src/test/results/clientpositive/mapjoin_subquery2.q.out > mapjoin_subquery dump small table (mapjoin table) to the same file > --- > > Key: HIVE-2466 > URL: https://issues.apache.org/jira/browse/HIVE-2466 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.7.1 >Reporter: binlijin >Assignee: binlijin >Priority: Critical > Attachments: D285.1.patch, D285.2.patch, hive-2466.1.patch, > hive-2466.2.patch, hive-2466.3.patch, hive-2466.4.patch > > > in mapjoin_subquery.q there is a query： > SELECT /*+ MAPJOIN(z) */ subq.key1, z.value > FROM > (SELECT /*+ MAPJOIN(x) */ x.key as key1, x.value as value1, y.key as key2, > y.value as value2 > FROM src1 x JOIN src y ON (x.key = y.key)) subq > JOIN srcpart z ON (subq.key1 = z.key and z.ds='2008-04-08' and z.hr=11); > when dump x and z to a local file,there all dump to the same file, so we lost > the data of x -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2545) Make metastore log4j configuration file configurable again.
[ https://issues.apache.org/jira/browse/HIVE-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146226#comment-13146226 ] Hudson commented on HIVE-2545: -- Integrated in Hive-trunk-h0.21 #1067 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1067/]) HIVE-2545. Make metastore log4j configuration file configurable again. (Kevin Wilfong via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199114 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java > Make metastore log4j configuration file configurable again. > --- > > Key: HIVE-2545 > URL: https://issues.apache.org/jira/browse/HIVE-2545 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2545.1.patch.txt > > > The patch for https://issues.apache.org/jira/browse/HIVE-2139 hard coded the > metastore to use hive-log4j.properties as the log4j configuration file. > Previously this was configurable through the log4j.configuration variable > passed into Java. It should be configurable again, though not necessarily > through the same means. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2527) Consecutive string literals should be combined into a single string literal.
[ https://issues.apache.org/jira/browse/HIVE-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146138#comment-13146138 ] Hudson commented on HIVE-2527: -- Integrated in Hive-trunk-h0.21 #1066 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1066/]) HIVE-2527 [jira] Consecutive string literals should be combined into a single string literal. (Jonathan Chang via jvs) Summary: HIVE C, Python, etc. all support this magical feature. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: akramer, jonchang, jsichi Differential Revision: 147 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199066 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/literal_string.q * /hive/trunk/ql/src/test/results/clientpositive/literal_string.q.out > Consecutive string literals should be combined into a single string literal. > > > Key: HIVE-2527 > URL: https://issues.apache.org/jira/browse/HIVE-2527 > Project: Hive > Issue Type: Improvement >Reporter: Jonathan Chang >Assignee: Jonathan Chang >Priority: Minor > Fix For: 0.9.0 > > Attachments: D147.1.patch, D147.2.patch, D147.3.patch, D147.3.patch, > D147.4.patch, D147.4.patch > > > C, Python, etc. all support this magical feature. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2178) Log related Check style Comments fixes
[ https://issues.apache.org/jira/browse/HIVE-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145941#comment-13145941 ] Hudson commented on HIVE-2178: -- Integrated in Hive-trunk-h0.21 #1065 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1065/]) HIVE-2178 Log related Check style Comments fixes (Chinna Rao Lalam via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1198841 Files : * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDataSource.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Partition.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/dynamic_type/SimpleCharStream.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/thrift/TBinarySortableProtocol.java > Log related Check style Comments fixes > -- > > Key: HIVE-2178 > URL: https://issues.apache.org/jira/browse/HIVE-2178 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.5.0, 0.8.0 > Environment: Hadoop 0.20.1, Hive0.8.0 and SUSE Linux Enterprise > Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5) >Reporter: Chinna Rao Lalam >Assignee: Chinna Rao Lalam > Attachments: D291.1.patch, HIVE-2178.1.patch, HIVE-2178.2.patch, > HIVE-2178.3.patch, HIVE-2178.4.patch, HIVE-2178.5.patch, HIVE-2178.patch > > > Fix Log related Check style Comments -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-11) better error code from Hive describe command
[ https://issues.apache.org/jira/browse/HIVE-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145186#comment-13145186 ] Hudson commented on HIVE-11: Integrated in Hive-trunk-h0.21 #1063 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1063/]) HIVE-11. better error code from Hive describe command (Ashutosh Chauhan via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1198566 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/test/queries/clientnegative/external1.q * /hive/trunk/ql/src/test/queries/clientnegative/external2.q * /hive/trunk/ql/src/test/queries/clientpositive/desc_non_existent_tbl.q * /hive/trunk/ql/src/test/results/clientnegative/external1.q.out * /hive/trunk/ql/src/test/results/clientnegative/external2.q.out * /hive/trunk/ql/src/test/results/clientpositive/desc_non_existent_tbl.q.out > better error code from Hive describe command > > > Key: HIVE-11 > URL: https://issues.apache.org/jira/browse/HIVE-11 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.3.0, 0.4.0, 0.4.1, 0.5.0, 0.6.0, 0.8.0, 0.9.0 >Reporter: Joydeep Sen Sarma >Assignee: Ashutosh Chauhan > Fix For: 0.9.0 > > Attachments: hive-11.patch, hive-11_1.patch, hive-11_2.patch > > > cryptic, non-informative error message > hive> describe hive1_scribeloadertest > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask > in this case the table was missing. better say that. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2550) Provide jira_base_url for improved arc commit workflow
[ https://issues.apache.org/jira/browse/HIVE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144532#comment-13144532 ] Hudson commented on HIVE-2550: -- Integrated in Hive-trunk-h0.21 #1060 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1060/]) HIVE-2550 Provide jira_base_url for improved arc commit workflow (Marek Sapota via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197738 Files : * /hive/trunk/.arcconfig > Provide jira_base_url for improved arc commit workflow > -- > > Key: HIVE-2550 > URL: https://issues.apache.org/jira/browse/HIVE-2550 > Project: Hive > Issue Type: Bug >Reporter: Marek Sapota > Fix For: 0.9.0 > > Attachments: D249.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2366) Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the old COLUMNS table
[ https://issues.apache.org/jira/browse/HIVE-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144489#comment-13144489 ] Hudson commented on HIVE-2366: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #82 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/82/]) HIVE-2366. Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the old COLUMNS table (Sohan Jain via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197646 Files : * /hive/branches/branch-0.8/metastore/scripts/upgrade/derby/008-HIVE-2246.derby.sql * /hive/branches/branch-0.8/metastore/scripts/upgrade/derby/008-REVERT-HIVE-2246.derby.sql * /hive/branches/branch-0.8/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the > old COLUMNS table > --- > > Key: HIVE-2366 > URL: https://issues.apache.org/jira/browse/HIVE-2366 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0, 0.9.0 > > Attachments: HIVE-2366.1.patch, HIVE-2366.2.patch > > > The upgrade scripts for the hive metastore in HIVE-2246 do not upgrade the > indexes. They also need to rename the old COLUMNS table after migration so > that old clients will not accidentally access the COLUMNS table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2246) Dedupe tables' column schemas from partitions in the metastore db
[ https://issues.apache.org/jira/browse/HIVE-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144490#comment-13144490 ] Hudson commented on HIVE-2246: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #82 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/82/]) HIVE-2366. Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the old COLUMNS table (Sohan Jain via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197646 Files : * /hive/branches/branch-0.8/metastore/scripts/upgrade/derby/008-HIVE-2246.derby.sql * /hive/branches/branch-0.8/metastore/scripts/upgrade/derby/008-REVERT-HIVE-2246.derby.sql * /hive/branches/branch-0.8/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Dedupe tables' column schemas from partitions in the metastore db > - > > Key: HIVE-2246 > URL: https://issues.apache.org/jira/browse/HIVE-2246 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0 > > Attachments: HIVE-2246.2.patch, HIVE-2246.3.patch, HIVE-2246.4.patch, > HIVE-2246.8.patch > > > Note: this patch proposes a schema change, and is therefore incompatible with > the current metastore. > We can re-organize the JDO models to reduce space usage to keep the metastore > scalable for the future. Currently, partitions are the fastest growing > objects in the metastore, and the metastore keeps a separate copy of the > columns list for each partition. We can normalize the metastore db by > decoupling Columns from Storage Descriptors and not storing duplicate lists > of the columns for each partition. > An idea is to create an additional level of indirection with a "Column > Descriptor" that has a list of columns. A table has a reference to its > latest Column Descriptor (note: a table may have more than one Column > Descriptor in the case of schema evolution). Partitions and Indexes can > reference the same Column Descriptors as their parent table. > Currently, the COLUMNS table in the metastore has roughly (number of > partitions + number of tables) * (average number of columns pertable) rows. > We can reduce this to (number of tables) * (average number of columns per > table) rows, while incurring a small cost proportional to the number of > tables to store the Column Descriptors. > Please see the latest review board for additional implementation details. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2366) Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the old COLUMNS table
[ https://issues.apache.org/jira/browse/HIVE-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1318#comment-1318 ] Hudson commented on HIVE-2366: -- Integrated in Hive-trunk-h0.21 #1059 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1059/]) HIVE-2366. Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the old COLUMNS table (Sohan Jain via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197644 Files : * /hive/trunk/metastore/scripts/upgrade/derby/008-HIVE-2246.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/008-REVERT-HIVE-2246.derby.sql * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the > old COLUMNS table > --- > > Key: HIVE-2366 > URL: https://issues.apache.org/jira/browse/HIVE-2366 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0, 0.9.0 > > Attachments: HIVE-2366.1.patch, HIVE-2366.2.patch > > > The upgrade scripts for the hive metastore in HIVE-2246 do not upgrade the > indexes. They also need to rename the old COLUMNS table after migration so > that old clients will not accidentally access the COLUMNS table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1690) HivePreparedStatement.executeImmediate(String sql) is breaking the exception stack
[ https://issues.apache.org/jira/browse/HIVE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144450#comment-13144450 ] Hudson commented on HIVE-1690: -- Integrated in Hive-trunk-h0.21 #1059 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1059/]) HIVE-1690. HivePreparedStatement.executeImmediate(String sql) is breaking the exception stack (Ashutosh Chauhan via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197698 Files : * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HivePreparedStatement.java > HivePreparedStatement.executeImmediate(String sql) is breaking the exception > stack > -- > > Key: HIVE-1690 > URL: https://issues.apache.org/jira/browse/HIVE-1690 > Project: Hive > Issue Type: Improvement > Components: JDBC >Reporter: Eli Griv >Assignee: Ashutosh Chauhan >Priority: Minor > Fix For: 0.9.0 > > Attachments: hive-1690.patch > > > in HivePreparedStatement.executeImmediate(String sql), the exception stack is > broken, so it's impossible to know which method throwed "Method not > supported" > FIX : > HivePreparedStatement.java > L166 > - throw new SQLException(e.getMessage(), e.getSQLState(), e.getErrorCode()); > + throw new SQLException(e.getMessage(), e.getSQLState(), e.getErrorCode(), > e); > L168 > - throw new SQLException(ex.toString(), "08S01"); > + throw new SQLException(ex.toString(), "08S01", ex); -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2246) Dedupe tables' column schemas from partitions in the metastore db
[ https://issues.apache.org/jira/browse/HIVE-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1319#comment-1319 ] Hudson commented on HIVE-2246: -- Integrated in Hive-trunk-h0.21 #1059 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1059/]) HIVE-2366. Metastore upgrade scripts for HIVE-2246 do not migrate indexes nor rename the old COLUMNS table (Sohan Jain via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197644 Files : * /hive/trunk/metastore/scripts/upgrade/derby/008-HIVE-2246.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/008-REVERT-HIVE-2246.derby.sql * /hive/trunk/metastore/scripts/upgrade/mysql/008-HIVE-2246.mysql.sql > Dedupe tables' column schemas from partitions in the metastore db > - > > Key: HIVE-2246 > URL: https://issues.apache.org/jira/browse/HIVE-2246 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.8.0 > > Attachments: HIVE-2246.2.patch, HIVE-2246.3.patch, HIVE-2246.4.patch, > HIVE-2246.8.patch > > > Note: this patch proposes a schema change, and is therefore incompatible with > the current metastore. > We can re-organize the JDO models to reduce space usage to keep the metastore > scalable for the future. Currently, partitions are the fastest growing > objects in the metastore, and the metastore keeps a separate copy of the > columns list for each partition. We can normalize the metastore db by > decoupling Columns from Storage Descriptors and not storing duplicate lists > of the columns for each partition. > An idea is to create an additional level of indirection with a "Column > Descriptor" that has a list of columns. A table has a reference to its > latest Column Descriptor (note: a table may have more than one Column > Descriptor in the case of schema evolution). Partitions and Indexes can > reference the same Column Descriptors as their parent table. > Currently, the COLUMNS table in the metastore has roughly (number of > partitions + number of tables) * (average number of columns pertable) rows. > We can reduce this to (number of tables) * (average number of columns per > table) rows, while incurring a small cost proportional to the number of > tables to store the Column Descriptors. > Please see the latest review board for additional implementation details. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2278) Support archiving for multiple partitions if the table is partitioned by multiple columns
[ https://issues.apache.org/jira/browse/HIVE-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143840#comment-13143840 ] Hudson commented on HIVE-2278: -- Integrated in Hive-trunk-h0.21 #1057 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1057/]) HIVE-2278 Support archiving for multiple partitions if the table is partitioned by multiple columns (Marcin Kurczych and Yongqiang He via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197400 Files : * /hive/trunk/data/files/archive_corrupt.rc * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ArchiveUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lockmgr/zookeeper/ZooKeeperHiveLockManager.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/DummyPartition.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientnegative/archive_insert1.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_insert2.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_insert3.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_insert4.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_multi1.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_multi2.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_multi3.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_multi4.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_multi5.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_multi6.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_multi7.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_partspec1.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_partspec2.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_partspec3.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_partspec4.q * /hive/trunk/ql/src/test/queries/clientnegative/archive_partspec5.q * /hive/trunk/ql/src/test/queries/clientpositive/archive_corrupt.q * /hive/trunk/ql/src/test/queries/clientpositive/archive_multi.q * /hive/trunk/ql/src/test/results/clientnegative/archive1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_insert1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_insert2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_insert3.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_insert4.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi3.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi4.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi5.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi6.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi7.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_partspec1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_partspec2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_partspec3.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_partspec4.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_partspec5.q.out * /hive/trunk/ql/src/test/results/clientpositive/archive_corrupt.q.out * /hive/trunk/ql/src/test/results/clientpositive/archive_multi.q.out > Support archiving for multiple partitions if the table is partitioned by > multiple columns > - > > Key: HIVE-2278 > URL: https://issues.apache.org/jira/browse/HIVE-2278 > Project: Hive > Issue Type: New Feature >Reporter: Namit Jain >Assignee: Marcin Kurczych > Attachments: HIVE-2278.10.patch, HIVE-2278.11.patch, > HIVE-2278.12.patch, HIVE-2278.2.patch, HIVE-2278.3.patch, HIVE-2278.4.patch, > HIVE-2278.5.patch, HIVE-2278.5.patch, HIVE-2278.6.patch, HIVE-2278.6.patch, > HIVE-2278.7.patch, HIVE-2278.8.patch, HIVE-2278.9.patch, archive_corrupt.rc, > hive.2278.1.patch > > > If a table is partitioned by ds,hr > it should be possible to archive all the files in ds to reduce the number of > files -- This message is automatically generated by JIRA. If you think it was sent incor
[jira] [Commented] (HIVE-2214) CommandNeedRetryException.java is missing ASF header
[ https://issues.apache.org/jira/browse/HIVE-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143660#comment-13143660 ] Hudson commented on HIVE-2214: -- Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #80 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/80/]) HIVE-2214. CommandNeedRetryException.java is missing ASF header (Ashutosh Chauhan via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197278 Files : * /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/CommandNeedRetryException.java > CommandNeedRetryException.java is missing ASF header > > > Key: HIVE-2214 > URL: https://issues.apache.org/jira/browse/HIVE-2214 > Project: Hive > Issue Type: Bug >Affects Versions: 0.8.0 >Reporter: John Sichi >Assignee: Ashutosh Chauhan > Fix For: 0.8.0 > > Attachments: hive-2214.patch > > > Please add one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2214) CommandNeedRetryException.java is missing ASF header
[ https://issues.apache.org/jira/browse/HIVE-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143594#comment-13143594 ] Hudson commented on HIVE-2214: -- Integrated in Hive-trunk-h0.21 #1056 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1056/]) HIVE-2214. CommandNeedRetryException.java is missing ASF header (Ashutosh Chauhan via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197276 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/CommandNeedRetryException.java > CommandNeedRetryException.java is missing ASF header > > > Key: HIVE-2214 > URL: https://issues.apache.org/jira/browse/HIVE-2214 > Project: Hive > Issue Type: Bug >Affects Versions: 0.8.0 >Reporter: John Sichi >Assignee: Ashutosh Chauhan > Fix For: 0.8.0 > > Attachments: hive-2214.patch > > > Please add one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2465) Primitive Data Types returning null if the data is out of range of the data type.
[ https://issues.apache.org/jira/browse/HIVE-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143595#comment-13143595 ] Hudson commented on HIVE-2465: -- Integrated in Hive-trunk-h0.21 #1056 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1056/]) HIVE-2465 Primitive Data Types returning null if the data is out of range of the data type. (Ashutosh Chauhan via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1197227 Files : * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyBinary.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyBoolean.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyByte.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyDouble.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFloat.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyInteger.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyLong.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyPrimitive.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyShort.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyTimestamp.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyPrimitive.java > Primitive Data Types returning null if the data is out of range of the data > type. > - > > Key: HIVE-2465 > URL: https://issues.apache.org/jira/browse/HIVE-2465 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.9.0 > Environment: Hadoop 0.20.1, Hive0.9.0 and SUSE Linux Enterprise > Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5) >Reporter: Chinna Rao Lalam >Assignee: Chinna Rao Lalam > Attachments: HIVE-2465.1.patch, HIVE-2465.2.patch, HIVE-2465.patch > > > Primitive Data Types returning null if the input data is out of range of the > data type. In this case it is better to log the message with the proper > message and actual data then user get to know some data is missing. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1310) Partitioning columns should be of primitive types only
[ https://issues.apache.org/jira/browse/HIVE-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13143001#comment-13143001 ] Hudson commented on HIVE-1310: -- Integrated in Hive-trunk-h0.21 #1054 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1054/]) HIVE-1310 Partitioning columns should be of primitive types only (Ashutosh Chauhan via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1196944 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientnegative/part_col_complex_type.q * /hive/trunk/ql/src/test/results/clientnegative/part_col_complex_type.q.out > Partitioning columns should be of primitive types only > -- > > Key: HIVE-1310 > URL: https://issues.apache.org/jira/browse/HIVE-1310 > Project: Hive > Issue Type: New Feature >Reporter: Ning Zhang >Assignee: Ashutosh Chauhan > Fix For: 0.9.0 > > Attachments: D225.1.patch, hive-1310.patch > > > If the user specify the partitioning column as complex type (e.g., array, > map) we should throw an error in semantic analyzer. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2543) Compact index table's files merged in creation
[ https://issues.apache.org/jira/browse/HIVE-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142827#comment-13142827 ] Hudson commented on HIVE-2543: -- Integrated in Hive-trunk-h0.21 #1053 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1053/]) HIVE-2543 Compact index table's files merged in creation (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1196859 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/AggregateIndexHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/compact/CompactIndexHandler.java > Compact index table's files merged in creation > -- > > Key: HIVE-2543 > URL: https://issues.apache.org/jira/browse/HIVE-2543 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2543.1.patch.txt > > > When a compact index is built there is the possibility of a merge task at the > end of the task tree. If this happens, the index table's files will no > longer be sorted. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2510) Hive throws Null Pointer Exception upon CREATE TABLE . .... if the given doesn't exist
[ https://issues.apache.org/jira/browse/HIVE-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141921#comment-13141921 ] Hudson commented on HIVE-2510: -- Integrated in Hive-trunk-h0.21 #1051 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1051/]) HIVE-2510. Hive throws Null Pointer Exception upon CREATE TABLE .if does not exists nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1196354 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientnegative/create_table_failure1.q * /hive/trunk/ql/src/test/queries/clientnegative/create_table_failure2.q * /hive/trunk/ql/src/test/queries/clientnegative/create_table_failure3.q * /hive/trunk/ql/src/test/queries/clientnegative/create_table_failure4.q * /hive/trunk/ql/src/test/queries/clientpositive/input46.q * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure1.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure2.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure3.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure4.q.out * /hive/trunk/ql/src/test/results/clientpositive/input46.q.out > Hive throws Null Pointer Exception upon CREATE TABLE . > if the given doesn't exist > - > > Key: HIVE-2510 > URL: https://issues.apache.org/jira/browse/HIVE-2510 > Project: Hive > Issue Type: Bug >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Trivial > Fix For: 0.9.0 > > Attachments: HIVE-2510.1.patch, HIVE-2510.2.patch, HIVE-2510.3.patch, > HIVE-2510.4.patch, HIVE-2510.5.patch, HIVE-2510.6.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2536) Support scientific notation for Double literals
[ https://issues.apache.org/jira/browse/HIVE-2536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141052#comment-13141052 ] Hudson commented on HIVE-2536: -- Integrated in Hive-trunk-h0.21 #1049 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1049/]) HIVE-2536. Support scientific notation for Double literals (Jonathan Chang via jvs) Summary: HIVE-2536 Of the form 1.0e10. Test Plan: EMPTY Reviewers: DUMMY_REVIEWER, jsichi Reviewed By: jsichi CC: JIRA, jonchang, jsichi Differential Revision: 129 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195830 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g * /hive/trunk/ql/src/test/queries/clientpositive/literal_double.q * /hive/trunk/ql/src/test/results/clientpositive/literal_double.q.out > Support scientific notation for Double literals > --- > > Key: HIVE-2536 > URL: https://issues.apache.org/jira/browse/HIVE-2536 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Fix For: 0.9.0 > > Attachments: D129.1.patch, D129.1.patch, D129.1.patch > > > Of the form 1.0e10. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2534) HiveIndexResult creation fails due to file system issue
[ https://issues.apache.org/jira/browse/HIVE-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140648#comment-13140648 ] Hudson commented on HIVE-2534: -- Integrated in Hive-trunk-h0.21 #1048 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1048/]) HIVE-2534: HiveIndexResult creation fails due to file system issue (Kevin Wilfong via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195580 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexResult.java > HiveIndexResult creation fails due to file system issue > --- > > Key: HIVE-2534 > URL: https://issues.apache.org/jira/browse/HIVE-2534 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2534.1.patch.txt > > > If the file system for temp files differs from the default file system in the > conf, HiveIndexResult's constructor fails. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1003) optimize metadata only queries
[ https://issues.apache.org/jira/browse/HIVE-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140649#comment-13140649 ] Hudson commented on HIVE-1003: -- Integrated in Hive-trunk-h0.21 #1048 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1048/]) HIVE-1003: optimize metadata only queries (Marcin Kurczych, Namit Jain via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195577 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDatabaseMetaData.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/OneNullRowInputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/MetadataOnlyOptimizer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/PhysicalOptimizer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/GroupByDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFType.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFMax.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFMin.java * /hive/trunk/ql/src/test/queries/clientpositive/metadataonly1.q * /hive/trunk/ql/src/test/results/clientpositive/metadataonly1.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/NullStructSerDe.java > optimize metadata only queries > -- > > Key: HIVE-1003 > URL: https://issues.apache.org/jira/browse/HIVE-1003 > Project: Hive > Issue Type: New Feature > Components: Query Processor >Reporter: Namit Jain >Assignee: Marcin Kurczych > Fix For: 0.9.0 > > Attachments: D105.1.patch, HIVE-1003.1.patch, hive.1003.2.patch, > hive.1003.3.patch, hive.1003.4.patch > > > Queries like: > select max(ds) from T > where ds is a partitioning column should be optimized. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2500) Allow Hive to be debugged remotely
[ https://issues.apache.org/jira/browse/HIVE-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139903#comment-13139903 ] Hudson commented on HIVE-2500: -- Integrated in Hive-trunk-h0.21 #1046 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1046/]) HIVE-2500. Allow Hive to be debugged remotely (Robert Surowka via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195288 Files : * /hive/trunk/bin/ext/debug.sh * /hive/trunk/bin/ext/help.sh * /hive/trunk/bin/hive * /hive/trunk/conf/hive-env.sh.template * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java > Allow Hive to be debugged remotely > -- > > Key: HIVE-2500 > URL: https://issues.apache.org/jira/browse/HIVE-2500 > Project: Hive > Issue Type: New Feature >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2500.1.patch, HIVE-2500.2.patch, HIVE-2500.3.patch, > HIVE-2500.4.patch, HIVE-2500.5.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1592) ProxyFileSystem.close calls super.close twice.
[
https://issues.apache.org/jira/browse/HIVE-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139496#comment-13139496
]
Hudson commented on HIVE-1592:
--
Integrated in Hive-trunk-h0.21 #1044 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1044/])
HIVE-1592. ProxyFileSystem.close calls super.close twice.
(Ashutosh Chauhan via jvs)
jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1194964
Files :
* /hive/trunk/shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java
> ProxyFileSystem.close calls super.close twice.
> --
>
> Key: HIVE-1592
> URL: https://issues.apache.org/jira/browse/HIVE-1592
> Project: Hive
> Issue Type: Bug
> Components: Testing Infrastructure
>Affects Versions: 0.7.0, 0.8.0, 0.9.0
>Reporter: John Sichi
>Assignee: Ashutosh Chauhan
>Priority: Minor
> Fix For: 0.9.0
>
> Attachments: hive-1592.patch
>
>
> public void close() throws IOException {
> super.close();
> super.close();
> }
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1975) "insert overwrite directory" Not able to insert data with multi level directory path
[
https://issues.apache.org/jira/browse/HIVE-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139115#comment-13139115
]
Hudson commented on HIVE-1975:
--
Integrated in Hive-trunk-h0.21 #1042 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1042/])
HIVE-1975 "insert overwrite directory" Not able to insert data with multi
level
directory path (Chinna Rao Lalam via namit)
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190719
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java
* /hive/trunk/ql/src/test/queries/clientpositive/input45.q
* /hive/trunk/ql/src/test/results/clientpositive/input45.q.out
> "insert overwrite directory" Not able to insert data with multi level
> directory path
>
>
> Key: HIVE-1975
> URL: https://issues.apache.org/jira/browse/HIVE-1975
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
>Affects Versions: 0.5.0
> Environment: Hadoop 0.20.1, Hive0.5.0 and SUSE Linux Enterprise
> Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5).
>Reporter: Chinna Rao Lalam
>Assignee: Chinna Rao Lalam
> Attachments: HIVE-1975.1.patch, HIVE-1975.2.patch, HIVE-1975.3.patch,
> HIVE-1975.patch
>
>
> Below query execution is failed
> Ex:
> {noformat}
>insert overwrite directory '/HIVEFT25686/chinna/' select * from dept_j;
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2247) ALTER TABLE RENAME PARTITION
[ https://issues.apache.org/jira/browse/HIVE-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139116#comment-13139116 ] Hudson commented on HIVE-2247: -- Integrated in Hive-trunk-h0.21 #1042 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1042/]) HIVE-2247 ALTER TABLE RENAME PARTITION (Weiyan Wang via. Siying Dong) sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190696 Files : * /hive/trunk/metastore/if/hive_metastore.thrift * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.h * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore_server.skeleton.cpp * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore-remote * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py * /hive/trunk/metastore/src/gen/thrift/gen-rb/thrift_hive_metastore.rb * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Partition.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DDLWork.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/HiveOperation.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/RenamePartitionDesc.java * /hive/trunk/ql/src/test/queries/clientnegative/alter_rename_partition_failure.q * /hive/trunk/ql/src/test/queries/clientnegative/alter_rename_partition_failure2.q * /hive/trunk/ql/src/test/queries/clientnegative/alter_rename_partition_failure3.q * /hive/trunk/ql/src/test/queries/clientpositive/alter_rename_partition.q * /hive/trunk/ql/src/test/queries/clientpositive/alter_rename_partition_authorization.q * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure2.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure3.q.out * /hive/trunk/ql/src/test/results/clientpositive/alter_rename_partition.q.out * /hive/trunk/ql/src/test/results/clientpositive/alter_rename_partition_authorization.q.out > ALTER TABLE RENAME PARTITION > > > Key: HIVE-2247 > URL: https://issues.apache.org/jira/browse/HIVE-2247 > Project: Hive > Issue Type: New Feature >Reporter: Siying Dong >Assignee: Weiyan Wang > Attachments: HIVE-2247.10.patch.txt, HIVE-2247.11.patch.txt, > HIVE-2247.3.patch.txt, HIVE-2247.4.patch.txt, HIVE-2247.5.patch.txt, > HIVE-2247.6.patch.txt, HIVE-2247.7.patch.txt, HIVE-2247.8.patch.txt, > HIVE-2247.9.patch.txt, HIVE-2247.9.patch.txt > > > We need a ALTER TABLE TABLE RENAME PARTITIONfunction that is similar t ALTER > TABLE RENAME. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2531) Allow people to use only issue numbers without 'HIVE-' prefix with `arc diff --jira`.
[ https://issues.apache.org/jira/browse/HIVE-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139020#comment-13139020 ] Hudson commented on HIVE-2531: -- Integrated in Hive-trunk-h0.21 #1041 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1041/]) HIVE-2531 [hive] Allow people to use only issue numbers without 'HIVE-' prefix with `arc diff --jira`. Test Plan: EMPTY Reviewers: jsichi, JIRA Reviewed By: jsichi CC: jsichi, mareksapotafb Differential Revision: 93 jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190567 Files : * /hive/trunk/.arcconfig > Allow people to use only issue numbers without 'HIVE-' prefix with `arc diff > --jira`. > - > > Key: HIVE-2531 > URL: https://issues.apache.org/jira/browse/HIVE-2531 > Project: Hive > Issue Type: Bug >Reporter: Marek Sapota >Assignee: Marek Sapota > Fix For: 0.9.0 > > Attachments: D93.1.patch > > > Allow people to use only issue numbers without 'HIVE-' prefix with `arc diff > --jira`. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2486) Phabricator for code review
[ https://issues.apache.org/jira/browse/HIVE-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136764#comment-13136764 ] Hudson commented on HIVE-2486: -- Integrated in Hive-trunk-h0.21 #1038 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1038/]) HIVE-2486. Phabricator for code review (Marek Sapota via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189535 Files : * /hive/trunk * /hive/trunk/.arcconfig * /hive/trunk/.gitignore * /hive/trunk/build.xml > Phabricator for code review > --- > > Key: HIVE-2486 > URL: https://issues.apache.org/jira/browse/HIVE-2486 > Project: Hive > Issue Type: Bug >Reporter: Marek Sapota >Assignee: Marek Sapota > Fix For: 0.9.0 > > Attachments: D51.1.patch, D51.2.patch, D51.2.patch, D57.1.patch, > D57.2.patch, D63.1.patch, D63.2.patch, D63.3.patch, D69.1.patch, D69.2.patch, > D69.3.patch, D75.1.patch, D75.2.patch, D9.1.diff, D9.2.diff, SOAP, SOAP, > TEST, x > > > Replacing Review Board with Phabricator and Differential. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1461) Clean up references to 'hive.metastore.local'
[ https://issues.apache.org/jira/browse/HIVE-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135829#comment-13135829 ] Hudson commented on HIVE-1461: -- Integrated in Hive-trunk-h0.21 #1036 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1036/]) HIVE-1461 Clean up references to 'hive.metastore.local' (Ashutosh Chuhan via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189025 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMarkPartitionRemote.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreAuthorization.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStore.java * /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java > Clean up references to 'hive.metastore.local' > - > > Key: HIVE-1461 > URL: https://issues.apache.org/jira/browse/HIVE-1461 > Project: Hive > Issue Type: Bug >Reporter: Paul Yang >Assignee: Ashutosh Chauhan >Priority: Minor > Attachments: hive-1461.patch > > > 'hive.metastore.local' should not be referred directly as a string. Instead, > a HiveConf.ConfVar entry should be created and used. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1850) alter table set serdeproperties bypasses regexps checks (leaves table in a non-recoverable state?)
[
https://issues.apache.org/jira/browse/HIVE-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135828#comment-13135828
]
Hudson commented on HIVE-1850:
--
Integrated in Hive-trunk-h0.21 #1036 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1036/])
HIVE-1850 alter table set serdeproperties bypasses regexps checks
(leaves table in a non-recoverable state?) (Amareshwari Sriramadasu via namit)
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1189026
Files :
*
/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java
* /hive/trunk/ql/src/test/queries/clientnegative/alter_table_wrong_regex.q
* /hive/trunk/ql/src/test/queries/clientnegative/create_table_wrong_regex.q
* /hive/trunk/ql/src/test/results/clientnegative/alter_table_wrong_regex.q.out
* /hive/trunk/ql/src/test/results/clientnegative/create_table_wrong_regex.q.out
> alter table set serdeproperties bypasses regexps checks (leaves table in a
> non-recoverable state?)
> --
>
> Key: HIVE-1850
> URL: https://issues.apache.org/jira/browse/HIVE-1850
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
>Affects Versions: 0.7.0
> Environment: Trunk build from a few days ago, but seen once before
> with older version as well.
>Reporter: Terje Marthinussen
>Assignee: Amareshwari Sriramadasu
> Attachments: patch-1850-2.txt, patch-1850.txt
>
>
> {code}
> create table aa ( test STRING )
> ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'
> WITH SERDEPROPERTIES ("input.regex" = "[^\\](.*)", "output.format.string" =
> "$1s");
> {code}
> This will fail. Great!
> {code}
> create table aa ( test STRING )
> ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'
> WITH SERDEPROPERTIES ("input.regex" = "(.*)", "output.format.string" =
> "$1s");
> {code}
> Works, no problem there.
> {code}
> alter table aa set serdeproperties ("input.regex" = "[^\\](.*)",
> "output.format.string" = "$1s");
> {code}
> Wups... I can set that without any problems!
> {code}
> alter table aa set serdeproperties ("input.regex" = "(.*)",
> "output.format.string" = "$1s");
> FAILED: Hive Internal Error: java.util.regex.PatternSyntaxException(Unclosed
> character class near index 7
> [^\](.*)
>^)
> java.util.regex.PatternSyntaxException: Unclosed character class near index 7
> [^\](.*)
>^
> at java.util.regex.Pattern.error(Pattern.java:1713)
> at java.util.regex.Pattern.clazz(Pattern.java:2254)
> at java.util.regex.Pattern.sequence(Pattern.java:1818)
> at java.util.regex.Pattern.expr(Pattern.java:1752)
> at java.util.regex.Pattern.compile(Pattern.java:1460)
> at java.util.regex.Pattern.(Pattern.java:1133)
> at java.util.regex.Pattern.compile(Pattern.java:847)
> at
> org.apache.hadoop.hive.contrib.serde2.RegexSerDe.initialize(RegexSerDe.java:101)
> at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:199)
> at
> org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253)
> at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:484)
> at
> org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:161)
> at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:803)
> at
> org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeAlterTableSerdeProps(DDLSemanticAnalyzer.java:558)
> at
> org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:232)
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:238)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:335)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:686)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:142)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:216)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:370)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> {code}
> After this, all further commands on the table fails, including drop table :)
> 1. The alter table command should probably check the regexp just like the
> create table command does
> 2. Even though the
[jira] [Commented] (HIVE-2501) When new instance of Hive (class) is created, the current database is reset to default (current database shouldn't be changed).
[ https://issues.apache.org/jira/browse/HIVE-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135731#comment-13135731 ] Hudson commented on HIVE-2501: -- Integrated in Hive-trunk-h0.21 #1035 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1035/]) HIVE-2501. When new instance of Hive (class) is created, the current database is reset to default. (Robert Surowka via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1188986 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java > When new instance of Hive (class) is created, the current database is reset > to default (current database shouldn't be changed). > --- > > Key: HIVE-2501 > URL: https://issues.apache.org/jira/browse/HIVE-2501 > Project: Hive > Issue Type: Bug >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2501.1.patch, HIVE-2501.2.patch > > > This bug manifested to me, when first thing I did after starting Hive, was to > call use ; but then calling show tables; was still showing tables > from the default database (and I had to call "use" again to actually change > database). This bug might have manifested only due to a specific Hive > deployment I am using (I didn't investigate this issue that deeply). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2360) create dynamic partition if and only if intermediate source has files
[ https://issues.apache.org/jira/browse/HIVE-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135732#comment-13135732 ] Hudson commented on HIVE-2360: -- Integrated in Hive-trunk-h0.21 #1035 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1035/]) HIVE-2360 create dynamic partition if and only if intermediate source has files (Franklin Hu, Kaushik Lakshminarayanan via Siying Dong) sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1188989 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java > create dynamic partition if and only if intermediate source has files > - > > Key: HIVE-2360 > URL: https://issues.apache.org/jira/browse/HIVE-2360 > Project: Hive > Issue Type: Bug >Reporter: Franklin Hu >Priority: Minor > Attachments: hive-2360.1.patch, hive-2360.2.patch > > > There are some conditions under which a partition description is created due > to insert overwriting a table using dynamic partitioning for partitions that > that are empty (have no files). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2509) Literal bigint
[ https://issues.apache.org/jira/browse/HIVE-2509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135624#comment-13135624 ] Hudson commented on HIVE-2509: -- Integrated in Hive-trunk-h0.21 #1034 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1034/]) HIVE-2509. Literal bigint (Jonathan Chang via jvs) jvs : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1188858 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/literal_ints.q * /hive/trunk/ql/src/test/results/clientpositive/literal_ints.q.out > Literal bigint > -- > > Key: HIVE-2509 > URL: https://issues.apache.org/jira/browse/HIVE-2509 > Project: Hive > Issue Type: New Feature >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Fix For: 0.9.0 > > Attachments: D15.1.patch, D15.1.patch, D15.2.patch, D15.2.patch, > D15.3.patch, D15.3.patch, D15.4.patch, D15.4.patch, D15.4.patch > > > Typing bigints is a pain because you have to write CAST(0 AS BIGINT). We > should let people type 0L instead. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2368) Slow dropping of partitions caused by full listing of storage descriptors
[ https://issues.apache.org/jira/browse/HIVE-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135623#comment-13135623 ] Hudson commented on HIVE-2368: -- Integrated in Hive-trunk-h0.21 #1034 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1034/]) HIVE-2368. Slow dropping of partitions caused by full listing of storage descriptors (Sohan Jain via pauly) pauly : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=116 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java > Slow dropping of partitions caused by full listing of storage descriptors > - > > Key: HIVE-2368 > URL: https://issues.apache.org/jira/browse/HIVE-2368 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Sohan Jain >Assignee: Sohan Jain > Fix For: 0.9.0 > > Attachments: HIVE-2368.1.patch > > > To determine if a column descriptor is unused, we call > listStorageDescriptorsWithCD(), which may return a big list of SDs. This can > severely slow down dropping partitions. > We can add a maximum number of SDs to return, and just ask for 1 SD, since we > are just doing an existential check. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2446) Introduction of client statistics publishers possibility
[ https://issues.apache.org/jira/browse/HIVE-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135498#comment-13135498 ] Hudson commented on HIVE-2446: -- Integrated in Hive-trunk-h0.21 #1033 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1033/]) HIVE-2446. bug (next one) - If constructor of ClientStatsPublisher throws runtime exception it will be propagated to HadoopJobExecHelper progress method and beyond, whereas it shouldnot nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1188796 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java > Introduction of client statistics publishers possibility > > > Key: HIVE-2446 > URL: https://issues.apache.org/jira/browse/HIVE-2446 > Project: Hive > Issue Type: Improvement > Components: Clients, Statistics >Reporter: Robert Surówka >Assignee: Robert Surówka >Priority: Minor > Fix For: 0.8.0 > > Attachments: HIVE-2446.1.patch, HIVE-2446.1.patch, HIVE-2446.2.patch, > HIVE-2446.2.patch, HIVE-2446.3.patch, HIVE-2446.3.patch > > Original Estimate: 1h > Remaining Estimate: 1h > > The purpose of this change is to allow publication or storage of counters > while the job is running. > Introduced two new variables to hive-default.xml and HiveConf.java: > "hive.client.stats.publishers" and "hive.client.stats.counters". First one > specifies classes names, whose instances will be executed by > HadoopJobExecHelper.java (similarly as hooks are) in its method > progress(ExecDriverTaskHandle): MapRedStats. Second one specifies list of > counters that any client stat publishers should publish or stored. Details > regarding format of this list is up to a specific deployment (it is up to > client stats publishers to parse it), yet it is required to use display names > of counter groups and counters. > Added interface ClientStatsPublishers in org.apache.hadoop.hive.ql.stats > package, that must be implemented by all stats publishers. > Added code to progress(ExecDriverTaskHandle): MapRedStats from > HadoopJobExecHelper.java that puts counters' values to a Java map and then > executes registered client stats publishers giving them that map and running > job id. Added two new methods to HadoopJobExecHelper: > extractAllCounterValues(Counters) and getClientStatsPublishers() that are > used by code from previous sentence. > Made cosmetic changes in two other classes > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2145) NPE during parsing order-by expression
[ https://issues.apache.org/jira/browse/HIVE-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135316#comment-13135316 ] Hudson commented on HIVE-2145: -- Integrated in Hive-trunk-h0.21 #1032 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1032/]) HIVE-2512. After HIVE-2145, Hive disallow any use of function in cluster-by clause (Chinna Rao Lalam via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1188473 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientnegative/orderby_function.q * /hive/trunk/ql/src/test/results/clientnegative/orderby_function.q.out > NPE during parsing order-by expression > -- > > Key: HIVE-2145 > URL: https://issues.apache.org/jira/browse/HIVE-2145 > Project: Hive > Issue Type: Bug >Reporter: Ning Zhang >Assignee: Chinna Rao Lalam > Fix For: 0.9.0 > > Attachments: HIVE-2145.patch > > > The following query throws NPE, where it should have throw parsing exception. > hive> select key, count(1) cnt from src group by key order by count(1) limit > 10; > select key, count(1) cnt from src group by key order by count(1) limit 10; > FAILED: Hive Internal Error: java.lang.NullPointerException(null) > java.lang.NullPointerException > at > org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:153) > at > org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:640) > at > org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:761) > at > org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:89) > at > org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:88) > at > org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:125) > at > org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:102) > at > org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory.genExprNode(TypeCheckProcFactory.java:156) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:6830) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:6788) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genReduceSinkPlan(SemanticAnalyzer.java:4303) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:5461) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6022) > at > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:6607) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:238) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:340) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:790) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:209) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:286) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:514) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:156) > We should still allow functions in the order by clause (as in MySQL) but fix > the NPE. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2497) partition pruning prune some right partition under specific conditions
[ https://issues.apache.org/jira/browse/HIVE-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135313#comment-13135313 ] Hudson commented on HIVE-2497: -- Integrated in Hive-trunk-h0.21 #1032 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1032/]) HIVE-2497 partition pruning prune some right partition under specific conditions (binlijin via namit) - begin *PUBLIC* platform impact section - Bugzilla: # - end platform impact - namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1188507 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/ExprProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/ppr_allchildsarenull.q * /hive/trunk/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out > partition pruning prune some right partition under specific conditions > --- > > Key: HIVE-2497 > URL: https://issues.apache.org/jira/browse/HIVE-2497 > Project: Hive > Issue Type: Bug >Affects Versions: 0.7.1 >Reporter: binlijin >Assignee: binlijin > Labels: patch > Fix For: 0.9.0 > > Attachments: hive-2497.2.patch, hive-2497.patch > > > create table src3(key string, value string) partitioned by (pt string) > row format delimited fields terminated by ','; > ALTER TABLE src3 ADD IF NOT EXISTS PARTITION (pt='2011091100') ; > ALTER TABLE src3 ADD IF NOT EXISTS PARTITION (pt='2011091200') ; > ALTER TABLE src3 ADD IF NOT EXISTS PARTITION (pt='2011091300') ; > explain extended > select user_id > from > ( >select > cast(key as int) as user_id > ,case when (value like 'aaa%' or value like 'vvv%') > then 1 > else 0 end as tag_student >from src3 > ) sub > where sub.tag_student > 0; > STAGE DEPENDENCIES: > Stage-1 is a root stage > Stage-0 is a root stage > STAGE PLANS: > Stage: Stage-1 > Map Reduce > Alias -> Map Operator Tree: > sub:src3 > TableScan > alias: src3 > Filter Operator > isSamplingPred: false > predicate: > expr: (CASE WHEN (((value like 'aaa%') or (value like > 'vvv%'))) THEN (1) ELSE (0) END > 0) > type: boolean > Select Operator > expressions: > expr: UDFToInteger(key) > type: int > expr: CASE WHEN (((value like 'aaa%') or (value like > 'vvv%'))) THEN (1) ELSE (0) END > type: int > outputColumnNames: _col0, _col1 > Filter Operator > isSamplingPred: false > predicate: > expr: (_col1 > 0) > type: boolean > Select Operator > expressions: > expr: _col0 > type: int > outputColumnNames: _col0 > File Output Operator > compressed: false > GlobalTableId: 0 > directory: > hdfs://localhost:54310/tmp/hive-tianzhao/hive_2011-10-11_19-26-12_894_9085644225727185586/-ext-10001 > NumFilesPerFileSink: 1 > table: > input format: > org.apache.hadoop.mapred.TextInputFormat > output format: > org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat > properties: > columns _col0 > columns.types int > serialization.format 1 > TotalFiles: 1 > MultiFileSpray: false > Needs Tagging: false > Stage: Stage-0 > Fetch Operator > limit: -1 > if we set hive.optimize.ppd=false; > STAGE DEPENDENCIES: > Stage-1 is a root stage > Stage-0 is a root stage > STAGE PLANS: > Stage: Stage-1 > Map Reduce > Alias -> Map Operator Tree: > sub:src3 > TableScan > alias: src3 > Select Operator > expressions: > expr: UDFToInteger(key) > type: int > expr: CASE WHEN (((value like 'aaa%') or (value like > 'vvv%'))) THEN (1) ELSE (0) END > type: int > outputColumnNames: _col0, _col1 > Filter Operator > isSamplingPred: false > predicate: > expr: (_col1 > 0) > type: boolean > Select Operator > expressions: > expr: _col0 > type: int
