[
https://issues.apache.org/jira/browse/HIVE-3156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434738#comment-13434738
]
Hudson commented on HIVE-3156:
------------------------------
Integrated in Hive-trunk-h0.21 #1605 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1605/])
HIVE-3341 [jira] Making hive tests run against different MR versions
(Sushanth Sowmyan via Ashutosh Chauhan)
Summary:
HIVE-3341 Making hive tests run against different MR versions
After we build hive, we want to have the ability to run unit tests against
specific hadoop versions. Currently, the classpath constructed has multiple
hadoop jars, which makes compiling okay, but running non-deterministic.
An example is HIVE-3156, where running against 0.23 shows issues with a couple
of tests (which should either be shimmed out, or separated into directories the
way it's done in the shims/ directory) - It would also be nice to find these
issues out at test-compile time itself, rather than having them fail at test
runtime.
With this patch, we can set ant variable hadoop.mr.rev to 20, 20S or 23 to test
against a particular version.
Test Plan: current tests continue to work - this is a build system change
Reviewers: JIRA, ashutoshc, cwsteinbach
Reviewed By: ashutoshc
Differential Revision: https://reviews.facebook.net/D4557 (Revision 1372745)
Result = SUCCESS
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1372745
Files :
* /hive/trunk/build-common.xml
* /hive/trunk/build.properties
* /hive/trunk/ivy/common-configurations.xml
* /hive/trunk/shims/build.xml
* /hive/trunk/shims/src/common-secure/test
* /hive/trunk/shims/src/common-secure/test/org
* /hive/trunk/shims/src/common-secure/test/org/apache
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift
*
/hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java
*
/hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java
*
/hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java
*
/hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java
> Support MiniMR tests for Hadoop-0.23
> ------------------------------------
>
> Key: HIVE-3156
> URL: https://issues.apache.org/jira/browse/HIVE-3156
> Project: Hive
> Issue Type: Bug
> Components: Tests
> Affects Versions: 0.9.1
> Environment: Hive-0.9.1 + Hadoop-0.23.0
> Reporter: rohithsharma
>
> When MiniMR tests are ran with hadoop-0.23.0, tests fails throwing following
> exception.
> java.lang.UnsupportedOperationException
> at
> org.apache.hadoop.mapred.MiniMRCluster.getJobTrackerPort(MiniMRCluster.java:88)
> at org.apache.hadoop.hive.ql.QTestUtil.initConf(QTestUtil.java:215)
> In hadoop-0.23 ,few mapreduce API's are not supported like
> getJobTrackerPort().
> Here, we need to use API's based on hadoop versions.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
