Get race condition in hive with script_pipe.q ( the same as HIVE-1491)

2012-02-07 Thread Bing Li 
Hi,All
I got the same error message described in [HIVE-1491] (
https://issues.apache.org/jira/browse/HIVE-1491) when ran script_pipe.q on
Open JDK.
Will hive plan to resolve this race condition?

Details:
=
[junit] Begin query: script_pipe.q
[junit] Ended Job = job_local_0001 with errors
[junit] Error during job, obtaining debugging information...
[junit] Exception: Client Execution failed with error code = 9
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] junit.framework.AssertionFailedError: Client Execution failed
with error code = 9
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_pipe(TestCliDriver.java:27636)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
[junit] at java.lang.reflect.Method.invoke(Method.java:611)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at
junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)


I tried to re-produce it:
1. create table src with two columns: key and value
2. run the following queries:
SELECT TRANSFORM(key, value) USING 'head -n 1' FROM src;// PASS
SELECT TRANSFORM(key, value) USING 'head -n 1' as a,b,c,d FROM src;
//PASS

SELECT TRANSFORM(key, value, key, value) USING 'head -n 1' FROM src;
//PASS
SELECT TRANSFORM(key, value, key, value) USING 'head -n 1' as a,b,c,d FROM
src;//PASS

SELECT TRANSFORM(key, value, key, value, key, value) USING 'head -n 1' FROM
src;//FAILED
SELECT TRANSFORM(key, value, key, value, key, value) USING 'head -n 1' as
a,b,c,d FROM src;//FAILED


Thanks,
-- Bing

JDBC Driver support for multiple database/schema

2012-02-07 Thread Bharath Ganesh 
Hello,

While using the JDBC driver on 0.7.1, there seems to be an issue around
support for multiple databases.

According to Hive JDBC documentation at
https://cwiki.apache.org/Hive/hiveclient.html :
*
*
*For standalone server, uri is jdbc:hive://host:port/dbname where host
and port are determined by where the hive server is run. For example,
jdbc:hive://localhost:1/default. Currently, the only dbname supported
is default. *

Was there any specific reason to not support non-default databases? The
obvious way for me to get it working is to patch the connection object,
parse the connection string, pick the database name and issue a USE
db-name query as part of initializing the connection. Do you think this
is a reasonable way to do this?

Would be happy to have your suggestions!

Thanks,
Bharath

[jira] [Commented] (HIVE-2779) Improve hooks run in Driver

2012-02-07 Thread Phabricator (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202611#comment-13202611
 ] 

Phabricator commented on HIVE-2779:
---

njain has accepted the revision HIVE-2779 [jira] Improve hooks run in Driver.

  Looks good - one minor comment. Can you add that all the inputs and outputs 
need not be populated
  in the semantic analyzer hook ?

REVISION DETAIL
  https://reviews.facebook.net/D1599


 Improve hooks run in Driver
 ---

 Key: HIVE-2779
 URL: https://issues.apache.org/jira/browse/HIVE-2779
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch


 There are some small improvements that can be made to the hooks which are run 
 in the Driver:
 1) The code to get hooks has been clearly just been copy+pasted for each of 
 Pre/Post/OnFailure/SemanticAnalyzer hooks.  This code should be consolidated 
 into a single method.
 2) There is a lot more information available to SemanticAnalyzer hooks which 
 ran after semantic analysis than to those that run before, such as inputs and 
 outputs.  We should make some of this information available to those hooks, 
 preferably through HiveSemanticAnalyzerHookContext, so that existing hooks 
 aren't broken.
 3) Currently, possibly unintentionally, hooks are initialized and run in the 
 order they appear in the comma separated list that is the value of the 
 configuration variable.  This is a useful property, we should add comments 
 indicating this is desired and add a unit test to enforce it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2716) Move retry logic in HiveMetaStore to a separe class

2012-02-07 Thread Ashutosh Chauhan (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202683#comment-13202683
 ] 

Ashutosh Chauhan commented on HIVE-2716:


@Enis,
Patch has gone stale. Can you rebase it ?

 Move retry logic in HiveMetaStore to a separe class
 ---

 Key: HIVE-2716
 URL: https://issues.apache.org/jira/browse/HIVE-2716
 Project: Hive
  Issue Type: Sub-task
  Components: Metastore
Affects Versions: 0.9.0
Reporter: Enis Soztutar
Assignee: Enis Soztutar
 Attachments: HIVE-2716.D1227.1.patch


 In HIVE-1219, method retrying for raw store operation are introduced to 
 handle jdo operations more robustly. However, the abstraction for the 
 RawStore operations can be moved to a separate class implementing RawStore, 
 which should clean up the code base for HiveMetaStore. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Kevin Wilfong (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-2612:


Attachment: HIVE-2612.2.patch.txt

 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, 
 HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Kevin Wilfong (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202719#comment-13202719
 ] 

Kevin Wilfong commented on HIVE-2612:
-

I attached a patch to this JIRA which provides scripts to update the metastore 
for derby, MySQL and postgres.

It also changes the default cluster name to '' (empty string) and fixes an 
inconsistency where the size of PRIMARY_CLUSTER_NAME in SDS had a different 
size than the CLUSTER_NAME column in CLUSTER_SDS.

 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, 
 HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Namit Jain (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202726#comment-13202726
 ] 

Namit Jain commented on HIVE-2612:
--

All the existing APIs will continue to work.

 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, 
 HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Phabricator (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2612:
--

Attachment: HIVE-2612.D1569.6.patch

njain updated the revision HIVE-2612 [jira] support hive table/partitions 
coexistes in more than one clusters.
Reviewers: JIRA

REVISION DETAIL
  https://reviews.facebook.net/D1569

AFFECTED FILES
  conf/hive-default.xml.template
  metastore/scripts/upgrade/derby/010-HIVE-2612.derby.sql
  metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql
  metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql
  metastore/scripts/upgrade/mysql/010-HIVE-2612.mysql.sql
  metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql
  metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql
  metastore/scripts/upgrade/postgres/010-HIVE-2612.postgres.sql
  metastore/src/model/package.jdo
  
metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java
  
metastore/src/model/org/apache/hadoop/hive/metastore/model/MClusterStorageDescriptor.java
  metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
  metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py
  metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py
  metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
  metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp
  metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h
  metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClusterStorageDescriptor.java
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java
  metastore/src/gen/thrift/gen-php/hive_metastore_constants.php
  metastore/src/gen/thrift/gen-php/ThriftHiveMetastore.php
  metastore/src/gen/thrift/gen-php/hive_metastore_types.php
  metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php
  metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php
  metastore/if/hive_metastore.thrift
  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
  ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java
  ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java
  ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java


 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, 
 HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Namit Jain (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202724#comment-13202724
 ] 

Namit Jain commented on HIVE-2612:
--

Can everyone concerned please take a look ?

For anyone not using clusters, they need to run the scripts provided in this 
patch to upgrade the metastore.
The time taken for the upgrade depends on the size of the metastore (number of 
tables/partitions), but it should
be fairly small - it is less than 10 minutes for facebook cluster.

 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, 
 HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Kevin Wilfong (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202783#comment-13202783
 ] 

Kevin Wilfong commented on HIVE-2612:
-

This change will require the user to update their metastore schema.  The 
scripts in the patch should be sufficient provided the schema is already up to 
date.

The only schema changes needed are a new table and a new column is added to 
SDS, it should not take long, no more than five minutes depending on the size 
of the SDS table, to update.

 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, 
 HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2779) Improve hooks run in Driver

2012-02-07 Thread Phabricator (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2779:
--

Attachment: HIVE-2779.D1599.3.patch

kevinwilfong updated the revision HIVE-2779 [jira] Improve hooks run in 
Driver.
Reviewers: JIRA, njain

  Updated the comments in HiveSemanticAnalyzerHookContext and 
HiveSemanticAnalyzerHookContextImpl to more explicitely say that the getInputs 
and getOutputs methods will only not return null if they are called after the 
update method is called, which should only be the case in the postAnalysis 
method of hooks.

REVISION DETAIL
  https://reviews.facebook.net/D1599

AFFECTED FILES
  ql/src/test/results/clientnegative/bad_exec_hooks.q.out
  ql/src/test/results/clientpositive/hook_order.q.out
  ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHooksRunInOrder.java
  ql/src/test/queries/clientpositive/hook_order.q
  ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHook.java
  
ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java
  
ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContextImpl.java
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java


 Improve hooks run in Driver
 ---

 Key: HIVE-2779
 URL: https://issues.apache.org/jira/browse/HIVE-2779
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, 
 HIVE-2779.D1599.3.patch


 There are some small improvements that can be made to the hooks which are run 
 in the Driver:
 1) The code to get hooks has been clearly just been copy+pasted for each of 
 Pre/Post/OnFailure/SemanticAnalyzer hooks.  This code should be consolidated 
 into a single method.
 2) There is a lot more information available to SemanticAnalyzer hooks which 
 ran after semantic analysis than to those that run before, such as inputs and 
 outputs.  We should make some of this information available to those hooks, 
 preferably through HiveSemanticAnalyzerHookContext, so that existing hooks 
 aren't broken.
 3) Currently, possibly unintentionally, hooks are initialized and run in the 
 order they appear in the comma separated list that is the value of the 
 configuration variable.  This is a useful property, we should add comments 
 indicating this is desired and add a unit test to enforce it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2781) HBaseSerDe should allow users to specify the timestamp passed to Puts

2012-02-07 Thread Francis Liu (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Francis Liu updated HIVE-2781:
--

Description: 
Users may want to specify the timestamp used for Put requests to hbase. Thus 
enabling users to have the same timestamp for a single batch of writes. Which 
would be useful for a number of things. HCatalog's HBase storageHandler 
implementation makes use of this feature to provide users with snapshot 
isolation and write transactions. My proposal is to add the timestamp option as 
a final static member:

public static final long HBASE_PUT_TIMESTAMP = hbase.put_timestamp

And passing this value to all the Puts created by serialize()
Summary: HBaseSerDe should allow users to specify the timestamp passed 
to Puts   (was: HBaseSerDe should allow users to specify the timestap to be 
used in Puts )

 HBaseSerDe should allow users to specify the timestamp passed to Puts 
 --

 Key: HIVE-2781
 URL: https://issues.apache.org/jira/browse/HIVE-2781
 Project: Hive
  Issue Type: Improvement
Reporter: Francis Liu

 Users may want to specify the timestamp used for Put requests to hbase. Thus 
 enabling users to have the same timestamp for a single batch of writes. Which 
 would be useful for a number of things. HCatalog's HBase storageHandler 
 implementation makes use of this feature to provide users with snapshot 
 isolation and write transactions. My proposal is to add the timestamp option 
 as a final static member:
 public static final long HBASE_PUT_TIMESTAMP = hbase.put_timestamp
 And passing this value to all the Puts created by serialize()

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Kevin Wilfong (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Wilfong updated HIVE-2612:


Attachment: HIVE-2612.3.patch.txt

 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.3.patch.txt, HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, 
 HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, 
 HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters

2012-02-07 Thread Kevin Wilfong (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13202935#comment-13202935
 ] 

Kevin Wilfong commented on HIVE-2612:
-

I attached a patch which fixes an error seen where JDO was looking for a column 
which doesn't exist in the schema in the update scripts provided.  The 
collection of MClusterStorageDescriptors was changed from a List to a Set, and 
a primary key was indicated in package.jdo.  This fixes the error by removing 
the need to order the MClusterStorageDescriptors and providing a way to 
uniquely identify them.  The primary key is already present in the upgrade 
scripts provided.

 support hive table/partitions coexistes in more than one clusters
 -

 Key: HIVE-2612
 URL: https://issues.apache.org/jira/browse/HIVE-2612
 Project: Hive
  Issue Type: New Feature
  Components: Metastore
Reporter: He Yongqiang
Assignee: Namit Jain
 Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, 
 HIVE-2612.3.patch.txt, HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, 
 HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, 
 HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch


 1) add cluster object into hive metastore
 2) each partition/table has a creation cluster and a list of living clusters, 
 and also data location in each cluster

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-2782) New BINARY type produces unexpected results with supported UDFS when using MapReduce2

2012-02-07 Thread Zhenxiao Luo (Created) (JIRA) 
New BINARY type produces unexpected results with supported UDFS when using 
MapReduce2
-

 Key: HIVE-2782
 URL: https://issues.apache.org/jira/browse/HIVE-2782
 Project: Hive
  Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Zhenxiao Luo


When using MapReduce2 for Hive

ba_table_udfs is failing with unexpected output:

[junit] Begin query: ba_table_udfs.q
[junit] 12/01/23 13:32:28 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 13:32:28 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I 
lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I 
Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I 
java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I Caused 
by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* more -I 
job_[0-9]*_[0-9]* -I USING 'java -cp 
/home/cloudera/Code/hive/build/ql/test/logs/clientpositive/ba_table_udfs.q.out 
/home/cloudera/Code/hive/ql/src/test/results/clientpositive/ba_table_udfs.q.out
[junit] 20,26c20,26
[junit]  2 10val_101
[junit]  3 164val_164  1
[junit]  3 150val_150  1
[junit]  2 18val_181
[junit]  3 177val_177  1
[junit]  2 12val_121
[junit]  2 11val_111
[junit] —
[junit]  3 120val_120  1
[junit]  3 192val_192  1
[junit]  3 119val_119  1
[junit]  3 187val_187  1
[junit]  3 176val_176  1
[junit]  3 199val_199  1
[junit]  3 118val_118  1
[junit] Exception: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to 
get more logs.
[junit] junit.framework.AssertionFailedError: Client execution results failed 
with error code = 1
[junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to 
get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at 
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ba_table_udfs(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to 
get more logs.)
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 10.751 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
[for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while 
executing this line:
[for] /home/cloudera/Code/hive/build.xml:328: The following error occurred 
while executing this line:
[for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed!

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HIVE-1977) DESCRIBE TABLE syntax doesn't support specifying a database qualified table name

2012-02-07 Thread Zhenxiao Luo (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhenxiao Luo reassigned HIVE-1977:
--

Assignee: Zhenxiao Luo

 DESCRIBE TABLE syntax doesn't support specifying a database qualified table 
 name
 

 Key: HIVE-1977
 URL: https://issues.apache.org/jira/browse/HIVE-1977
 Project: Hive
  Issue Type: Bug
  Components: Query Processor, SQL
Reporter: Carl Steinbach
Assignee: Zhenxiao Luo

 The syntax for DESCRIBE is broken. It should be:
 {code}
 DESCRIBE [EXTENDED] [database DOT]table [column]
 {code}
 but is actually
 {code}
 DESCRIBE [EXTENDED] table[DOT col_name]
 {code}
 Ref: http://dev.mysql.com/doc/refman/5.0/en/describe.html

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-2783) Predicate Pushdown failure a view with union when using MapReduce2

2012-02-07 Thread Zhenxiao Luo (Created) (JIRA) 
Predicate Pushdown failure a view with union when using MapReduce2
--

 Key: HIVE-2783
 URL: https://issues.apache.org/jira/browse/HIVE-2783
 Project: Hive
  Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Zhenxiao Luo


ppd_union_view failure:

[junit] Begin query: ppd_union_view.q
[junit] 12/01/23 16:57:30 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:57:30 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:57:37 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:57:37 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:57:44 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:57:44 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:57:51 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:57:51 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:57:57 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:57:57 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:04 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:04 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:11 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:11 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:16 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:16 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:21 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:21 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:26 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:26 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:31 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:31 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:35 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:35 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:41 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:41 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:46 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:46 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:50 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:50 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:58:55 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:58:55 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:00 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:00 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:04 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:04 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use

[jira] [Updated] (HIVE-2774) Message when trying to create a view from a view should give name of offending view

2012-02-07 Thread Namit Jain (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain updated HIVE-2774:
-

Status: Open  (was: Patch Available)

 Message when trying to create a view from a view should give name of 
 offending view
 ---

 Key: HIVE-2774
 URL: https://issues.apache.org/jira/browse/HIVE-2774
 Project: Hive
  Issue Type: Improvement
  Components: Query Processor
Affects Versions: 0.7.1
Reporter: Jakob Homan
Assignee: Jakob Homan
 Fix For: 0.9.0

 Attachments: HIVE-2774.patch


 Currently when trying to create a view that contains another view (a 
 prohibited operation) the exception is:
 {noformat}FAILED: Error in semantic analysis: Invalid Table Alias Referencing 
 view from foreign databases is not supported.{noformat}
 'Twould be better if this message included the view that caused the error so 
 that when building views from lots of tables, one doesn't need to hunt to 
 figure out which one was the actual view.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2787) When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage error

2012-02-07 Thread Zhenxiao Luo (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhenxiao Luo updated HIVE-2787:
---

Description: 
[junit] Begin query: archive_multi.q
[junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] rmr: DEPRECATED: Please use 'rm -r' instead.
[junit] Deleted 
/var/lib/hudson/workspace/CDH4-Hive-0.8.0/build/ql/test/data/warehouse/tstsrc
[junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] archive -archiveName NAME -p parent path src* dest
[junit] Invalid usage.
[junit] 
[junit] Exception: Client Execution failed with error code = 9
This affects the following TestCliDriver test cases:

archive
archive_multi
archive1
archive_insert1
archive_insert2
archive_insert3
archive_insert4
archive_multi1
archive_multi3
archive_multi4
archive_multi5
archive_multi6

 When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage 
 error
 --

 Key: HIVE-2787
 URL: https://issues.apache.org/jira/browse/HIVE-2787
 Project: Hive
  Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Carl Steinbach

 [junit] Begin query: archive_multi.q
 [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] rmr: DEPRECATED: Please use 'rm -r' instead.
 [junit] Deleted 
 /var/lib/hudson/workspace/CDH4-Hive-0.8.0/build/ql/test/data/warehouse/tstsrc
 [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] archive -archiveName NAME -p parent path src* dest
 [junit] Invalid usage.
 [junit] 
 [junit] Exception: Client Execution failed with error code = 9
 This affects the following TestCliDriver test cases:
 archive
 archive_multi
 archive1
 archive_insert1
 archive_insert2
 archive_insert3
 archive_insert4
 archive_multi1
 archive_multi3
 archive_multi4
 archive_multi5
 archive_multi6

--
This

[jira] [Updated] (HIVE-2726) COALESCE(NULL, NULL) NPEs

2012-02-07 Thread Jonathan Chang (Updated) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jonathan Chang updated HIVE-2726:
-

Attachment: HIVE-2726.D1317.1.patch

 COALESCE(NULL, NULL) NPEs
 -

 Key: HIVE-2726
 URL: https://issues.apache.org/jira/browse/HIVE-2726
 Project: Hive
  Issue Type: Bug
Reporter: Jonathan Chang
Assignee: Jonathan Chang
Priority: Minor
 Attachments: HIVE-2726.D1317.1.patch, HIVE-2726.D1317.1.patch


 ReturnOIResolver returns null when it gets no non-void arguments.  This is 
 bad.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-2788) When integrating into MapReduce2, get wrong file exception in loading archive_corrupt.rc

2012-02-07 Thread Zhenxiao Luo (Created) (JIRA) 
When integrating into MapReduce2, get wrong file exception in loading 
archive_corrupt.rc


 Key: HIVE-2788
 URL: https://issues.apache.org/jira/browse/HIVE-2788
 Project: Hive
  Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Zhenxiao Luo


archive_corrupt.q is failing due to file format exception when loading 
archive_corrupt.rc:

[junit] Running org.apache.hadoop.hive.cli.TestCliDriver
[junit] Begin query: archive_corrupt.q
[junit] Copying file: 
file:/home/cloudera/Code/hive/data/files/archive_corrupt.rc
[junit] Exception: Client Execution failed with error code = 9
[junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to 
get more logs.
[junit] junit.framework.AssertionFailedError: Client Execution failed with 
error code = 9
[junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to 
get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at 
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_corrupt(TestCliDriver.java:109)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to 
get more logs.)
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 6.778 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
[for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while 
executing this line:
[for] /home/cloudera/Code/hive/build.xml:328: The following error occurred 
while executing this line:
[for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed!

And, in /build/ql/test/logs/clientpositive/archive_corrupt.q.out:

PREHOOK: query: drop table tstsrcpart
PREHOOK: type: DROPTABLE
POSTHOOK: query: drop table tstsrcpart
POSTHOOK: type: DROPTABLE
PREHOOK: query: create table tstsrcpart like srcpart
PREHOOK: type: CREATETABLE
POSTHOOK: query: create table tstsrcpart like srcpart
POSTHOOK: type: CREATETABLE
POSTHOOK: Output: default@tstsrcpart
PREHOOK: query: load data local inpath '../data/files/archive_corrupt.rc' 
overwrite into table tstsrcpart partition (ds='2008-04-08', hr='11')
PREHOOK: type: LOAD
PREHOOK: Output: default@tstsrcpart
Failed with exception Wrong file format. Please check the file's format.
FAILED: Execution Error, return code 1 from 
org.apache.hadoop.hive.ql.exec.MoveTask

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-2789) When integrating into MapReduce2, 'select * from src distribute by src.key limit 1' returns non-deterministic result

2012-02-07 Thread Zhenxiao Luo (Created) (JIRA) 
When integrating into MapReduce2, 'select * from src distribute by src.key 
limit 1' returns non-deterministic result


 Key: HIVE-2789
 URL: https://issues.apache.org/jira/browse/HIVE-2789
 Project: Hive
  Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Zhenxiao Luo


query_properties.q test failure:

[junit] Begin query: query_properties.q
[junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 17:00:27 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/23 17:00:27 WARN conf.Configuration: mapred.local.dir is 
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/23 17:00:31 WARN conf.Configuration: mapred.system.dir is 
deprecated. Instead, use

[jira] [Assigned] (HIVE-2784) Integrating with MapReduce2 get NPE throwed when executing a query with a TABLESAMPLE(x percent) clause

2012-02-07 Thread Carl Steinbach (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach reassigned HIVE-2784:


Assignee: Carl Steinbach

 Integrating with MapReduce2 get NPE throwed when executing a query with a 
 TABLESAMPLE(x percent) clause
 -

 Key: HIVE-2784
 URL: https://issues.apache.org/jira/browse/HIVE-2784
 Project: Hive
  Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Carl Steinbach

 the following TestCliDriver testcases fail:
 sample_islocalmode_hook
 split_sample
 [junit] java.lang.NullPointerException
 [junit]   at 
 org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450)
 [junit]   at 
 org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403)
 [junit]   at 
 org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472)
 [junit]   at 
 org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464)
 [junit]   at 
 org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360)
 [junit]   at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215)
 [junit]   at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212)
 [junit]   at java.security.AccessController.doPrivileged(Native Method)
 [junit]   at javax.security.auth.Subject.doAs(Subject.java:396)
 [junit]   at 
 org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
 [junit]   at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212)
 [junit]   at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:592)
 [junit]   at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:587)
 [junit]   at java.security.AccessController.doPrivileged(Native Method)
 [junit]   at javax.security.auth.Subject.doAs(Subject.java:396)
 [junit]   at 
 org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
 [junit]   at 
 org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:587)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:452)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:710)
 [junit]   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 [junit]   at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 [junit]   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 [junit]   at java.lang.reflect.Method.invoke(Method.java:597)
 [junit]   at org.apache.hadoop.util.RunJar.main(RunJar.java:200)
 There are other qfiles which pass which use TABLESAMPLE without specifying a 
 percent

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2779) Improve hooks run in Driver

2012-02-07 Thread Hudson (Commented) (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13203311#comment-13203311
 ] 

Hudson commented on HIVE-2779:
--

Integrated in Hive-trunk-h0.21 #1247 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1247/])
HIVE-2779 Improve Hooks run in Driver
(Kevin Wilfong via namit)

namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1241729
Files : 
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java
* 
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHook.java
* 
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java
* 
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContextImpl.java
* 
/hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHooksRunInOrder.java
* /hive/trunk/ql/src/test/queries/clientpositive/hook_order.q
* /hive/trunk/ql/src/test/results/clientnegative/bad_exec_hooks.q.out
* /hive/trunk/ql/src/test/results/clientpositive/hook_order.q.out


 Improve hooks run in Driver
 ---

 Key: HIVE-2779
 URL: https://issues.apache.org/jira/browse/HIVE-2779
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, 
 HIVE-2779.D1599.3.patch


 There are some small improvements that can be made to the hooks which are run 
 in the Driver:
 1) The code to get hooks has been clearly just been copy+pasted for each of 
 Pre/Post/OnFailure/SemanticAnalyzer hooks.  This code should be consolidated 
 into a single method.
 2) There is a lot more information available to SemanticAnalyzer hooks which 
 ran after semantic analysis than to those that run before, such as inputs and 
 outputs.  We should make some of this information available to those hooks, 
 preferably through HiveSemanticAnalyzerHookContext, so that existing hooks 
 aren't broken.
 3) Currently, possibly unintentionally, hooks are initialized and run in the 
 order they appear in the comma separated list that is the value of the 
 configuration variable.  This is a useful property, we should add comments 
 indicating this is desired and add a unit test to enforce it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Hive-trunk-h0.21 - Build # 1247 - Failure

2012-02-07 Thread Apache Jenkins Server 
Changes for Build #1204
[cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws)


Changes for Build #1205

Changes for Build #1207
[namit] HIVE-2718 NPE in union followed by join
(He Yongqiang via namit)


Changes for Build #1208

Changes for Build #1209

Changes for Build #1210
[namit] HIVE-2674 get_partitions_ps throws TApplicationException if table 
doesn't
exist (Kevin Wilfong via namit)


Changes for Build #1211
[cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao 
Luo via cws)

[cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws)


Changes for Build #1212
[hashutosh] HIVE-2589 : Newly created partition should inherit properties from 
table (Ashutosh Chauhan)


Changes for Build #1213

Changes for Build #1214

Changes for Build #1215

Changes for Build #1216
[cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws)


Changes for Build #1217

Changes for Build #1218

Changes for Build #1219
[hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS 
environment setting (thw via hashutosh)


Changes for Build #1220
[namit] HIVE-2727 add a testcase for partitioned view on union and base tables 
have
index (He Yongqiang via namit)


Changes for Build #1221
[hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of 
connection failure to server (hashutosh)

[cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive
(Enis Söztutar via Carl Steinbach)

Summary:
third version of the patch

Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S
release.

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: cwsteinbach, enis

Differential Revision: https://reviews.facebook.net/D1389


Changes for Build #1222
[namit] HIVE-2750 Hive multi group by single reducer optimization causes 
invalid column
reference error (Kevin Wilfong via namit)


Changes for Build #1223

Changes for Build #1224
[cws] HIVE-2734 [jira] Fix some nondeterministic test output
(Zhenxiao Luo via Carl Steinbach)

Summary:
HIVE-2734: Fix some nondeterministic test output

Many Hive query tests lack an ORDER BY clause, and consequently the ordering
of the rows in the result set is nondeterministic:

groupby1_limit
input11_limit
input1_limit
input_lazyserde
join18_multi_distinct
join_1to1
join_casesensitive
join_filters
join_nulls
merge3
rcfile_columnar
rcfile_lazydecompress
rcfile_union
sample10
udf_sentences
union24
columnarserde_create_shortcut
combine1
global_limit

Test Plan: EMPTY

Reviewers: JIRA, cwsteinbach

Reviewed By: cwsteinbach

CC: zhenxiao, cwsteinbach

Differential Revision: https://reviews.facebook.net/D1449

[namit] HIVE-2754 NPE in union with lateral view
(Yongqiang He via namit)


Changes for Build #1225

Changes for Build #1226

Changes for Build #1227
[namit] HIVE-2755 union follwowed by union_subq does not work if the subquery 
union
has reducers (He Yongqiang via namit)


Changes for Build #1228

Changes for Build #1229
[hashutosh] HIVE-2735: PlanUtils.configureTableJobPropertiesForStorageHandler() 
is not called for partitioned table (sushanth via ashutosh)


Changes for Build #1230
[cws] HIVE-2760 [jira] TestCliDriver should log elapsed time

Summary: HIVE-2760. TestCliDriver should log elapsed time

Test Plan: EMPTY

Reviewers: JIRA, ashutoshc

Reviewed By: ashutoshc

CC: ashutoshc, cwsteinbach

Differential Revision: https://reviews.facebook.net/D1503

[cws] HIVE-2662 [jira] Add Ant configuration property for dumping classpath of 
tests

Summary: HIVE-2662. Add Ant configuration property for dumping classpath of
tests

Test Plan: EMPTY

Reviewers: JIRA, jsichi, ashutoshc

Reviewed By: ashutoshc

CC: ashutoshc

Differential Revision: https://reviews.facebook.net/D903


Changes for Build #1231
[hashutosh] HIVE_2645: Hive Web Server startup messages logs incorrect path it 
is searching for WAR (Edward Capriolo via Ashutosh Chauhan)


Changes for Build #1232

Changes for Build #1233
[sdong] HIVE-2249 When creating constant expression for numbers, try to infer 
type from another comparison operand, instead of trying to use integer first, 
and then long and double (Zhiqiu Kong via Siying Dong)


Changes for Build #1234

Changes for Build #1235
[heyongqiang] HIVE-2765 hbase handler uses ZooKeeperConnectionException which 
is not compatible with HBase versions other than 0.89 (Pei Yue via He Yongqiang)


Changes for Build #1236

Changes for Build #1237

Changes for Build #1238
[heyongqiang] HIVE-2772 [jira] make union31.q deterministic
(Namit Jain via Yongqiang He)

Summary:
https://issues.apache.org/jira/browse/HIVE-2772

HIVE-2772



Test Plan: EMPTY

Reviewers: JIRA, ashutoshc

Reviewed By: ashutoshc

CC: ashutoshc

Differential Revision: https://reviews.facebook.net/D1557

[kevinwilfong] HIVE-2758 Metastore is caching too aggressively (Kevin Wilfong 
reviewed by Carl Steinbach)


Changes for Build #1239

Changes for Build #1240
[namit] HIVE-2762 Alter Table Partition Concatenate Fails On Certain

[jira] [Assigned] (HIVE-2789) When integrating into MapReduce2, 'select * from src distribute by src.key limit 1' returns non-deterministic result

2012-02-07 Thread Carl Steinbach (Assigned) (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach reassigned HIVE-2789:


Assignee: Carl Steinbach  (was: Zhenxiao Luo)

 When integrating into MapReduce2, 'select * from src distribute by src.key 
 limit 1' returns non-deterministic result
 

 Key: HIVE-2789
 URL: https://issues.apache.org/jira/browse/HIVE-2789
 Project: Hive
  Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Carl Steinbach

 query_properties.q test failure:
 [junit] Begin query: query_properties.q
 [junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.system.dir is 
 deprecated. Instead, use mapreduce.jobtracker.system.dir
 [junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.local.dir is 
 deprecated. Instead, use mapreduce.cluster.local.dir
 [junit] 12/01/23 17:00:27 WARN conf.Configuration: