Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #217

2012-12-02 Thread Apache Jenkins Server
See 
https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/217/

--
Started by timer
Building remotely on ubuntu4 in workspace 
https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/
hudson.util.IOException2: remote file operation failed: 
https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/ 
at hudson.remoting.Channel@3780abed:ubuntu4
at hudson.FilePath.act(FilePath.java:848)
at hudson.FilePath.act(FilePath.java:825)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:743)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:685)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1324)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:676)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:581)
at hudson.model.Run.execute(Run.java:1518)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:236)
Caused by: java.io.IOException: Remote call on ubuntu4 failed
at hudson.remoting.Channel.call(Channel.java:674)
at hudson.FilePath.act(FilePath.java:841)
... 11 more
Caused by: java.lang.LinkageError: loader (instance of  
hudson/remoting/RemoteClassLoader): attempted  duplicate class definition for 
name: hudson/model/Descriptor
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:634)
at java.lang.ClassLoader.defineClass(ClassLoader.java:480)
at 
hudson.remoting.RemoteClassLoader.loadClassFile(RemoteClassLoader.java:152)
at 
hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:131)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at java.lang.Class.getDeclaredFields0(Native Method)
at java.lang.Class.privateGetDeclaredFields(Class.java:2308)
at java.lang.Class.getDeclaredField(Class.java:1897)
at 
java.io.ObjectStreamClass.getDeclaredSUID(ObjectStreamClass.java:1624)
at java.io.ObjectStreamClass.access$700(ObjectStreamClass.java:69)
at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:442)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.init(ObjectStreamClass.java:430)
at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:327)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:564)
at 
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1600)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1513)
at 
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1600)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1513)
at 
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1749)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at 
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1963)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1887)
at 
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1770)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at 
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1963)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1887)
at 
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1770)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at 
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1963)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1887)
at 
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1770)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:368)
at hudson.remoting.UserRequest.deserialize(UserRequest.java:182)
at hudson.remoting.UserRequest.perform(UserRequest.java:98)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:326)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 

Hive-trunk-h0.21 - Build # 1830 - Fixed

2012-12-02 Thread Apache Jenkins Server
Changes for Build #1828
[hashutosh] HIVE-3724 : Metastore tests use hardcoded ports (Kevin Wilfong via 
Ashutosh Chauhan)


Changes for Build #1829

Changes for Build #1830



All tests passed

The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1830)

Status: Fixed

Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1830/ to 
view the results.

[jira] [Created] (HIVE-3762) Minor fix for 'tableName' in Hive.g

2012-12-02 Thread Navis (JIRA)
Navis created HIVE-3762:
---

 Summary: Minor fix for 'tableName' in Hive.g
 Key: HIVE-3762
 URL: https://issues.apache.org/jira/browse/HIVE-3762
 Project: Hive
  Issue Type: Improvement
  Components: Query Processor
Reporter: Navis
Assignee: Navis
Priority: Trivial


Current definition for 'tableName' is (db=Identifier DOT)? tab=Identifier. If 
user specifies value default. for it, hive parser accepts default as table 
name and reserves . for next token but it's not valid.

Really trivial but it is small needed part for improving query auto-completion 
(I'm doing it).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-3747) Provide hive operation name for hookContext

2012-12-02 Thread Namit Jain (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508465#comment-13508465
 ] 

Namit Jain commented on HIVE-3747:
--

+1

 Provide hive operation name for hookContext
 ---

 Key: HIVE-3747
 URL: https://issues.apache.org/jira/browse/HIVE-3747
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Sudhanshu Arora
Assignee: Shreepadma Venugopalan
 Attachments: HIVE-3747.1.patch.txt


 The hookContext exposed through ExecuteWithHookContext, does not provide the 
 name of the Hive operation. 
 The following public API should be added in HookContext.
 public String getOperationName() {
 return SessionState.get().getHiveOperation().name();
 }

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-3747) Provide hive operation name for hookContext

2012-12-02 Thread Namit Jain (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508466#comment-13508466
 ] 

Namit Jain commented on HIVE-3747:
--

https://reviews.facebook.net/D7089

just for the record

 Provide hive operation name for hookContext
 ---

 Key: HIVE-3747
 URL: https://issues.apache.org/jira/browse/HIVE-3747
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Sudhanshu Arora
Assignee: Shreepadma Venugopalan
 Attachments: HIVE-3747.1.patch.txt


 The hookContext exposed through ExecuteWithHookContext, does not provide the 
 name of the Hive operation. 
 The following public API should be added in HookContext.
 public String getOperationName() {
 return SessionState.get().getHiveOperation().name();
 }

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-3747) Provide hive operation name for hookContext

2012-12-02 Thread Shreepadma Venugopalan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508481#comment-13508481
 ] 

Shreepadma Venugopalan commented on HIVE-3747:
--

Thanks Namit for creating a review request. Will do so in the future for other 
reviews. 

 Provide hive operation name for hookContext
 ---

 Key: HIVE-3747
 URL: https://issues.apache.org/jira/browse/HIVE-3747
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Sudhanshu Arora
Assignee: Shreepadma Venugopalan
 Attachments: HIVE-3747.1.patch.txt


 The hookContext exposed through ExecuteWithHookContext, does not provide the 
 name of the Hive operation. 
 The following public API should be added in HookContext.
 public String getOperationName() {
 return SessionState.get().getHiveOperation().name();
 }

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-3633) sort-merge join does not work with sub-queries

2012-12-02 Thread Namit Jain (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain updated HIVE-3633:
-

Attachment: hive.3633.8.patch

 sort-merge join does not work with sub-queries
 --

 Key: HIVE-3633
 URL: https://issues.apache.org/jira/browse/HIVE-3633
 Project: Hive
  Issue Type: Improvement
  Components: Query Processor
Reporter: Namit Jain
Assignee: Namit Jain
 Attachments: hive.3633.1.patch, hive.3633.2.patch, hive.3633.3.patch, 
 hive.3633.4.patch, hive.3633.5.patch, hive.3633.6.patch, hive.3633.7.patch, 
 hive.3633.8.patch


 Consider the following query:
 create table smb_bucket_1(key int, value string) CLUSTERED BY (key) SORTED BY 
 (key) INTO 6 BUCKETS STORED AS TEXTFILE;
 create table smb_bucket_2(key int, value string) CLUSTERED BY (key) SORTED BY 
 (key) INTO 6 BUCKETS STORED AS TEXTFILE;
 -- load the above tables
 set hive.optimize.bucketmapjoin = true;
 set hive.optimize.bucketmapjoin.sortedmerge = true;
 set hive.input.format = 
 org.apache.hadoop.hive.ql.io.BucketizedHiveInputFormat;
 explain
 select count(*) from
 (
 select /*+mapjoin(a)*/ a.key as key1, b.key as key2, a.value as value1, 
 b.value as value2
 from smb_bucket_1 a join smb_bucket_2 b on a.key = b.key)
 subq;
 The above query does not use sort-merge join. This would be very useful as we 
 automatically convert the queries to use sorting and bucketing properties for 
 join.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HIVE-3763) Aggregation followed by a sort-merge join requires a new MR job

2012-12-02 Thread Namit Jain (JIRA)
Namit Jain created HIVE-3763:


 Summary: Aggregation followed by a sort-merge join requires a new 
MR job
 Key: HIVE-3763
 URL: https://issues.apache.org/jira/browse/HIVE-3763
 Project: Hive
  Issue Type: Bug
Reporter: Namit Jain


After Hive-3633, if tbl1 and tbl2 are tables bucketiezed and sorted by key into 
2 buckets, the following query:


select count(*) from (  
  select /*+mapjoin(a)*/ a.key as key, a.value as val1, b.value as val2 from 
tbl1 a join tbl2 b on a.key = b.key
) subq1;

requires 2 MR job - the first one is a sort-merge join, and the second MR job
performs the count(*) on the output of the sort-merge join. 

Ideally, this should be performed in a single MR job.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

2012-12-02 Thread Phabricator (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-3384:
--

Attachment: D6873.6.patch

mbautin updated the revision [jira] [HIVE-3384] HIVE JDBC module won't compile 
under JDK1.7 as new methods added in JDBC specification.
Reviewers: cdrome, weidongbian, JIRA, ashutoshc

  Reverting an unnecessary change of a value attribute to a line attribute.

REVISION DETAIL
  https://reviews.facebook.net/D6873

AFFECTED FILES
  build-common.xml
  build.properties
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveCallableStatement.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDataSource.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDatabaseMetaData.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDriver.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HivePreparedStatement.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java
  jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveStatement.java
  metastore/build.xml
  pdk/scripts/build-plugin.xml

To: cdrome, weidongbian, JIRA, ashutoshc, mbautin


 HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC 
 specification
 --

 Key: HIVE-3384
 URL: https://issues.apache.org/jira/browse/HIVE-3384
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Reporter: Weidong Bian
Priority: Minor
 Attachments: D6873-0.9.1.patch, D6873.1.patch, D6873.2.patch, 
 D6873.3.patch, D6873.4.patch, D6873.5.patch, D6873.6.patch, 
 HIVE-3384.2.patch, HIVE-3384.patch, HIVE-JDK7-JDBC.patch


 jdbc module couldn't be compiled with jdk7 as it adds some abstract method in 
 the JDBC specification 
 some error info:
  error: HiveCallableStatement is not abstract and does not override abstract
 method TgetObject(String,ClassT) in CallableStatement
 .
 .
 .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

2012-12-02 Thread Mikhail Bautin (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Bautin updated HIVE-3384:
-

Attachment: HIVE-3384-2012-12-02.patch

Uploading a patch corresponding to 
https://reviews.facebook.net/D6873?vs=onid=22815whitespace=ignore-all#differential-review-toc
 but generated manually so that it applies cleanly using the patch command.

 HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC 
 specification
 --

 Key: HIVE-3384
 URL: https://issues.apache.org/jira/browse/HIVE-3384
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Reporter: Weidong Bian
Priority: Minor
 Attachments: D6873-0.9.1.patch, D6873.1.patch, D6873.2.patch, 
 D6873.3.patch, D6873.4.patch, D6873.5.patch, D6873.6.patch, 
 HIVE-3384-2012-12-02.patch, HIVE-3384.2.patch, HIVE-3384.patch, 
 HIVE-JDK7-JDBC.patch


 jdbc module couldn't be compiled with jdk7 as it adds some abstract method in 
 the JDBC specification 
 some error info:
  error: HiveCallableStatement is not abstract and does not override abstract
 method TgetObject(String,ClassT) in CallableStatement
 .
 .
 .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-3384) HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC specification

2012-12-02 Thread Mikhail Bautin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508518#comment-13508518
 ] 

Mikhail Bautin commented on HIVE-3384:
--

[~ashutoshc]: PluginTest succeeds for me with my most recent patch.

{quote}
Testsuite: org.apache.hive.pdk.PluginTest
Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 33.596 sec
- Standard Error -
GLOBAL SETUP:  Copying file: file:/wd/hive-trunk/builtins/test/onerow.txt
Deleted file:/wd/hive-trunk/build/builtins/warehouse/onerow
Copying file: file:/wd/hive-trunk/builtins/test/iris.txt
Deleted file:/wd/hive-trunk/build/builtins/warehouse/iris
org.apache.hive.builtins.UDAFUnionMap TEARDOWN:  
Hive history file=/tmp/mbautin/hive_job_log_mbautin_201212022240_971726350.txt
GLOBAL TEARDOWN:  
Hive history file=/tmp/mbautin/hive_job_log_mbautin_201212022240_805568604.txt
OK
Time taken: 8.473 seconds
OK
Time taken: 0.531 seconds
-  ---

Testcase: SELECT size(UNION_MAP(MAP(sepal_width, sepal_length))) FROM iris took 
3.454 sec
{quote}


 HIVE JDBC module won't compile under JDK1.7 as new methods added in JDBC 
 specification
 --

 Key: HIVE-3384
 URL: https://issues.apache.org/jira/browse/HIVE-3384
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Reporter: Weidong Bian
Priority: Minor
 Attachments: D6873-0.9.1.patch, D6873.1.patch, D6873.2.patch, 
 D6873.3.patch, D6873.4.patch, D6873.5.patch, D6873.6.patch, 
 HIVE-3384-2012-12-02.patch, HIVE-3384.2.patch, HIVE-3384.patch, 
 HIVE-JDK7-JDBC.patch


 jdbc module couldn't be compiled with jdk7 as it adds some abstract method in 
 the JDBC specification 
 some error info:
  error: HiveCallableStatement is not abstract and does not override abstract
 method TgetObject(String,ClassT) in CallableStatement
 .
 .
 .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira