[jira] [Commented] (HIVE-2958) GROUP BY causing ClassCastException [LazyDioInteger cannot be cast LazyInteger]
[
https://issues.apache.org/jira/browse/HIVE-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258037#comment-13258037
]
Hudson commented on HIVE-2958:
--
Integrated in Hive-trunk-h0.21 #1384 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1384/])
HIVE-2958 [jira] GROUP BY causing ClassCastException [LazyDioInteger cannot
be
cast LazyInteger]
(Navis Ryu via Ashutosh Chauhan)
Summary:
DPAL- GROUP BY causing ClassCastException [LazyDioInteger cannot be cast
LazyInteger]
This relates to https://issues.apache.org/jira/browse/HIVE-1634.
The following work fine:
CREATE EXTERNAL TABLE tim_hbase_occurrence (
id int,
scientific_name string,
data_resource_id int
) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH
SERDEPROPERTIES (
"hbase.columns.mapping" = ":key#b,v:scientific_name#s,v:data_resource_id#b"
) TBLPROPERTIES(
"hbase.table.name" = "mini_occurrences",
"hbase.table.default.storage.type" = "binary"
);
SELECT * FROM tim_hbase_occurrence LIMIT 3;
SELECT * FROM tim_hbase_occurrence WHERE data_resource_id=1081 LIMIT 3;
However, the following fails:
SELECT data_resource_id, count(*) FROM tim_hbase_occurrence GROUP BY
data_resource_id;
The error given:
0 TS
2012-04-17 16:58:45,693 INFO org.apache.hadoop.hive.ql.exec.MapOperator:
Initialization Done 7 MAP
2012-04-17 16:58:45,714 INFO org.apache.hadoop.hive.ql.exec.MapOperator:
Processing alias tim_hbase_occurrence for file
hdfs://c1n2.gbif.org/user/hive/warehouse/tim_hbase_occurrence
2012-04-17 16:58:45,714 INFO org.apache.hadoop.hive.ql.exec.MapOperator: 7
forwarding 1 rows
2012-04-17 16:58:45,714 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: 0
forwarding 1 rows
2012-04-17 16:58:45,716 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 1
forwarding 1 rows
2012-04-17 16:58:45,723 FATAL ExecMapper:
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
processing row {"id":1444,"scientific_name":null,"data_resource_id":1081}
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:548)
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassCastException:
org.apache.hadoop.hive.serde2.lazydio.LazyDioInteger cannot be cast to
org.apache.hadoop.hive.serde2.lazy.LazyInteger
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:737)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:83)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:529)
... 9 more
Caused by: java.lang.ClassCastException:
org.apache.hadoop.hive.serde2.lazydio.LazyDioInteger cannot be cast to
org.apache.hadoop.hive.serde2.lazy.LazyInteger
at
org.apache.hadoop.hive.serde2.lazy.objectinspector.primitive.LazyIntObjectInspector.copyObject(LazyIntObjectInspector.java:43)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:239)
at
org.apache.hadoop.hive.ql.exec.KeyWrapperFactory$ListKeyWrapper.deepCopyElements(KeyWrapperFactory.java:150)
at
org.apache.hadoop.hive.ql.exec.KeyWrapperFactory$ListKeyWrapper.deepCopyElements(KeyWrapperFactory.java:142)
at
org.apache.hadoop.hive.ql.exec.KeyWrapperFactory$ListKeyWrapper.copyKey(KeyWrapperFactory.java:119)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:750)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:722)
... 18 more
Test Plan: EMPTY
Reviewers: JIRA, ashutoshc
Reviewed By: ashutoshc
Differential Revision: https://reviews.facebook.net/D2871 (Revision 1328157)
[jira] [Commented] (HIVE-1634) Allow access to Primitive types stored in binary format in HBase
[
https://issues.apache.org/jira/browse/HIVE-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258036#comment-13258036
]
Hudson commented on HIVE-1634:
--
Integrated in Hive-trunk-h0.21 #1384 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1384/])
HIVE-2958 [jira] GROUP BY causing ClassCastException [LazyDioInteger cannot
be
cast LazyInteger]
(Navis Ryu via Ashutosh Chauhan)
Summary:
DPAL- GROUP BY causing ClassCastException [LazyDioInteger cannot be cast
LazyInteger]
This relates to https://issues.apache.org/jira/browse/HIVE-1634.
The following work fine:
CREATE EXTERNAL TABLE tim_hbase_occurrence (
id int,
scientific_name string,
data_resource_id int
) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH
SERDEPROPERTIES (
"hbase.columns.mapping" = ":key#b,v:scientific_name#s,v:data_resource_id#b"
) TBLPROPERTIES(
"hbase.table.name" = "mini_occurrences",
"hbase.table.default.storage.type" = "binary"
);
SELECT * FROM tim_hbase_occurrence LIMIT 3;
SELECT * FROM tim_hbase_occurrence WHERE data_resource_id=1081 LIMIT 3;
However, the following fails:
SELECT data_resource_id, count(*) FROM tim_hbase_occurrence GROUP BY
data_resource_id;
The error given:
0 TS
2012-04-17 16:58:45,693 INFO org.apache.hadoop.hive.ql.exec.MapOperator:
Initialization Done 7 MAP
2012-04-17 16:58:45,714 INFO org.apache.hadoop.hive.ql.exec.MapOperator:
Processing alias tim_hbase_occurrence for file
hdfs://c1n2.gbif.org/user/hive/warehouse/tim_hbase_occurrence
2012-04-17 16:58:45,714 INFO org.apache.hadoop.hive.ql.exec.MapOperator: 7
forwarding 1 rows
2012-04-17 16:58:45,714 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: 0
forwarding 1 rows
2012-04-17 16:58:45,716 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: 1
forwarding 1 rows
2012-04-17 16:58:45,723 FATAL ExecMapper:
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
processing row {"id":1444,"scientific_name":null,"data_resource_id":1081}
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:548)
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassCastException:
org.apache.hadoop.hive.serde2.lazydio.LazyDioInteger cannot be cast to
org.apache.hadoop.hive.serde2.lazy.LazyInteger
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:737)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:83)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:529)
... 9 more
Caused by: java.lang.ClassCastException:
org.apache.hadoop.hive.serde2.lazydio.LazyDioInteger cannot be cast to
org.apache.hadoop.hive.serde2.lazy.LazyInteger
at
org.apache.hadoop.hive.serde2.lazy.objectinspector.primitive.LazyIntObjectInspector.copyObject(LazyIntObjectInspector.java:43)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:239)
at
org.apache.hadoop.hive.ql.exec.KeyWrapperFactory$ListKeyWrapper.deepCopyElements(KeyWrapperFactory.java:150)
at
org.apache.hadoop.hive.ql.exec.KeyWrapperFactory$ListKeyWrapper.deepCopyElements(KeyWrapperFactory.java:142)
at
org.apache.hadoop.hive.ql.exec.KeyWrapperFactory$ListKeyWrapper.copyKey(KeyWrapperFactory.java:119)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:750)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:722)
... 18 more
Test Plan: EMPTY
Reviewers: JIRA, ashutoshc
Reviewed By: ashutoshc
Differential Revision: https://reviews.facebook.net/D2871 (Revision 1328157)
[jira] [Commented] (HIVE-2959) TestRemoteHiveMetaStoreIpAddress always uses the same port
[ https://issues.apache.org/jira/browse/HIVE-2959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257148#comment-13257148 ] Hudson commented on HIVE-2959: -- Integrated in Hive-trunk-h0.21 #1382 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1382/]) HIVE-2959 [jira] TestRemoteHiveMetaStoreIpAddress always uses the same port (Kevin Wilfong via Ashutosh Chauhan) Summary: https://issues.apache.org/jira/browse/HIVE-2959 TestRemoteHiveMetaStoreIpAddress now uses the standard way of finding a free port using Java's ServerSocket class. TestRemoteHiveMetaStoreIpAddress always uses the same port, meaning that if another process happens to be using that port, the tests cannot succeed. There seems to be a standard way of finding a free port using Java's ServerSocket class, this should be used instead. Test Plan: Ran TestRemoteHiveMetaStoreIpAddress and TestRemoteUGIHiveMetaStoreIpAddress, the two tests which would be affected by this change. I verified they passed and did not use port 39083. Reviewers: JIRA, njain, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2841 (Revision 1327591) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327591 Files : * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStoreIpAddress.java > TestRemoteHiveMetaStoreIpAddress always uses the same port > -- > > Key: HIVE-2959 > URL: https://issues.apache.org/jira/browse/HIVE-2959 > Project: Hive > Issue Type: Test >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.10 > > Attachments: HIVE-2959.D2841.1.patch > > > TestRemoteHiveMetaStoreIpAddress always uses the same port, meaning that if > another process happens to be using that port, the tests cannot succeed. > There seems to be a standard way of finding a free port using Java's > ServerSocket class, this should be used instead. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2946) Hive metastore does not have any log messages while shutting itself down.
[ https://issues.apache.org/jira/browse/HIVE-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256245#comment-13256245 ] Hudson commented on HIVE-2946: -- Integrated in Hive-trunk-h0.21 #1380 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1380/]) HIVE-2946 [jira] Hive metastore does not have any log messages while shutting itself down. (Vandana Kasavajjala via Ashutosh Chauhan) Summary: https://issues.apache.org/jira/browse/HIVE-2946 Addressed Ashutosh's comments. When hive metastore is started, the event is logged with good amount of information. But when it is stopped ( using a kill) command, no information is being written to the logs. It will be good if we can add a shutdown event to the HiveMetastore class. Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2787 (Revision 1327323) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327323 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java > Hive metastore does not have any log messages while shutting itself down. > -- > > Key: HIVE-2946 > URL: https://issues.apache.org/jira/browse/HIVE-2946 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Vandana Ayyalasomayajula >Assignee: Vandana Ayyalasomayajula >Priority: Minor > Labels: metastore > Fix For: 0.9.0 > > Attachments: HIVE-2946.D2745.1.patch, HIVE-2946.D2787.1.patch > > > When hive metastore is started, the event is logged with good amount of > information. But when it is stopped ( using a kill) command, no information > is being written to the logs. It will be good if we can add a shutdown event > to the HiveMetastore class. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2930) Add license to the Hive files
[ https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256131#comment-13256131 ] Hudson commented on HIVE-2930: -- Integrated in Hive-trunk-h0.21 #1379 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1379/]) HIVE-2930 [jira] Add license to the Hive files (Owen O'Malley via Ashutosh Chauhan) Summary: <> Fixing rat warnings We need to clean up the RAT report to 0. Apache projects aren't supposed to release until they have shown that all of their files have proper headers. Note that although most of the files are just missing headers, some of them explicitly say copyright by facebook and released under the Thrift (not Apache) license. I'll generate a list of them, but I'd really appreciate it if someone from facebook could in verify that they intend to license them to Apache. Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2835 (Revision 1327205) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327205 Files : * /hive/trunk/.checkstyle * /hive/trunk/build.properties * /hive/trunk/build.xml * /hive/trunk/common/src/java/conf/hive-log4j.properties * /hive/trunk/conf/configuration.xsl * /hive/trunk/conf/hive-env.sh.template * /hive/trunk/data/conf/hive-log4j.properties * /hive/trunk/data/scripts/cat.py * /hive/trunk/data/scripts/cat_error.py * /hive/trunk/data/scripts/dumpdata_script.py * /hive/trunk/data/scripts/error_script * /hive/trunk/data/scripts/input20_script * /hive/trunk/docs/velocity.properties * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/eclipse-templates/.classpath._hbase * /hive/trunk/eclipse-templates/.externalToolBuilders/Hive_Ant_Builder.launch * /hive/trunk/eclipse-templates/.project * /hive/trunk/eclipse-templates/.settings/org.eclipse.jdt.core.prefs * /hive/trunk/eclipse-templates/.settings/org.eclipse.jdt.ui.prefs * /hive/trunk/eclipse-templates/HiveCLI.launchtemplate * /hive/trunk/eclipse-templates/TestCliDriver.launchtemplate * /hive/trunk/eclipse-templates/TestEmbeddedHiveMetaStore.launchtemplate * /hive/trunk/eclipse-templates/TestHBaseCliDriver.launchtemplate * /hive/trunk/eclipse-templates/TestHive.launchtemplate * /hive/trunk/eclipse-templates/TestHiveMetaStoreChecker.launchtemplate * /hive/trunk/eclipse-templates/TestJdbc.launchtemplate * /hive/trunk/eclipse-templates/TestMTQueries.launchtemplate * /hive/trunk/eclipse-templates/TestRemoteHiveMetaStore.launchtemplate * /hive/trunk/eclipse-templates/TestTruncate.launchtemplate * /hive/trunk/hbase-handler/src/test/templates/TestHBaseCliDriver.vm * /hive/trunk/metastore/if/hive_metastore.thrift * /hive/trunk/metastore/scripts/hive.metastore_ctrl * /hive/trunk/metastore/scripts/hive.metastore_daemon * /hive/trunk/metastore/scripts/upgrade/001-HIVE-2795.update_view_partitions.py * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g * /hive/trunk/metastore/src/model/package.jdo * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyPreListener.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteUGIHiveMetaStoreIpAddress.java * /hive/trunk/ql/if/queryplan.thrift * /hive/trunk/ql/src/java/conf/hive-exec-log4j.properties * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/MetadataOnlyOptimizer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/mapredplan.jr * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFOPPlus.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/exec/sample_plan.xml * /hive/trunk/ql/src/test/queries/clientnegative/dyn_part_empty.q.disabled * /hive/trunk/ql/src/test/scripts/testgrep * /hive/trunk/ql/src/test/templates/TestCliDriver.vm * /hive/trunk/ql/src/test/templates/TestNegativeCliDriver.vm * /hive/trunk/ql/src/test/templates/TestParse.vm * /hive/trunk/ql/src/test/templates/TestParseNegative.vm * /hive/trunk/serde/if/serde.thrift * /hive/trunk/serde/if/test/complex.thrift * /hive/trunk/serde/if/test/complexpb.proto * /hive/trunk/serde/if/test/testthrift.thrift * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/columnar/LazyBinaryColumnarSerDe.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/dynamic_type/thrift_grammar.jjt * /hive/trunk/service/lib/php/ext/thrift_protocol/config.m4 * /hive/trunk/service/lib/php/ext/thrift_protocol/tags/1.0.0/config.m4 * /hive/trunk/service/lib/php/ext/thrift_protocol/tags/1.0.0/php_thrift_protocol.cpp * /hive/trunk/service/lib/php/ext/thrift_protocol/tags/1.0.0/php_thrift_protocol.h * /hive/trunk/service/lib/py/fb303/__init__.py * /hive/trunk/service/lib/py/thrift/protocol/fastbinary.c * /hive/trunk/service/lib/py/thrift/reflection/__init__.py * /hive/trunk/service/lib/py/thrift/reflection/l
[jira] [Commented] (HIVE-2530) Implement SHOW TBLPROPERTIES
[
https://issues.apache.org/jira/browse/HIVE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13256132#comment-13256132
]
Hudson commented on HIVE-2530:
--
Integrated in Hive-trunk-h0.21 #1379 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1379/])
HIVE-2530. Implement SHOW TBLPROPERTIES. (leizhao via kevinwilfong)
(Revision 1327189)
Result = SUCCESS
kevinwilfong :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327189
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ParseDriver.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DDLWork.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/HiveOperation.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ShowTblPropertiesDesc.java
* /hive/trunk/ql/src/test/queries/clientpositive/show_tblproperties.q
* /hive/trunk/ql/src/test/results/clientpositive/show_tblproperties.q.out
> Implement SHOW TBLPROPERTIES
>
>
> Key: HIVE-2530
> URL: https://issues.apache.org/jira/browse/HIVE-2530
> Project: Hive
> Issue Type: New Feature
>Reporter: Adam Kramer
>Assignee: Lei Zhao
>Priority: Minor
> Attachments: HIVE-2530.D2589.1.patch, HIVE-2530.D2589.2.patch,
> HIVE-2530.D2589.3.patch
>
>
> Since table properties can be defined arbitrarily, they should be easy for a
> user to query from the command-line.
> SHOW TBLPROPERTIES tblname;
> ...would show all of them, one per row, key \t value
> SHOW TBLPROPERTIES tblname ("FOOBAR");
> ...would just show the value for the FOOBAR tblproperty.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2937) TestHiveServerSessions hangs when executed directly
[
https://issues.apache.org/jira/browse/HIVE-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254070#comment-13254070
]
Hudson commented on HIVE-2937:
--
Integrated in Hive-trunk-h0.21 #1373 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1373/])
HIVE-2937. TestHiveServerSessions hangs when executed directly. (navis via
kevinwilfong) (Revision 1325830)
Result = SUCCESS
kevinwilfong :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1325830
Files :
*
/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
* /hive/trunk/service/src/java/org/apache/hadoop/hive/service/HiveServer.java
> TestHiveServerSessions hangs when executed directly
> ---
>
> Key: HIVE-2937
> URL: https://issues.apache.org/jira/browse/HIVE-2937
> Project: Hive
> Issue Type: Test
>Reporter: Navis
>Assignee: Navis
>Priority: Trivial
> Attachments: HIVE-2937.D2697.1.patch, HIVE-2937.D2697.2.patch
>
>
> {code}
> ant test -Doffline=true -Dtestcase=TestHiveServerSessions
> {code}
> Hangs infinitely.
> I couldn't imagine exact cause of the problem, but found that by adding 'new
> HiveServer.HiveServerHandler();' in setup(), test resulted to success.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2936) Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory
[ https://issues.apache.org/jira/browse/HIVE-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253991#comment-13253991 ] Hudson commented on HIVE-2936: -- Integrated in Hive-trunk-h0.21 #1372 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1372/]) HIVE-2936 : Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Rohini via Ashutosh Chauhan) (Revision 1325791) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1325791 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestEmbeddedHiveMetaStore.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java > Warehouse table subdirectories should inherit the group permissions of the > warehouse parent directory > - > > Key: HIVE-2936 > URL: https://issues.apache.org/jira/browse/HIVE-2936 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: Rohini Palaniswamy >Assignee: Rohini Palaniswamy > Fix For: 0.9.0 > > Attachments: HIVE-2504-1.patch, HIVE-2504.patch, HIVE-2504.patch, > HIVE-2936-2.patch > > > When the Hive Metastore creates a subdirectory in the Hive warehouse for > a new table it does so with the default HDFS permissions derived from > dfs.umask or dfs.umaskmode. There should be a option to inherit the > permissions of the parent directory (default warehouse or custom database > directory) so that the table directories have the same permissions as the > database directories. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2940) RCFileMergeMapper Prints To Standard Output Even In Silent Mode
[ https://issues.apache.org/jira/browse/HIVE-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253992#comment-13253992 ] Hudson commented on HIVE-2940: -- Integrated in Hive-trunk-h0.21 #1372 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1372/]) HIVE-2940 : RCFileMergeMapper Prints To Standard Output Even In Silent Mode (Thiruvel via Ashutosh Chauhan) (Revision 1325793) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1325793 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/merge/RCFileMergeMapper.java > RCFileMergeMapper Prints To Standard Output Even In Silent Mode > --- > > Key: HIVE-2940 > URL: https://issues.apache.org/jira/browse/HIVE-2940 > Project: Hive > Issue Type: Task >Affects Versions: 0.8.1, 0.9.0 >Reporter: Thiruvel Thirumoolan >Assignee: Thiruvel Thirumoolan >Priority: Trivial > Fix For: 0.10 > > Attachments: HIVE-2940.patch > > > A very minor issue. One of our users was running partition concatenate in > local mode as part of their application and this was a little noisy. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2948) HiveFileFormatUtils should use Path.SEPARATOR instead of File.Separator
[ https://issues.apache.org/jira/browse/HIVE-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253357#comment-13253357 ] Hudson commented on HIVE-2948: -- Integrated in Hive-trunk-h0.21 #1371 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1371/]) HIVE-2948 [jira] HiveFileFormatUtils should use Path.SEPARATOR instead of File.Separator Summary: https://issues.apache.org/jira/browse/HIVE-2948 Simple patch which replaces File.separator to Path.SEPARATOR since separator for hdfs path is Path.SEPARATOR not java's File.SEPARATOR Because its munging hdfs paths and not OS paths. Test Plan: EMPTY Reviewers: JIRA, kevinwilfong Reviewed By: kevinwilfong Differential Revision: https://reviews.facebook.net/D2763 (Revision 1325615) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1325615 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveFileFormatUtils.java > HiveFileFormatUtils should use Path.SEPARATOR instead of File.Separator > --- > > Key: HIVE-2948 > URL: https://issues.apache.org/jira/browse/HIVE-2948 > Project: Hive > Issue Type: Bug >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Attachments: HIVE-2948.D2763.1.patch > > > Because its munging hdfs paths and not OS paths. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2767) Optionally use framed transport with metastore
[
https://issues.apache.org/jira/browse/HIVE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253072#comment-13253072
]
Hudson commented on HIVE-2767:
--
Integrated in Hive-trunk-h0.21 #1370 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1370/])
HIVE-2767 [jira] Optionally use framed transport with metastore
(Travis Crawford via Ashutosh Chauhan)
Summary:
Add support for optionally using the thrift framed transport, enabling
integration with environments where that is necessary.
Users may want/need to use thrift's framed transport when communicating with the
Hive MetaStore. This patch adds a new property
hive.metastore.thrift.framed.transport.enabled that enables the framed transport
(defaults to off, aka no change from before the patch). This property must be
set for both clients and the HMS server.
It wasn't immediately clear how to use the framed transport with SASL, so as
written an exception is thrown if you try starting the server with both options.
If SASL and the framed transport will indeed work together I can update the
patch (although I don't have a secured environment to test in).
Test Plan:
Tested locally that client and server can connect, both with and
without the flag. Tests pass.
Reviewers: JIRA, ashutoshc
Reviewed By: ashutoshc
Differential Revision: https://reviews.facebook.net/D2661 (Revision 1325446)
Result = SUCCESS
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1325446
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml.template
*
/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
*
/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
> Optionally use framed transport with metastore
> --
>
> Key: HIVE-2767
> URL: https://issues.apache.org/jira/browse/HIVE-2767
> Project: Hive
> Issue Type: New Feature
> Components: Metastore
>Reporter: Travis Crawford
>Assignee: Travis Crawford
> Fix For: 0.10
>
> Attachments: HIVE-2767.D2661.1.patch, HIVE-2767.D2661.2.patch,
> HIVE-2767.D2661.3.patch, HIVE-2767.patch.txt, HIVE-2767_a.patch.txt
>
>
> Users may want/need to use thrift's framed transport when communicating with
> the Hive MetaStore. This patch adds a new property
> {{hive.metastore.thrift.framed.transport.enabled}} that enables the framed
> transport (defaults to off, aka no change from before the patch). This
> property must be set for both clients and the HMS server.
> It wasn't immediately clear how to use the framed transport with SASL, so as
> written an exception is thrown if you try starting the server with both
> options. If SASL and the framed transport will indeed work together I can
> update the patch (although I don't have a secured environment to test in).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2910) Improve the HWI interface
[ https://issues.apache.org/jira/browse/HIVE-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253071#comment-13253071 ] Hudson commented on HIVE-2910: -- Integrated in Hive-trunk-h0.21 #1370 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1370/]) HIVE-2910 : Improve the HWI interface (Hugo Trippaers via Ashutosh Chauhan) (Revision 1325492) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1325492 Files : * /hive/trunk/NOTICE * /hive/trunk/hwi/web/authorize.jsp * /hive/trunk/hwi/web/css * /hive/trunk/hwi/web/css/bootstrap.min.css * /hive/trunk/hwi/web/diagnostics.jsp * /hive/trunk/hwi/web/error_page.jsp * /hive/trunk/hwi/web/img * /hive/trunk/hwi/web/img/glyphicons-halflings-white.png * /hive/trunk/hwi/web/img/glyphicons-halflings.png * /hive/trunk/hwi/web/index.jsp * /hive/trunk/hwi/web/left_navigation.jsp * /hive/trunk/hwi/web/navbar.jsp * /hive/trunk/hwi/web/session_create.jsp * /hive/trunk/hwi/web/session_diagnostics.jsp * /hive/trunk/hwi/web/session_history.jsp * /hive/trunk/hwi/web/session_kill.jsp * /hive/trunk/hwi/web/session_list.jsp * /hive/trunk/hwi/web/session_manage.jsp * /hive/trunk/hwi/web/session_remove.jsp * /hive/trunk/hwi/web/session_result.jsp * /hive/trunk/hwi/web/show_database.jsp * /hive/trunk/hwi/web/show_databases.jsp * /hive/trunk/hwi/web/show_table.jsp * /hive/trunk/hwi/web/view_file.jsp > Improve the HWI interface > - > > Key: HIVE-2910 > URL: https://issues.apache.org/jira/browse/HIVE-2910 > Project: Hive > Issue Type: Improvement > Components: Web UI >Reporter: Hugo Trippaers >Assignee: Hugo Trippaers >Priority: Minor > Labels: newbie, patch > Fix For: 0.10 > > Attachments: glyphicons-halflings-white.png, > glyphicons-halflings.png, hive-2910.3.patch.log, hive-2910.3.patch.txt, > hive-2910.4.patch.txt, hive-hwi-2.patch, hive-hwi.patch, screenie001.PNG, > screenie002.PNG > > > I've made some improvements to the HWI interface with the Twitter bootstrap > system. I'm looking for feedback on the new design. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2711) Make the header of RCFile unique
[ https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253070#comment-13253070 ] Hudson commented on HIVE-2711: -- Integrated in Hive-trunk-h0.21 #1370 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1370/]) HIVE-2711 : Make the header of RCFile unique (Owen Omalley via Ashutosh Chauhan) (Revision 1325442) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1325442 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java * /hive/trunk/ql/src/test/data * /hive/trunk/ql/src/test/data/rc-file-v0.rc * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java * /hive/trunk/ql/src/test/results/clientpositive/alter_concatenate_indexed_table.q.out * /hive/trunk/ql/src/test/results/clientpositive/alter_merge.q.out * /hive/trunk/ql/src/test/results/clientpositive/alter_merge_stats.q.out * /hive/trunk/ql/src/test/results/clientpositive/create_merge_compressed.q.out * /hive/trunk/ql/src/test/results/clientpositive/ctas.q.out * /hive/trunk/ql/src/test/results/clientpositive/partition_wise_fileformat.q.out * /hive/trunk/ql/src/test/results/clientpositive/partition_wise_fileformat3.q.out * /hive/trunk/ql/src/test/results/clientpositive/sample10.q.out > Make the header of RCFile unique > > > Key: HIVE-2711 > URL: https://issues.apache.org/jira/browse/HIVE-2711 > Project: Hive > Issue Type: Bug > Components: Serializers/Deserializers >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Fix For: 0.10 > > Attachments: HIVE-2711.D2115.1.patch, HIVE-2711.D2115.2.patch, > HIVE-2711.D2115.3.patch, HIVE-2711.D2571.1.patch, rc-file-v0.rc > > > The RCFile implementation was copied from Hadoop's SequenceFile and copied > the 'magic' string in the header. This means that you can't use the header to > distinguish between RCFiles and SequenceFiles. > I'd propose that we create a new header for RCFiles (RCF?) to replace the > current SEQ. To maintain compatibility, we'll need to continue to accept the > current 'SEQ\06' and just make new files contain the new header. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2907) Hive error when dropping a table with large number of partitions
[ https://issues.apache.org/jira/browse/HIVE-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251235#comment-13251235 ] Hudson commented on HIVE-2907: -- Integrated in Hive-trunk-h0.21 #1367 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1367/]) HIVE-2907. Hive error when dropping a table with large number of partitions. (mousom via kevinwilfong) (Revision 1311850) Result = FAILURE kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1311850 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/test/queries/clientnegative/drop_table_failure3.q * /hive/trunk/ql/src/test/queries/clientpositive/drop_table2.q * /hive/trunk/ql/src/test/results/clientnegative/drop_table_failure3.q.out * /hive/trunk/ql/src/test/results/clientpositive/drop_table2.q.out > Hive error when dropping a table with large number of partitions > > > Key: HIVE-2907 > URL: https://issues.apache.org/jira/browse/HIVE-2907 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.9.0 > Environment: General. Hive Metastore bug. >Reporter: Mousom Dhar Gupta >Assignee: Mousom Dhar Gupta >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2907.1.patch.txt, HIVE-2907.2.patch.txt, > HIVE-2907.3.patch.txt, HIVE-2907.D2505.1.patch, HIVE-2907.D2505.2.patch, > HIVE-2907.D2505.3.patch, HIVE-2907.D2505.4.patch, HIVE-2907.D2505.5.patch, > HIVE-2907.D2505.6.patch, HIVE-2907.D2505.7.patch > > Original Estimate: 10h > Remaining Estimate: 10h > > Running into an "Out Of Memory" error when trying to drop a table with 128K > partitions. > The methods dropTable in > metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java > and dropTable in ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java > encounter out of memory errors > when dropping tables with lots of partitions because they try to load the > metadata for every partition into memory. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2764) Obtain delegation tokens for MR jobs in secure hbase setup
[ https://issues.apache.org/jira/browse/HIVE-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250410#comment-13250410 ] Hudson commented on HIVE-2764: -- Integrated in Hive-trunk-h0.21 #1364 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1364/]) HIVE-2764: Obtain delegation tokens for MR jobs in secure hbase setup (Enis Soztutar via Ashutosh Chauhan) (Revision 1311418) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1311418 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableOutputFormat.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHFileOutputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveNullValueSequenceFileOutputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveOutputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveOutputFormatImpl.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveSequenceFileOutputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFileOutputFormat.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/merge/BlockMergeTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java > Obtain delegation tokens for MR jobs in secure hbase setup > > > Key: HIVE-2764 > URL: https://issues.apache.org/jira/browse/HIVE-2764 > Project: Hive > Issue Type: Improvement > Components: HBase Handler, Security >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 0.9.0 > > Attachments: HIVE-2764.D2205.1.patch, HIVE-2764.D2205.2.patch, > HIVE-2764.D2205.3.patch, HIVE-2764.D2205.4.patch, HIVE-2764.D2205.5.patch, > HIVE-2764_v0.patch > > > As discussed in HCATALOG-244, in a secure hbase setup with 0.92, we need to > obtain delegation tokens for hbase and save it in jobconf, so that tasks can > access region servers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2929) race condition in DAG execute tasks for hive
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249219#comment-13249219 ] Hudson commented on HIVE-2929: -- Integrated in Hive-trunk-h0.21 #1360 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1360/]) HIVE-2929 race condition in DAG execute tasks for hive (Namit Jain via Siying Dong) (Revision 1310619) Result = ABORTED sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310619 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java > race condition in DAG execute tasks for hive > > > Key: HIVE-2929 > URL: https://issues.apache.org/jira/browse/HIVE-2929 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: hive.2929.1.patch > > > select ... > ( > SubQuery involving MapReduce > union all > SubQuery involving MapReduce > ); > or > select ... > (SubQuery involving MapReduce) > join > (SubQuery involving MapReduce) > ; > If both the subQueries finish at nearly the same time, there is a race > condition in which the results of the subQuery finishing last will be > completely missed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2858) Cache remote map reduce job stack traces for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249218#comment-13249218 ] Hudson commented on HIVE-2858: -- Integrated in Hive-trunk-h0.21 #1360 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1360/]) HIVE-2858 Cache remote map reduce job stack traces for additional logging (Kevin Wilfong via namit) (Revision 1310583) Result = ABORTED namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310583 Files : * /hive/trunk/build-common.xml * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/errors/TaskLogProcessor.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifySessionStateStackTracesHook.java * /hive/trunk/ql/src/test/queries/clientnegative/mapreduce_stack_trace.q * /hive/trunk/ql/src/test/queries/clientnegative/mapreduce_stack_trace_turnoff.q * /hive/trunk/ql/src/test/results/clientnegative/mapreduce_stack_trace.q.out * /hive/trunk/ql/src/test/results/clientnegative/mapreduce_stack_trace_turnoff.q.out > Cache remote map reduce job stack traces for additional logging > --- > > Key: HIVE-2858 > URL: https://issues.apache.org/jira/browse/HIVE-2858 > Project: Hive > Issue Type: Improvement > Components: Logging >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2858.D2223.1.patch, HIVE-2858.D2223.2.patch > > > Currently we are parsing the task logs for failed jobs for information to > display to the user in the CLI. In addition, we could parse those logs for > stack traces and store e them in the SessionState. This way, when we log > failed queries, these will give us a decent idea of why those queries failed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2923) testAclPositive in TestZooKeeperTokenStore failing in clean checkout when run on Mac
[ https://issues.apache.org/jira/browse/HIVE-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248745#comment-13248745 ] Hudson commented on HIVE-2923: -- Integrated in Hive-trunk-h0.21 #1358 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1358/]) HIVE-2923 : testAclPositive in TestZooKeeperTokenStore failing in clean checkout when run on Mac (Thomas Weise via Ashutosh Chauhan) (Revision 1310406) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310406 Files : * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java * /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java > testAclPositive in TestZooKeeperTokenStore failing in clean checkout when run > on Mac > > > Key: HIVE-2923 > URL: https://issues.apache.org/jira/browse/HIVE-2923 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 > Environment: Mac OSX Lion >Reporter: Kevin Wilfong >Assignee: Thomas Weise >Priority: Blocker > Fix For: 0.9.0 > > Attachments: HIVE-2923.patch > > > When running testAclPositive in TestZooKeeperTokenStore in a clean checkout, > it fails with the error: > Failed to validate token path. > org.apache.hadoop.hive.thrift.DelegationTokenStore$TokenStoreException: > Failed to validate token path. > at > org.apache.hadoop.hive.thrift.ZooKeeperTokenStore.init(ZooKeeperTokenStore.java:207) > at > org.apache.hadoop.hive.thrift.ZooKeeperTokenStore.setConf(ZooKeeperTokenStore.java:225) > at > org.apache.hadoop.hive.thrift.TestZooKeeperTokenStore.testAclPositive(TestZooKeeperTokenStore.java:170) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at junit.framework.TestCase.runTest(TestCase.java:168) > at junit.framework.TestCase.runBare(TestCase.java:134) > at junit.framework.TestResult$1.protect(TestResult.java:110) > at junit.framework.TestResult.runProtected(TestResult.java:128) > at junit.framework.TestResult.run(TestResult.java:113) > at junit.framework.TestCase.run(TestCase.java:124) > at junit.framework.TestSuite.runTest(TestSuite.java:232) > at junit.framework.TestSuite.run(TestSuite.java:227) > at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) > at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) > at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) > Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: > KeeperErrorCode = ConnectionLoss for /zktokenstore-testAcl > at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778) > at > org.apache.hadoop.hive.thrift.ZooKeeperTokenStore.ensurePath(ZooKeeperTokenStore.java:119) > at > org.apache.hadoop.hive.thrift.ZooKeeperTokenStore.init(ZooKeeperTokenStore.java:204) > ... 17 more > This message is also printed to standard out: > Unable to load realm mapping info from SCDynamicStore > The test seems to run fine in Linux, but more than one developer has reported > this on a Mac. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2901) Hive union with NULL constant and string in same column returns all null
[ https://issues.apache.org/jira/browse/HIVE-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248260#comment-13248260 ] Hudson commented on HIVE-2901: -- Integrated in Hive-trunk-h0.21 #1357 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1357/]) HIVE-2901 Hive union with NULL constant and string in same column returns all null (Navis via namit) (Revision 1310179) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310179 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientpositive/union_null.q * /hive/trunk/ql/src/test/results/clientpositive/union_null.q.out > Hive union with NULL constant and string in same column returns all null > > > Key: HIVE-2901 > URL: https://issues.apache.org/jira/browse/HIVE-2901 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Navis >Priority: Critical > Attachments: HIVE-2901.D2541.1.patch, HIVE-2901.D2541.2.patch, > HIVE-2901.D2541.3.patch > > > select x from (select value as x from src union all select NULL as x from > src)a; > This query produces all nulls, where value is a string column. > Notably, > select x from (select key as x from src union all select NULL as x from src)a; > where key is a string, but can be cast to a double, the query returns correct > results. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2863) Ambiguous table name or column reference message displays when table and column names are the same
[ https://issues.apache.org/jira/browse/HIVE-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248157#comment-13248157 ] Hudson commented on HIVE-2863: -- Integrated in Hive-trunk-h0.21 #1356 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1356/]) HIVE-2863 Ambiguous table name or column reference message displays when table and column names are the same (Navis via namit) (Revision 1310126) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310126 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/nomore_ambiguous_table_col.q * /hive/trunk/ql/src/test/queries/negative/ambiguous_table_col.q * /hive/trunk/ql/src/test/results/clientpositive/nomore_ambiguous_table_col.q.out * /hive/trunk/ql/src/test/results/compiler/errors/ambiguous_table_col.q.out > Ambiguous table name or column reference message displays when table and > column names are the same > -- > > Key: HIVE-2863 > URL: https://issues.apache.org/jira/browse/HIVE-2863 > Project: Hive > Issue Type: Bug >Reporter: Mauro Cazzari >Assignee: Navis > Attachments: HIVE-2863.D2361.1.patch > > > Given the following table: > CREATE TABLE `Y` (`y` DOUBLE) ROW FORMAT DELIMITED FIELDS TERMINATED BY > '\001' STORED AS TEXTFILE; > The following query fails: > SELECT `Y`.`y` FROM `Y` WHERE ( `y` = 1 ) > ERROR: java.sql.SQLException: Query returned non-zero code: 10, cause: > FAILED: Error in >semantic analysis: Line 1:36 Ambiguous table alias or column reference > '`y`' > ERROR: Unable to execute Hadoop query. > ERROR: Prepare error. SQL statement: SELECT `Y`.`y` FROM `Y` WHERE ( `y` > = 1 ). > The problem goes away if the table and column names do not match. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2822) Add JSON output to the hive ddl commands
[
https://issues.apache.org/jira/browse/HIVE-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247537#comment-13247537
]
Hudson commented on HIVE-2822:
--
Integrated in Hive-trunk-h0.21 #1354 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1354/])
HIVE-2822: Second part of it (ctdean via Ashutosh Chauhan) (Revision
1309667)
HIVE-2822 [jira] Add JSON output to the hive ddl commands
(Chris Dean via Ashutosh Chauhan)
Summary:
JSON output for DDL commands
By setting the variable hive.format=json then ddl commands will
produce json output suitable for client side parsing. For example, to
list all the databases one might get:
{
"databases": [
"default"
]
}
The goal is to have an option to produce JSON output of the DDL commands that is
easily machine parseable.
For example, "desc my_table" currently gives
idbigint
user string
and we want to allow a json output:
{
"columns": [
{"name": "id", "type": "bigint"},
{"name": "user", "type": "string"}
]
}
Test Plan: Run the provided unit tests
Reviewers: JIRA, ashutoshc
Reviewed By: ashutoshc
Differential Revision: https://reviews.facebook.net/D2475 (Revision 1309666)
Result = FAILURE
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309667
Files :
* /hive/trunk/ql/src/test/results/clientnegative/column_rename1.q.out
* /hive/trunk/ql/src/test/results/clientnegative/column_rename4.q.out
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309666
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml.template
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/MetaDataFormatUtils.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MapBuilder.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatter.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java
* /hive/trunk/ql/src/test/queries/clientpositive/describe_database_json.q
* /hive/trunk/ql/src/test/queries/clientpositive/describe_table_json.q
* /hive/trunk/ql/src/test/queries/clientpositive/misc_json.q
* /hive/trunk/ql/src/test/queries/clientpositive/partitions_json.q
*
/hive/trunk/ql/src/test/results/clientnegative/database_create_already_exists.q.out
*
/hive/trunk/ql/src/test/results/clientnegative/database_drop_does_not_exist.q.out
* /hive/trunk/ql/src/test/results/clientpositive/describe_database_json.q.out
* /hive/trunk/ql/src/test/results/clientpositive/describe_table_json.q.out
* /hive/trunk/ql/src/test/results/clientpositive/misc_json.q.out
* /hive/trunk/ql/src/test/results/clientpositive/partitions_json.q.out
> Add JSON output to the hive ddl commands
>
>
> Key: HIVE-2822
> URL: https://issues.apache.org/jira/browse/HIVE-2822
> Project: Hive
> Issue Type: Improvement
>Reporter: Chris Dean
>Assignee: Chris Dean
> Fix For: 0.9.0
>
> Attachments: HIVE-2822.03-branch0-8.patch, HIVE-2822.03.patch,
> HIVE-2822.03b.patch, HIVE-2822.04-branch-08.patch,
> HIVE-2822.05-branch0-8-1.patch, HIVE-2822.05-branch0-8.patch,
> HIVE-2822.05.patch, HIVE-2822.D2475.1.patch, HIVE-2822.D2475.2.patch,
> HIVE-2822.D2475.3.patch, HIVE-2822.D2475.4.patch,
> hive-json-01-branch0-8.patch, hive-json-01.patch,
> hive-json-02-branch0-8.patch, hive-json-02.patch
>
>
> The goal is to have an option to produce JSON output of the DDL commands that
> is easily machine parseable.
> For example, "desc my_table" currently gives
> {noformat}
> idbigint
> user string
> {noformat}
> and we want to allow a json output:
> {noformat}
> {
> "columns": [
> {"name": "id", "type": "bigint"},
> {"name": "user", "type": "string"}
> ]
> }
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2559) Add target to install Hive JARs/POMs in the local Maven cache
[ https://issues.apache.org/jira/browse/HIVE-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247535#comment-13247535 ] Hudson commented on HIVE-2559: -- Integrated in Hive-trunk-h0.21 #1354 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1354/]) HIVE-2559 : Add target to install Hive JARs/POMs in the local Maven cache (Alan Gates via Ashutosh Chauhan) (Revision 1309675) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309675 Files : * /hive/trunk/build.xml > Add target to install Hive JARs/POMs in the local Maven cache > - > > Key: HIVE-2559 > URL: https://issues.apache.org/jira/browse/HIVE-2559 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Affects Versions: 0.9.0 >Reporter: Alejandro Abdelnur >Assignee: Alan Gates >Priority: Critical > Fix For: 0.9.0 > > Attachments: HIVE-2559.patch > > > HIVE-2391 is producing usable Maven artifacts. > However, it only as a target to deploy/publish those artifacts to Apache > Maven repos. > There should be a new target to locally install Hive Maven artifacts, thus > enabling their use from other projects before they are committed/publish to > Apache Maven (this is critical to test patches that may address issues in > downstream components). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2879) Add "rat" target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247536#comment-13247536 ] Hudson commented on HIVE-2879: -- Integrated in Hive-trunk-h0.21 #1354 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1354/]) HIVE-2879 : Add rat target to build to look for missing license headers (Owen Omalley via Ashutosh Chauhan) (Revision 1309676) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309676 Files : * /hive/trunk/build.xml * /hive/trunk/ivy.xml * /hive/trunk/ivy/libraries.properties > Add "rat" target to build to look for missing license headers > - > > Key: HIVE-2879 > URL: https://issues.apache.org/jira/browse/HIVE-2879 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Fix For: 0.9.0 > > Attachments: HIVE-2879.D2373.1.patch, HIVE-2879.D2373.2.patch, > HIVE-2879.D2373.3.patch > > > We should have a "rat" target that can generate an Apache RAT report. RAT is > used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2822) Add JSON output to the hive ddl commands
[
https://issues.apache.org/jira/browse/HIVE-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247079#comment-13247079
]
Hudson commented on HIVE-2822:
--
Integrated in Hive-trunk-h0.21 #1353 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1353/])
HIVE-2822: Second part of it (ctdean via Ashutosh Chauhan) (Revision
1309667)
HIVE-2822 [jira] Add JSON output to the hive ddl commands
(Chris Dean via Ashutosh Chauhan)
Summary:
JSON output for DDL commands
By setting the variable hive.format=json then ddl commands will
produce json output suitable for client side parsing. For example, to
list all the databases one might get:
{
"databases": [
"default"
]
}
The goal is to have an option to produce JSON output of the DDL commands that is
easily machine parseable.
For example, "desc my_table" currently gives
idbigint
user string
and we want to allow a json output:
{
"columns": [
{"name": "id", "type": "bigint"},
{"name": "user", "type": "string"}
]
}
Test Plan: Run the provided unit tests
Reviewers: JIRA, ashutoshc
Reviewed By: ashutoshc
Differential Revision: https://reviews.facebook.net/D2475 (Revision 1309666)
Result = FAILURE
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309667
Files :
* /hive/trunk/ql/src/test/results/clientnegative/column_rename1.q.out
* /hive/trunk/ql/src/test/results/clientnegative/column_rename4.q.out
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1309666
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml.template
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/MetaDataFormatUtils.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MapBuilder.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatter.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java
* /hive/trunk/ql/src/test/queries/clientpositive/describe_database_json.q
* /hive/trunk/ql/src/test/queries/clientpositive/describe_table_json.q
* /hive/trunk/ql/src/test/queries/clientpositive/misc_json.q
* /hive/trunk/ql/src/test/queries/clientpositive/partitions_json.q
*
/hive/trunk/ql/src/test/results/clientnegative/database_create_already_exists.q.out
*
/hive/trunk/ql/src/test/results/clientnegative/database_drop_does_not_exist.q.out
* /hive/trunk/ql/src/test/results/clientpositive/describe_database_json.q.out
* /hive/trunk/ql/src/test/results/clientpositive/describe_table_json.q.out
* /hive/trunk/ql/src/test/results/clientpositive/misc_json.q.out
* /hive/trunk/ql/src/test/results/clientpositive/partitions_json.q.out
> Add JSON output to the hive ddl commands
>
>
> Key: HIVE-2822
> URL: https://issues.apache.org/jira/browse/HIVE-2822
> Project: Hive
> Issue Type: Improvement
>Reporter: Chris Dean
>Assignee: Chris Dean
> Fix For: 0.9.0
>
> Attachments: HIVE-2822.03-branch0-8.patch, HIVE-2822.03.patch,
> HIVE-2822.03b.patch, HIVE-2822.04-branch-08.patch,
> HIVE-2822.05-branch0-8-1.patch, HIVE-2822.05-branch0-8.patch,
> HIVE-2822.05.patch, HIVE-2822.D2475.1.patch, HIVE-2822.D2475.2.patch,
> HIVE-2822.D2475.3.patch, HIVE-2822.D2475.4.patch,
> hive-json-01-branch0-8.patch, hive-json-01.patch,
> hive-json-02-branch0-8.patch, hive-json-02.patch
>
>
> The goal is to have an option to produce JSON output of the DDL commands that
> is easily machine parseable.
> For example, "desc my_table" currently gives
> {noformat}
> idbigint
> user string
> {noformat}
> and we want to allow a json output:
> {noformat}
> {
> "columns": [
> {"name": "id", "type": "bigint"},
> {"name": "user", "type": "string"}
> ]
> }
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2861) Support eventual constant expression for filter pushdown for key ranges in hbase
[
https://issues.apache.org/jira/browse/HIVE-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245593#comment-13245593
]
Hudson commented on HIVE-2861:
--
Integrated in Hive-trunk-h0.21 #1350 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1350/])
HIVE-2861 : Support eventual constant expression for filter pushdown for
key ranges in hbase (navis via Ashutosh Chauhan) (Revision 1308763)
Result = FAILURE
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308763
Files :
* /hive/trunk/hbase-handler/src/test/queries/hbase_ppd_key_range.q
* /hive/trunk/hbase-handler/src/test/results/hbase_ppd_key_range.q.out
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/IndexPredicateAnalyzer.java
> Support eventual constant expression for filter pushdown for key ranges in
> hbase
>
>
> Key: HIVE-2861
> URL: https://issues.apache.org/jira/browse/HIVE-2861
> Project: Hive
> Issue Type: Improvement
> Components: HBase Handler
>Reporter: Navis
>Assignee: Navis
>Priority: Trivial
> Fix For: 0.9.0
>
> Attachments: HIVE-2861.D2259.1.patch
>
>
> Minor upgrade from HIVE-2771, which supports simple eventual constant
> expression as a filter (especially 'cast').
> For example,
> {noformat}
> select * from hbase_pushdown where key > cast(20 + 30 as string);
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2913) BlockMergeTask Doesn't Honor Job Configuration Properties when used directly
[ https://issues.apache.org/jira/browse/HIVE-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245592#comment-13245592 ] Hudson commented on HIVE-2913: -- Integrated in Hive-trunk-h0.21 #1350 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1350/]) HIVE-2913. Fixes BlockMergeTask to honor Configuration Properties when used directly. (Thiruvel Thirumoolan via amareshwari) (Revision 1308812) Result = FAILURE amareshwari : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308812 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/merge/BlockMergeTask.java > BlockMergeTask Doesn't Honor Job Configuration Properties when used directly > > > Key: HIVE-2913 > URL: https://issues.apache.org/jira/browse/HIVE-2913 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.8.1 >Reporter: Thiruvel Thirumoolan >Assignee: Thiruvel Thirumoolan >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2913.D2547.1.patch, HIVE-2913_1.patch, blockmerge.sh > > > BlockMergeTask has a main() and when used directly (instead of say partition > concatenate feature), the -jobconf arguments are not honored. This is not > something most people directly use. > Usage: > BlockMergeTask -input -outputDir outputDir > [-jobconf k1=v1 [-jobconf k2=v2] ...] > To reproduce: > Run BlockMergeTask with say -jobconf mapred.job.name=test and launched job > will have a different name. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2920) TestStatsPublisherEnhanced throws NPE on JDBC connection failure
[ https://issues.apache.org/jira/browse/HIVE-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13245275#comment-13245275 ] Hudson commented on HIVE-2920: -- Integrated in Hive-trunk-h0.21 #1349 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1349/]) HIVE-2920 : TestStatsPublisherEnhanced throws NPE on JDBC connection failure (Carl Steinbach via Ashutosh Chauhan) (Revision 1308731) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308731 Files : * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/exec/TestStatsPublisherEnhanced.java > TestStatsPublisherEnhanced throws NPE on JDBC connection failure > > > Key: HIVE-2920 > URL: https://issues.apache.org/jira/browse/HIVE-2920 > Project: Hive > Issue Type: Bug > Components: Statistics, Testing Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2920.D2577.1.patch, HIVE-2920.D2577.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2908) Hive: Extend ALTER TABLE DROP PARTITION syntax to use all comparators
[ https://issues.apache.org/jira/browse/HIVE-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244924#comment-13244924 ] Hudson commented on HIVE-2908: -- Integrated in Hive-trunk-h0.21 #1348 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1348/]) HIVE-2908. Hive: Extend ALTER TABLE DROP PARTITION syntax to use all comparators. (sambavim via kevinwilfong) (Revision 1308427) Result = SUCCESS kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308427 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/DropTableDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionSpec.java * /hive/trunk/ql/src/test/queries/clientnegative/drop_partition_filter_failure.q * /hive/trunk/ql/src/test/queries/clientpositive/drop_partitions_filter.q * /hive/trunk/ql/src/test/results/clientnegative/drop_partition_failure.q.out * /hive/trunk/ql/src/test/results/clientnegative/drop_partition_filter_failure.q.out * /hive/trunk/ql/src/test/results/clientpositive/drop_multi_partitions.q.out * /hive/trunk/ql/src/test/results/clientpositive/drop_partitions_filter.q.out * /hive/trunk/ql/src/test/results/clientpositive/escape1.q.out > Hive: Extend ALTER TABLE DROP PARTITION syntax to use all comparators > - > > Key: HIVE-2908 > URL: https://issues.apache.org/jira/browse/HIVE-2908 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Affects Versions: 0.9.0 >Reporter: Sambavi Muthukrishnan >Assignee: Sambavi Muthukrishnan >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2908.D2523.1.patch, HIVE-2908.D2523.2.patch, > HIVE-2908.final.patch.txt > > Original Estimate: 96h > Remaining Estimate: 96h > > To drop a partition from a Hive table, this works: > ALTER TABLE foo DROP PARTITION(ds = 'date') > ...but it should also work to drop all partitions prior to date. > ALTER TABLE foo DROP PARTITION(ds < 'date') > This task is to implement ALTER TABLE DROP PARTITION for all of the > comparators, < > <= >= <> = != instead of just for =. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2853) Add pre event listeners to metastore
[ https://issues.apache.org/jira/browse/HIVE-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244632#comment-13244632 ] Hudson commented on HIVE-2853: -- Integrated in Hive-trunk-h0.21 #1347 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1347/]) HIVE-2853 Add pre event listeners to metastore (Kevin Wilfong via namit) (Revision 1308399) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308399 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStorePreEventListener.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreAddPartitionEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreAlterPartitionEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreAlterTableEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreCreateDatabaseEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreCreateTableEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreDropDatabaseEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreDropPartitionEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreDropTableEvent.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreEventContext.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreLoadPartitionDoneEvent.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyPreListener.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java > Add pre event listeners to metastore > > > Key: HIVE-2853 > URL: https://issues.apache.org/jira/browse/HIVE-2853 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2853.D2175.1.patch, HIVE-2853.D2175.2.patch > > > Currently there are event listeners in the metastore which run after the > completion of a method. It would be useful to have similar hooks which run > before the metastore method is executed. These can be used to make > validating names, locations, etc. customizable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2805) Move metastore upgrade scripts labeled 0.10.0 into scripts labeled 0.9.0
[ https://issues.apache.org/jira/browse/HIVE-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244633#comment-13244633 ] Hudson commented on HIVE-2805: -- Integrated in Hive-trunk-h0.21 #1347 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1347/]) HIVE-2805 Move metastore upgrade scripts labeled 0.10.0 into scripts labeled 0.9.0 (Kevin Wilfong via namit) (Revision 1308392) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308392 Files : * /hive/trunk/metastore/scripts/upgrade/derby/009-HIVE-2612.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/010-HIVE-2612.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/hive-schema-0.9.0.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/upgrade-0.8.0-to-0.9.0.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql * /hive/trunk/metastore/scripts/upgrade/mysql/009-HIVE-2612.mysql.sql * /hive/trunk/metastore/scripts/upgrade/mysql/010-HIVE-2612.mysql.sql * /hive/trunk/metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql * /hive/trunk/metastore/scripts/upgrade/mysql/hive-schema-0.9.0.mysql.sql * /hive/trunk/metastore/scripts/upgrade/mysql/upgrade-0.8.0-to-0.9.0.mysql.sql * /hive/trunk/metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql * /hive/trunk/metastore/scripts/upgrade/postgres/009-HIVE-2612.postgres.sql * /hive/trunk/metastore/scripts/upgrade/postgres/010-HIVE-2612.postgres.sql > Move metastore upgrade scripts labeled 0.10.0 into scripts labeled 0.9.0 > > > Key: HIVE-2805 > URL: https://issues.apache.org/jira/browse/HIVE-2805 > Project: Hive > Issue Type: Task > Components: Metastore >Affects Versions: 0.9.0 >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2805.D1743.1.patch > > > Move contents of upgrade-0.9.0-to-0.10.0.mysql.sql, > upgrade-0.9.0-to-0.10.0.derby.sql into upgrade-0.8.0-to-0.9.0.mysql.sql, > upgrade-0.8.0-to-0.9.0.derby.sql > Rename hive-schema-0.10.0.derby.sql, hive-schema-0.10.0.mysql.sql to > hive-schema-0.9.0.derby.sql, hive-schema-0.9.0.mysql.sql -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2881) Remove redundant key comparing in SMBMapJoinOperator
[ https://issues.apache.org/jira/browse/HIVE-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244141#comment-13244141 ] Hudson commented on HIVE-2881: -- Integrated in Hive-trunk-h0.21 #1346 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1346/]) HIVE-2881 Remove redundant key comparing in SMBMapJoinOperator (Navis via namit) (Revision 1308241) Result = ABORTED namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308241 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/SMBMapJoinOperator.java > Remove redundant key comparing in SMBMapJoinOperator > > > Key: HIVE-2881 > URL: https://issues.apache.org/jira/browse/HIVE-2881 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Navis >Assignee: Navis >Priority: Minor > Attachments: HIVE-2881.D2379.1.patch > > > Currently, SMBJoin compares keys twice in #findSmallestKey and #joinObject. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2866) Cache local map reduce job errors for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243298#comment-13243298 ] Hudson commented on HIVE-2866: -- Integrated in Hive-trunk-h0.21 #1343 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1343/]) HIVE-2866 Cache local map reduce job errors for additional logging (Kevin Wilfong via namit) (Revision 1307814) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1307814 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/io/CachingPrintStream.java * /hive/trunk/data/scripts/cat_error.py * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifySessionStateLocalErrorsHook.java * /hive/trunk/ql/src/test/queries/clientnegative/local_mapred_error_cache.q * /hive/trunk/ql/src/test/results/clientnegative/local_mapred_error_cache.q.out > Cache local map reduce job errors for additional logging > > > Key: HIVE-2866 > URL: https://issues.apache.org/jira/browse/HIVE-2866 > Project: Hive > Issue Type: Improvement > Components: Logging >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2866.D2277.1.patch > > > Using the CachingPrintStream we are storing errors that occur locally in > Hive, but because local map reduce jobs are run in a separate JVM we are not > storing that occur for these. We can use this same construct to store errors > written to the subprocesses error stream. This way, when we log failed > queries, these will give us a decent idea of why those queries failed. > See related issues: > https://issues.apache.org/jira/browse/HIVE-2832 > https://issues.apache.org/jira/browse/HIVE-2858 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2676) The row count that loaded to a table may not right
[ https://issues.apache.org/jira/browse/HIVE-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243084#comment-13243084 ] Hudson commented on HIVE-2676: -- Integrated in Hive-trunk-h0.21 #1342 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1342/]) HIVE-2676 The row count that loaded to a table may not right (binlijin via namit) (Revision 1307691) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1307691 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java > The row count that loaded to a table may not right > - > > Key: HIVE-2676 > URL: https://issues.apache.org/jira/browse/HIVE-2676 > Project: Hive > Issue Type: Improvement >Reporter: binlijin >Priority: Minor > Labels: patch > Attachments: HIVE-2676.patch > > > create table tablename as SELECT *** > At the end hive will print a number that show how many Rows loaded to the > tablename, but sometimes the number is not right. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2518) pull junit jar from maven repos via ivy
[ https://issues.apache.org/jira/browse/HIVE-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240908#comment-13240908 ] Hudson commented on HIVE-2518: -- Integrated in Hive-trunk-h0.21 #1338 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1338/]) HIVE-2518 pull junit jar from maven repos via ivy (Kevin Wilfong via namit) (Revision 1306470) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1306470 Files : * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/ql/ivy.xml * /hive/trunk/testlibs/junit-4.10.LICENSE.txt * /hive/trunk/testlibs/junit-4.10.jar > pull junit jar from maven repos via ivy > --- > > Key: HIVE-2518 > URL: https://issues.apache.org/jira/browse/HIVE-2518 > Project: Hive > Issue Type: Improvement >Reporter: He Yongqiang >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2518.D2493.1.patch > > > see https://issues.apache.org/jira/browse/HIVE-2505 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240907#comment-13240907 ] Hudson commented on HIVE-2898: -- Integrated in Hive-trunk-h0.21 #1338 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1338/]) HIVE-2898: Add nicer helper functions for adding and reading metadata from RCFiles (Owen Omalley via Ashutosh Chauhan) (Revision 1306464) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1306464 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java > Add nicer helper functions for adding and reading metadata from RCFiles > --- > > Key: HIVE-2898 > URL: https://issues.apache.org/jira/browse/HIVE-2898 > Project: Hive > Issue Type: New Feature > Components: Serializers/Deserializers >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Fix For: 0.9.0 > > Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, > HIVE-2898.D2433.3.patch, HIVE-2898.D2433.4.patch, HIVE-2898.D2433.5.patch > > > Currently, to use the metadata in RCFile, you need to manipulate it using > SequenceFile.Metadata. I'd like to add two helper functions that make it more > convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2891) TextConverter for UDF's is inefficient if the input object is already Text or Lazy
[ https://issues.apache.org/jira/browse/HIVE-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240300#comment-13240300 ] Hudson commented on HIVE-2891: -- Integrated in Hive-trunk-h0.21 #1336 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1336/]) HIVE-2891: TextConverter for UDF's is inefficient if the input object is already Text or Lazy (Cliff Engle via Ashutosh Chauhan) (Revision 1306096) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1306096 Files : * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorConverter.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestObjectInspectorConverters.java > TextConverter for UDF's is inefficient if the input object is already Text or > Lazy > -- > > Key: HIVE-2891 > URL: https://issues.apache.org/jira/browse/HIVE-2891 > Project: Hive > Issue Type: Improvement > Components: Serializers/Deserializers >Affects Versions: 0.7.0, 0.7.1, 0.8.1 >Reporter: Cliff Engle >Assignee: Cliff Engle >Priority: Minor > Fix For: 0.9.0 > > Attachments: HIVE-2891.1.patch.txt, HIVE-2891.2.patch.txt > > > The TextConverter in PrimitiveObjectInspectorConverter.java is very > inefficient if the input object is already Text or Lazy. Since it calls > getPrimitiveJavaObject, each Text is decoded into a String and then > re-encoded into Text. The solution is to check if preferWritable() is true, > then call getPrimitiveWritable(input). > To test performance, I ran the Grep query from > https://issues.apache.org/jira/browse/HIVE-396 on a cluster of 3 ec2 large > nodes (2 slaves 1 master) on 6GB of data. It took 21 map tasks. With the > current 0.8.1 version, it took 81 seconds. After patching, it took 66 seconds. > I will attach a patch and testcases. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2797) Make the IP address of a Thrift client available to HMSHandler.
[ https://issues.apache.org/jira/browse/HIVE-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237952#comment-13237952 ] Hudson commented on HIVE-2797: -- Integrated in Hive-trunk-h0.21 #1332 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1332/]) HIVE-2797: Make the IP address of a Thrift client available to HMSHandler. (Kevin Wilfong via Ashutosh Chauhan) (Revision 1305041) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1305041 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/TSetIpAddressProcessor.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/TUGIBasedProcessor.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/IpAddressListener.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteHiveMetaStoreIpAddress.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestRemoteUGIHiveMetaStoreIpAddress.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/thrift/TUGIContainingTransport.java > Make the IP address of a Thrift client available to HMSHandler. > --- > > Key: HIVE-2797 > URL: https://issues.apache.org/jira/browse/HIVE-2797 > Project: Hive > Issue Type: Improvement > Components: Metastore >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2797.7.patch, HIVE-2797.D1701.1.patch, > HIVE-2797.D1701.2.patch, HIVE-2797.D1701.3.patch, HIVE-2797.D1701.4.patch, > HIVE-2797.D1701.5.patch, HIVE-2797.D1701.6.patch > > > Currently, in unsecured mode, metastore Thrift calls are, from the > HMSHandler's point of view, anonymous. If we expose the IP address of the > Thrift client to the HMSHandler from the Processor, this will help to give > some context, in particular for audit logging, of where the call is coming > from. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2894) RCFile Reader doesn't provide access to Metadata
[ https://issues.apache.org/jira/browse/HIVE-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13237464#comment-13237464 ] Hudson commented on HIVE-2894: -- Integrated in Hive-trunk-h0.21 #1330 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1330/]) HIVE-2894 [jira] RCFile Reader doesn't provide access to Metadata (Owen O'Malley via Ashutosh Chauhan) Summary: hive-2894 Add an accessor for RCFile's metadata. Currently the RCFile writer can add metadata to an RCFile, but the reader doesn't provide an accessor. I'd like to add one. Test Plan: I added a call to test that the metadata that was passed in was available from the reader. Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2421 (Revision 1304693) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1304693 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java > RCFile Reader doesn't provide access to Metadata > > > Key: HIVE-2894 > URL: https://issues.apache.org/jira/browse/HIVE-2894 > Project: Hive > Issue Type: New Feature >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Fix For: 0.9.0 > > Attachments: HIVE-2894.D2421.1.patch > > > Currently the RCFile writer can add metadata to an RCFile, but the reader > doesn't provide an accessor. I'd like to add one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2773) HiveStorageHandler.configureTableJobProperites() should let the handler know wether it is configuration for input or output
[ https://issues.apache.org/jira/browse/HIVE-2773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236772#comment-13236772 ] Hudson commented on HIVE-2773: -- Integrated in Hive-trunk-h0.21 #1328 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1328/]) HIVE-2773: HiveStorageHandler.configureTableJobProperites() should let the handler know wether it is configuration for input or output (Francis Liu via Ashutosh Chauhan) (Revision 1304167) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1304167 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/DefaultStorageHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveStorageHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java > HiveStorageHandler.configureTableJobProperites() should let the handler know > wether it is configuration for input or output > --- > > Key: HIVE-2773 > URL: https://issues.apache.org/jira/browse/HIVE-2773 > Project: Hive > Issue Type: Improvement >Reporter: Francis Liu >Assignee: Francis Liu > Labels: hcatalog, storage_handler > Fix For: 0.9.0 > > Attachments: HIVE-2773.D1815.1.patch, HIVE-2773.D2007.1.patch, > HIVE-2773.D2415.1.patch, HIVE-2773.patch > > > HiveStorageHandler.configureTableJobProperties() is called to allow the > storage handler to setup any properties that the underlying > inputformat/outputformat/serde may need. But the handler implementation does > not know whether it is being called for configuring input or output. This > makes it a problem for handlers which sets an external state. In the case of > HCatalog's HBase storageHandler, whenever a write needs to be configured we > create a write transaction which needs to be committed or aborted later on. > In this case configuring for both input and output each time > configureTableJobProperties() is called would not be desirable. This has > become an issue since HCatalog is dropping storageDrivers for SerDe and > StorageHandler (see HCATALOG-237). > My proposal is to replace configureTableJobProperties() with two methods: > configureInputJobProperties() > configureOutputJobProperties() > Each method will have the same signature. I cursory look at the code and I > believe changes should be straighforward also given that we are not really > changing anything just splitting responsibility. If the community is fine > with this approach I will go ahead and create a aptch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2577) Expose the HiveConf in HiveConnection API
[ https://issues.apache.org/jira/browse/HIVE-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236462#comment-13236462 ] Hudson commented on HIVE-2577: -- Integrated in Hive-trunk-h0.21 #1327 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1327/]) HIVE-2577: Expose the HiveConf in HiveConnection API (Nicolas Lalevee via Ashutosh Chauhan) (Revision 1304068) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1304068 Files : * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java > Expose the HiveConf in HiveConnection API > - > > Key: HIVE-2577 > URL: https://issues.apache.org/jira/browse/HIVE-2577 > Project: Hive > Issue Type: Improvement >Affects Versions: 0.8.0 >Reporter: Nicolas Lalevée >Assignee: Nicolas Lalevée > Fix For: 0.9.0 > > Attachments: HIVE-2577-r1201637.patch > > > When running the jdbc code in a local mode, there no way to programatically > manage the hive conf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2819) Closed range scans on hbase keys
[ https://issues.apache.org/jira/browse/HIVE-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236245#comment-13236245 ] Hudson commented on HIVE-2819: -- Integrated in Hive-trunk-h0.21 #1326 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1326/]) HIVE-2819 : Closed range scans on hbase keys : Reviewed by Carl Steinbach (hashutosh) (Revision 1303978) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303978 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java * /hive/trunk/hbase-handler/src/test/queries/hbase_ppd_key_range.q * /hive/trunk/hbase-handler/src/test/queries/ppd_key_ranges.q * /hive/trunk/hbase-handler/src/test/results/hbase_ppd_key_range.q.out * /hive/trunk/hbase-handler/src/test/results/ppd_key_ranges.q.out > Closed range scans on hbase keys > - > > Key: HIVE-2819 > URL: https://issues.apache.org/jira/browse/HIVE-2819 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 0.9.0 > > Attachments: HIVE-2819.D1923.1.patch, HIVE-2819.D1923.2.patch, > HIVE-2819.D1923.3.patch > > > This patch pushes range scans on keys of closed form into hbase -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2471) Add timestamp column to the partition stats table.
[ https://issues.apache.org/jira/browse/HIVE-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233258#comment-13233258 ] Hudson commented on HIVE-2471: -- Integrated in Hive-trunk-h0.21 #1322 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1322/]) HIVE-2471 Add timestamp column to the partition stats table. (Kevin Wilfong via namit) (Revision 1302739) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1302739 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsSetupConstants.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java > Add timestamp column to the partition stats table. > -- > > Key: HIVE-2471 > URL: https://issues.apache.org/jira/browse/HIVE-2471 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2471.1.patch.txt, HIVE-2471.D2367.1.patch, > HIVE-2471.D2367.2.patch, HIVE-2471.D2367.3.patch > > > Occasionally, when entries are added to the partition stats table the program > is halted before it can delete those entries, by an exception, keyboard > interrupt, etc. These build up to the point where the table gets very large, > and it hurts the performance of the update statement which is often called. > In order to fix this, I am adding a column to the table which is > auto-populated with the current timestamp. This will allow us to create > scripts that go through periodically and clean out old entries from the table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2864) If hive history file's directory doesn't exist don't crash
[ https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233105#comment-13233105 ] Hudson commented on HIVE-2864: -- Integrated in Hive-trunk-h0.21 #1321 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1321/]) HIVE-2864 If hive history file's directory doesn't exist don't crash (Kevin Wilfong via namit) (Revision 1302550) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1302550 Files : * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java > If hive history file's directory doesn't exist don't crash > -- > > Key: HIVE-2864 > URL: https://issues.apache.org/jira/browse/HIVE-2864 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch > > > Currently, if the history file's directory does not exist the Hive client > crashes. Instead, since this is not a vital feature, it should just display > a warning to the user and continue without it. > This will become more important once the directory becomes configurable, see: > https://issues.apache.org/jira/browse/HIVE-1708 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2865) hive-config.sh should honor HIVE_HOME env
[ https://issues.apache.org/jira/browse/HIVE-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231864#comment-13231864 ] Hudson commented on HIVE-2865: -- Integrated in Hive-trunk-h0.21 #1317 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1317/]) HIVE-2865 : hive-config.sh should honor HIVE_HOME env (gkesvan via hashutosh) (Revision 1301797) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301797 Files : * /hive/trunk/bin/hive-config.sh > hive-config.sh should honor HIVE_HOME env > -- > > Key: HIVE-2865 > URL: https://issues.apache.org/jira/browse/HIVE-2865 > Project: Hive > Issue Type: Improvement >Affects Versions: 0.8.0 >Reporter: Giridharan Kesavan >Assignee: Giridharan Kesavan > Fix For: 0.9.0 > > Attachments: HIVE-2865.patch > > > hive-config.sh should honor HIVE_HOME env variable if set. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2850) Remove zero length files
[ https://issues.apache.org/jira/browse/HIVE-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231764#comment-13231764 ] Hudson commented on HIVE-2850: -- Integrated in Hive-trunk-h0.21 #1316 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1316/]) HIVE-2850 [jira] Remove zero length files (Owen O'Malley via Ashutosh Chauhan) Summary: <> Remove empty files There are also zero-length non-source files that need to be removed. Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2163 (Revision 1301629) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301629 Files : * /hive/trunk/data/warehouse/src/.gitignore * /hive/trunk/hwi/web/set_processor.jsp * /hive/trunk/metastore/src/gen-py/__init__.py * /hive/trunk/metastore/src/gen/thrift/gen-py/__init__.py * /hive/trunk/ql/src/gen/thrift/gen-py/__init__.py * /hive/trunk/ql/src/test/queries/clientpositive/describe_function.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_avg.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_count.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_max.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_min.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_std.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_stddev_samp.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_sum.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_var_samp.q * /hive/trunk/ql/src/test/queries/clientpositive/udaf_variance.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_divider.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_hour_minute_second.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_json.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_lpad_rpad.q * /hive/trunk/ql/src/test/results/clientpositive/describe_function.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_avg.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_count.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_max.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_min.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_std.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_stddev_samp.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_sum.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_var_samp.q.out * /hive/trunk/ql/src/test/results/clientpositive/udaf_variance.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_divider.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_hour_minute_second.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_json.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_lpad_rpad.q.out * /hive/trunk/ql/src/test/results/compiler/errors/invalid_function_param1.q.out * /hive/trunk/ql/src/test/results/compiler/errors/unknown_function5.q.out * /hive/trunk/serde/src/gen-py/__init__.py * /hive/trunk/serde/src/gen/thrift/gen-py/__init__.py * /hive/trunk/service/src/gen-py/__init__.py * /hive/trunk/service/src/gen/thrift/gen-py/__init__.py > Remove zero length files > > > Key: HIVE-2850 > URL: https://issues.apache.org/jira/browse/HIVE-2850 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Fix For: 0.9.0 > > Attachments: HIVE-2850.D2163.1.patch > > > There are also zero-length non-source files that need to be removed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2871) Add a new hook to run at the beginning and end of the Driver.run method
[ https://issues.apache.org/jira/browse/HIVE-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231762#comment-13231762 ] Hudson commented on HIVE-2871: -- Integrated in Hive-trunk-h0.21 #1316 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1316/]) HIVE-2871 Add a new hook to run at the beginning and end of the Driver.run method (Kevin Wilfong via namit) (Revision 1301610) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301610 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/HiveDriverRunHook.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/HiveDriverRunHookContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/HiveDriverRunHookContextImpl.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHooksRunInOrder.java * /hive/trunk/ql/src/test/queries/clientpositive/hook_order.q * /hive/trunk/ql/src/test/results/clientpositive/hook_order.q.out > Add a new hook to run at the beginning and end of the Driver.run method > --- > > Key: HIVE-2871 > URL: https://issues.apache.org/jira/browse/HIVE-2871 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2871.D2331.1.patch, HIVE-2871.D2331.2.patch, > HIVE-2871.D2331.3.patch > > > Driver.run is the highest level method which all queries go through, whether > they come from Hive Server, the CLI, or any other entry. We also do not have > any hooks before the compilation method is called, and having hooks in > Driver.run would provide this. Having hooks in Driver.run will allow, for > example, being able to overwrite config values used throughout query > processing, including compilation, and at the other end, cleaning up any > resources/logging any final values just before returning to the user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2831) TestContribCliDriver.dboutput and TestCliDriver.input45 fail on 0.23
[ https://issues.apache.org/jira/browse/HIVE-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231763#comment-13231763 ] Hudson commented on HIVE-2831: -- Integrated in Hive-trunk-h0.21 #1316 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1316/]) HIVE-2831 [jira] Mask FsShell output in QTestUtil (Carl Steinbach via Ashutosh Chauhan) Summary: HIVE-2831. Mask FsShell output in QTestUtil Test Plan: EMPTY Reviewers: JIRA, edwardcapriolo, ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D2049 (Revision 1301630) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301630 Files : * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java > TestContribCliDriver.dboutput and TestCliDriver.input45 fail on 0.23 > > > Key: HIVE-2831 > URL: https://issues.apache.org/jira/browse/HIVE-2831 > Project: Hive > Issue Type: Bug > Components: Tests >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2831.1.patch.txt, HIVE-2831.D2049.1.patch, > HIVE-2831.D2049.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2503) HiveServer should provide per session configuration
[ https://issues.apache.org/jira/browse/HIVE-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231560#comment-13231560 ] Hudson commented on HIVE-2503: -- Integrated in Hive-trunk-h0.21 #1315 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1315/]) HIVE-2503: HiveServer should provide per session configuration (navis via hashutosh) (Revision 1301568) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301568 Files : * /hive/trunk/service/src/java/org/apache/hadoop/hive/service/HiveServer.java * /hive/trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServerSessions.java > HiveServer should provide per session configuration > --- > > Key: HIVE-2503 > URL: https://issues.apache.org/jira/browse/HIVE-2503 > Project: Hive > Issue Type: Bug > Components: CLI, Server Infrastructure >Affects Versions: 0.9.0 >Reporter: Navis >Assignee: Navis > Fix For: 0.9.0 > > Attachments: HIVE-2503.1.patch.txt > > > Currently ThriftHiveProcessorFactory returns same HiveConf instance to > HiveServerHandler, making impossible to use per sesssion configuration. Just > wrapping 'conf' -> 'new HiveConf(conf)' seemed to solve this problem. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2872) Store which configs the user has explicitly changed
[ https://issues.apache.org/jira/browse/HIVE-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231136#comment-13231136 ] Hudson commented on HIVE-2872: -- Integrated in Hive-trunk-h0.21 #1314 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1314/]) HIVE-2872 Store which configs the user has explicitly changed (Kevin Wilfng via namit) (Revision 1301347) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301347 Files : * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyOverriddenConfigsHook.java * /hive/trunk/ql/src/test/queries/clientpositive/overridden_confs.q * /hive/trunk/ql/src/test/results/clientpositive/overridden_confs.q.out > Store which configs the user has explicitly changed > --- > > Key: HIVE-2872 > URL: https://issues.apache.org/jira/browse/HIVE-2872 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2872.D2337.1.patch, HIVE-2872.D2337.2.patch > > > It would be useful to keep track of which config variables the user has > explicitly changed from the values which are either default or loaded from > hive-site.xml. These include config variables set using the hiveconf > argument to the CLI, and via the SET command. This could be used to prevent > Hive from changing a config variable which has been explicitly set by the > user, and also potentially for logging to help with later debugging of failed > queries. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2835) Change default configuration for hive.exec.dynamic.partition
[ https://issues.apache.org/jira/browse/HIVE-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13231135#comment-13231135 ] Hudson commented on HIVE-2835: -- Integrated in Hive-trunk-h0.21 #1314 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1314/]) HIVE-2835: Change default configuration for hive.exec.dynamic.partition (Owen Omalley via hashutosh) (Revision 1301348) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301348 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template > Change default configuration for hive.exec.dynamic.partition > > > Key: HIVE-2835 > URL: https://issues.apache.org/jira/browse/HIVE-2835 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Fix For: 0.9.0 > > Attachments: HIVE-2835.D2157.1.patch, HIVE-2835.D2157.2.patch > > > I think we should enable dynamic partitions by default. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format
[ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230955#comment-13230955 ] Hudson commented on HIVE-2815: -- Integrated in Hive-trunk-h0.21 #1313 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1313/]) HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format (Ashutosh Chauhan via Carl Steinbach) Summary: Further support for pushdown on keys stored in binary format This patch enables filter pushdown for keys stored in binary format in hbase Test Plan: Included a new test case. Reviewers: JIRA, jsichi, njain, cwsteinbach Reviewed By: cwsteinbach Differential Revision: https://reviews.facebook.net/D1875 (Revision 1301315) Result = FAILURE cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301315 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDe.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java * /hive/trunk/hbase-handler/src/test/queries/external_table_ppd.q * /hive/trunk/hbase-handler/src/test/results/external_table_ppd.q.out > Filter pushdown in hbase for keys stored in binary format > - > > Key: HIVE-2815 > URL: https://issues.apache.org/jira/browse/HIVE-2815 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1 >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan > Fix For: 0.9.0 > > Attachments: HIVE-2815.D1875.1.patch, HIVE-2815.D1875.2.patch > > > This patch enables filter pushdown for keys stored in binary format in hbase -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2778) Fail on table sampling
[
https://issues.apache.org/jira/browse/HIVE-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230954#comment-13230954
]
Hudson commented on HIVE-2778:
--
Integrated in Hive-trunk-h0.21 #1313 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1313/])
HIVE-2778 [jira] Fail on table sampling
(Navis Ryu via Carl Steinbach)
Summary:
HIVE-2778 fix NPE on table sampling
Trying table sampling on any non-empty table throws NPE. This does not occur by
test on mini-MR. select count(*) from
emp tablesample (0.1 percent); Total MapReduce jobs = 1 Launching Job 1 out
of 1 Number of reduce tasks determined at compile time: 1 In order to change the
average load for a reducer (in bytes): set
hive.exec.reducers.bytes.per.reducer= In order to limit the maximum
number of reducers: set hive.exec.reducers.max= In order to set a
constant number of reducers: set mapred.reduce.tasks=
java.lang.NullPointerException at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403)
at
org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:971)at
org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:963) at
org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170) at
org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)at
org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:396) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833) at
org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807)at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:432) at
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136) at
org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134) at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at
org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332) at
org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123) at
org.apache.hadoop.hive.ql.Driver.run(Driver.java:931) at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)
at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)at
org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)at
org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597) at
org.apache.hadoop.util.RunJar.main(RunJar.java:186) Job Submission failed with
exception 'java.lang.NullPointerException(null)' FAILED: Execution Error, return
code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
Test Plan: EMPTY
Reviewers: JIRA, cwsteinbach
Reviewed By: cwsteinbach
Differential Revision: https://reviews.facebook.net/D1593 (Revision 1301310)
Result = FAILURE
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301310
Files :
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java
> Fail on table sampling
> ---
>
> Key: HIVE-2778
> URL: https://issues.apache.org/jira/browse/HIVE-2778
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
>Affects Versions: 0.9.0
> Environment: Reproduced only on hadoop-0.20.2-CDH3u1, work fine on
> hadoop-0.20.2
>Reporter: Navis
>Assignee: Navis
> Fix For: 0.9.0
>
> Attachments: HIVE-2778.D1593.1.patch, HIVE-2778.D1593.2.patch,
> HIVE-2778.D1593.2.patch
>
>
> Trying table sampling on any non-empty table throws NPE. This does not occur
> by test on mini-MR.
> {noformat}
> select count(*) from emp tablesample (0.1 percent);
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks determined at compile time: 1
> In order to change the average load for a reducer (in bytes):
> set hive.exec.reducers.bytes.per.reducer=
> In order to limit the maximum number of reducers:
> set hive.exec.reducers.max=
> In order to set a constant number of reducers:
> set mapred.reduce.tasks=
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450)
> a
[jira] [Commented] (HIVE-2856) Fix TestCliDriver escape1.q failure on MR2
[ https://issues.apache.org/jira/browse/HIVE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230856#comment-13230856 ] Hudson commented on HIVE-2856: -- Integrated in Hive-trunk-h0.21 #1312 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1312/]) HIVE-2856. Fix TestCliDriver escape1.q failure on MR2 (Zhenxiao Luo via cws) (Revision 1301162) Result = FAILURE cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301162 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/FileUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/escape1.q * /hive/trunk/ql/src/test/queries/clientpositive/escape2.q * /hive/trunk/ql/src/test/results/clientpositive/escape1.q.out * /hive/trunk/ql/src/test/results/clientpositive/escape2.q.out > Fix TestCliDriver escape1.q failure on MR2 > -- > > Key: HIVE-2856 > URL: https://issues.apache.org/jira/browse/HIVE-2856 > Project: Hive > Issue Type: Bug > Components: Query Processor, Tests >Affects Versions: 0.8.0 >Reporter: Zhenxiao Luo >Assignee: Zhenxiao Luo > Fix For: 0.9.0 > > Attachments: HIVE-2856.1.patch.txt, HIVE-2856.2.patch.txt, > escape1.q.out, escape1.q.out, escape2.q.out > > > Additional '^' in escape test: > [junit] Begin query: escape1.q > [junit] Copying file: file:/home/cloudera/Code/hive/data/files/escapetest.txt > [junit] 12/01/23 15:22:15 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 15:22:15 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I > lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime > -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I > java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I > Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* > more -I job_[0-9]*_[0-9]* -I USING 'java -cp > /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/escape1.q.out > /home/cloudera/Code/hive/ql/src/test/results/clientpositive/escape1.q.out > [junit] 893d892 > [junit] < 1 1 ^ > [junit] junit.framework.AssertionFailedError: Client execution results failed > with error code = 1 > [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" > to get more logs. > [junit] at junit.framework.Assert.fail(Assert.java:50) > [junit] at > org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_escape1(TestCliDriver.java:131) > [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit] at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > [junit] at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > [junit] at java.lang.reflect.Method.invoke(Method.java:616) > [junit] at junit.framework.TestCase.runTest(TestCase.java:168) > [junit] at junit.framework.TestCase.runBare(TestCase.java:134) > [junit] at junit.framework.TestResult$1.protect(TestResult.java:110) > [junit] at junit.framework.TestResult.runProtected(TestResult.java:128) > [junit] at junit.framework.TestResult.run(TestResult.java:113) > [junit] at junit.framework.TestCase.run(TestCase.java:124) > [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) > [junit] at junit.framework.TestSuite.run(TestSuite.java:238) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768) > [junit] Exception: Client execution results failed with error code = 1 > [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" > to get more logs. > [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" > to get more logs.) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2748) Upgrade Hbase and ZK dependcies
[ https://issues.apache.org/jira/browse/HIVE-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230089#comment-13230089 ] Hudson commented on HIVE-2748: -- Integrated in Hive-trunk-h0.21 #1310 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1310/]) HIVE-2748: Upgrade Hbase and ZK dependcies (enis via hashutosh) (Revision 1300818) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1300818 Files : * /hive/trunk/hbase-handler/ivy.xml * /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/HBaseTestSetup.java * /hive/trunk/ivy/ivysettings.xml * /hive/trunk/ivy/libraries.properties * /hive/trunk/shims/ivy.xml * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenStore.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java * /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java > Upgrade Hbase and ZK dependcies > --- > > Key: HIVE-2748 > URL: https://issues.apache.org/jira/browse/HIVE-2748 > Project: Hive > Issue Type: Task >Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0 >Reporter: Ashutosh Chauhan >Assignee: Enis Soztutar > Fix For: 0.9.0 > > Attachments: HIVE-2748.3.patch, HIVE-2748.D1431.1.patch, > HIVE-2748.D1431.2.patch, HIVE-2748_v4.patch, HIVE-2748_v5.patch, > HIVE-2748_v6.patch, HIVE-2748_v7.patch, HIVE-2748_v8.patch > > > Both softwares have moved forward with significant improvements. Lets bump > compile time dependency to keep up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2714) Lots of special characters are not handled in LIKE
[ https://issues.apache.org/jira/browse/HIVE-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228188#comment-13228188 ] Hudson commented on HIVE-2714: -- Integrated in Hive-trunk-h0.21 #1307 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1307/]) HIVE-2714. Lots of special characters are not handled in LIKE. (jonchang via kevinwilfong) (Revision 1299948) Result = FAILURE kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1299948 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFLike.java * /hive/trunk/ql/src/test/queries/clientpositive/udf_like.q * /hive/trunk/ql/src/test/results/clientpositive/udf_like.q.out > Lots of special characters are not handled in LIKE > -- > > Key: HIVE-2714 > URL: https://issues.apache.org/jira/browse/HIVE-2714 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Attachments: HIVE-2714.D1239.1.patch, HIVE-2714.D1239.1.patch > > > Currently LIKE converts the string to a regular expression. It tries to > handle special characters but many are not correctly handled, e.g. +, ?, |, > etc. That code should just use Pattern.quote. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2837) insert into external tables should not be allowed
[ https://issues.apache.org/jira/browse/HIVE-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226664#comment-13226664 ] Hudson commented on HIVE-2837: -- Integrated in Hive-trunk-h0.21 #1302 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1302/]) HIVE-2837. insert into external tables should not be allowed. (namit via kevinwilfong) (Revision 1298936) Result = SUCCESS kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298936 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientnegative/insertexternal1.q * /hive/trunk/ql/src/test/results/clientnegative/insertexternal1.q.out > insert into external tables should not be allowed > - > > Key: HIVE-2837 > URL: https://issues.apache.org/jira/browse/HIVE-2837 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Attachments: HIVE-2837.D2211.1.patch, HIVE-2837.D2211.2.patch > > > This is a very risky thing to allow. > Since, the external tables can point to any user location, which can > potentially corrupt some other tables. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2832) Cache error messages for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226665#comment-13226665 ] Hudson commented on HIVE-2832: -- Integrated in Hive-trunk-h0.21 #1302 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1302/]) HIVE-2832 Cache error messages for additional logging (Kevin Wilfong via namit) (Revision 1299000) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1299000 Files : * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/io/CachingPrintStream.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyCachingPrintStreamHook.java * /hive/trunk/ql/src/test/queries/clientnegative/cachingprintstream.q * /hive/trunk/ql/src/test/results/clientnegative/cachingprintstream.q.out > Cache error messages for additional logging > --- > > Key: HIVE-2832 > URL: https://issues.apache.org/jira/browse/HIVE-2832 > Project: Hive > Issue Type: Improvement > Components: Logging >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2832.D2025.1.patch, HIVE-2832.D2025.2.patch > > > It would be good if we could cache logs written to SessionState.err so that > they could be exposed to hooks for additional logging. This would allow > logging of error messages with the queries that failed in a central location. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2838) cleanup readentity/writeentity
[ https://issues.apache.org/jira/browse/HIVE-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226007#comment-13226007 ] Hudson commented on HIVE-2838: -- Integrated in Hive-trunk-h0.21 #1300 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1300/]) HIVE-2838. cleanup readentity/writeentity. (namit via kevinwilfong) (Revision 1298699) Result = FAILURE kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298699 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/hooks/Entity.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/hooks/ReadEntity.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/hooks/WriteEntity.java > cleanup readentity/writeentity > -- > > Key: HIVE-2838 > URL: https://issues.apache.org/jira/browse/HIVE-2838 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Fix For: 0.9.0 > > Attachments: HIVE-2838.D2193.1.patch, HIVE-2838.D2193.2.patch > > > Ideally, there should be one common entity instead of readentity/writeentity. > Unfortunately, that would be a backward incompatible change since users os > hive might have written > there own hooks, where they are using readentity/writeentity. > We should atleast create a common class, and then we can deprecate read/write > entity later, for a new release. > For now, I propose to make a backward compatible change. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1634) Allow access to Primitive types stored in binary format in HBase
[ https://issues.apache.org/jira/browse/HIVE-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225871#comment-13225871 ] Hudson commented on HIVE-1634: -- Integrated in Hive-trunk-h0.21 #1299 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1299/]) HIVE-1634: Allow access to Primitive types stored in binary format in HBase (Basab Maulik, Ashutosh Chauhan via hashutosh) (Revision 1298673) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298673 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDe.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStatsAggregator.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStatsPublisher.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableOutputFormat.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/LazyHBaseCellMap.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/LazyHBaseRow.java * /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/HBaseTestSetup.java * /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/TestHBaseSerDe.java * /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/TestLazyHBaseObject.java * /hive/trunk/hbase-handler/src/test/queries/hbase_binary_external_table_queries.q * /hive/trunk/hbase-handler/src/test/queries/hbase_binary_map_queries.q * /hive/trunk/hbase-handler/src/test/queries/hbase_binary_storage_queries.q * /hive/trunk/hbase-handler/src/test/results/hbase_binary_external_table_queries.q.out * /hive/trunk/hbase-handler/src/test/results/hbase_binary_map_queries.q.out * /hive/trunk/hbase-handler/src/test/results/hbase_binary_storage_queries.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyObject.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyPrimitive.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioBoolean.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioByte.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioDouble.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioFloat.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioInteger.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioLong.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazydio/LazyDioShort.java > Allow access to Primitive types stored in binary format in HBase > > > Key: HIVE-1634 > URL: https://issues.apache.org/jira/browse/HIVE-1634 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Affects Versions: 0.7.0, 0.8.0, 0.9.0 >Reporter: Basab Maulik >Assignee: Ashutosh Chauhan > Fix For: 0.9.0 > > Attachments: HIVE-1634.0.patch, HIVE-1634.1.patch, > HIVE-1634.D1581.1.patch, HIVE-1634.D1581.2.patch, HIVE-1634.D1581.3.patch, > TestHiveHBaseExternalTable.java, hive-1634_3.patch > > > This addresses HIVE-1245 in part, for atomic or primitive types. > The serde property "hbase.columns.storage.types" = "-,b,b,b,b,b,b,b,b" is a > specification of the storage option for the corresponding column in the serde > property "hbase.columns.mapping". Allowed values are '-' for table default, > 's' for standard string storage, and 'b' for binary storage as would be > obtained from o.a.h.hbase.utils.Bytes. Map types for HBase column families > use a colon separated pair such as 's:b' for the key and value part > specifiers respectively. See the test cases and queries for HBase handler for > additional examples. > There is also a table property "hbase.table.default.storage.type" = "string" > to specify a table level default storage type. The other valid specification > is "binary". The table level default is overridden by a column level > specification. > This control is available for the boolean, tinyint, smallint, int, bigint, > float, and double primitive types. The attached patch also relaxes the > mapping of map types to HBase column families to allow any primitive type to > be the map key. > Attached is a program for creating a table and populating it in HBase. The > external tab
[jira] [Commented] (HIVE-2841) Fix javadoc warnings
[ https://issues.apache.org/jira/browse/HIVE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224874#comment-13224874 ] Hudson commented on HIVE-2841: -- Integrated in Hive-trunk-h0.21 #1297 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1297/]) HIVE-2841: Fix javadoc warnings (Owen Omalley via hashutosh) (Revision 1298041) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298041 Files : * /hive/trunk/build.xml * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/cli/CommonCliOptions.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBean.java * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveDatabaseMetaData.java * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HivePreparedStatement.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/AlterHandler.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEventListener.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreFS.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/hooks/JDOConnectionURLHook.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MDBPrivilege.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MGlobalPrivilege.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MIndex.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MPartitionColumnPrivilege.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MPartitionEvent.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MPartitionPrivilege.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MRegionStorageDescriptor.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MTableColumnPrivilege.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MTablePrivilege.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyListener.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ArchiveUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecMapperContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeGenericFuncEvaluator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinDoubleKeys.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinObjectKey.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinSingleKey.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/history/HiveHistory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/hooks/LineageInfo.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/IndexSearchCondition.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/AuthorizationException.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Partition.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/index/RewriteParseContextGenerator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/lineage/LineageCtx.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/PhysicalPlanResolver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java
[jira] [Commented] (HIVE-2840) INPUT__FILE__NAME virtual column returns unqualified paths on Hadoop 0.23
[ https://issues.apache.org/jira/browse/HIVE-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224875#comment-13224875 ] Hudson commented on HIVE-2840: -- Integrated in Hive-trunk-h0.21 #1297 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1297/]) HIVE-2840: INPUT__FILE__NAME virtual column returns unqualified paths on Hadoop 0.23 (Carl Steinbach via hashutosh) (Revision 1298042) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298042 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java > INPUT__FILE__NAME virtual column returns unqualified paths on Hadoop 0.23 > - > > Key: HIVE-2840 > URL: https://issues.apache.org/jira/browse/HIVE-2840 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2840.D2127.1.patch, HIVE-2840.D2127.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2810) Implement NULL-safe equality operator <=>
[ https://issues.apache.org/jira/browse/HIVE-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224440#comment-13224440 ] Hudson commented on HIVE-2810: -- Integrated in Hive-trunk-h0.21 #1295 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1295/]) HIVE-2827 [jira] Implement nullsafe equi-join (Navis Ryu via Carl Steinbach) Summary: DPAL-873 Implement nullsafe equi-join was part of HIVE-2810, but separated because it affected more classes than expected. SELECT * FROM a JOIN b ON a.key <=> b.key Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach Differential Revision: https://reviews.facebook.net/D1971 (Revision 1297919) Result = SUCCESS cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1297919 Files : * /hive/trunk/data/files/in8.txt * /hive/trunk/data/files/in9.txt * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/AbstractMapJoinOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/CommonJoinOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JoinOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/SMBMapJoinOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/AbstractMapJoinKey.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinDoubleKeys.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinObjectKey.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinSingleKey.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/GenMRSkewJoinProcessor.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/QBJoinTree.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java * /hive/trunk/ql/src/test/queries/clientpositive/join_nullsafe.q * /hive/trunk/ql/src/test/results/clientpositive/join_nullsafe.q.out * /hive/trunk/ql/src/test/results/compiler/plan/join1.q.xml * /hive/trunk/ql/src/test/results/compiler/plan/join2.q.xml * /hive/trunk/ql/src/test/results/compiler/plan/join3.q.xml * /hive/trunk/ql/src/test/results/compiler/plan/join4.q.xml * /hive/trunk/ql/src/test/results/compiler/plan/join5.q.xml * /hive/trunk/ql/src/test/results/compiler/plan/join6.q.xml * /hive/trunk/ql/src/test/results/compiler/plan/join7.q.xml * /hive/trunk/ql/src/test/results/compiler/plan/join8.q.xml * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java > Implement NULL-safe equality operator <=> > - > > Key: HIVE-2810 > URL: https://issues.apache.org/jira/browse/HIVE-2810 > Project: Hive > Issue Type: New Feature > Components: Query Processor, UDF >Reporter: Carl Steinbach >Assignee: Navis > Fix For: 0.9.0 > > Attachments: HIVE-2810.D1791.1.patch, HIVE-2810.D1791.2.patch, > HIVE-2810.D1791.3.patch, HIVE-2810.D1791.4.patch > > > Ref: > http://dev.mysql.com/doc/refman/5.0/en/comparison-operators.html#operator_equal-to -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2827) Implement nullsafe equi-join
[
https://issues.apache.org/jira/browse/HIVE-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224439#comment-13224439
]
Hudson commented on HIVE-2827:
--
Integrated in Hive-trunk-h0.21 #1295 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1295/])
HIVE-2827 [jira] Implement nullsafe equi-join
(Navis Ryu via Carl Steinbach)
Summary:
DPAL-873 Implement nullsafe equi-join
was part of HIVE-2810, but separated because it affected more classes than
expected.
SELECT * FROM a JOIN b ON a.key <=> b.key
Test Plan: EMPTY
Reviewers: JIRA, cwsteinbach
Reviewed By: cwsteinbach
Differential Revision: https://reviews.facebook.net/D1971 (Revision 1297919)
Result = SUCCESS
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1297919
Files :
* /hive/trunk/data/files/in8.txt
* /hive/trunk/data/files/in9.txt
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/AbstractMapJoinOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/CommonJoinOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JoinOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/SMBMapJoinOperator.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/AbstractMapJoinKey.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinDoubleKeys.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinObjectKey.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinSingleKey.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/GenMRSkewJoinProcessor.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/QBJoinTree.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/JoinDesc.java
* /hive/trunk/ql/src/test/queries/clientpositive/join_nullsafe.q
* /hive/trunk/ql/src/test/results/clientpositive/join_nullsafe.q.out
* /hive/trunk/ql/src/test/results/compiler/plan/join1.q.xml
* /hive/trunk/ql/src/test/results/compiler/plan/join2.q.xml
* /hive/trunk/ql/src/test/results/compiler/plan/join3.q.xml
* /hive/trunk/ql/src/test/results/compiler/plan/join4.q.xml
* /hive/trunk/ql/src/test/results/compiler/plan/join5.q.xml
* /hive/trunk/ql/src/test/results/compiler/plan/join6.q.xml
* /hive/trunk/ql/src/test/results/compiler/plan/join7.q.xml
* /hive/trunk/ql/src/test/results/compiler/plan/join8.q.xml
* /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java
> Implement nullsafe equi-join
>
>
> Key: HIVE-2827
> URL: https://issues.apache.org/jira/browse/HIVE-2827
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
> Environment: ubuntu 10.04
>Reporter: Navis
>Assignee: Navis
>Priority: Minor
> Fix For: 0.9.0
>
> Attachments: HIVE-2827.D1971.1.patch, HIVE-2827.D1971.2.patch,
> HIVE-2827.D1971.3.patch, HIVE-2827.D1971.4.patch, HIVE-2827.D1971.5.patch,
> HIVE-2827.D1971.6.patch, HIVE-2827.D1971.7.patch
>
>
> was part of HIVE-2810, but separated because it affected more classes than
> expected.
> {noformat}
> SELECT * FROM a JOIN b ON a.key <=> b.key
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2833) Fix test failures caused by HIVE-2716
[ https://issues.apache.org/jira/browse/HIVE-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13222307#comment-13222307 ] Hudson commented on HIVE-2833: -- Integrated in Hive-trunk-h0.21 #1290 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1290/]) HIVE-2833 Fix test failures caused by HIVE-2716 (Kevin Wilfong via namit) (Revision 1296946) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296946 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingRawStore.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyJdoConnectionUrlHook.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreForJdoConnection.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreConnectionUrlHook.java > Fix test failures caused by HIVE-2716 > - > > Key: HIVE-2833 > URL: https://issues.apache.org/jira/browse/HIVE-2833 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Carl Steinbach >Assignee: Kevin Wilfong > Attachments: HIVE-2716.D2055.1.patch, HIVE-2833.D2055.2.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2716) Move retry logic in HiveMetaStore to a separe class
[ https://issues.apache.org/jira/browse/HIVE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13222306#comment-13222306 ] Hudson commented on HIVE-2716: -- Integrated in Hive-trunk-h0.21 #1290 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1290/]) HIVE-2833 Fix test failures caused by HIVE-2716 (Kevin Wilfong via namit) (Revision 1296946) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1296946 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingRawStore.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyJdoConnectionUrlHook.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyRawStoreForJdoConnection.java * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreConnectionUrlHook.java > Move retry logic in HiveMetaStore to a separe class > --- > > Key: HIVE-2716 > URL: https://issues.apache.org/jira/browse/HIVE-2716 > Project: Hive > Issue Type: Sub-task > Components: Metastore >Affects Versions: 0.9.0 >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 0.9.0 > > Attachments: HIVE-2716.D1227.1.patch, HIVE-2716.D1227.2.patch, > HIVE-2716.D1227.3.patch, HIVE-2716.D1227.4.patch, HIVE-2716.D2055.1.patch, > HIVE-2716.patch > > > In HIVE-1219, method retrying for raw store operation are introduced to > handle jdo operations more robustly. However, the abstraction for the > RawStore operations can be moved to a separate class implementing RawStore, > which should clean up the code base for HiveMetaStore. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2825) Concatenating a partition does not inherit location from table
[ https://issues.apache.org/jira/browse/HIVE-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218875#comment-13218875 ] Hudson commented on HIVE-2825: -- Integrated in Hive-trunk-h0.21 #1284 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1284/]) HIVE-2825 Concatenating a partition does not inherit location from table (Kevin Wilfong via namit) (Revision 1294942) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1294942 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyPartitionIsSubdirectoryOfTableHook.java * /hive/trunk/ql/src/test/queries/clientpositive/concatenate_inherit_table_location.q * /hive/trunk/ql/src/test/results/clientpositive/concatenate_inherit_table_location.q.out > Concatenating a partition does not inherit location from table > -- > > Key: HIVE-2825 > URL: https://issues.apache.org/jira/browse/HIVE-2825 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2825.D1995.1.patch, HIVE-2825.D1995.2.patch > > > When a table is created in one dfs, a partition is added to that table, the > table's dfs is changed, and the partitioned is concatenated, the partitions > location remains exactly the same. Instead, it should inherit its location > from the table, and be updated accordingly. > See https://issues.apache.org/jira/browse/HIVE-1707 for an analogous change > to insert overwrite. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2811) Export LANG=en_US.UTF-8 to environment while running tests
[ https://issues.apache.org/jira/browse/HIVE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217167#comment-13217167 ] Hudson commented on HIVE-2811: -- Integrated in Hive-trunk-h0.21 #1279 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1279/]) HIVE-2811: Export LANG=en_US.UTF-8 to environment while running tests (ecapriolo via hashutosh) (Revision 1294049) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1294049 Files : * /hive/trunk/build-common.xml > Export LANG=en_US.UTF-8 to environment while running tests > -- > > Key: HIVE-2811 > URL: https://issues.apache.org/jira/browse/HIVE-2811 > Project: Hive > Issue Type: Bug > Components: Tests >Affects Versions: 0.9.0 >Reporter: Ashutosh Chauhan >Assignee: Edward Capriolo > Fix For: 0.9.0 > > Attachments: HIVE-2811.3.patch, HIVE-2811.3.patch, > HIVE-2811.D1905.1.patch, HIVE-2811.D1905.2.patch > > > Most OS has this value by default, but in some cases (on apache build > machines) it has a different value making inputddl5.q test to fail. This > variable should be exported while running the tests. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2824) typo in configuration parameter
[ https://issues.apache.org/jira/browse/HIVE-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216543#comment-13216543 ] Hudson commented on HIVE-2824: -- Integrated in Hive-trunk-h0.21 #1276 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1276/]) HIVE-2824: typo in configuration parameter (Sho Shimauchi via hashutosh) (Revision 1293618) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293618 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template > typo in configuration parameter > --- > > Key: HIVE-2824 > URL: https://issues.apache.org/jira/browse/HIVE-2824 > Project: Hive > Issue Type: Bug > Components: Configuration >Reporter: Sho Shimauchi >Assignee: Sho Shimauchi > Fix For: 0.9.0 > > Attachments: HIVE-2824.txt > > > hive.files.umask.vlaue > should be: > hive.files.umask.value -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2761) Remove lib/javaewah-0.3.jar
[ https://issues.apache.org/jira/browse/HIVE-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216544#comment-13216544 ] Hudson commented on HIVE-2761: -- Integrated in Hive-trunk-h0.21 #1276 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1276/]) HIVE-2761: Remove lib/javaewah-0.3.jar (ecapriolo via hashutosh) (Revision 1293617) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293617 Files : * /hive/trunk/build-common.xml * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/ivy/libraries.properties * /hive/trunk/lib/javaewah-0.3.jar * /hive/trunk/lib/javaewah.LICENSE * /hive/trunk/ql/build.xml * /hive/trunk/ql/ivy.xml > Remove lib/javaewah-0.3.jar > --- > > Key: HIVE-2761 > URL: https://issues.apache.org/jira/browse/HIVE-2761 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 0.8.0, 0.8.1, 0.9.0 >Reporter: Ashutosh Chauhan >Assignee: Edward Capriolo > Fix For: 0.9.0 > > Attachments: HIVE-2761.2.patch.txt, HIVE-2761.3.patch.txt, > HIVE-2761.D1911.1.patch, HIVE-2761.D1911.2.patch > > > After HIVE-2391 it is retrieved from maven repo via ivy, we can get rid of it > from our lib/ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2781) HBaseSerDe should allow users to specify the timestamp passed to Puts
[ https://issues.apache.org/jira/browse/HIVE-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216542#comment-13216542 ] Hudson commented on HIVE-2781: -- Integrated in Hive-trunk-h0.21 #1276 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1276/]) HIVE-2781: HBaseSerDe should allow users to specify the timestamp passed to Puts (toffer via hashutosh) (Revision 1293616) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293616 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDe.java * /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/TestHBaseSerDe.java > HBaseSerDe should allow users to specify the timestamp passed to Puts > -- > > Key: HIVE-2781 > URL: https://issues.apache.org/jira/browse/HIVE-2781 > Project: Hive > Issue Type: Improvement >Affects Versions: 0.9.0 >Reporter: Francis Liu >Assignee: Francis Liu > Fix For: 0.9.0 > > Attachments: HIVE-2781.D1863.1.patch, HIVE-2781.D1863.2.patch, > HIVE-2781.D1881.1.patch, HIVE-2781.D1881.1.patch > > > Users may want to specify the timestamp used for Put requests to hbase. Thus > enabling users to have the same timestamp for a single batch of writes. Which > would be useful for a number of things. HCatalog's HBase storageHandler > implementation makes use of this feature to provide users with snapshot > isolation and write transactions. My proposal is to add the timestamp option > as a final static member: > public static final long HBASE_PUT_TIMESTAMP = "hbase.put_timestamp" > And passing this value to all the Puts created by serialize() -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2712) Make ZooKeeper token store ACL configurable
[ https://issues.apache.org/jira/browse/HIVE-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216387#comment-13216387 ] Hudson commented on HIVE-2712: -- Integrated in Hive-trunk-h0.21 #1275 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1275/]) HIVE-2712: Make ZooKeeper token store ACL configurable (thw via hashutosh) (Revision 1293530) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293530 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/DelegationTokenStore.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/MemoryTokenStore.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/TokenStoreDelegationTokenSecretManager.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/ZooKeeperTokenStore.java * /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java * /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java > Make ZooKeeper token store ACL configurable > --- > > Key: HIVE-2712 > URL: https://issues.apache.org/jira/browse/HIVE-2712 > Project: Hive > Issue Type: Improvement > Components: Metastore, Security, Server Infrastructure >Affects Versions: 0.8.0, 0.8.1, 0.9.0 >Reporter: Thomas Weise >Assignee: Thomas Weise > Fix For: 0.9.0 > > Attachments: HIVE-2712.3.patch, HIVE-2712.D1401.1.patch, > HIVE-2712.D1401.2.patch, HIVE-2712.D1401.3.patch > > > ACL needs to be set to secure the token store with ZK 3.4. > The patch will also include the review changes from HIVE-2467 that were not > committed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2490) Add reset operation and average time attribute to Metrics MBean.
[ https://issues.apache.org/jira/browse/HIVE-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216224#comment-13216224 ] Hudson commented on HIVE-2490: -- Integrated in Hive-trunk-h0.21 #1274 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1274/]) HIVE-2490: Add reset operation and average time attribute to Metrics MBean. (kevinwilfong via hashutosh) (Revision 1293352) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1293352 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/Metrics.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBeanImpl.java > Add reset operation and average time attribute to Metrics MBean. > > > Key: HIVE-2490 > URL: https://issues.apache.org/jira/browse/HIVE-2490 > Project: Hive > Issue Type: New Feature >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2490.1.patch.txt > > > We should add a reset operation to the Metrics MBean, which will set all the > counters to 0. > Note: Deleting the counters from the map of attributes was not suggested > because that could break any scripts that get the list of attributes from the > bean and then the values of each attribute. Also, 0 is unlikely to be an > actual value for any counter, and it will not break the increment > functionality. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2768) Add a getAuthorizationProvider to HiveStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13215326#comment-13215326 ] Hudson commented on HIVE-2768: -- Integrated in Hive-trunk-h0.21 #1272 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1272/]) HIVE-2768: Add a getAuthorizationProvider to HiveStorageHandler (toffer via hashutosh) (Revision 1292969) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1292969 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/DefaultStorageHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveStorageHandler.java > Add a getAuthorizationProvider to HiveStorageHandler > > > Key: HIVE-2768 > URL: https://issues.apache.org/jira/browse/HIVE-2768 > Project: Hive > Issue Type: Task > Components: HBase Handler >Reporter: Alan Gates >Assignee: Francis Liu > Fix For: 0.9.0 > > Attachments: HIVE-2768.D1869.1.patch, HIVE-2768.D1869.1.patch > > > In version 0.92 HBase supports ACLs for tables. In HCatalog, since we > delegate security to the underlying storage layer, we would like to be able > to obtain a HiveAuthorizationProvider specific to a HiveStorageHandler > instance. This can be done by adding a getAuthorizationProvider method to > HiveStorageHandler. In the case where Hive is configured to use the > DefaultHiveAuthorizationProvider this call will return the same default > provider, since Hive handles all of the authorization itself in that case. > In the case where it is configured to use the HCatAuthorizationProvider, it > would return an instance specific to the underlying storage. > For more background on this proposed change see HCATALOG-237 and > https://cwiki.apache.org/confluence/display/HCATALOG/Hcat+Security+Design -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2716) Move retry logic in HiveMetaStore to a separe class
[ https://issues.apache.org/jira/browse/HIVE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13214149#comment-13214149 ] Hudson commented on HIVE-2716: -- Integrated in Hive-trunk-h0.21 #1270 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1270/]) HIVE-2716 : Move retry logic in HiveMetaStore to a separe class (enis via hashutosh) (Revision 1292420) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1292420 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RetryingRawStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/EventCleanerTask.java > Move retry logic in HiveMetaStore to a separe class > --- > > Key: HIVE-2716 > URL: https://issues.apache.org/jira/browse/HIVE-2716 > Project: Hive > Issue Type: Sub-task > Components: Metastore >Affects Versions: 0.9.0 >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 0.9.0 > > Attachments: HIVE-2716.D1227.1.patch, HIVE-2716.D1227.2.patch, > HIVE-2716.D1227.3.patch, HIVE-2716.D1227.4.patch, HIVE-2716.patch > > > In HIVE-1219, method retrying for raw store operation are introduced to > handle jdo operations more robustly. However, the abstraction for the > RawStore operations can be moved to a separate class implementing RawStore, > which should clean up the code base for HiveMetaStore. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2792) SUBSTR(CAST( AS BINARY)) produces unexpected results
[ https://issues.apache.org/jira/browse/HIVE-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212985#comment-13212985 ] Hudson commented on HIVE-2792: -- Integrated in Hive-trunk-h0.21 #1268 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1268/]) HIVE-2792: SUBSTR(CAST( AS BINARY)) produces unexpected results (navis via hashutosh) (Revision 1291633) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291633 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFSubstr.java * /hive/trunk/ql/src/test/queries/clientpositive/ba_table_udfs.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_substr.q * /hive/trunk/ql/src/test/results/clientpositive/ba_table_udfs.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_substr.q.out > SUBSTR(CAST( AS BINARY)) produces unexpected results > > > Key: HIVE-2792 > URL: https://issues.apache.org/jira/browse/HIVE-2792 > Project: Hive > Issue Type: Bug > Components: UDF >Affects Versions: 0.8.0, 0.8.1 >Reporter: Carl Steinbach >Assignee: Navis > Fix For: 0.9.0 > > Attachments: HIVE-2792.D1797.1.patch, HIVE-2792.D1797.2.patch, > HIVE-2792.D1797.2.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2344) filter is removed due to regression of HIVE-1538
[ https://issues.apache.org/jira/browse/HIVE-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212986#comment-13212986 ] Hudson commented on HIVE-2344: -- Integrated in Hive-trunk-h0.21 #1268 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1268/]) HIVE-2791: filter is still removed due to regression of HIVE-1538 althougth HIVE-2344 (binlijin via hashutosh) (Revision 1291916) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291916 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ppd/OpProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/ppd2.q * /hive/trunk/ql/src/test/results/clientpositive/ppd2.q.out > filter is removed due to regression of HIVE-1538 > > > Key: HIVE-2344 > URL: https://issues.apache.org/jira/browse/HIVE-2344 > Project: Hive > Issue Type: Bug >Affects Versions: 0.8.0 >Reporter: He Yongqiang >Assignee: Amareshwari Sriramadasu > Fix For: 0.8.0 > > Attachments: hive-patch-2344-2.txt, hive-patch-2344.txt, > ppd_udf_col.q.out.txt > > > select * from > ( > select type_bucket,randum123 > from (SELECT *, cast(rand() as double) AS randum123 FROM tbl where ds = ...) > a > where randum123 <=0.1)s where s.randum123>0.1 limit 20; > This is returning results... > and > explain > select type_bucket,randum123 > from (SELECT *, cast(rand() as double) AS randum123 FROM tbl where ds = ...) > a > where randum123 <=0.1 > shows that there is no filter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2791) filter is still removed due to regression of HIVE-1538 althougth HIVE-2344
[ https://issues.apache.org/jira/browse/HIVE-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212984#comment-13212984 ] Hudson commented on HIVE-2791: -- Integrated in Hive-trunk-h0.21 #1268 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1268/]) HIVE-2791: filter is still removed due to regression of HIVE-1538 althougth HIVE-2344 (binlijin via hashutosh) (Revision 1291916) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291916 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ppd/OpProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/ppd2.q * /hive/trunk/ql/src/test/results/clientpositive/ppd2.q.out > filter is still removed due to regression of HIVE-1538 althougth HIVE-2344 > -- > > Key: HIVE-2791 > URL: https://issues.apache.org/jira/browse/HIVE-2791 > Project: Hive > Issue Type: Bug >Reporter: binlijin >Assignee: binlijin > Fix For: 0.9.0 > > Attachments: HIVE-2791.2.patch, HIVE-2791.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1538) FilterOperator is applied twice with ppd on.
[ https://issues.apache.org/jira/browse/HIVE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212987#comment-13212987 ] Hudson commented on HIVE-1538: -- Integrated in Hive-trunk-h0.21 #1268 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1268/]) HIVE-2791: filter is still removed due to regression of HIVE-1538 althougth HIVE-2344 (binlijin via hashutosh) (Revision 1291916) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291916 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ppd/OpProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/ppd2.q * /hive/trunk/ql/src/test/results/clientpositive/ppd2.q.out > FilterOperator is applied twice with ppd on. > > > Key: HIVE-1538 > URL: https://issues.apache.org/jira/browse/HIVE-1538 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Amareshwari Sriramadasu >Assignee: Amareshwari Sriramadasu > Fix For: 0.8.0 > > Attachments: patch-1538-1.txt, patch-1538-2.txt, patch-1538-3.txt, > patch-1538-4.txt, patch-1538.txt > > > With hive.optimize.ppd set to true, FilterOperator is applied twice. And it > seems second operator is always filtering zero rows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2792) SUBSTR(CAST( AS BINARY)) produces unexpected results
[ https://issues.apache.org/jira/browse/HIVE-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212572#comment-13212572 ] Hudson commented on HIVE-2792: -- Integrated in Hive-trunk-h0.21 #1267 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1267/]) HIVE-2792: SUBSTR(CAST( AS BINARY)) produces unexpected results (navis via hashutosh) (Revision 1291633) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291633 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFSubstr.java * /hive/trunk/ql/src/test/queries/clientpositive/ba_table_udfs.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_substr.q * /hive/trunk/ql/src/test/results/clientpositive/ba_table_udfs.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_substr.q.out > SUBSTR(CAST( AS BINARY)) produces unexpected results > > > Key: HIVE-2792 > URL: https://issues.apache.org/jira/browse/HIVE-2792 > Project: Hive > Issue Type: Bug > Components: UDF >Affects Versions: 0.8.0, 0.8.1 >Reporter: Carl Steinbach >Assignee: Navis > Fix For: 0.9.0 > > Attachments: HIVE-2792.D1797.1.patch, HIVE-2792.D1797.2.patch, > HIVE-2792.D1797.2.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2782) New BINARY type produces unexpected results with supported UDFS when using MapReduce2
[ https://issues.apache.org/jira/browse/HIVE-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208493#comment-13208493 ] Hudson commented on HIVE-2782: -- Integrated in Hive-trunk-h0.21 #1259 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1259/]) HIVE-2782 [jira] New BINARY type produces unexpected results with supported UDFS when using MapReduce2 Summary: HIVE-2782. Make ba_table_udfs.q deterministic Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D1653 (Revision 1244314) Result = FAILURE cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1244314 Files : * /hive/trunk/ql/src/test/queries/clientpositive/ba_table_udfs.q * /hive/trunk/ql/src/test/results/clientpositive/ba_table_udfs.q.out > New BINARY type produces unexpected results with supported UDFS when using > MapReduce2 > - > > Key: HIVE-2782 > URL: https://issues.apache.org/jira/browse/HIVE-2782 > Project: Hive > Issue Type: Bug >Reporter: Zhenxiao Luo >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2782.D1653.1.patch, HIVE-2782.D1653.1.patch > > > When using MapReduce2 for Hive > ba_table_udfs is failing with unexpected output: > [junit] Begin query: ba_table_udfs.q > [junit] 12/01/23 13:32:28 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 13:32:28 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I > lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime > -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I > java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I > Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* > more -I job_[0-9]*_[0-9]* -I USING 'java -cp > /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/ba_table_udfs.q.out > > /home/cloudera/Code/hive/ql/src/test/results/clientpositive/ba_table_udfs.q.out > [junit] 20,26c20,26 > [junit] < 2 10val_101 > [junit] < 3 164val_164 1 > [junit] < 3 150val_150 1 > [junit] < 2 18val_181 > [junit] < 3 177val_177 1 > [junit] < 2 12val_121 > [junit] < 2 11val_111 > [junit] — > [junit] > 3 120val_120 1 > [junit] > 3 192val_192 1 > [junit] > 3 119val_119 1 > [junit] > 3 187val_187 1 > [junit] > 3 176val_176 1 > [junit] > 3 199val_199 1 > [junit] > 3 118val_118 1 > [junit] Exception: Client execution results failed with error code = 1 > [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" > to get more logs. > [junit] junit.framework.AssertionFailedError: Client execution results failed > with error code = 1 > [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" > to get more logs. > [junit] at junit.framework.Assert.fail(Assert.java:50) > [junit] at > org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ba_table_udfs(TestCliDriver.java:129) > [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit] at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > [junit] at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > [junit] at java.lang.reflect.Method.invoke(Method.java:616) > [junit] at junit.framework.TestCase.runTest(TestCase.java:168) > [junit] at junit.framework.TestCase.runBare(TestCase.java:134) > [junit] at junit.framework.TestResult$1.protect(TestResult.java:110) > [junit] at junit.framework.TestResult.runProtected(TestResult.java:128) > [junit] at junit.framework.TestResult.run(TestResult.java:113) > [junit] at junit.framework.TestCase.run(TestCase.java:124) > [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) > [junit] at junit.framework.TestSuite.run(TestSuite.java:238) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911) > [junit] at > org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768) > [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" > to get more logs.) > [junit] Cleaning up TestCliDriver > [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 10.751 sec > [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED > [for] /home/cloudera/Code/hive/ql/build.xml: The fo
[jira] [Commented] (HIVE-2793) Disable loadpart_err.q on 0.23
[ https://issues.apache.org/jira/browse/HIVE-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208494#comment-13208494 ] Hudson commented on HIVE-2793: -- Integrated in Hive-trunk-h0.21 #1259 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1259/]) HIVE-2793 [jira] Disable loadpart_err.q on 0.23 Summary: HIVE-2793. Add 0.23 to list of excluded Hadoop versions for loadpart_err.q Test Plan: EMPTY Reviewers: JIRA, jsichi, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D1665 (Revision 1244311) Result = FAILURE cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1244311 Files : * /hive/trunk/ql/src/test/queries/clientpositive/loadpart_err.q > Disable loadpart_err.q on 0.23 > -- > > Key: HIVE-2793 > URL: https://issues.apache.org/jira/browse/HIVE-2793 > Project: Hive > Issue Type: Bug > Components: Testing Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2793.D1665.1.patch, HIVE-2793.D1665.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2753) Remove empty java files
[
https://issues.apache.org/jira/browse/HIVE-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207557#comment-13207557
]
Hudson commented on HIVE-2753:
--
Integrated in Hive-trunk-h0.21 #1257 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1257/])
HIVE-2753 [jira] Remove empty java files
(Owen O'Malley via Carl Steinbach)
Summary:
remove dead java files
When looking at the 0.8.1 rc1, I discovered there were a set of empty Java files
that were likely left over from using 'patch' without the -E.
jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcSessionState.java
ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeIndexEvaluator.java
ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinObject.java
ql/src/java/org/apache/hadoop/hive/ql/exec/PathUtil.java
ql/src/java/org/apache/hadoop/hive/ql/exec/TypedBytesRecordReader.java
ql/src/java/org/apache/hadoop/hive/ql/plan/AlterPartitionProtectModeDesc.java
ql/src/java/org/apache/hadoop/hive/ql/plan/TouchDesc.java
ql/src/test/org/apache/hadoop/hive/ql/plan/TestAddPartition.java
serde/src/gen-java/org/apache/hadoop/hive/serde/test/Constants.java
shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java
shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java
Test Plan: EMPTY
Reviewers: JIRA, cwsteinbach
Reviewed By: cwsteinbach
CC: cwsteinbach
Differential Revision: https://reviews.facebook.net/D1611 (Revision 1243762)
Result = FAILURE
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1243762
Files :
* /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcSessionState.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeIndexEvaluator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinObject.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/PathUtil.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TypedBytesRecordReader.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterPartitionProtectModeDesc.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TouchDesc.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/plan/TestAddPartition.java
*
/hive/trunk/serde/src/gen-java/org/apache/hadoop/hive/serde/test/Constants.java
* /hive/trunk/shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java
* /hive/trunk/shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java
> Remove empty java files
> ---
>
> Key: HIVE-2753
> URL: https://issues.apache.org/jira/browse/HIVE-2753
> Project: Hive
> Issue Type: Bug
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Fix For: 0.9.0
>
> Attachments: HIVE-2753.D1611.1.patch, h-2753.patch
>
>
> When looking at the 0.8.1 rc1, I discovered there were a set of empty Java
> files that were likely left over from using 'patch' without the -E.
> {quote}
> jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcSessionState.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeIndexEvaluator.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinObject.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/PathUtil.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/TypedBytesRecordReader.java
> ql/src/java/org/apache/hadoop/hive/ql/plan/AlterPartitionProtectModeDesc.java
> ql/src/java/org/apache/hadoop/hive/ql/plan/TouchDesc.java
> ql/src/test/org/apache/hadoop/hive/ql/plan/TestAddPartition.java
> serde/src/gen-java/org/apache/hadoop/hive/serde/test/Constants.java
> shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java
> shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java
> {quote}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2612) support hive table/partitions exists in more than one region
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206096#comment-13206096 ] Hudson commented on HIVE-2612: -- Integrated in Hive-trunk-h0.21 #1254 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1254/]) HIVE-2612 support hive table/partitions exists in more than one region (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1243013 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template * /hive/trunk/contrib/src/test/results/clientnegative/serde_regex.q.out * /hive/trunk/contrib/src/test/results/clientpositive/fileformat_base64.q.out * /hive/trunk/contrib/src/test/results/clientpositive/serde_regex.q.out * /hive/trunk/metastore/if/hive_metastore.thrift * /hive/trunk/metastore/scripts/upgrade/derby/010-HIVE-2612.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql * /hive/trunk/metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql * /hive/trunk/metastore/scripts/upgrade/mysql/010-HIVE-2612.mysql.sql * /hive/trunk/metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql * /hive/trunk/metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql * /hive/trunk/metastore/scripts/upgrade/postgres/010-HIVE-2612.postgres.sql * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp * /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp * /hive/trunk/metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/RegionStorageDescriptor.java * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java * /hive/trunk/metastore/src/gen/thrift/gen-php/ThriftHiveMetastore.php * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore_constants.php * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore_types.php * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py * /hive/trunk/metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MRegionStorageDescriptor.java * /hive/trunk/metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java * /hive/trunk/metastore/src/model/package.jdo * /hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java * /hive/trunk/ql/src/test/results/clientpositive/create_union_table.q.out * /hive/trunk/ql/src/test/results/clientpositive/ctas.q.out * /hive/trunk/ql/src/test/results/clientpositive/fileformat_sequencefile.q.out * /hive/trunk/ql/src/test/results/clientpositive/fileformat_text.q.out * /hive/trunk/ql/src/test/results/clientpositive/input15.q.out * /hive/trunk/ql/src/test/results/clientpositive/inputddl1.q.out * /hive/trunk/ql/src/test/results/clientpositive/inputddl2.q.out * /hive/trunk/ql/src/test/results/clientpositive/inputddl3.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge3.q.out * /hive/trunk/ql/src/test/results/clientpositive/rcfile_create
[jira] [Commented] (HIVE-2795) View partitions do not have a storage descriptor
[ https://issues.apache.org/jira/browse/HIVE-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13205354#comment-13205354 ] Hudson commented on HIVE-2795: -- Integrated in Hive-trunk-h0.21 #1252 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1252/]) HIVE-2795 View partitions do not have a storage descriptor (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1242682 Files : * /hive/trunk/metastore/scripts/upgrade/001-HIVE-2795.update_view_partitions.py * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/ql/src/test/queries/clientpositive/describe_formatted_view_partitioned.q * /hive/trunk/ql/src/test/results/clientpositive/describe_formatted_view_partitioned.q.out > View partitions do not have a storage descriptor > > > Key: HIVE-2795 > URL: https://issues.apache.org/jira/browse/HIVE-2795 > Project: Hive > Issue Type: Improvement >Reporter: Namit Jain >Assignee: Kevin Wilfong > Attachments: HIVE-2795.D1683.1.patch, HIVE-2795.D1683.2.patch, > HIVE-2795.D1683.3.patch > > > Besides being an inconsistency, it causes errors. > Calling describe formatted on a view partition throws an exception > java.lang.NullPointerException > at org.apache.hadoop.hive.ql.metadata.Partition.getCols(Partition.java:505) > > at org.apache.hadoop.hive.ql.exec.DDLTask.describeTable(DDLTask.java:2570) > because it does not have a column descriptor, which is part of the storage > descriptor. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2749) CONV returns incorrect results sometimes
[ https://issues.apache.org/jira/browse/HIVE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204428#comment-13204428 ] Hudson commented on HIVE-2749: -- Integrated in Hive-trunk-h0.21 #1250 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1250/]) HIVE-2749 CONV returns incorrect results sometimes (Jonathan Chang via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=124 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFConv.java * /hive/trunk/ql/src/test/queries/clientpositive/udf_conv.q * /hive/trunk/ql/src/test/results/clientpositive/udf_conv.q.out > CONV returns incorrect results sometimes > > > Key: HIVE-2749 > URL: https://issues.apache.org/jira/browse/HIVE-2749 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Attachments: HIVE-2749.D1437.1.patch, HIVE-2749.D1437.2.patch, > HIVE-2749.D1437.2.patch > > > ...because it fails to reset state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2759) Change global_limit.q into linux format file
[ https://issues.apache.org/jira/browse/HIVE-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204174#comment-13204174 ] Hudson commented on HIVE-2759: -- Integrated in Hive-trunk-h0.21 #1249 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1249/]) HIVE-2759 Change global_limit.q into linux format file (Zhenxiao Luo via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1242071 Files : * /hive/trunk/ql/src/test/queries/clientpositive/global_limit.q > Change global_limit.q into linux format file > > > Key: HIVE-2759 > URL: https://issues.apache.org/jira/browse/HIVE-2759 > Project: Hive > Issue Type: Bug > Components: Testing Infrastructure >Reporter: Zhenxiao Luo >Assignee: Zhenxiao Luo > Attachments: HIVE-2759.D1497.1.patch, HIVE-2759.D1497.1.patch > > > global_limit.q is in dos format, and has "\ No newline at end of file". > Needs to be changed into linux format, removing all "^M" at the end of each > line. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2779) Improve hooks run in Driver
[ https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203311#comment-13203311 ] Hudson commented on HIVE-2779: -- Integrated in Hive-trunk-h0.21 #1247 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1247/]) HIVE-2779 Improve Hooks run in Driver (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241729 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHook.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContextImpl.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHooksRunInOrder.java * /hive/trunk/ql/src/test/queries/clientpositive/hook_order.q * /hive/trunk/ql/src/test/results/clientnegative/bad_exec_hooks.q.out * /hive/trunk/ql/src/test/results/clientpositive/hook_order.q.out > Improve hooks run in Driver > --- > > Key: HIVE-2779 > URL: https://issues.apache.org/jira/browse/HIVE-2779 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, > HIVE-2779.D1599.3.patch > > > There are some small improvements that can be made to the hooks which are run > in the Driver: > 1) The code to get hooks has been clearly just been copy+pasted for each of > Pre/Post/OnFailure/SemanticAnalyzer hooks. This code should be consolidated > into a single method. > 2) There is a lot more information available to SemanticAnalyzer hooks which > ran after semantic analysis than to those that run before, such as inputs and > outputs. We should make some of this information available to those hooks, > preferably through HiveSemanticAnalyzerHookContext, so that existing hooks > aren't broken. > 3) Currently, possibly unintentionally, hooks are initialized and run in the > order they appear in the comma separated list that is the value of the > configuration variable. This is a useful property, we should add comments > indicating this is desired and add a unit test to enforce it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199657#comment-13199657 ] Hudson commented on HIVE-2756: -- Integrated in Hive-trunk-h0.21 #1241 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1241/]) HIVE-2756 Views should be added to the inputs of queries. (Yongqiang He via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1240005 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/results/clientnegative/create_or_replace_view7.q.out * /hive/trunk/ql/src/test/results/clientnegative/invalidate_view1.q.out * /hive/trunk/ql/src/test/results/clientnegative/recursive_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/alter_view_rename.q.out * /hive/trunk/ql/src/test/results/clientpositive/create_big_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/create_or_replace_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/create_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/create_view_partitioned.q.out * /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out > Views should be added to the inputs of queries. > --- > > Key: HIVE-2756 > URL: https://issues.apache.org/jira/browse/HIVE-2756 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2756.D1575.1.patch > > > Views, in addition to the underlying tables, should be included in the inputs > of a command which queries a view. > This is useful when we want to know exactly what inputs need to be present in > order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2762) Alter Table Partition Concatenate Fails On Certain Characters
[ https://issues.apache.org/jira/browse/HIVE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199375#comment-13199375 ] Hudson commented on HIVE-2762: -- Integrated in Hive-trunk-h0.21 #1240 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1240/]) HIVE-2762 Alter Table Partition Concatenate Fails On Certain Characters (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239754 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientpositive/escape2.q * /hive/trunk/ql/src/test/results/clientpositive/escape2.q.out > Alter Table Partition Concatenate Fails On Certain Characters > - > > Key: HIVE-2762 > URL: https://issues.apache.org/jira/browse/HIVE-2762 > Project: Hive > Issue Type: Bug > Components: Metastore >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2762.1.patch.txt, HIVE-2762.2.patch.txt, > HIVE-2762.D1533.1.patch, HIVE-2762.D1533.2.patch, HIVE-2762.D1533.3.patch > > > Alter table partition concatenate creates a Java URI object for the location > of a partition. If the partition name contains certain characters, such as } > or space ' ', the object constructor fails, causing the query to fail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2772) make union31.q deterministic
[ https://issues.apache.org/jira/browse/HIVE-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198383#comment-13198383 ] Hudson commented on HIVE-2772: -- Integrated in Hive-trunk-h0.21 #1238 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1238/]) HIVE-2772 [jira] make union31.q deterministic (Namit Jain via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2772 HIVE-2772 Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D1557 heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239286 Files : * /hive/trunk/ql/src/test/queries/clientpositive/union31.q * /hive/trunk/ql/src/test/results/clientpositive/union31.q.out > make union31.q deterministic > > > Key: HIVE-2772 > URL: https://issues.apache.org/jira/browse/HIVE-2772 > Project: Hive > Issue Type: Bug >Reporter: Namit Jain >Assignee: Namit Jain > Fix For: 0.9.0 > > Attachments: HIVE-2772.D1557.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2758) Metastore is caching too aggressively
[
https://issues.apache.org/jira/browse/HIVE-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198384#comment-13198384
]
Hudson commented on HIVE-2758:
--
Integrated in Hive-trunk-h0.21 #1238 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1238/])
HIVE-2758 Metastore is caching too aggressively (Kevin Wilfong reviewed by
Carl Steinbach)
kevinwilfong :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239232
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
*
/hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java
> Metastore is caching too aggressively
> -
>
> Key: HIVE-2758
> URL: https://issues.apache.org/jira/browse/HIVE-2758
> Project: Hive
> Issue Type: Bug
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Fix For: 0.9.0
>
> Attachments: HIVE-2758.D1491.1.patch, HIVE-2758.D1491.2.patch
>
>
> The metastore is caching values, like table names and locations too
> aggressively, leading to inconsistencies across Hive clients and metastore
> Thrift servers.
> For example, open two Hive clients, in each call
> DESCRIBE FORMATTED table_foo;
> Then in one of those clients, execute
> ALTER TABLE table_foo RENAME TO table_bar;
> Then in both clients call
> DESCRIBE FORMATTED table_bar;
> In the client that executed the alter command, the location is correct,
> however, in the other Hive client, it will still show the original location
> of table_foo.
> A similar experiment can be done using metastore Thrift servers, substituting
> get_table for DESCRIBE FORMATTED and alter_table for ALTER TABLE ... RENAME
> TO.
> On the Thrift server you can see that the one which did not execute the alter
> command, not only returns the wrong location, despite calling
> get_table('table_bar') it will return a table that still has the name
> table_foo.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2765) hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89
[ https://issues.apache.org/jira/browse/HIVE-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197560#comment-13197560 ] Hudson commented on HIVE-2765: -- Integrated in Hive-trunk-h0.21 #1235 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1235/]) HIVE-2765 hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89 (Pei Yue via He Yongqiang) heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1238837 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java > hbase handler uses ZooKeeperConnectionException which is not compatible with > HBase versions other than 0.89 > > > Key: HIVE-2765 > URL: https://issues.apache.org/jira/browse/HIVE-2765 > Project: Hive > Issue Type: Improvement > Components: HBase Handler >Affects Versions: 0.7.0, 0.8.0 >Reporter: Pei Yue > Labels: patch > Fix For: 0.9.0 > > Attachments: HIVE-2765.D1485.3.patch > > Original Estimate: 2h > Remaining Estimate: 2h > > It cannot integrate with HBase0.21 and may not be able to integrate with > hbase0.9x -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2249) When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double
[ https://issues.apache.org/jira/browse/HIVE-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196844#comment-13196844 ] Hudson commented on HIVE-2249: -- Integrated in Hive-trunk-h0.21 #1233 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1233/]) HIVE-2249 When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double (Zhiqiu Kong via Siying Dong) sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1238175 Files : * /hive/trunk/contrib/src/test/results/clientpositive/dboutput.q.out * /hive/trunk/contrib/src/test/results/clientpositive/serde_typedbytes4.q.out * /hive/trunk/data/files/infer_const_type.txt * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/infer_const_type.q * /hive/trunk/ql/src/test/queries/clientpositive/insert1_overwrite_partitions.q * /hive/trunk/ql/src/test/queries/clientpositive/insert2_overwrite_partitions.q * /hive/trunk/ql/src/test/queries/clientpositive/ppr_pushdown.q * /hive/trunk/ql/src/test/results/clientpositive/auto_join0.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join11.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join12.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join13.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join14.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join16.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join20.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join21.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join23.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join27.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join28.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join29.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join4.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join5.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join6.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join7.q.out * /hive/trunk/ql/src/test/results/clientpositive/auto_join8.q.out * /hive/trunk/ql/src/test/results/clientpositive/cast1.q.out * /hive/trunk/ql/src/test/results/clientpositive/cluster.q.out * /hive/trunk/ql/src/test/results/clientpositive/create_view.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby_multi_single_reducer.q.out * /hive/trunk/ql/src/test/results/clientpositive/having.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_empty.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_file_format.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_mult_tables.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_mult_tables_compact.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_multiple.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_partitioned.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_self_join.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_unused.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_auto_update.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_bitmap3.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_bitmap_auto.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_bitmap_auto_partitioned.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_bitmap_compression.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_compression.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_stale.q.out * /hive/trunk/ql/src/test/results/clientpositive/index_stale_partitioned.q.out * /hive/trunk/ql/src/test/results/clientpositive/infer_const_type.q.out * /hive/trunk/ql/src/test/results/clientpositive/input11.q.out * /hive/trunk/ql/src/test/results/clientpositive/input11_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/input12.q.out * /hive/trunk/ql/src/test/results/clientpositive/input13.q.out * /hive/trunk/ql/src/test/results/clientpositive/input14.q.out * /hive/trunk/ql/src/test/results/clientpositive/input14_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/input18.q.out * /hive/trunk/ql/src/test/results/clientpositive/input1_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/input2_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/input42.q.out * /hive/trunk/ql/src/test/results/clientpositive/input_part1.q.out * /hive/trunk/ql/src/test/results/clientpositive/input_part2.q.out * /hive/trunk/ql/src/test/results/clientpositive/input_part5.q.out * /hive/trunk/ql/src/test/results/clientpositive/input_part7.q.out * /hive/trunk/ql/src/test/results/clientpositiv
[jira] [Commented] (HIVE-2760) TestCliDriver should log elapsed time
[ https://issues.apache.org/jira/browse/HIVE-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195944#comment-13195944 ] Hudson commented on HIVE-2760: -- Integrated in Hive-trunk-h0.21 #1230 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1230/]) HIVE-2760 [jira] TestCliDriver should log elapsed time Summary: HIVE-2760. TestCliDriver should log elapsed time Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc CC: ashutoshc, cwsteinbach Differential Revision: https://reviews.facebook.net/D1503 cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237511 Files : * /hive/trunk/hbase-handler/src/test/templates/TestHBaseCliDriver.vm * /hive/trunk/ql/src/test/templates/TestCliDriver.vm * /hive/trunk/ql/src/test/templates/TestNegativeCliDriver.vm * /hive/trunk/ql/src/test/templates/TestParse.vm * /hive/trunk/ql/src/test/templates/TestParseNegative.vm > TestCliDriver should log elapsed time > - > > Key: HIVE-2760 > URL: https://issues.apache.org/jira/browse/HIVE-2760 > Project: Hive > Issue Type: Improvement > Components: Testing Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2760.D1503.1.patch, HIVE-2760.D1503.1.patch, > HIVE-2760.D1503.2.patch, HIVE-2760.D1503.2.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2662) Add Ant configuration property for dumping classpath of tests
[ https://issues.apache.org/jira/browse/HIVE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195943#comment-13195943 ] Hudson commented on HIVE-2662: -- Integrated in Hive-trunk-h0.21 #1230 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1230/]) HIVE-2662 [jira] Add Ant configuration property for dumping classpath of tests Summary: HIVE-2662. Add Ant configuration property for dumping classpath of tests Test Plan: EMPTY Reviewers: JIRA, jsichi, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D903 cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237510 Files : * /hive/trunk/build-common.xml > Add Ant configuration property for dumping classpath of tests > - > > Key: HIVE-2662 > URL: https://issues.apache.org/jira/browse/HIVE-2662 > Project: Hive > Issue Type: Improvement > Components: Testing Infrastructure >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Fix For: 0.9.0 > > Attachments: HIVE-2662.D903.1.patch, HIVE-2662.D903.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2735) PlanUtils.configureTableJobPropertiesForStorageHandler() is not called for partitioned table
[ https://issues.apache.org/jira/browse/HIVE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195844#comment-13195844 ] Hudson commented on HIVE-2735: -- Integrated in Hive-trunk-h0.21 #1229 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1229/]) HIVE-2735: PlanUtils.configureTableJobPropertiesForStorageHandler() is not called for partitioned table (sushanth via ashutosh) hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237329 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java > PlanUtils.configureTableJobPropertiesForStorageHandler() is not called for > partitioned table > > > Key: HIVE-2735 > URL: https://issues.apache.org/jira/browse/HIVE-2735 > Project: Hive > Issue Type: Bug >Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0 >Reporter: Ashutosh Chauhan >Assignee: Sushanth Sowmyan > Fix For: 0.9.0 > > Attachments: sem_patch.patch > > > As a result, if there is a query which results in a MR job which needs to be > configured via storage handler, it returns in failure. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2755) union follwowed by union_subq does not work if the subquery union has reducers
[ https://issues.apache.org/jira/browse/HIVE-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195779#comment-13195779 ] Hudson commented on HIVE-2755: -- Integrated in Hive-trunk-h0.21 #1227 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1227/]) HIVE-2755 union follwowed by union_subq does not work if the subquery union has reducers (He Yongqiang via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237253 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcFactory.java * /hive/trunk/ql/src/test/queries/clientpositive/union28.q * /hive/trunk/ql/src/test/queries/clientpositive/union29.q * /hive/trunk/ql/src/test/queries/clientpositive/union30.q * /hive/trunk/ql/src/test/results/clientpositive/union28.q.out * /hive/trunk/ql/src/test/results/clientpositive/union29.q.out * /hive/trunk/ql/src/test/results/clientpositive/union30.q.out > union follwowed by union_subq does not work if the subquery union has reducers > -- > > Key: HIVE-2755 > URL: https://issues.apache.org/jira/browse/HIVE-2755 > Project: Hive > Issue Type: Bug >Reporter: He Yongqiang >Assignee: He Yongqiang > Attachments: HIVE-2755.D1479.1.patch, HIVE-2755.D1479.2.patch, > HIVE-2755.D1479.3.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13194505#comment-13194505 ] Hudson commented on HIVE-2734: -- Integrated in Hive-trunk-h0.21 #1224 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1224/]) HIVE-2734 [jira] Fix some nondeterministic test output (Zhenxiao Luo via Carl Steinbach) Summary: HIVE-2734: Fix some nondeterministic test output Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: zhenxiao, cwsteinbach Differential Revision: https://reviews.facebook.net/D1449 cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236489 Files : * /hive/trunk/ql/src/test/queries/clientpositive/columnarserde_create_shortcut.q * /hive/trunk/ql/src/test/queries/clientpositive/combine1.q * /hive/trunk/ql/src/test/queries/clientpositive/global_limit.q * /hive/trunk/ql/src/test/queries/clientpositive/groupby1_limit.q * /hive/trunk/ql/src/test/queries/clientpositive/input11_limit.q * /hive/trunk/ql/src/test/queries/clientpositive/input1_limit.q * /hive/trunk/ql/src/test/queries/clientpositive/input_lazyserde.q * /hive/trunk/ql/src/test/queries/clientpositive/join18_multi_distinct.q * /hive/trunk/ql/src/test/queries/clientpositive/join_1to1.q * /hive/trunk/ql/src/test/queries/clientpositive/join_casesensitive.q * /hive/trunk/ql/src/test/queries/clientpositive/join_filters.q * /hive/trunk/ql/src/test/queries/clientpositive/join_nulls.q * /hive/trunk/ql/src/test/queries/clientpositive/merge3.q * /hive/trunk/ql/src/test/queries/clientpositive/rcfile_columnar.q * /hive/trunk/ql/src/test/queries/clientpositive/rcfile_lazydecompress.q * /hive/trunk/ql/src/test/queries/clientpositive/rcfile_union.q * /hive/trunk/ql/src/test/queries/clientpositive/sample10.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_sentences.q * /hive/trunk/ql/src/test/queries/clientpositive/union24.q * /hive/trunk/ql/src/test/results/clientpositive/columnarserde_create_shortcut.q.out * /hive/trunk/ql/src/test/results/clientpositive/combine1.q.out * /hive/trunk/ql/src/test/results/clientpositive/global_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/groupby1_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/input11_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/input1_limit.q.out * /hive/trunk/ql/src/test/results/clientpositive/input_lazyserde.q.out * /hive/trunk/ql/src/test/results/clientpositive/join18_multi_distinct.q.out * /hive/trunk/ql/src/test/results/clientpositive/join_1to1.q.out * /hive/trunk/ql/src/test/results/clientpositive/join_casesensitive.q.out * /hive/trunk/ql/src/test/results/clientpositive/join_filters.q.out * /hive/trunk/ql/src/test/results/clientpositive/join_nulls.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge3.q.out * /hive/trunk/ql/src/test/results/clientpositive/rcfile_columnar.q.out * /hive/trunk/ql/src/test/results/clientpositive/rcfile_lazydecompress.q.out * /hive/trunk/ql/src/test/results/clientpositive/rcfile_union.q.out * /hive/trunk/ql/src/test/results/clientpositive/sample10.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_sentences.q.out * /hive/trunk/ql/src/test/results/clientpositive/union24.q.out > Fix some nondeterministic test output > - > > Key: HIVE-2734 > URL: https://issues.apache.org/jira/browse/HIVE-2734 > Project: Hive > Issue Type: Bug > Components: Testing Infrastructure >Reporter: Zhenxiao Luo >Assignee: Zhenxiao Luo > Fix For: 0.9.0 > > Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, > HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, > HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, > HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1443.1.patch, > HIVE-2734.D1443.1.patch, HIVE-2734.D1449.1.patch, HIVE-2734.D1449.1.patch > > > Many Hive query tests lack an ORDER BY clause, and consequently the ordering > of the rows in the result set is nondeterministic: > groupby1_limit > input11_limit > input1_limit > input_lazyserde > join18_multi_distinct > join_1to1 > join_casesensitive > join_filters > join_nulls > merge3 > rcfile_columnar > rcfile_lazydecompress > rcfile_union > sample10 > udf_sentences > union24 > columnarserde_create_shortcut > combine1 > global_limit -- This message is automatically generated by JIRA. If
[jira] [Commented] (HIVE-2754) NPE in union with lateral view
[ https://issues.apache.org/jira/browse/HIVE-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13194504#comment-13194504 ] Hudson commented on HIVE-2754: -- Integrated in Hive-trunk-h0.21 #1224 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1224/]) HIVE-2754 NPE in union with lateral view (Yongqiang He via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236479 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRRedSink3.java * /hive/trunk/ql/src/test/queries/clientpositive/union_lateralview.q * /hive/trunk/ql/src/test/results/clientpositive/union_lateralview.q.out > NPE in union with lateral view > -- > > Key: HIVE-2754 > URL: https://issues.apache.org/jira/browse/HIVE-2754 > Project: Hive > Issue Type: Bug >Reporter: He Yongqiang >Assignee: He Yongqiang > Attachments: HIVE-2754.D1467.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2750) Hive multi group by single reducer optimization causes invalid column reference error
[ https://issues.apache.org/jira/browse/HIVE-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193949#comment-13193949 ] Hudson commented on HIVE-2750: -- Integrated in Hive-trunk-h0.21 #1222 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1222/]) HIVE-2750 Hive multi group by single reducer optimization causes invalid column reference error (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236150 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientpositive/groupby_multi_single_reducer2.q * /hive/trunk/ql/src/test/results/clientpositive/groupby_multi_single_reducer2.q.out > Hive multi group by single reducer optimization causes invalid column > reference error > - > > Key: HIVE-2750 > URL: https://issues.apache.org/jira/browse/HIVE-2750 > Project: Hive > Issue Type: Bug >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2750.D1455.1.patch > > > After the optimization, if two query blocks have the same distinct clause and > the same group by keys, but the first query block does not reference all the > rows the second query block does, an invalid column reference error is raised > for the columns unreferenced in the first query block. > E.g. > FROM src > INSERT OVERWRITE TABLE dest_g2 SELECT substr(src.key,1,1), count(DISTINCT > src.key) WHERE substr(src.key,1,1) >= 5 GROUP BY substr(src.key,1,1) > INSERT OVERWRITE TABLE dest_g3 SELECT substr(src.key,1,1), count(DISTINCT > src.key), count(src.value) WHERE substr(src.key,1,1) < 5 GROUP BY > substr(src.key,1,1); > This results in an invalid column reference error on src.value -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
