[jira] [Commented] (HIVE-4802) Fix url check for missing / or /db after hostname in jdb uri
[ https://issues.apache.org/jira/browse/HIVE-4802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702995#comment-13702995 ] Hudson commented on HIVE-4802: -- Integrated in Hive-trunk-h0.21 #2187 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2187/]) HIVE-4802 : Fix url check for missing / or /db after hostname in jdb uri (Thejas Nair via Ashutosh Chauhan) (Revision 1500781) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1500781 Files : * /hive/trunk/jdbc/src/java/org/apache/hive/jdbc/Utils.java * /hive/trunk/jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java Fix url check for missing / or /db after hostname in jdb uri - Key: HIVE-4802 URL: https://issues.apache.org/jira/browse/HIVE-4802 Project: Hive Issue Type: Bug Components: HiveServer2, JDBC Affects Versions: 0.12.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4802.1.patch HIVE-4406 added a check for jdbc uri to prevent unintentional use of embedded mode. But that does not correctly check for uri like jdbc:hive2://localhost:1;principal=hive/hiveserver2h...@your-realm.com that can also result in embedded mode being used. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4796) Increase coverage of package org.apache.hadoop.hive.common.metrics
[ https://issues.apache.org/jira/browse/HIVE-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703011#comment-13703011 ] Hudson commented on HIVE-4796: -- Integrated in Hive-trunk-hadoop1-ptest #49 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/49/]) HIVE-4796 : Increase coverage of package org.apache.hadoop.hive.common.metrics (Ivan Veselovsky) (Revision 1501052) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501052 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/Metrics.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBean.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBeanImpl.java * /hive/trunk/common/src/test/org/apache/hadoop/hive/common * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/metrics * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/metrics/TestMetrics.java Increase coverage of package org.apache.hadoop.hive.common.metrics -- Key: HIVE-4796 URL: https://issues.apache.org/jira/browse/HIVE-4796 Project: Hive Issue Type: Test Affects Versions: 0.12.0 Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Fix For: 0.12.0 Attachments: HIVE-4796-trunk--N1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4580) Change DDLTask to report errors using canonical error messages rather than http status codes
[ https://issues.apache.org/jira/browse/HIVE-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703010#comment-13703010 ] Hudson commented on HIVE-4580: -- Integrated in Hive-trunk-hadoop1-ptest #49 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/49/]) HIVE-4580 : Change DDLTask to report errors using canonical error messages rather than http status codes (Eugene Koifman via Ashutosh Chauhan) (Revision 1501053) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501053 Files : * /hive/trunk/contrib/src/test/results/clientnegative/serde_regex.q.out * /hive/trunk/contrib/src/test/results/clientnegative/url_hook.q.out * /hive/trunk/hcatalog/src/test/e2e/templeton/tests/ddl.conf * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/AppConfig.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/BadParam.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/BusyException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CallbackFailedException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CatchallExceptionMapper.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/HcatDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/HcatException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/JsonBuilder.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Main.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/NotAuthorizedException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/QueueException.java * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskResult.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskRunner.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveException.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/InvalidTableException.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatter.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java * /hive/trunk/ql/src/test/results/clientnegative/add_partition_with_whitelist.q.out * /hive/trunk/ql/src/test/results/clientnegative/addpart1.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_partition_nodrop_table.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_partition_with_whitelist.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure2.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure3.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_table_wrong_regex.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_view_failure4.q.out * /hive/trunk/ql/src/test/results/clientnegative/altern1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi3.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi4.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi5.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi6.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi7.q.out * /hive/trunk/ql/src/test/results/clientnegative/authorization_fail_1.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename1.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename2.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename4.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure3.q.out *
[jira] [Commented] (HIVE-4813) Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr
[ https://issues.apache.org/jira/browse/HIVE-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703013#comment-13703013 ] Hudson commented on HIVE-4813: -- Integrated in Hive-trunk-hadoop1-ptest #50 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/50/]) HIVE-4813 : Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr (Ivan Veselovsky via Ashutosh Chauhan) (Revision 1501099) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501099 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcCtx.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDescUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/pcr.q * /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr Key: HIVE-4813 URL: https://issues.apache.org/jira/browse/HIVE-4813 Project: Hive Issue Type: Test Affects Versions: 0.12.0 Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Fix For: 0.12.0 Attachments: HIVE-4813-trunk--N1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4819) Comments in CommonJoinOperator for aliasTag is not valid
[ https://issues.apache.org/jira/browse/HIVE-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4819: --- Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Navis! Comments in CommonJoinOperator for aliasTag is not valid Key: HIVE-4819 URL: https://issues.apache.org/jira/browse/HIVE-4819 Project: Hive Issue Type: Task Components: Documentation Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4819.D11619.1.patch I've written that but it's does not make sense even to me. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4826) Setup build infrastructure for tez
[ https://issues.apache.org/jira/browse/HIVE-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4826: - Issue Type: New Feature (was: Sub-task) Parent: (was: HIVE-4660) Setup build infrastructure for tez -- Key: HIVE-4826 URL: https://issues.apache.org/jira/browse/HIVE-4826 Project: Hive Issue Type: New Feature Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: tez-branch Attachments: HIVE-4826.patch Address changes required in ivy and build xml files to support tez. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4828) Make vectorization branch compile under JDK 7
[ https://issues.apache.org/jira/browse/HIVE-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4828: --- Assignee: Dmitriy V. Ryaboy Make vectorization branch compile under JDK 7 - Key: HIVE-4828 URL: https://issues.apache.org/jira/browse/HIVE-4828 Project: Hive Issue Type: Sub-task Reporter: Dmitriy V. Ryaboy Assignee: Dmitriy V. Ryaboy Attachments: HIVE-4828.patch It seems that, at minimum, HIVE-4496 is not in the vectorization branch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-4828) Make vectorization branch compile under JDK 7
[ https://issues.apache.org/jira/browse/HIVE-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved HIVE-4828. Resolution: Fixed Fix Version/s: vectorization-branch Assignee: Ashutosh Chauhan (was: Dmitriy V. Ryaboy) We do it using svn merge command. I just merged in the latest trunk in vectorization branch. Make vectorization branch compile under JDK 7 - Key: HIVE-4828 URL: https://issues.apache.org/jira/browse/HIVE-4828 Project: Hive Issue Type: Sub-task Reporter: Dmitriy V. Ryaboy Assignee: Ashutosh Chauhan Fix For: vectorization-branch Attachments: HIVE-4828.patch It seems that, at minimum, HIVE-4496 is not in the vectorization branch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4819) Comments in CommonJoinOperator for aliasTag is not valid
[ https://issues.apache.org/jira/browse/HIVE-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703089#comment-13703089 ] Hudson commented on HIVE-4819: -- Integrated in Hive-trunk-hadoop1-ptest #51 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/51/]) HIVE-4819 : Comments in CommonJoinOperator for aliasTag is not valid (Navis via Ashutosh Chauhan) (Revision 1501129) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501129 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/CommonJoinOperator.java Comments in CommonJoinOperator for aliasTag is not valid Key: HIVE-4819 URL: https://issues.apache.org/jira/browse/HIVE-4819 Project: Hive Issue Type: Task Components: Documentation Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4819.D11619.1.patch I've written that but it's does not make sense even to me. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4299) exported metadata by HIVE-3068 cannot be imported because of wrong file name
[
https://issues.apache.org/jira/browse/HIVE-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703130#comment-13703130
]
Sho Shimauchi commented on HIVE-4299:
-
Hi Edward,
Thanks for the comment.
Do you mean a filepath of the exported data should be changed to more static
one, like '/user/sho/test_table/test_table.metadata' ?
Or should I retain a filepath
'/user/sho/test_table.2013-04-05-20-13-14/test_table.metadata' in some place
like '/${user.home}/.hive_table_metadata'?
Sho
exported metadata by HIVE-3068 cannot be imported because of wrong file name
Key: HIVE-4299
URL: https://issues.apache.org/jira/browse/HIVE-4299
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Sho Shimauchi
Assignee: Sho Shimauchi
Attachments: HIVE-4299.patch
h2. Symptom
When DROP TABLE a table, metadata of the table is generated to be able to
import the dropped table again.
However, the exported metadata name is 'table name.metadata'.
Since ImportSemanticAnalyzer allows only '_metadata' as metadata filename,
user have to rename the metadata file to import the table.
h2. How to reproduce
Set the following setting to hive-site.xml:
{code}
property
namehive.metastore.pre.event.listeners/name
valueorg.apache.hadoop.hive.ql.parse.MetaDataExportListener/value
/property
{code}
Then run the following queries:
{code}
CREATE TABLE test_table (id INT, name STRING);
DROP TABLE test_table;
IMPORT TABLE test_table_imported FROM '/path/to/metadata/file';
FAILED: SemanticException [Error 10027]: Invalid path
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
Brock Noland created HIVE-4829:
--
Summary: TestWebHCatE2e checkstyle violation causes all tests to
fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Reporter: Brock Noland
Priority: Critical
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4580) Change DDLTask to report errors using canonical error messages rather than http status codes
[ https://issues.apache.org/jira/browse/HIVE-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703239#comment-13703239 ] Brock Noland commented on HIVE-4580: Hey guys, it looks like this caused HIVE-4829 which results in all tests failing and the parallel test system filling it's drives. Change DDLTask to report errors using canonical error messages rather than http status codes Key: HIVE-4580 URL: https://issues.apache.org/jira/browse/HIVE-4580 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Fix For: 0.12.0 Attachments: HIVE-4580.1.patch, HIVE-4580.2.patch, HIVE-4580.3.patch, HIVE-4580.patch Original Estimate: 40h Remaining Estimate: 40h org.apache.hadoop.hive.ql.exec.DDLTask handles DDL operations in Hive. Some operations (those exposed as REST API by Templeton) in this class, write a JSON object to stdout (on failure) which includes error and errorCode fields. errorCode is set to values like 404, 500, etc. i.e. Http Status codes. I believe this was done to support Templeton REST API. This is not the right place to introduce Http codes. DDLTask should use canonical error messages defined in org.apache.hadoop.hive.ql.ErrorMsg and propagate it up to HCatCli which can decide how to encode the error and to which stream. In particular it can create a parseable JSON object which Templeton can then interpret. JSON object can also be generated here for errors from the parser/resolver (e.g. trying to describe a table which doesn't exist). Then Templeton can map the canonical error code to appropriate Http Code. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703255#comment-13703255
]
Brock Noland commented on HIVE-4829:
OK from a ptest side I introduced a bug in the shell script which builds the
source which meant the exit code was not transfered accordingly. I'll fix that
via HIVE-4815.
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Reporter: Brock Noland
Priority: Critical
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3810) HiveHistory.log need to replace '\r' with space before writing Entry.value to historyfile
[
https://issues.apache.org/jira/browse/HIVE-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703290#comment-13703290
]
Hudson commented on HIVE-3810:
--
Integrated in Hive-trunk-hadoop2 #279 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2/279/])
HIVE-3810 : HiveHistory.log need to replace \r with space before writing
Entry.value to historyfile (Mark Grover via Ashutosh Chauhan) (Revision 1500991)
Result = ABORTED
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1500991
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/history/HiveHistory.java
HiveHistory.log need to replace '\r' with space before writing Entry.value to
historyfile
-
Key: HIVE-3810
URL: https://issues.apache.org/jira/browse/HIVE-3810
Project: Hive
Issue Type: Bug
Components: Logging
Reporter: qiangwang
Assignee: Mark Grover
Priority: Minor
Fix For: 0.12.0
Attachments: HIVE-3810.1.patch, HIVE-3810.2.patch, HIVE-3810.3.patch,
HIVE-3810.4.patch
HiveHistory.log will replace '\n' with space before writing Entry.value to
history file:
val = val.replace('\n', ' ');
but HiveHistory.parseHiveHistory use BufferedReader.readLine which takes
'\n', '\r', '\r\n' as line delimiter to parse history file
if val contains '\r', there is a high possibility that HiveHistory.parseLine
will fail, in which case usually RecordTypes.valueOf(recType) will throw
exception 'java.lang.IllegalArgumentException'
HiveHistory.log need to replace '\r' with space as well:
val = val.replace('\n', ' ');
changed to
val = val.replaceAll(\r|\n, );
or
val = val.replace('\r', ' ').replace('\n', ' ');
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4779) Enhance coverage of package org.apache.hadoop.hive.ql.udf
[ https://issues.apache.org/jira/browse/HIVE-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703308#comment-13703308 ] Ivan A. Veselovsky commented on HIVE-4779: -- Hi, Ashotush, Edward, thanks for the comments, answering regarding the deleted UDFs. 1) UDFToDate was a function converting numbers (surprisingly not Writable-s) to java.sql.Date. It was not registered in FunctionRegistry, and not used anyhow else (neither in Java code nor .q scripts). In function registry we have registerUDF(to_date, UDFDate.class, false); (line 271). But its purpose slightly different: it extracts date part from Text or Timestamp writables. Conversion of an arbitrary type to Timestamp is done using org.apache.hadoop.hive.ql.udf.generic.GenericUDFTimestamp. 2) UDFUnixTimeStamp was also not used anyhow, and, as far as I understand, is superseded by the following functions: registerGenericUDF(unix_timestamp, GenericUDFUnixTimeStamp.class); registerGenericUDF(to_unix_timestamp, GenericUDFToUnixTimeStamp.class); These functions are covered well by .q tests. 3) UDFBaseCompare was simply not used. I suppose that all the generic comparison logic was transferred to org.apache.hadoop.hive.ql.udf.generic.GenericUDFBaseCompare and related classes. If some of these removed classes are still needed, of course, I will change the patch to return them back. Enhance coverage of package org.apache.hadoop.hive.ql.udf - Key: HIVE-4779 URL: https://issues.apache.org/jira/browse/HIVE-4779 Project: Hive Issue Type: Test Affects Versions: 0.12.0 Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Attachments: HIVE-4779-trunk--N1.patch Enhance coverage of package org.apache.hadoop.hive.ql.udf up to 80%. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4299) exported metadata by HIVE-3068 cannot be imported because of wrong file name
[
https://issues.apache.org/jira/browse/HIVE-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703313#comment-13703313
]
Edward Capriolo commented on HIVE-4299:
---
No. I mean in one file with have a magic string _metadata and in another file
we have a magic string .METADATA
Create a constant like this:
{quote}
public static final String META_DATA=_metadata;
{quote}
and have both methods reference the constant.
exported metadata by HIVE-3068 cannot be imported because of wrong file name
Key: HIVE-4299
URL: https://issues.apache.org/jira/browse/HIVE-4299
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.11.0
Reporter: Sho Shimauchi
Assignee: Sho Shimauchi
Attachments: HIVE-4299.patch
h2. Symptom
When DROP TABLE a table, metadata of the table is generated to be able to
import the dropped table again.
However, the exported metadata name is 'table name.metadata'.
Since ImportSemanticAnalyzer allows only '_metadata' as metadata filename,
user have to rename the metadata file to import the table.
h2. How to reproduce
Set the following setting to hive-site.xml:
{code}
property
namehive.metastore.pre.event.listeners/name
valueorg.apache.hadoop.hive.ql.parse.MetaDataExportListener/value
/property
{code}
Then run the following queries:
{code}
CREATE TABLE test_table (id INT, name STRING);
DROP TABLE test_table;
IMPORT TABLE test_table_imported FROM '/path/to/metadata/file';
FAILED: SemanticException [Error 10027]: Invalid path
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4580) Change DDLTask to report errors using canonical error messages rather than http status codes
[ https://issues.apache.org/jira/browse/HIVE-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703368#comment-13703368 ] Brock Noland commented on HIVE-4580: Sorry to be unclear...that was caused by a bug in ptest2 which I am fixing at present. Change DDLTask to report errors using canonical error messages rather than http status codes Key: HIVE-4580 URL: https://issues.apache.org/jira/browse/HIVE-4580 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Fix For: 0.12.0 Attachments: HIVE-4580.1.patch, HIVE-4580.2.patch, HIVE-4580.3.patch, HIVE-4580.patch Original Estimate: 40h Remaining Estimate: 40h org.apache.hadoop.hive.ql.exec.DDLTask handles DDL operations in Hive. Some operations (those exposed as REST API by Templeton) in this class, write a JSON object to stdout (on failure) which includes error and errorCode fields. errorCode is set to values like 404, 500, etc. i.e. Http Status codes. I believe this was done to support Templeton REST API. This is not the right place to introduce Http codes. DDLTask should use canonical error messages defined in org.apache.hadoop.hive.ql.ErrorMsg and propagate it up to HCatCli which can decide how to encode the error and to which stream. In particular it can create a parseable JSON object which Templeton can then interpret. JSON object can also be generated here for errors from the parser/resolver (e.g. trying to describe a table which doesn't exist). Then Templeton can map the canonical error code to appropriate Http Code. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-4829:
---
Assignee: Eugene Koifman
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Reporter: Brock Noland
Assignee: Eugene Koifman
Priority: Critical
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4580) Change DDLTask to report errors using canonical error messages rather than http status codes
[ https://issues.apache.org/jira/browse/HIVE-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703363#comment-13703363 ] Eugene Koifman commented on HIVE-4580: -- I can fix the checkstyle issue. Why do you think this is causing disks to fill up. There is nothing in this change that writes anything to disk (that I know of). Change DDLTask to report errors using canonical error messages rather than http status codes Key: HIVE-4580 URL: https://issues.apache.org/jira/browse/HIVE-4580 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.11.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Fix For: 0.12.0 Attachments: HIVE-4580.1.patch, HIVE-4580.2.patch, HIVE-4580.3.patch, HIVE-4580.patch Original Estimate: 40h Remaining Estimate: 40h org.apache.hadoop.hive.ql.exec.DDLTask handles DDL operations in Hive. Some operations (those exposed as REST API by Templeton) in this class, write a JSON object to stdout (on failure) which includes error and errorCode fields. errorCode is set to values like 404, 500, etc. i.e. Http Status codes. I believe this was done to support Templeton REST API. This is not the right place to introduce Http codes. DDLTask should use canonical error messages defined in org.apache.hadoop.hive.ql.ErrorMsg and propagate it up to HCatCli which can decide how to encode the error and to which stream. In particular it can create a parseable JSON object which Templeton can then interpret. JSON object can also be generated here for errors from the parser/resolver (e.g. trying to describe a table which doesn't exist). Then Templeton can map the canonical error code to appropriate Http Code. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4815) Create cloud hosting option for ptest2
[
https://issues.apache.org/jira/browse/HIVE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brock Noland updated HIVE-4815:
---
Attachment: HIVE-4815.patch
I had changed the source-prep script which executes ant package to use tee so
the ant package logs show up on jenkins. The problem with this was that now the
pipe was eating the exit code and therefore we were not catching failures to
build hive (see HIVE-4829).
The following change fixes this, manually verified it works:
{noformat}
) 21 | tee $logDir/source-prep.txt
+exit ${PIPESTATUS[0]}
{noformat}
Create cloud hosting option for ptest2
--
Key: HIVE-4815
URL: https://issues.apache.org/jira/browse/HIVE-4815
Project: Hive
Issue Type: New Feature
Reporter: Brock Noland
Assignee: Brock Noland
Fix For: 0.12.0
Attachments: HIVE-4815.patch, HIVE-4815.patch, HIVE-4815.patch,
HIVE-4815.patch, HIVE-4815.patch, HIVE-4815.patch
HIVE-4675 creates a parallel testing environment. To support HIVE-4739 we
should allow this environment to run in a cloud environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Koifman updated HIVE-4829:
-
Status: Patch Available (was: Open)
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Reporter: Brock Noland
Assignee: Eugene Koifman
Priority: Critical
Attachments: HIVE-4829.patch
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Koifman updated HIVE-4829:
-
Attachment: HIVE-4829.patch
HIVE-4829.patch removes the unused import stmt.
ant test -logfile ant.log -Dmodule=hcatalog -Dtestcase=TestWebHCatE2e
checkstyle is happy
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Reporter: Brock Noland
Assignee: Eugene Koifman
Priority: Critical
Attachments: HIVE-4829.patch
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HIVE-4822) implement vectorized math functions
[ https://issues.apache.org/jira/browse/HIVE-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-4822 started by Eric Hanson. implement vectorized math functions --- Key: HIVE-4822 URL: https://issues.apache.org/jira/browse/HIVE-4822 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Implement vectorized support for the all the built-in math functions. This includes implementing the vectorized operation, and tying it all together in VectorizationContext so it runs end-to-end. These functions include: round(Col) Round(Col, N) Floor(Col) Ceil(Col) Rand(), Rand(seed) Exp(Col) Ln(Col) Log10(Col) Log2(Col) Log(base, Col) Pow(col, p), Power(col, p) Sqrt(Col) Bin(Col) Hex(Col) Unhex(Col) Conv(Col, from_base, to_base) Abs(Col) Pmod(arg1, arg2) Sin(Col) Asin(Col) Cos(Col) ACos(Col) Atan(Col) Degrees(Col) Radians(Col) Positive(Col) Negative(Col) Sign(Col) E() Pi() To reduce the total code volume, do an implicit type cast from non-double input types to double. Also, POSITITVE and NEGATIVE are syntactic sugar for unary + and unary -, so reuse code for those as appropriate. Try to call the function directly in the inner loop and avoid new() or expensive operations, as appropriate. Templatize the code where appropriate, e.g. all the unary function of form DOUBLE func(DOUBLE) can probably be done with a template. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4822) implement vectorized math functions
[ https://issues.apache.org/jira/browse/HIVE-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703480#comment-13703480 ] Eric Hanson commented on HIVE-4822: --- I just started on this. Probably I will break it down to some smaller JIRAs. I started with ROUND(). If anybody wants to help, please let me know. implement vectorized math functions --- Key: HIVE-4822 URL: https://issues.apache.org/jira/browse/HIVE-4822 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Implement vectorized support for the all the built-in math functions. This includes implementing the vectorized operation, and tying it all together in VectorizationContext so it runs end-to-end. These functions include: round(Col) Round(Col, N) Floor(Col) Ceil(Col) Rand(), Rand(seed) Exp(Col) Ln(Col) Log10(Col) Log2(Col) Log(base, Col) Pow(col, p), Power(col, p) Sqrt(Col) Bin(Col) Hex(Col) Unhex(Col) Conv(Col, from_base, to_base) Abs(Col) Pmod(arg1, arg2) Sin(Col) Asin(Col) Cos(Col) ACos(Col) Atan(Col) Degrees(Col) Radians(Col) Positive(Col) Negative(Col) Sign(Col) E() Pi() To reduce the total code volume, do an implicit type cast from non-double input types to double. Also, POSITITVE and NEGATIVE are syntactic sugar for unary + and unary -, so reuse code for those as appropriate. Try to call the function directly in the inner loop and avoid new() or expensive operations, as appropriate. Templatize the code where appropriate, e.g. all the unary function of form DOUBLE func(DOUBLE) can probably be done with a template. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4822) implement vectorized math functions
[ https://issues.apache.org/jira/browse/HIVE-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Hanson updated HIVE-4822: -- Assignee: Eric Hanson implement vectorized math functions --- Key: HIVE-4822 URL: https://issues.apache.org/jira/browse/HIVE-4822 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Implement vectorized support for the all the built-in math functions. This includes implementing the vectorized operation, and tying it all together in VectorizationContext so it runs end-to-end. These functions include: round(Col) Round(Col, N) Floor(Col) Ceil(Col) Rand(), Rand(seed) Exp(Col) Ln(Col) Log10(Col) Log2(Col) Log(base, Col) Pow(col, p), Power(col, p) Sqrt(Col) Bin(Col) Hex(Col) Unhex(Col) Conv(Col, from_base, to_base) Abs(Col) Pmod(arg1, arg2) Sin(Col) Asin(Col) Cos(Col) ACos(Col) Atan(Col) Degrees(Col) Radians(Col) Positive(Col) Negative(Col) Sign(Col) E() Pi() To reduce the total code volume, do an implicit type cast from non-double input types to double. Also, POSITITVE and NEGATIVE are syntactic sugar for unary + and unary -, so reuse code for those as appropriate. Try to call the function directly in the inner loop and avoid new() or expensive operations, as appropriate. Templatize the code where appropriate, e.g. all the unary function of form DOUBLE func(DOUBLE) can probably be done with a template. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4801) output deprecation warning for hive.mapred.map.tasks.speculative.execution
[ https://issues.apache.org/jira/browse/HIVE-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chu Tong updated HIVE-4801: --- Attachment: HIVE-4801.patch output deprecation warning for hive.mapred.map.tasks.speculative.execution -- Key: HIVE-4801 URL: https://issues.apache.org/jira/browse/HIVE-4801 Project: Hive Issue Type: Bug Components: Configuration Affects Versions: 0.10.0 Reporter: Chu Tong Assignee: Chu Tong Attachments: HIVE-4801.patch, HIVE-4801.patch Output deprecation warning for hive.mapred.map.tasks.speculative.execution, use are encouraged to use mapred.reduce.tasks.speculative.execution -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4801) output deprecation warning for hive.mapred.map.tasks.speculative.execution
[ https://issues.apache.org/jira/browse/HIVE-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chu Tong updated HIVE-4801: --- Summary: output deprecation warning for hive.mapred.map.tasks.speculative.execution (was: hive.mapred.map.tasks.speculative.execution is not used to configure Hadoop jobs) output deprecation warning for hive.mapred.map.tasks.speculative.execution -- Key: HIVE-4801 URL: https://issues.apache.org/jira/browse/HIVE-4801 Project: Hive Issue Type: Bug Components: Configuration Affects Versions: 0.10.0 Reporter: Chu Tong Assignee: Chu Tong Attachments: HIVE-4801.patch, HIVE-4801.patch Hive does not honor hive.mapred.map.tasks.speculative.execution parameter while it comes to configuring hadoop jobs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4801) output deprecation warning for hive.mapred.map.tasks.speculative.execution
[ https://issues.apache.org/jira/browse/HIVE-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chu Tong updated HIVE-4801: --- Status: Patch Available (was: Open) output deprecation warning for hive.mapred.map.tasks.speculative.execution -- Key: HIVE-4801 URL: https://issues.apache.org/jira/browse/HIVE-4801 Project: Hive Issue Type: Bug Components: Configuration Affects Versions: 0.10.0 Reporter: Chu Tong Assignee: Chu Tong Attachments: HIVE-4801.patch, HIVE-4801.patch Output deprecation warning for hive.mapred.map.tasks.speculative.execution, use are encouraged to use mapred.reduce.tasks.speculative.execution -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4801) output deprecation warning for hive.mapred.map.tasks.speculative.execution
[ https://issues.apache.org/jira/browse/HIVE-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chu Tong updated HIVE-4801: --- Description: Output deprecation warning for hive.mapred.map.tasks.speculative.execution, use are encouraged to use mapred.reduce.tasks.speculative.execution (was: Output deprecation warning for hive.mapred.map.tasks.speculative.execution, use are encouraged to use ) output deprecation warning for hive.mapred.map.tasks.speculative.execution -- Key: HIVE-4801 URL: https://issues.apache.org/jira/browse/HIVE-4801 Project: Hive Issue Type: Bug Components: Configuration Affects Versions: 0.10.0 Reporter: Chu Tong Assignee: Chu Tong Attachments: HIVE-4801.patch, HIVE-4801.patch Output deprecation warning for hive.mapred.map.tasks.speculative.execution, use are encouraged to use mapred.reduce.tasks.speculative.execution -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4801) output deprecation warning for hive.mapred.map.tasks.speculative.execution
[ https://issues.apache.org/jira/browse/HIVE-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chu Tong updated HIVE-4801: --- Description: Output deprecation warning for hive.mapred.map.tasks.speculative.execution, use are encouraged to use (was: Hive does not honor hive.mapred.map.tasks.speculative.execution parameter while it comes to configuring hadoop jobs.) output deprecation warning for hive.mapred.map.tasks.speculative.execution -- Key: HIVE-4801 URL: https://issues.apache.org/jira/browse/HIVE-4801 Project: Hive Issue Type: Bug Components: Configuration Affects Versions: 0.10.0 Reporter: Chu Tong Assignee: Chu Tong Attachments: HIVE-4801.patch, HIVE-4801.patch Output deprecation warning for hive.mapred.map.tasks.speculative.execution, use are encouraged to use -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4824) make TestWebHCatE2e run w/o requiring installing external hadoop
[ https://issues.apache.org/jira/browse/HIVE-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-4824: - Component/s: HCatalog make TestWebHCatE2e run w/o requiring installing external hadoop Key: HIVE-4824 URL: https://issues.apache.org/jira/browse/HIVE-4824 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Currently WebHCat will use hive/build/dist/hcatalog/bin/hcat to execute DDL commands, which in turn uses Hadoop Jar command. This in turn requires that HADOOP_HOME env var be defined and point to an existing Hadoop install. Need to see we can apply hive/testutils/hadoop idea here to make WebHCat not depend on external hadoop. This will make Unit tests better/easier to write and make dev/test cycle simpler. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Koifman updated HIVE-4829:
-
Component/s: HCatalog
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Brock Noland
Assignee: Eugene Koifman
Priority: Critical
Attachments: HIVE-4829.patch
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703657#comment-13703657
]
Brock Noland commented on HIVE-4829:
Thanks for the quick turnaround on this!
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Brock Noland
Assignee: Eugene Koifman
Priority: Critical
Fix For: 0.12.0
Attachments: HIVE-4829.patch
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-4829:
---
Resolution: Fixed
Fix Version/s: 0.12.0
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks, Eugene!
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Brock Noland
Assignee: Eugene Koifman
Priority: Critical
Fix For: 0.12.0
Attachments: HIVE-4829.patch
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4829) TestWebHCatE2e checkstyle violation causes all tests to fail
[
https://issues.apache.org/jira/browse/HIVE-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703686#comment-13703686
]
Hudson commented on HIVE-4829:
--
Integrated in Hive-trunk-hadoop1-ptest #55 (See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/55/])
HIVE-4829 : TestWebHCatE2e checkstyle violation causes all tests to fail
(Eugene Koifman via Ashutosh Chauhan) (Revision 1501463)
Result = FAILURE
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501463
Files :
*
/hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java
TestWebHCatE2e checkstyle violation causes all tests to fail
Key: HIVE-4829
URL: https://issues.apache.org/jira/browse/HIVE-4829
Project: Hive
Issue Type: Bug
Components: HCatalog
Reporter: Brock Noland
Assignee: Eugene Koifman
Priority: Critical
Fix For: 0.12.0
Attachments: HIVE-4829.patch
The following error caused all tests to fail and thus filled up the ptest
systems drives.
{noformat}
[echo] hcatalog
[checkstyle] Running Checkstyle 5.5 on 419 files
[checkstyle]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java:31:8:
Unused import - org.junit.BeforeClass.
[for] hcatalog: The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/build.xml:310:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build.xml:123:
The following error occurred while executing this line:
[for]
/home/hiveptest/ip-10-234-1-228-hiveptest-1/apache-github-source/hcatalog/build-support/ant/checkstyle.xml:32:
Got 1 errors and 0 warnings.
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-4810) Refactor exec package
[ https://issues.apache.org/jira/browse/HIVE-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved HIVE-4810. Resolution: Fixed Fix Version/s: 0.12.0 Committed to trunk. Thanks, Gunther! Refactor exec package - Key: HIVE-4810 URL: https://issues.apache.org/jira/browse/HIVE-4810 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: 0.12.0 Attachments: HIVE-4810.1.patch, HIVE-4810.2.patch, HIVE-4810.3.patch, HIVE-4810.4.patch, HIVE-4810.5.patch, HIVE-4810.6.patch, HIVE-4810.7.patch The exec package contains both operators and classes used to execute the job. Moving the latter into a sub package makes the package slightly more manageable and will make it easier to provide a tez-based implementation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4815) Create cloud hosting option for ptest2
[ https://issues.apache.org/jira/browse/HIVE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703689#comment-13703689 ] Brock Noland commented on HIVE-4815: The parallel tests are currently failing despite HIVE-4829 being fixed because ptest only understands git, therefore pulls from github.com/apache/hive. I'll fix this so it can pull from svn. Create cloud hosting option for ptest2 -- Key: HIVE-4815 URL: https://issues.apache.org/jira/browse/HIVE-4815 Project: Hive Issue Type: New Feature Reporter: Brock Noland Assignee: Brock Noland Fix For: 0.12.0 Attachments: HIVE-4815.patch, HIVE-4815.patch, HIVE-4815.patch, HIVE-4815.patch, HIVE-4815.patch, HIVE-4815.patch HIVE-4675 creates a parallel testing environment. To support HIVE-4739 we should allow this environment to run in a cloud environment. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4830) Test clientnegative/nested_complex_neg.q got broken due to 4580
[ https://issues.apache.org/jira/browse/HIVE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703690#comment-13703690 ] Ashutosh Chauhan commented on HIVE-4830: Simply need to update .q.out file. Test clientnegative/nested_complex_neg.q got broken due to 4580 --- Key: HIVE-4830 URL: https://issues.apache.org/jira/browse/HIVE-4830 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.12.0 Reporter: Ashutosh Chauhan Both HIVE-3253 and HIVE-4580 were racing to modify .q.out files for this test. Eventually, one patch lost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4831) QTestUtil based test exiting abnormally on windows fails startup of other QTestUtil tests
Thejas M Nair created HIVE-4831: --- Summary: QTestUtil based test exiting abnormally on windows fails startup of other QTestUtil tests Key: HIVE-4831 URL: https://issues.apache.org/jira/browse/HIVE-4831 Project: Hive Issue Type: Bug Components: Testing Infrastructure Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair QTestUtil tests start mini zookeeper cluster. If it exits abnormally (eg timeout), it fails to stop the zookeeper mini cluster. On Windows when the process is still running the files can't be deleted, and as a result the new zookeeper cluster started by a new QFileUtil based test case fails to start. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4831) QTestUtil based test exiting abnormally on windows fails startup of other QTestUtil tests
[ https://issues.apache.org/jira/browse/HIVE-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4831: Status: Patch Available (was: Open) QTestUtil based test exiting abnormally on windows fails startup of other QTestUtil tests - Key: HIVE-4831 URL: https://issues.apache.org/jira/browse/HIVE-4831 Project: Hive Issue Type: Bug Components: Testing Infrastructure Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Attachments: HIVE-4831.1.patch QTestUtil tests start mini zookeeper cluster. If it exits abnormally (eg timeout), it fails to stop the zookeeper mini cluster. On Windows when the process is still running the files can't be deleted, and as a result the new zookeeper cluster started by a new QFileUtil based test case fails to start. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4831) QTestUtil based test exiting abnormally on windows fails startup of other QTestUtil tests
[ https://issues.apache.org/jira/browse/HIVE-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4831: Attachment: HIVE-4831.1.patch HIVE-4831.1.patch - change to pick a different directory for use by zookeeper mini cluster QTestUtil based test exiting abnormally on windows fails startup of other QTestUtil tests - Key: HIVE-4831 URL: https://issues.apache.org/jira/browse/HIVE-4831 Project: Hive Issue Type: Bug Components: Testing Infrastructure Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Attachments: HIVE-4831.1.patch QTestUtil tests start mini zookeeper cluster. If it exits abnormally (eg timeout), it fails to stop the zookeeper mini cluster. On Windows when the process is still running the files can't be deleted, and as a result the new zookeeper cluster started by a new QFileUtil based test case fails to start. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4813) Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr
[ https://issues.apache.org/jira/browse/HIVE-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703736#comment-13703736 ] Hudson commented on HIVE-4813: -- Integrated in Hive-trunk-h0.21 #2188 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2188/]) HIVE-4813 : Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr (Ivan Veselovsky via Ashutosh Chauhan) (Revision 1501099) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501099 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcCtx.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDescUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/pcr.q * /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr Key: HIVE-4813 URL: https://issues.apache.org/jira/browse/HIVE-4813 Project: Hive Issue Type: Test Affects Versions: 0.12.0 Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Fix For: 0.12.0 Attachments: HIVE-4813-trunk--N1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4580) Change DDLTask to report errors using canonical error messages rather than http status codes
[ https://issues.apache.org/jira/browse/HIVE-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703734#comment-13703734 ] Hudson commented on HIVE-4580: -- Integrated in Hive-trunk-h0.21 #2188 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2188/]) HIVE-4580 : Change DDLTask to report errors using canonical error messages rather than http status codes (Eugene Koifman via Ashutosh Chauhan) (Revision 1501053) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501053 Files : * /hive/trunk/contrib/src/test/results/clientnegative/serde_regex.q.out * /hive/trunk/contrib/src/test/results/clientnegative/url_hook.q.out * /hive/trunk/hcatalog/src/test/e2e/templeton/tests/ddl.conf * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/AppConfig.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/BadParam.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/BusyException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CallbackFailedException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CatchallExceptionMapper.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/HcatDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/HcatException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/JsonBuilder.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Main.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/NotAuthorizedException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/QueueException.java * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskResult.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskRunner.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveException.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/InvalidTableException.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatter.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java * /hive/trunk/ql/src/test/results/clientnegative/add_partition_with_whitelist.q.out * /hive/trunk/ql/src/test/results/clientnegative/addpart1.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_partition_nodrop_table.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_partition_with_whitelist.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure2.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure3.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_table_wrong_regex.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_view_failure4.q.out * /hive/trunk/ql/src/test/results/clientnegative/altern1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi3.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi4.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi5.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi6.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi7.q.out * /hive/trunk/ql/src/test/results/clientnegative/authorization_fail_1.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename1.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename2.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename4.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure3.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure4.q.out *
[jira] [Commented] (HIVE-4812) Logical explain plan
[ https://issues.apache.org/jira/browse/HIVE-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703735#comment-13703735 ] Hudson commented on HIVE-4812: -- Integrated in Hive-trunk-h0.21 #2188 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2188/]) HIVE-4812 : Logical explain plan (Gunther Hagleitner V via Navis) (Revision 1501036) Result = ABORTED navis : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501036 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Context.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ExplainSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java * /hive/trunk/ql/src/test/queries/clientpositive/explain_logical.q * /hive/trunk/ql/src/test/results/clientpositive/explain_logical.q.out Logical explain plan Key: HIVE-4812 URL: https://issues.apache.org/jira/browse/HIVE-4812 Project: Hive Issue Type: Bug Components: Diagnosability Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: 0.12.0 Attachments: HIVE-4812.1.patch, HIVE-4812.2.patch, HIVE-4812.3.patch In various situations it would have been useful to me to glance at the operator plan before we break it into tasks and apply join, total order sort, etc optimizations. I've added this as an options to explain. Explain logical QUERY will output the full operator tree (not the stage plans, tasks, AST etc). Again, I don't think this has to even be documented for users, but might be useful to developers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4796) Increase coverage of package org.apache.hadoop.hive.common.metrics
[ https://issues.apache.org/jira/browse/HIVE-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703738#comment-13703738 ] Hudson commented on HIVE-4796: -- Integrated in Hive-trunk-h0.21 #2188 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2188/]) HIVE-4796 : Increase coverage of package org.apache.hadoop.hive.common.metrics (Ivan Veselovsky via Ashutosh Chauhan) (Revision 1501052) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501052 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/Metrics.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBean.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBeanImpl.java * /hive/trunk/common/src/test/org/apache/hadoop/hive/common * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/metrics * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/metrics/TestMetrics.java Increase coverage of package org.apache.hadoop.hive.common.metrics -- Key: HIVE-4796 URL: https://issues.apache.org/jira/browse/HIVE-4796 Project: Hive Issue Type: Test Affects Versions: 0.12.0 Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Fix For: 0.12.0 Attachments: HIVE-4796-trunk--N1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3810) HiveHistory.log need to replace '\r' with space before writing Entry.value to historyfile
[
https://issues.apache.org/jira/browse/HIVE-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703737#comment-13703737
]
Hudson commented on HIVE-3810:
--
Integrated in Hive-trunk-h0.21 #2188 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/2188/])
HIVE-3810 : HiveHistory.log need to replace \r with space before writing
Entry.value to historyfile (Mark Grover via Ashutosh Chauhan) (Revision 1500991)
Result = ABORTED
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1500991
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/history/HiveHistory.java
HiveHistory.log need to replace '\r' with space before writing Entry.value to
historyfile
-
Key: HIVE-3810
URL: https://issues.apache.org/jira/browse/HIVE-3810
Project: Hive
Issue Type: Bug
Components: Logging
Reporter: qiangwang
Assignee: Mark Grover
Priority: Minor
Fix For: 0.12.0
Attachments: HIVE-3810.1.patch, HIVE-3810.2.patch, HIVE-3810.3.patch,
HIVE-3810.4.patch
HiveHistory.log will replace '\n' with space before writing Entry.value to
history file:
val = val.replace('\n', ' ');
but HiveHistory.parseHiveHistory use BufferedReader.readLine which takes
'\n', '\r', '\r\n' as line delimiter to parse history file
if val contains '\r', there is a high possibility that HiveHistory.parseLine
will fail, in which case usually RecordTypes.valueOf(recType) will throw
exception 'java.lang.IllegalArgumentException'
HiveHistory.log need to replace '\r' with space as well:
val = val.replace('\n', ' ');
changed to
val = val.replaceAll(\r|\n, );
or
val = val.replace('\r', ' ').replace('\n', ' ');
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4832) script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c'
Thejas M Nair created HIVE-4832: --- Summary: script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c' Key: HIVE-4832 URL: https://issues.apache.org/jira/browse/HIVE-4832 Project: Hive Issue Type: Test Components: Tests Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair script_pipe.q is a streaming test case that uses 'head -n 1' shell command. On windows, for streaming, the command needs to be replaced with 'cmd /c head -n 1' . The wiki doc has been updated - https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=27362047selectedPageVersions=6selectedPageVersions=5 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4832) script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c'
[ https://issues.apache.org/jira/browse/HIVE-4832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4832: Attachment: HIVE-4832.1.patch HIVE-4832.1.patch - excludes script_pipe.q from windows, and adds a new test case script_pipe_win.q that is run only on windows. script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c' Key: HIVE-4832 URL: https://issues.apache.org/jira/browse/HIVE-4832 Project: Hive Issue Type: Test Components: Tests Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Labels: windows Attachments: HIVE-4832.1.patch script_pipe.q is a streaming test case that uses 'head -n 1' shell command. On windows, for streaming, the command needs to be replaced with 'cmd /c head -n 1' . The wiki doc has been updated - https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=27362047selectedPageVersions=6selectedPageVersions=5 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4830) Test clientnegative/nested_complex_neg.q got broken due to 4580
[ https://issues.apache.org/jira/browse/HIVE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4830: - Attachment: HIVE-4830.patch Updated the output file. Test clientnegative/nested_complex_neg.q got broken due to 4580 --- Key: HIVE-4830 URL: https://issues.apache.org/jira/browse/HIVE-4830 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.12.0 Reporter: Ashutosh Chauhan Attachments: HIVE-4830.patch Both HIVE-3253 and HIVE-4580 were racing to modify .q.out files for this test. Eventually, one patch lost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4830) Test clientnegative/nested_complex_neg.q got broken due to 4580
[ https://issues.apache.org/jira/browse/HIVE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4830: - Assignee: Vikram Dixit K Test clientnegative/nested_complex_neg.q got broken due to 4580 --- Key: HIVE-4830 URL: https://issues.apache.org/jira/browse/HIVE-4830 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.12.0 Reporter: Ashutosh Chauhan Assignee: Vikram Dixit K Attachments: HIVE-4830.patch Both HIVE-3253 and HIVE-4580 were racing to modify .q.out files for this test. Eventually, one patch lost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4832) script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c'
[ https://issues.apache.org/jira/browse/HIVE-4832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703805#comment-13703805 ] Edward Capriolo commented on HIVE-4832: --- This is getting really ludicrous that we are trying to support hive on windows, and we literally have no way to test anything. script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c' Key: HIVE-4832 URL: https://issues.apache.org/jira/browse/HIVE-4832 Project: Hive Issue Type: Test Components: Tests Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Labels: windows Attachments: HIVE-4832.1.patch script_pipe.q is a streaming test case that uses 'head -n 1' shell command. On windows, for streaming, the command needs to be replaced with 'cmd /c head -n 1' . The wiki doc has been updated - https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=27362047selectedPageVersions=6selectedPageVersions=5 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4830) Test clientnegative/nested_complex_neg.q got broken due to 4580
[ https://issues.apache.org/jira/browse/HIVE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4830: - Status: Patch Available (was: Open) Updated the q file output. Test clientnegative/nested_complex_neg.q got broken due to 4580 --- Key: HIVE-4830 URL: https://issues.apache.org/jira/browse/HIVE-4830 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.12.0 Reporter: Ashutosh Chauhan Assignee: Vikram Dixit K Attachments: HIVE-4830.patch Both HIVE-3253 and HIVE-4580 were racing to modify .q.out files for this test. Eventually, one patch lost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
Yin Huai created HIVE-4833: -- Summary: Fix eclipse template classpath to include the correct jdo lib Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4834) Hive eclipse classpath update for jdo
Vikram Dixit K created HIVE-4834: Summary: Hive eclipse classpath update for jdo Key: HIVE-4834 URL: https://issues.apache.org/jira/browse/HIVE-4834 Project: Hive Issue Type: Bug Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Minor The eclipse template files point to an invalid jdo version. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4834) Hive eclipse classpath update for jdo
[ https://issues.apache.org/jira/browse/HIVE-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4834: - Status: Patch Available (was: Open) Hive eclipse classpath update for jdo - Key: HIVE-4834 URL: https://issues.apache.org/jira/browse/HIVE-4834 Project: Hive Issue Type: Bug Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Minor Attachments: HIVE-4834.patch The eclipse template files point to an invalid jdo version. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4834) Hive eclipse classpath update for jdo
[ https://issues.apache.org/jira/browse/HIVE-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4834: - Attachment: HIVE-4834.patch Hive eclipse classpath update for jdo - Key: HIVE-4834 URL: https://issues.apache.org/jira/browse/HIVE-4834 Project: Hive Issue Type: Bug Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Minor Attachments: HIVE-4834.patch The eclipse template files point to an invalid jdo version. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
[ https://issues.apache.org/jira/browse/HIVE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-4833: --- Attachment: HIVE-4833.patch.txt Fix eclipse template classpath to include the correct jdo lib - Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial Attachments: HIVE-4833.patch.txt HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
[ https://issues.apache.org/jira/browse/HIVE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-4833: --- Status: Patch Available (was: Open) Fix eclipse template classpath to include the correct jdo lib - Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial Attachments: HIVE-4833.patch.txt HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
[ https://issues.apache.org/jira/browse/HIVE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-4833: --- Attachment: HIVE-4833.patch.txt Fix eclipse template classpath to include the correct jdo lib - Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial Attachments: HIVE-4833.patch.txt HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
[ https://issues.apache.org/jira/browse/HIVE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-4833: --- Attachment: (was: HIVE-4833.patch.txt) Fix eclipse template classpath to include the correct jdo lib - Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial Attachments: HIVE-4833.patch.txt HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4835) Methods in Metrics class could avoid throwing IOException
Arup Malakar created HIVE-4835:
--
Summary: Methods in Metrics class could avoid throwing IOException
Key: HIVE-4835
URL: https://issues.apache.org/jira/browse/HIVE-4835
Project: Hive
Issue Type: Bug
Affects Versions: 0.11.0
Reporter: Arup Malakar
Priority: Minor
I see that most of the methods in the Metrics class throws exception:
{code:java}
public void resetMetrics() throws IOException {
public void open() throws IOException {
public void close() throws IOException {
public void reopen() throws IOException {
public static void init() throws Exception {
public static Long incrementCounter(String name) throws IOException{
public static Long incrementCounter(String name, long increment) throws
IOException{
public static void set(String name, Object value) throws IOException{
public static Object get(String name) throws IOException{
public static void initializeScope(String name) throws IOException {
public static MetricsScope startScope(String name) throws IOException{
public static MetricsScope getScope(String name) throws IOException {
public static void endScope(String name) throws IOException{
{code}
I believe Metrics should be best effort and the Metrics system should just log
error messages in case it is unable to capture the Metrics. Throwing exception
makes the caller code unnecessarily lengthy. Also the caller would never want
to stop execution because of failure to capture metrics, so it ends up just
logging the exception.
The kind of code we see is like:
{code:java}
// Snippet from HiveMetaStore.java
try {
Metrics.startScope(function);
} catch (IOException e) {
LOG.debug(Exception when starting metrics scope
+ e.getClass().getName() + + e.getMessage());
MetaStoreUtils.printStackTrace(e);
}
{code}
which could have been:
{code:java}
Metrics.startScope(function);
{code}
Thoughts?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4835) Methods in Metrics class could avoid throwing IOException
[
https://issues.apache.org/jira/browse/HIVE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703914#comment-13703914
]
Ashutosh Chauhan commented on HIVE-4835:
I agree. Metrics is best effort, throwing exceptions from it is not best of the
ideas.
CC'ing [~sushanth] who originally authored this class.
Methods in Metrics class could avoid throwing IOException
-
Key: HIVE-4835
URL: https://issues.apache.org/jira/browse/HIVE-4835
Project: Hive
Issue Type: Bug
Affects Versions: 0.11.0
Reporter: Arup Malakar
Priority: Minor
I see that most of the methods in the Metrics class throws exception:
{code:java}
public void resetMetrics() throws IOException {
public void open() throws IOException {
public void close() throws IOException {
public void reopen() throws IOException {
public static void init() throws Exception {
public static Long incrementCounter(String name) throws IOException{
public static Long incrementCounter(String name, long increment) throws
IOException{
public static void set(String name, Object value) throws IOException{
public static Object get(String name) throws IOException{
public static void initializeScope(String name) throws IOException {
public static MetricsScope startScope(String name) throws IOException{
public static MetricsScope getScope(String name) throws IOException {
public static void endScope(String name) throws IOException{
{code}
I believe Metrics should be best effort and the Metrics system should just
log error messages in case it is unable to capture the Metrics. Throwing
exception makes the caller code unnecessarily lengthy. Also the caller would
never want to stop execution because of failure to capture metrics, so it
ends up just logging the exception.
The kind of code we see is like:
{code:java}
// Snippet from HiveMetaStore.java
try {
Metrics.startScope(function);
} catch (IOException e) {
LOG.debug(Exception when starting metrics scope
+ e.getClass().getName() + + e.getMessage());
MetaStoreUtils.printStackTrace(e);
}
{code}
which could have been:
{code:java}
Metrics.startScope(function);
{code}
Thoughts?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4835) Methods in Metrics class could avoid throwing IOException
[
https://issues.apache.org/jira/browse/HIVE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703934#comment-13703934
]
Sushanth Sowmyan commented on HIVE-4835:
Agreed, that should make a lot of the metrics calls simpler, and will clean up
calling code.
Methods in Metrics class could avoid throwing IOException
-
Key: HIVE-4835
URL: https://issues.apache.org/jira/browse/HIVE-4835
Project: Hive
Issue Type: Bug
Affects Versions: 0.11.0
Reporter: Arup Malakar
Priority: Minor
I see that most of the methods in the Metrics class throws exception:
{code:java}
public void resetMetrics() throws IOException {
public void open() throws IOException {
public void close() throws IOException {
public void reopen() throws IOException {
public static void init() throws Exception {
public static Long incrementCounter(String name) throws IOException{
public static Long incrementCounter(String name, long increment) throws
IOException{
public static void set(String name, Object value) throws IOException{
public static Object get(String name) throws IOException{
public static void initializeScope(String name) throws IOException {
public static MetricsScope startScope(String name) throws IOException{
public static MetricsScope getScope(String name) throws IOException {
public static void endScope(String name) throws IOException{
{code}
I believe Metrics should be best effort and the Metrics system should just
log error messages in case it is unable to capture the Metrics. Throwing
exception makes the caller code unnecessarily lengthy. Also the caller would
never want to stop execution because of failure to capture metrics, so it
ends up just logging the exception.
The kind of code we see is like:
{code:java}
// Snippet from HiveMetaStore.java
try {
Metrics.startScope(function);
} catch (IOException e) {
LOG.debug(Exception when starting metrics scope
+ e.getClass().getName() + + e.getMessage());
MetaStoreUtils.printStackTrace(e);
}
{code}
which could have been:
{code:java}
Metrics.startScope(function);
{code}
Thoughts?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4834) Hive eclipse classpath update for jdo
[ https://issues.apache.org/jira/browse/HIVE-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4834: - Resolution: Duplicate Status: Resolved (was: Patch Available) Hive eclipse classpath update for jdo - Key: HIVE-4834 URL: https://issues.apache.org/jira/browse/HIVE-4834 Project: Hive Issue Type: Bug Reporter: Vikram Dixit K Assignee: Vikram Dixit K Priority: Minor Attachments: HIVE-4834.patch The eclipse template files point to an invalid jdo version. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4810) Refactor exec package
[ https://issues.apache.org/jira/browse/HIVE-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703945#comment-13703945 ] Hudson commented on HIVE-4810: -- Integrated in Hive-trunk-hadoop1-ptest #56 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/56/]) HIVE-4810 [jira] Refactor exec package (Gunther Hagleitner via Ashutosh Chauhan) Summary: HIVE-4810 The exec package contains both operators and classes used to execute the job. Moving the latter into a sub package makes the package slightly more manageable and will make it easier to provide a tez-based implementation. Test Plan: Refactoring Reviewers: ashutoshc Reviewed By: ashutoshc Differential Revision: https://reviews.facebook.net/D11625 (Revision 1501476) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501476 Files : * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java * /hive/trunk/contrib/src/test/results/clientnegative/case_with_row_sequence.q.out * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/QueryPlan.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ColumnStatsTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecMapper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecMapperContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecReducer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FetchTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHook.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JobTrackerURLResolver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TableScanOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Throttle.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecMapper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecMapperContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecReducer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HadoopJobExecHelper.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HadoopJobExecHook.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/JobDebugger.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/JobTrackerURLResolver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapRedTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/Throttle.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/BucketizedHiveInputSplit.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveRecordReader.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/merge/BlockMergeTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/stats/PartialScanTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/truncate/ColumnTruncateTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/AbstractJoinTaskDispatcher.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/BucketingSortingInferenceOptimizer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/CommonJoinTaskDispatcher.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/MapJoinResolver.java *
[jira] [Commented] (HIVE-4835) Methods in Metrics class could avoid throwing IOException
[
https://issues.apache.org/jira/browse/HIVE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703965#comment-13703965
]
Thiruvel Thirumoolan commented on HIVE-4835:
I think the method should return at-least return a boolean on whether an
increment succeeded, so a corresponding decrement can be avoided if the
increment failed. An incr might succeed but a decr fail, but that's again best
effort to be consistent.
Methods in Metrics class could avoid throwing IOException
-
Key: HIVE-4835
URL: https://issues.apache.org/jira/browse/HIVE-4835
Project: Hive
Issue Type: Bug
Affects Versions: 0.11.0
Reporter: Arup Malakar
Priority: Minor
I see that most of the methods in the Metrics class throws exception:
{code:java}
public void resetMetrics() throws IOException {
public void open() throws IOException {
public void close() throws IOException {
public void reopen() throws IOException {
public static void init() throws Exception {
public static Long incrementCounter(String name) throws IOException{
public static Long incrementCounter(String name, long increment) throws
IOException{
public static void set(String name, Object value) throws IOException{
public static Object get(String name) throws IOException{
public static void initializeScope(String name) throws IOException {
public static MetricsScope startScope(String name) throws IOException{
public static MetricsScope getScope(String name) throws IOException {
public static void endScope(String name) throws IOException{
{code}
I believe Metrics should be best effort and the Metrics system should just
log error messages in case it is unable to capture the Metrics. Throwing
exception makes the caller code unnecessarily lengthy. Also the caller would
never want to stop execution because of failure to capture metrics, so it
ends up just logging the exception.
The kind of code we see is like:
{code:java}
// Snippet from HiveMetaStore.java
try {
Metrics.startScope(function);
} catch (IOException e) {
LOG.debug(Exception when starting metrics scope
+ e.getClass().getName() + + e.getMessage());
MetaStoreUtils.printStackTrace(e);
}
{code}
which could have been:
{code:java}
Metrics.startScope(function);
{code}
Thoughts?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4820) webhcat_config.sh should set default values for HIVE_HOME and HCAT_PREFIX that work with default build tree structure
[ https://issues.apache.org/jira/browse/HIVE-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-4820: - Attachment: HIVE4820.patch 1. added logic in hcat/webhcat scripts to come up with defaults that make sense in the standard build tree for HIVE_HOME, HCAT_PREFIX and TEMPLETON_HOME (unless defined by user) 2. propagate the same values through Ant build files so that TestWebHCatE2e can run w/o having to define HCAT_PREFIX, HIVE_HOME explicitly. 3. improved a few error messages webhcat_config.sh should set default values for HIVE_HOME and HCAT_PREFIX that work with default build tree structure - Key: HIVE-4820 URL: https://issues.apache.org/jira/browse/HIVE-4820 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Fix For: 0.12.0 Attachments: HIVE4820.patch Currently they are expected to be set by the user which makes development inconvenient. It makes writing unit tests for WebHcat more difficult as well. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4824) make TestWebHCatE2e run w/o requiring installing external hadoop
[ https://issues.apache.org/jira/browse/HIVE-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703976#comment-13703976 ] Eugene Koifman commented on HIVE-4824: -- HIVE-4820 eliminates the need to define HIVE_HOME, HCAT_PREFIX env vars explicitly. Once this is fixed the rest of the tests in TestWebHCatE2e can be enabled. make TestWebHCatE2e run w/o requiring installing external hadoop Key: HIVE-4824 URL: https://issues.apache.org/jira/browse/HIVE-4824 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Currently WebHCat will use hive/build/dist/hcatalog/bin/hcat to execute DDL commands, which in turn uses Hadoop Jar command. This in turn requires that HADOOP_HOME env var be defined and point to an existing Hadoop install. Need to see we can apply hive/testutils/hadoop idea here to make WebHCat not depend on external hadoop. This will make Unit tests better/easier to write and make dev/test cycle simpler. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4835) Methods in Metrics class could avoid throwing IOException
[
https://issues.apache.org/jira/browse/HIVE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703975#comment-13703975
]
Arup Malakar commented on HIVE-4835:
[~thiruvel] Makes sense, that way the caller could handle failure if it prefers
to, but is not forced to.
Methods in Metrics class could avoid throwing IOException
-
Key: HIVE-4835
URL: https://issues.apache.org/jira/browse/HIVE-4835
Project: Hive
Issue Type: Bug
Affects Versions: 0.11.0
Reporter: Arup Malakar
Priority: Minor
I see that most of the methods in the Metrics class throws exception:
{code:java}
public void resetMetrics() throws IOException {
public void open() throws IOException {
public void close() throws IOException {
public void reopen() throws IOException {
public static void init() throws Exception {
public static Long incrementCounter(String name) throws IOException{
public static Long incrementCounter(String name, long increment) throws
IOException{
public static void set(String name, Object value) throws IOException{
public static Object get(String name) throws IOException{
public static void initializeScope(String name) throws IOException {
public static MetricsScope startScope(String name) throws IOException{
public static MetricsScope getScope(String name) throws IOException {
public static void endScope(String name) throws IOException{
{code}
I believe Metrics should be best effort and the Metrics system should just
log error messages in case it is unable to capture the Metrics. Throwing
exception makes the caller code unnecessarily lengthy. Also the caller would
never want to stop execution because of failure to capture metrics, so it
ends up just logging the exception.
The kind of code we see is like:
{code:java}
// Snippet from HiveMetaStore.java
try {
Metrics.startScope(function);
} catch (IOException e) {
LOG.debug(Exception when starting metrics scope
+ e.getClass().getName() + + e.getMessage());
MetaStoreUtils.printStackTrace(e);
}
{code}
which could have been:
{code:java}
Metrics.startScope(function);
{code}
Thoughts?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4820) webhcat_config.sh should set default values for HIVE_HOME and HCAT_PREFIX that work with default build tree structure
[ https://issues.apache.org/jira/browse/HIVE-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-4820: - Status: Patch Available (was: Open) webhcat_config.sh should set default values for HIVE_HOME and HCAT_PREFIX that work with default build tree structure - Key: HIVE-4820 URL: https://issues.apache.org/jira/browse/HIVE-4820 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Fix For: 0.12.0 Attachments: HIVE4820.patch Currently they are expected to be set by the user which makes development inconvenient. It makes writing unit tests for WebHcat more difficult as well. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4836) make checkstyle ignore IntelliJ files and templeton e2e files
Eugene Koifman created HIVE-4836: Summary: make checkstyle ignore IntelliJ files and templeton e2e files Key: HIVE-4836 URL: https://issues.apache.org/jira/browse/HIVE-4836 Project: Hive Issue Type: Bug Components: HCatalog Affects Versions: 0.12.0 Reporter: Eugene Koifman Assignee: Eugene Koifman Fix For: 0.12.0 hcatalog/build-support/ant/checkstyle.xml already has exclude name=src/test/e2e/hcatalog/testdist/**/ !-- Test run results -- exclude name=src/test/e2e/hcatalog/tar/**/ !-- Test build area -- exclude name=src/test/e2e/hcatalog/udfs/java/*.jar/ !-- Test build area -- exclude name=src/test/e2e/hcatalog/hcattests.tar/ !-- Test build artifact -- It needs to exclude the same under e2e/templeton/ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4830) Test clientnegative/nested_complex_neg.q got broken due to 4580
[ https://issues.apache.org/jira/browse/HIVE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704016#comment-13704016 ] Ashutosh Chauhan commented on HIVE-4830: +1 Test clientnegative/nested_complex_neg.q got broken due to 4580 --- Key: HIVE-4830 URL: https://issues.apache.org/jira/browse/HIVE-4830 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.12.0 Reporter: Ashutosh Chauhan Assignee: Vikram Dixit K Attachments: HIVE-4830.patch Both HIVE-3253 and HIVE-4580 were racing to modify .q.out files for this test. Eventually, one patch lost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4830) Test clientnegative/nested_complex_neg.q got broken due to 4580
[ https://issues.apache.org/jira/browse/HIVE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4830: --- Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Vikram! Test clientnegative/nested_complex_neg.q got broken due to 4580 --- Key: HIVE-4830 URL: https://issues.apache.org/jira/browse/HIVE-4830 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.12.0 Reporter: Ashutosh Chauhan Assignee: Vikram Dixit K Fix For: 0.12.0 Attachments: HIVE-4830.patch Both HIVE-3253 and HIVE-4580 were racing to modify .q.out files for this test. Eventually, one patch lost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
[ https://issues.apache.org/jira/browse/HIVE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704023#comment-13704023 ] Ashutosh Chauhan commented on HIVE-4833: +1 Fix eclipse template classpath to include the correct jdo lib - Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial Attachments: HIVE-4833.patch.txt HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
[ https://issues.apache.org/jira/browse/HIVE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4833: --- Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Yin! Fix eclipse template classpath to include the correct jdo lib - Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4833.patch.txt HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4810) Refactor exec package
[ https://issues.apache.org/jira/browse/HIVE-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704035#comment-13704035 ] Edward Capriolo commented on HIVE-4810: --- I do not think we are going about this the correct way. This is an excessively large patch on one of the keys pieces of hive. I dont think this type of thing should be done in 10 days with the +1 of only one committer, for the sole purpose of making it easier to add new cool feature x , while simultaniously sending a big fu to all the other people that have patches waiting for review for months that they will now have to rebase. I am not sure anyone has sold tez to the committers in a way that we should refactor key components of hive just so we can play with it. Refactor exec package - Key: HIVE-4810 URL: https://issues.apache.org/jira/browse/HIVE-4810 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: 0.12.0 Attachments: HIVE-4810.1.patch, HIVE-4810.2.patch, HIVE-4810.3.patch, HIVE-4810.4.patch, HIVE-4810.5.patch, HIVE-4810.6.patch, HIVE-4810.7.patch The exec package contains both operators and classes used to execute the job. Moving the latter into a sub package makes the package slightly more manageable and will make it easier to provide a tez-based implementation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3630) udf_substr.q fails when using JDK7
[ https://issues.apache.org/jira/browse/HIVE-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704043#comment-13704043 ] Xuefu Zhang commented on HIVE-3630: --- I think HIVE-3630 and HIVE-3840 are dealing with two different issues: HIVE-3840 is about inconsistency of null vs NULL, while HIVE-3630 about an internal error causing a result diff of empty string vs NULL. With patch in HIVE-3840, the test fails with the following diff: [junit] 36c36 [junit] NULL NULLNULLNULL [junit] --- [junit] NULL NULLNULLNULLNULL [junit] 184c184 [junit] NULL NULLNULLNULLA AB ABC ABC A AB ABC ABC B BC BC BC C C C C C C C C B BC BC BC A AB ABC ABC [junit] --- [junit] NULL NULLNULLNULLNULLA AB ABC ABC A AB ABC ABC B BC BC BC C C C C C C C C B BC BC BC A AB ABC ABC Compare it with the original diff in JDK7: [junit] 36c36 [junit] NULL NULLNULLNULL [junit] --- [junit] NULL NULLNULLNULLNULL [junit] 184c184 [junit] NULL NULLNULLNULLA AB ABC ABC A AB ABC ABC B BC BC BC C C C C C C C C B BC BC BC A AB ABC ABC [junit] --- [junit] NULL NULLNULLNULLNULLA AB ABC ABC A AB ABC ABC B BC BC BC C C C C C C C C B BC BC BC A AB ABC ABC Please note that there is no null in the result any more, thanks to the patch in HIVE-3840. With patch in HIVE-3630, the test passes. In fact, with JDK7, more test failures are observed because of output ordering, probably due to the iterator behaviour difference introduced in JDK7, same cause as HIVE-3630. udf_substr.q fails when using JDK7 -- Key: HIVE-3630 URL: https://issues.apache.org/jira/browse/HIVE-3630 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.9.1, 0.10.0, 0.11.0 Reporter: Chris Drome Assignee: Chris Drome Attachments: HIVE-3630-0.10.patch, HIVE-3630-0.9.patch, HIVE-3630-trunk.patch Internal error: Cannot find ConstantObjectInspector for BINARY This exception has two causes. JDK7 iterators do not return values in the same order as JDK6, which selects a different implementation of this UDF when the first argument is null. With JDK7 this happens to be the binary version. The binary version is not implemented properly which ultimately causes the exception when the method is called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2608) Do not require AS a,b,c part in LATERAL VIEW
[ https://issues.apache.org/jira/browse/HIVE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704047#comment-13704047 ] Navis commented on HIVE-2608: - Sorry, I think it's based on other branch. Will be updated soon. Do not require AS a,b,c part in LATERAL VIEW Key: HIVE-2608 URL: https://issues.apache.org/jira/browse/HIVE-2608 Project: Hive Issue Type: Improvement Components: Query Processor, UDF Affects Versions: 0.10.0 Reporter: Igor Kabiljo Assignee: Navis Priority: Minor Currently, it is required to state column names when LATERAL VIEW is used. That shouldn't be necessary, since UDTF returns struct which contains column names - and they should be used by default. For example, it would be great if this was possible: SELECT t.*, t.key1 + t.key4 FROM some_table LATERAL VIEW JSON_TUPLE(json, 'key1', 'key2', 'key3', 'key3') t; -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2608) Do not require AS a,b,c part in LATERAL VIEW
[ https://issues.apache.org/jira/browse/HIVE-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2608: -- Attachment: HIVE-2608.D4317.5.patch navis updated the revision HIVE-2608 [jira] Do not require AS a,b,c part in LATERAL VIEW. Rebased to trunk Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D4317 CHANGE SINCE LAST DIFF https://reviews.facebook.net/D4317?vs=14751id=35535#toc AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/parse/FromClauseParser.g ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ql/src/test/queries/clientpositive/lateral_view_noalias.q ql/src/test/results/clientpositive/lateral_view_noalias.q.out To: JIRA, navis Cc: ikabiljo Do not require AS a,b,c part in LATERAL VIEW Key: HIVE-2608 URL: https://issues.apache.org/jira/browse/HIVE-2608 Project: Hive Issue Type: Improvement Components: Query Processor, UDF Affects Versions: 0.10.0 Reporter: Igor Kabiljo Assignee: Navis Priority: Minor Attachments: HIVE-2608.D4317.5.patch Currently, it is required to state column names when LATERAL VIEW is used. That shouldn't be necessary, since UDTF returns struct which contains column names - and they should be used by default. For example, it would be great if this was possible: SELECT t.*, t.key1 + t.key4 FROM some_table LATERAL VIEW JSON_TUPLE(json, 'key1', 'key2', 'key3', 'key3') t; -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4827) Merge a Map-only job to its following MapReduce job with multiple inputs
[
https://issues.apache.org/jira/browse/HIVE-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704063#comment-13704063
]
Yin Huai commented on HIVE-4827:
I have been studying the code related to MapJoinOperator and
CommonJoinResolver. Besides CommonJoinResolver, seems that we also need to
change MapJoinOperator to load correct hash tables because some hash tables may
not be needed by a MapJoinOperator.
Merge a Map-only job to its following MapReduce job with multiple inputs
Key: HIVE-4827
URL: https://issues.apache.org/jira/browse/HIVE-4827
Project: Hive
Issue Type: Improvement
Reporter: Yin Huai
Assignee: Yin Huai
When hive.optimize.mapjoin.mapreduce is on, CommonJoinResolver can attach a
Map-only job (MapJoin) to its following MapReduce job. But this merge only
happens when the MapReduce job has a single input. With Correlation Optimizer
(HIVE-2206), it is possible that the MapReduce job can have multiple inputs
(for multiple operation paths). It is desired to improve CommonJoinResolver
to merge a Map-only job to the corresponding Map task of the MapReduce job.
Example:
{code:sql}
SELECT tmp1.key, count(*)
FROM (SELECT x1.key2 AS key
FROM bigTable1 x1 JOIN smallTable1 y1 ON (x1.key1 = y1.key1)
GROUP BY x1.key2) tmp1
JOIN (SELECT x2.key2 AS key
FROM bigTable2 x2 JOIN smallTable2 y2 ON (x2.key1 = y2.key1)
GROUP BY x2.key2) tmp2
ON (tmp1.key = tmp2.key)
GROUP BY tmp1.key;
{\code}
In this query, join operations inside tmp1 and tmp2 will be converted to two
MapJoins. With Correlation Optimizer, aggregations in tmp1, tmp2, and join of
tmp1 and tmp2, and the last aggregation will be executed in the same
MapReduce job (Reduce side). Since this MapReduce job has two inputs, right
now, CommonJoinResolver cannot attach two MapJoins to the Map side of a
MapReduce job.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-556) let hive support theta join
[
https://issues.apache.org/jira/browse/HIVE-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704064#comment-13704064
]
Brock Noland commented on HIVE-556:
---
Hi,
I have created a design document for this JIRA on the wiki:
https://cwiki.apache.org/confluence/display/Hive/Theta+Join
Brock
let hive support theta join
---
Key: HIVE-556
URL: https://issues.apache.org/jira/browse/HIVE-556
Project: Hive
Issue Type: New Feature
Affects Versions: 0.4.0
Reporter: Min Zhou
Assignee: Brock Noland
Right now , hive only support equal joins . Sometimes it's not enough, we
must consider implementing theta joins like
{code:sql}
SELECT
a.subid, a.id, t.url
FROM
tbl t JOIN aux_tbl a ON t.url rlike a.url_pattern
WHERE
t.dt='20090609'
AND a.dt='20090609';
{code}
any condition expression following 'ON' is appropriate.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4658) Make KW_OUTER optional in outer joins
[ https://issues.apache.org/jira/browse/HIVE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704082#comment-13704082 ] Navis commented on HIVE-4658: - Brock commented two test failed. org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20 org.apache.hcatalog.fileformats.TestOrcDynamicPartitioned.testHCatDynamicPartitionedTable Can you assert that? I cannot reproduce. Make KW_OUTER optional in outer joins - Key: HIVE-4658 URL: https://issues.apache.org/jira/browse/HIVE-4658 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Navis Assignee: Edward Capriolo Priority: Trivial Attachments: hive-4658.2.patch.txt, HIVE-4658.D11091.1.patch For really trivial migration issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-4832) script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c'
[ https://issues.apache.org/jira/browse/HIVE-4832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair resolved HIVE-4832. - Resolution: Invalid I was able to get it working with cygwin in path, this is not an issue. [~appodictic] I agree that we need to setup some public builds infrastructure on windows. I will talk to people here at Hortonworks and figure out what can be done. I also agree that we should try and write platform independent tests where possible. Right now, we workaround this issue on windows for many streaming tests by having cygwin on the machines. script_pipe.q test fails on windows as streaming shell cmd requires 'cmd /c' Key: HIVE-4832 URL: https://issues.apache.org/jira/browse/HIVE-4832 Project: Hive Issue Type: Test Components: Tests Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Labels: windows Attachments: HIVE-4832.1.patch script_pipe.q is a streaming test case that uses 'head -n 1' shell command. On windows, for streaming, the command needs to be replaced with 'cmd /c head -n 1' . The wiki doc has been updated - https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=27362047selectedPageVersions=6selectedPageVersions=5 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4658) Make KW_OUTER optional in outer joins
[ https://issues.apache.org/jira/browse/HIVE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704101#comment-13704101 ] Brock Noland commented on HIVE-4658: Navis, sorry I was unclear. My comment Both appear to be flaky and unrelated to the change. meant that I think those two failures were unrelated. I have seen both fail before. Make KW_OUTER optional in outer joins - Key: HIVE-4658 URL: https://issues.apache.org/jira/browse/HIVE-4658 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Navis Assignee: Edward Capriolo Priority: Trivial Attachments: hive-4658.2.patch.txt, HIVE-4658.D11091.1.patch For really trivial migration issue. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4837) Union on void type fails with NPE
Navis created HIVE-4837:
---
Summary: Union on void type fails with NPE
Key: HIVE-4837
URL: https://issues.apache.org/jira/browse/HIVE-4837
Project: Hive
Issue Type: Bug
Components: Query Processor
Reporter: Navis
Assignee: Navis
Priority: Minor
From mailing list,
http://www.mail-archive.com/user@hive.apache.org/msg08683.html
{noformat}
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 17 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
... 22 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:64)
at java.lang.String.valueOf(String.java:2826)
at java.lang.StringBuilder.append(StringBuilder.java:115)
at
org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:563)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100)
... 22 more
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4837) Union on void type fails with NPE
Navis created HIVE-4837:
---
Summary: Union on void type fails with NPE
Key: HIVE-4837
URL: https://issues.apache.org/jira/browse/HIVE-4837
Project: Hive
Issue Type: Bug
Components: Query Processor
Reporter: Navis
Assignee: Navis
Priority: Minor
From mailing list,
http://www.mail-archive.com/user@hive.apache.org/msg08683.html
{noformat}
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 17 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
... 22 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:64)
at java.lang.String.valueOf(String.java:2826)
at java.lang.StringBuilder.append(StringBuilder.java:115)
at
org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:563)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100)
... 22 more
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4837) Union on void type fails with NPE
[
https://issues.apache.org/jira/browse/HIVE-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Navis updated HIVE-4837:
Status: Patch Available (was: Open)
Union on void type fails with NPE
-
Key: HIVE-4837
URL: https://issues.apache.org/jira/browse/HIVE-4837
Project: Hive
Issue Type: Bug
Components: Query Processor
Reporter: Navis
Assignee: Navis
Priority: Minor
Attachments: HIVE-4837.D11649.1.patch
From mailing list,
http://www.mail-archive.com/user@hive.apache.org/msg08683.html
{noformat}
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 17 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at
org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
... 22 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:64)
at java.lang.String.valueOf(String.java:2826)
at java.lang.StringBuilder.append(StringBuilder.java:115)
at
org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:563)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at
org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100)
... 22 more
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4837) Union on void type fails with NPE
[
https://issues.apache.org/jira/browse/HIVE-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-4837:
--
Attachment: HIVE-4837.D11649.1.patch
navis requested code review of HIVE-4837 [jira] Union on void type fails with
NPE.
Reviewers: JIRA
HIVE-4837 Union on void type fails with NPE
From mailing list,
http://www.mail-archive.com/user@hive.apache.org/msg08683.html
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 17 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
... 22 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:64)
at java.lang.String.valueOf(String.java:2826)
at java.lang.StringBuilder.append(StringBuilder.java:115)
at
org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:451)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:407)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:186)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:563)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:375)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:100)
... 22 more
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D11649
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/exec/UnionOperator.java
ql/src/test/queries/clientpositive/union_null.q
ql/src/test/results/beelinepositive/union_null.q.out
ql/src/test/results/clientpositive/union_null.q.out
MANAGE HERALD RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/27561/
To: JIRA, navis
Union on void type fails with NPE
-
Key: HIVE-4837
URL: https://issues.apache.org/jira/browse/HIVE-4837
Project: Hive
Issue Type: Bug
Components: Query Processor
Reporter: Navis
Assignee: Navis
Priority: Minor
Attachments: HIVE-4837.D11649.1.patch
From mailing list,
http://www.mail-archive.com/user@hive.apache.org/msg08683.html
{noformat}
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
[jira] [Commented] (HIVE-4833) Fix eclipse template classpath to include the correct jdo lib
[ https://issues.apache.org/jira/browse/HIVE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704195#comment-13704195 ] Hudson commented on HIVE-4833: -- Integrated in Hive-trunk-hadoop1-ptest #59 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/59/]) HIVE-4833 : Fix eclipse template classpath to include the correct jdo lib (Yin Huai via Ashutosh Chauhan) (Revision 1501618) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501618 Files : * /hive/trunk/eclipse-templates/.classpath * /hive/trunk/eclipse-templates/.classpath._hbase Fix eclipse template classpath to include the correct jdo lib - Key: HIVE-4833 URL: https://issues.apache.org/jira/browse/HIVE-4833 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Yin Huai Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4833.patch.txt HIVE-4089 upgraded jdo to 3.0.1, but .classpath and classpath._hbase in eclipse tempalte has not been changed accordingly -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4830) Test clientnegative/nested_complex_neg.q got broken due to 4580
[ https://issues.apache.org/jira/browse/HIVE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704194#comment-13704194 ] Hudson commented on HIVE-4830: -- Integrated in Hive-trunk-hadoop1-ptest #59 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/59/]) HIVE-4830 : Test clientnegative/nested_complex_neg.q got broken due to 4580 (Vikram Dixit via Ashutosh Chauhan) (Revision 1501616) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501616 Files : * /hive/trunk/ql/src/test/results/clientnegative/nested_complex_neg.q.out Test clientnegative/nested_complex_neg.q got broken due to 4580 --- Key: HIVE-4830 URL: https://issues.apache.org/jira/browse/HIVE-4830 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.12.0 Reporter: Ashutosh Chauhan Assignee: Vikram Dixit K Fix For: 0.12.0 Attachments: HIVE-4830.patch Both HIVE-3253 and HIVE-4580 were racing to modify .q.out files for this test. Eventually, one patch lost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4810) Refactor exec package
[ https://issues.apache.org/jira/browse/HIVE-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704204#comment-13704204 ] Gunther Hagleitner commented on HIVE-4810: -- [~appodictic] have you looked at the changes? I know there's quite a few files that are being touched, but the changes are rather simple and straight forward in my opinion. The reason so many files have changed is simply because the full path names of some classes is recorded in some golden files. No core logic has changed. Even if you have to rebase against it that shouldn't be hard. As I pointed out in the description, I think grouping some logically cohesive units into its own package has value in itself, which is why I pitched it for inclusion into the trunk as opposed to the branch. Refactor exec package - Key: HIVE-4810 URL: https://issues.apache.org/jira/browse/HIVE-4810 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: 0.12.0 Attachments: HIVE-4810.1.patch, HIVE-4810.2.patch, HIVE-4810.3.patch, HIVE-4810.4.patch, HIVE-4810.5.patch, HIVE-4810.6.patch, HIVE-4810.7.patch The exec package contains both operators and classes used to execute the job. Moving the latter into a sub package makes the package slightly more manageable and will make it easier to provide a tez-based implementation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4819) Comments in CommonJoinOperator for aliasTag is not valid
[ https://issues.apache.org/jira/browse/HIVE-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704226#comment-13704226 ] Hudson commented on HIVE-4819: -- Integrated in Hive-trunk-hadoop2 #280 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/280/]) HIVE-4819 : Comments in CommonJoinOperator for aliasTag is not valid (Navis via Ashutosh Chauhan) (Revision 1501129) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501129 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/CommonJoinOperator.java Comments in CommonJoinOperator for aliasTag is not valid Key: HIVE-4819 URL: https://issues.apache.org/jira/browse/HIVE-4819 Project: Hive Issue Type: Task Components: Documentation Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4819.D11619.1.patch I've written that but it's does not make sense even to me. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4813) Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr
[ https://issues.apache.org/jira/browse/HIVE-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704228#comment-13704228 ] Hudson commented on HIVE-4813: -- Integrated in Hive-trunk-hadoop2 #280 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/280/]) HIVE-4813 : Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr (Ivan Veselovsky via Ashutosh Chauhan) (Revision 1501099) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501099 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/DefaultRuleDispatcher.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/lib/RuleRegExp.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcCtx.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeDescUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/pcr.q * /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out Improve test coverage of package org.apache.hadoop.hive.ql.optimizer.pcr Key: HIVE-4813 URL: https://issues.apache.org/jira/browse/HIVE-4813 Project: Hive Issue Type: Test Affects Versions: 0.12.0 Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Fix For: 0.12.0 Attachments: HIVE-4813-trunk--N1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4796) Increase coverage of package org.apache.hadoop.hive.common.metrics
[ https://issues.apache.org/jira/browse/HIVE-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704229#comment-13704229 ] Hudson commented on HIVE-4796: -- Integrated in Hive-trunk-hadoop2 #280 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/280/]) HIVE-4796 : Increase coverage of package org.apache.hadoop.hive.common.metrics (Ivan Veselovsky via Ashutosh Chauhan) (Revision 1501052) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501052 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/Metrics.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBean.java * /hive/trunk/common/src/java/org/apache/hadoop/hive/common/metrics/MetricsMBeanImpl.java * /hive/trunk/common/src/test/org/apache/hadoop/hive/common * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/metrics * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/metrics/TestMetrics.java Increase coverage of package org.apache.hadoop.hive.common.metrics -- Key: HIVE-4796 URL: https://issues.apache.org/jira/browse/HIVE-4796 Project: Hive Issue Type: Test Affects Versions: 0.12.0 Reporter: Ivan A. Veselovsky Assignee: Ivan A. Veselovsky Fix For: 0.12.0 Attachments: HIVE-4796-trunk--N1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4580) Change DDLTask to report errors using canonical error messages rather than http status codes
[ https://issues.apache.org/jira/browse/HIVE-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704225#comment-13704225 ] Hudson commented on HIVE-4580: -- Integrated in Hive-trunk-hadoop2 #280 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/280/]) HIVE-4580 : Change DDLTask to report errors using canonical error messages rather than http status codes (Eugene Koifman via Ashutosh Chauhan) (Revision 1501053) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501053 Files : * /hive/trunk/contrib/src/test/results/clientnegative/serde_regex.q.out * /hive/trunk/contrib/src/test/results/clientnegative/url_hook.q.out * /hive/trunk/hcatalog/src/test/e2e/templeton/tests/ddl.conf * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/AppConfig.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/BadParam.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/BusyException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CallbackFailedException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CatchallExceptionMapper.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/HcatDelegator.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/HcatException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/JsonBuilder.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Main.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/NotAuthorizedException.java * /hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/QueueException.java * /hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskResult.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TaskRunner.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveException.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/InvalidTableException.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/JsonMetaDataFormatter.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/MetaDataFormatter.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java * /hive/trunk/ql/src/test/results/clientnegative/add_partition_with_whitelist.q.out * /hive/trunk/ql/src/test/results/clientnegative/addpart1.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_partition_nodrop_table.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_partition_with_whitelist.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure2.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_rename_partition_failure3.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_table_wrong_regex.q.out * /hive/trunk/ql/src/test/results/clientnegative/alter_view_failure4.q.out * /hive/trunk/ql/src/test/results/clientnegative/altern1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi1.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi2.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi3.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi4.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi5.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi6.q.out * /hive/trunk/ql/src/test/results/clientnegative/archive_multi7.q.out * /hive/trunk/ql/src/test/results/clientnegative/authorization_fail_1.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename1.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename2.q.out * /hive/trunk/ql/src/test/results/clientnegative/column_rename4.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure3.q.out * /hive/trunk/ql/src/test/results/clientnegative/create_table_failure4.q.out *
[jira] [Commented] (HIVE-4812) Logical explain plan
[ https://issues.apache.org/jira/browse/HIVE-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704227#comment-13704227 ] Hudson commented on HIVE-4812: -- Integrated in Hive-trunk-hadoop2 #280 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/280/]) HIVE-4812 : Logical explain plan (Gunther Hagleitner V via Navis) (Revision 1501036) Result = ABORTED navis : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1501036 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Context.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ExplainSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ExplainWork.java * /hive/trunk/ql/src/test/queries/clientpositive/explain_logical.q * /hive/trunk/ql/src/test/results/clientpositive/explain_logical.q.out Logical explain plan Key: HIVE-4812 URL: https://issues.apache.org/jira/browse/HIVE-4812 Project: Hive Issue Type: Bug Components: Diagnosability Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: 0.12.0 Attachments: HIVE-4812.1.patch, HIVE-4812.2.patch, HIVE-4812.3.patch In various situations it would have been useful to me to glance at the operator plan before we break it into tasks and apply join, total order sort, etc optimizations. I've added this as an options to explain. Explain logical QUERY will output the full operator tree (not the stage plans, tasks, AST etc). Again, I don't think this has to even be documented for users, but might be useful to developers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
