[jira] [Created] (HIVE-5440) HiveServer2 doesn't apply SQL operation's config property
Prasad Mujumdar created HIVE-5440: - Summary: HiveServer2 doesn't apply SQL operation's config property Key: HIVE-5440 URL: https://issues.apache.org/jira/browse/HIVE-5440 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Prasad Mujumdar Assignee: Prasad Mujumdar The HiveServer2 thrift IDL includes an optional config overlay map which is currently not used. -- This message was sent by Atlassian JIRA (v6.1#6144)
Review Request 14484: HIVE-5440: HiveServer2 doesn't apply SQL operation's config property
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14484/ --- Review request for hive. Bugs: HIVE-5440 https://issues.apache.org/jira/browse/HIVE-5440 Repository: hive-git Description --- The patch clones the session config object and applies the specified per-operation properties, if any. This way the changes are applicable to the current driver and not to the parent session. The patch also extends this for the async query to isolate the session and query config. Diffs - service/src/java/org/apache/hive/service/cli/operation/ExecuteStatementOperation.java 6b5a5c3 service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java bb0f711 service/src/test/org/apache/hive/service/cli/CLIServiceTest.java 794ede8 Diff: https://reviews.apache.org/r/14484/diff/ Testing --- Added new test cases for the patch Thanks, Prasad Mujumdar
[jira] [Updated] (HIVE-5440) HiveServer2 doesn't apply SQL operation's config property
[ https://issues.apache.org/jira/browse/HIVE-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad Mujumdar updated HIVE-5440: -- Status: Patch Available (was: Open) Review request on https://reviews.apache.org/r/14484/ HiveServer2 doesn't apply SQL operation's config property -- Key: HIVE-5440 URL: https://issues.apache.org/jira/browse/HIVE-5440 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Prasad Mujumdar Assignee: Prasad Mujumdar Attachments: HIVE-5440.1.patch The HiveServer2 thrift IDL includes an optional config overlay map which is currently not used. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5440) HiveServer2 doesn't apply SQL operation's config property
[ https://issues.apache.org/jira/browse/HIVE-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad Mujumdar updated HIVE-5440: -- Attachment: HIVE-5440.1.patch HiveServer2 doesn't apply SQL operation's config property -- Key: HIVE-5440 URL: https://issues.apache.org/jira/browse/HIVE-5440 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Prasad Mujumdar Assignee: Prasad Mujumdar Attachments: HIVE-5440.1.patch The HiveServer2 thrift IDL includes an optional config overlay map which is currently not used. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13785966#comment-13785966
]
Hive QA commented on HIVE-5364:
---
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12606384/D13215.1.patch
{color:green}SUCCESS:{color} +1 4051 tests passed
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1027/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1027/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5295) HiveConnection#configureConnection tries to execute statement even after it is closed
[ https://issues.apache.org/jira/browse/HIVE-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13785978#comment-13785978 ] Thejas M Nair commented on HIVE-5295: - +1 HiveConnection#configureConnection tries to execute statement even after it is closed - Key: HIVE-5295 URL: https://issues.apache.org/jira/browse/HIVE-5295 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Vaibhav Gumashta Assignee: Vaibhav Gumashta Fix For: 0.12.0 Attachments: D12957.1.patch, D12957.2.patch, D12957.3.patch, HIVE-5295.D12957.3.patch, HIVE-5295.D12957.3.patch, HIVE-5295.D12957.4.patch HiveConnection#configureConnection tries to execute statement even after it is closed. For remote JDBC client, it tries to set the conf var using 'set foo=bar' by calling HiveStatement.execute for each conf var pair, but closes the statement after the 1st iteration through the conf var pairs. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HIVE-5441) Async query execution doesn't return resultset status
Prasad Mujumdar created HIVE-5441: - Summary: Async query execution doesn't return resultset status Key: HIVE-5441 URL: https://issues.apache.org/jira/browse/HIVE-5441 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Prasad Mujumdar Assignee: Prasad Mujumdar For synchronous statement execution (SQL as well as metadata and other), the operation handle includes a boolean flag indicating whether the statement returns a resultset. In case of async execution, that's always set to false. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thejas M Nair updated HIVE-5364:
Resolution: Fixed
Status: Resolved (was: Patch Available)
Patch committed to 0.12 branch and trunk.
Thanks for the contribution Owen, and thanks for the review Gunther!
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thejas M Nair updated HIVE-5364:
Fix Version/s: 0.12.0
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Resolved] (HIVE-5401) Array Out Of Bounds in OrcRecordReader
[
https://issues.apache.org/jira/browse/HIVE-5401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thejas M Nair resolved HIVE-5401.
-
Resolution: Fixed
Fixed as part of HIVE-5364
Array Out Of Bounds in OrcRecordReader
--
Key: HIVE-5401
URL: https://issues.apache.org/jira/browse/HIVE-5401
Project: Hive
Issue Type: Bug
Components: File Formats
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
On trunk
{code}
create table A (
id int,
msg1 string
msg2 string
msg3 string
) partitioned by )
year int,
month int,
day int) stored as orc;
{code}
if field msg2 contains empty value, then query fails:
select id, msg2 from a where day=15
{code}
Error: java.io.IOException: java.lang.reflect.InvocationTargetException
at
org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderCreationException(HiveIOExceptionHandlerChain.java:97)
at
org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderCreationException(HiveIOExceptionHandlerUtil.java:57)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.initNextRecordReader(HadoopShimsSecure.java:343)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.init(HadoopShimsSecure.java:290)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getRecordReader(HadoopShimsSecure.java:404)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:544)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.init(MapTask.java:167)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:408)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.initNextRecordReader(HadoopShimsSecure.java:329)
... 11 more
Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.pickRowGroups(RecordReaderImpl.java:1675)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.readStripe(RecordReaderImpl.java:1720)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceStripe(RecordReaderImpl.java:2109)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.advanceToNextRow(RecordReaderImpl.java:2151)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.init(RecordReaderImpl.java:129)
at org.apache.hadoop.hive.ql.io.orc.ReaderImpl.rows(ReaderImpl.java:333)
at
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.init(OrcInputFormat.java:98)
at
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:203)
at
org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.init(CombineHiveRecordReader.java:65)
... 16 more
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HIVE-5441) Async query execution doesn't return resultset status
[ https://issues.apache.org/jira/browse/HIVE-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad Mujumdar updated HIVE-5441: -- Attachment: HIVE-5441.1.patch Async query execution doesn't return resultset status - Key: HIVE-5441 URL: https://issues.apache.org/jira/browse/HIVE-5441 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Prasad Mujumdar Assignee: Prasad Mujumdar Attachments: HIVE-5441.1.patch For synchronous statement execution (SQL as well as metadata and other), the operation handle includes a boolean flag indicating whether the statement returns a resultset. In case of async execution, that's always set to false. -- This message was sent by Atlassian JIRA (v6.1#6144)
Review Request 14486: HIVE-5441: Async query execution doesn't return resultset status
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14486/ --- Review request for hive. Bugs: HIVE-5441 https://issues.apache.org/jira/browse/HIVE-5441 Repository: hive-git Description --- Separate out the query compilation and execute that part synchronously. Diffs - ql/src/java/org/apache/hadoop/hive/ql/Driver.java 5308e2c service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java bb0f711 service/src/test/org/apache/hive/service/cli/CLIServiceTest.java 794ede8 Diff: https://reviews.apache.org/r/14486/diff/ Testing --- Added test cases Thanks, Prasad Mujumdar
[jira] [Commented] (HIVE-5441) Async query execution doesn't return resultset status
[ https://issues.apache.org/jira/browse/HIVE-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13785983#comment-13785983 ] Prasad Mujumdar commented on HIVE-5441: --- Review request on https://reviews.apache.org/r/14486/ Async query execution doesn't return resultset status - Key: HIVE-5441 URL: https://issues.apache.org/jira/browse/HIVE-5441 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Prasad Mujumdar Assignee: Prasad Mujumdar Attachments: HIVE-5441.1.patch For synchronous statement execution (SQL as well as metadata and other), the operation handle includes a boolean flag indicating whether the statement returns a resultset. In case of async execution, that's always set to false. -- This message was sent by Atlassian JIRA (v6.1#6144)
Re: Review Request 14486: HIVE-5441: Async query execution doesn't return resultset status
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14486/ --- (Updated Oct. 4, 2013, 8:18 a.m.) Review request for hive. Changes --- Test update Bugs: HIVE-5441 https://issues.apache.org/jira/browse/HIVE-5441 Repository: hive-git Description --- Separate out the query compilation and execute that part synchronously. Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/Driver.java 5308e2c service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java bb0f711 service/src/test/org/apache/hive/service/cli/CLIServiceTest.java 794ede8 Diff: https://reviews.apache.org/r/14486/diff/ Testing --- Added test cases Thanks, Prasad Mujumdar
Re: Review Request 14486: HIVE-5441: Async query execution doesn't return resultset status
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14486/ --- (Updated Oct. 4, 2013, 8:19 a.m.) Review request for hive. Bugs: HIVE-5441 https://issues.apache.org/jira/browse/HIVE-5441 Repository: hive-git Description --- Separate out the query compilation and execute that part synchronously. Diffs - ql/src/java/org/apache/hadoop/hive/ql/Driver.java 5308e2c service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java bb0f711 service/src/test/org/apache/hive/service/cli/CLIServiceTest.java 794ede8 Diff: https://reviews.apache.org/r/14486/diff/ Testing --- Added test cases Thanks, Prasad Mujumdar
[jira] [Updated] (HIVE-5429) HiveVarcharWritable length not reset when value is changed
[ https://issues.apache.org/jira/browse/HIVE-5429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-5429: Fix Version/s: (was: 0.13.0) 0.12.0 HiveVarcharWritable length not reset when value is changed -- Key: HIVE-5429 URL: https://issues.apache.org/jira/browse/HIVE-5429 Project: Hive Issue Type: Bug Components: Types Reporter: Jason Dere Assignee: Jason Dere Fix For: 0.12.0 Attachments: HIVE-5429.1.patch HiveVarcharWritable has a field to save the character length when it is determined the first time. There are a couple of setter methods where this length field is not reset when the string value is changed. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5429) HiveVarcharWritable length not reset when value is changed
[ https://issues.apache.org/jira/browse/HIVE-5429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13785991#comment-13785991 ] Thejas M Nair commented on HIVE-5429: - Patch committed to 0.12 branch. HiveVarcharWritable length not reset when value is changed -- Key: HIVE-5429 URL: https://issues.apache.org/jira/browse/HIVE-5429 Project: Hive Issue Type: Bug Components: Types Reporter: Jason Dere Assignee: Jason Dere Fix For: 0.12.0 Attachments: HIVE-5429.1.patch HiveVarcharWritable has a field to save the character length when it is determined the first time. There are a couple of setter methods where this length field is not reset when the string value is changed. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5433) Fix varchar unit tests to work with hadoop-2.1.1
[ https://issues.apache.org/jira/browse/HIVE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-5433: Status: Open (was: Patch Available) Fix varchar unit tests to work with hadoop-2.1.1 Key: HIVE-5433 URL: https://issues.apache.org/jira/browse/HIVE-5433 Project: Hive Issue Type: Bug Components: Tests Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5433.1.patch, HIVE-5433.1.patch A few of the varchar tests fail when testing against hadoop-2.1.1. It looks like some of the input/output rows used in the tests need to be sorted so that the results look consistent across hadoop versions. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5433) Fix varchar unit tests to work with hadoop-2.1.1
[ https://issues.apache.org/jira/browse/HIVE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-5433: Attachment: HIVE-5433.1.patch reattaching file to kick off tests Fix varchar unit tests to work with hadoop-2.1.1 Key: HIVE-5433 URL: https://issues.apache.org/jira/browse/HIVE-5433 Project: Hive Issue Type: Bug Components: Tests Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5433.1.patch, HIVE-5433.1.patch A few of the varchar tests fail when testing against hadoop-2.1.1. It looks like some of the input/output rows used in the tests need to be sorted so that the results look consistent across hadoop versions. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5433) Fix varchar unit tests to work with hadoop-2.1.1
[ https://issues.apache.org/jira/browse/HIVE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-5433: Status: Patch Available (was: Open) Fix varchar unit tests to work with hadoop-2.1.1 Key: HIVE-5433 URL: https://issues.apache.org/jira/browse/HIVE-5433 Project: Hive Issue Type: Bug Components: Tests Reporter: Jason Dere Assignee: Jason Dere Attachments: HIVE-5433.1.patch, HIVE-5433.1.patch A few of the varchar tests fail when testing against hadoop-2.1.1. It looks like some of the input/output rows used in the tests need to be sorted so that the results look consistent across hadoop versions. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4542) TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
[
https://issues.apache.org/jira/browse/HIVE-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786007#comment-13786007
]
Hive QA commented on HIVE-4542:
---
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12606713/D13269.2.patch
{color:green}SUCCESS:{color} +1 4052 tests passed
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1028/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1028/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
---
Key: HIVE-4542
URL: https://issues.apache.org/jira/browse/HIVE-4542
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Vaibhav Gumashta
Attachments: D13269.1.patch, D13269.2.patch, HIVE-4542.1.patch,
HIVE-4542.2.patch
The check for database name in TestJdbcDriver2.testMetaDataGetSchemas fails
with the error -
{code}
junit.framework.ComparisonFailure: expected:...efault but was:...bname
{code}
ie, a database called dbname is found, which it does not expect. This failure
will happen depending on the order in which the function get the databases,
if default database is the first one, it succeeds.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Created] (HIVE-5442) Plumbing for map join in tez
Gunther Hagleitner created HIVE-5442: Summary: Plumbing for map join in tez Key: HIVE-5442 URL: https://issues.apache.org/jira/browse/HIVE-5442 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: tez-branch Need to set up some classes to differentiate how MR and tez load the hashtables for MapJoins. NO PRECOMMIT TESTS -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5442) Plumbing for map join in tez
[ https://issues.apache.org/jira/browse/HIVE-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-5442: - Attachment: HIVE-5442.1.patch Plumbing for map join in tez Key: HIVE-5442 URL: https://issues.apache.org/jira/browse/HIVE-5442 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: tez-branch Attachments: HIVE-5442.1.patch Need to set up some classes to differentiate how MR and tez load the hashtables for MapJoins. NO PRECOMMIT TESTS -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Resolved] (HIVE-5442) Plumbing for map join in tez
[ https://issues.apache.org/jira/browse/HIVE-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner resolved HIVE-5442. -- Resolution: Fixed Plumbing for map join in tez Key: HIVE-5442 URL: https://issues.apache.org/jira/browse/HIVE-5442 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: tez-branch Attachments: HIVE-5442.1.patch Need to set up some classes to differentiate how MR and tez load the hashtables for MapJoins. NO PRECOMMIT TESTS -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5442) Plumbing for map join in tez
[ https://issues.apache.org/jira/browse/HIVE-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786019#comment-13786019 ] Gunther Hagleitner commented on HIVE-5442: -- Committed to branch. Plumbing for map join in tez Key: HIVE-5442 URL: https://issues.apache.org/jira/browse/HIVE-5442 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: tez-branch Attachments: HIVE-5442.1.patch Need to set up some classes to differentiate how MR and tez load the hashtables for MapJoins. NO PRECOMMIT TESTS -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4690) stats_partscan_1.q makes different result with different hadhoop.mr.rev
[ https://issues.apache.org/jira/browse/HIVE-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786024#comment-13786024 ] Hudson commented on HIVE-4690: -- FAILURE: Integrated in Hive-trunk-h0.21 #2378 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2378/]) HIVE-4690 : stats_partscan_1.q makes different result with different hadhoop.mr.rev (Navis Brock Noland via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529037) * /hive/trunk/ql/src/test/queries/clientpositive/stats_partscan_1.q * /hive/trunk/ql/src/test/queries/clientpositive/stats_partscan_1_23.q * /hive/trunk/ql/src/test/results/clientpositive/stats_partscan_1.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats_partscan_1_23.q.out stats_partscan_1.q makes different result with different hadhoop.mr.rev Key: HIVE-4690 URL: https://issues.apache.org/jira/browse/HIVE-4690 Project: Hive Issue Type: Sub-task Affects Versions: 0.11.0 Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4690.2.patch, HIVE-4690.D11163.1.patch stats_partscan_1.q uses mapred.min/max.split.size and logs number of files, which can be different with different hadoop.mr.rev. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5429) HiveVarcharWritable length not reset when value is changed
[ https://issues.apache.org/jira/browse/HIVE-5429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786025#comment-13786025 ] Hudson commented on HIVE-5429: -- FAILURE: Integrated in Hive-trunk-h0.21 #2378 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2378/]) HIVE-5429 : HiveVarcharWritable length not reset when value is changed (Jason Dere via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529038) * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/type/TestHiveVarchar.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/io/HiveVarcharWritable.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/io/TestHiveVarcharWritable.java HiveVarcharWritable length not reset when value is changed -- Key: HIVE-5429 URL: https://issues.apache.org/jira/browse/HIVE-5429 Project: Hive Issue Type: Bug Components: Types Reporter: Jason Dere Assignee: Jason Dere Fix For: 0.12.0 Attachments: HIVE-5429.1.patch HiveVarcharWritable has a field to save the character length when it is determined the first time. There are a couple of setter methods where this length field is not reset when the string value is changed. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5419) Fix schema tool issues with Oracle metastore
[ https://issues.apache.org/jira/browse/HIVE-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786023#comment-13786023 ] Hudson commented on HIVE-5419: -- FAILURE: Integrated in Hive-branch-0.12-hadoop1 #9 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop1/9/]) HIVE-5419 : Fix schema tool issues with Oracle metastore (Prasad Mujumdar via Ashutosh Chauhan) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529047) * /hive/branches/branch-0.12/beeline/src/java/org/apache/hive/beeline/HiveSchemaHelper.java * /hive/branches/branch-0.12/beeline/src/java/org/apache/hive/beeline/HiveSchemaTool.java * /hive/branches/branch-0.12/beeline/src/test/org/apache/hive/beeline/src/test/TestSchemaTool.java * /hive/branches/branch-0.12/metastore/scripts/upgrade/oracle/014-HIVE-3764.oracle.sql * /hive/branches/branch-0.12/metastore/scripts/upgrade/oracle/hive-schema-0.12.0.oracle.sql * /hive/branches/branch-0.12/metastore/scripts/upgrade/oracle/upgrade-0.11.0-to-0.12.0.oracle.sql * /hive/branches/branch-0.12/metastore/scripts/upgrade/postgres/hive-schema-0.12.0.postgres.sql * /hive/branches/branch-0.12/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetastoreVersion.java Fix schema tool issues with Oracle metastore - Key: HIVE-5419 URL: https://issues.apache.org/jira/browse/HIVE-5419 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.12.0, 0.13.0 Reporter: Prasad Mujumdar Assignee: Prasad Mujumdar Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5419.1.patch Address oracle schema upgrade script issue in 0.12 and trunk (0.13) -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5426) TestThriftBinaryCLIService tests fail on branch 0.12
[ https://issues.apache.org/jira/browse/HIVE-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786036#comment-13786036 ] Hudson commented on HIVE-5426: -- FAILURE: Integrated in Hive-branch-0.12-hadoop1 #10 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop1/10/]) HIVE-5426: TestThriftBinaryCLIService tests fail on branch 0.12 (Vaibhav Gumashta via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529064) * /hive/branches/branch-0.12/service/src/test/org/apache/hive/service/cli/CLIServiceTest.java * /hive/branches/branch-0.12/service/src/test/org/apache/hive/service/cli/thrift/ThriftCLIServiceTest.java TestThriftBinaryCLIService tests fail on branch 0.12 Key: HIVE-5426 URL: https://issues.apache.org/jira/browse/HIVE-5426 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Thejas M Nair Assignee: Vaibhav Gumashta Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5426.1.patch Two tests of TestThriftBinaryCLIService are failing in branch 0.12. See https://builds.apache.org/job/Hive-branch-0.12-hadoop1/lastCompletedBuild/testReport/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5394) ObjectInspectorConverters.getConvertedOI() does not return the correct object inspector for primitive type.
[ https://issues.apache.org/jira/browse/HIVE-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786032#comment-13786032 ] Hudson commented on HIVE-5394: -- FAILURE: Integrated in Hive-branch-0.12-hadoop1 #10 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop1/10/]) HIVE-5394 : ObjectInspectorConverters.getConvertedOI() does not return the correct object inspector for primitive type (add missing files) (Hari Sankar via Ashutosh Chauhan) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529056) * /hive/branches/branch-0.12/ql/src/test/queries/clientpositive/alter_varchar2.q * /hive/branches/branch-0.12/ql/src/test/results/clientpositive/alter_varchar2.q.out HIVE-5394 : ObjectInspectorConverters.getConvertedOI() does not return the correct object inspector for primitive type. (Hari Sankar via Ashutosh Chauhan) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529053) * /hive/branches/branch-0.12/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorConverters.java * /hive/branches/branch-0.12/serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestObjectInspectorConverters.java ObjectInspectorConverters.getConvertedOI() does not return the correct object inspector for primitive type. --- Key: HIVE-5394 URL: https://issues.apache.org/jira/browse/HIVE-5394 Project: Hive Issue Type: Bug Affects Versions: 0.12.0 Reporter: Hari Sankar Sivarama Subramaniyan Assignee: Hari Sankar Sivarama Subramaniyan Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5394.12.branch.txt, HIVE-5394.1.patch, HIVE-5394.2.patch.txt, HIVE-5394.3.patch The code currently returns settable type of the input primitive object inspector where as it should return settable type of output object inspector -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4690) stats_partscan_1.q makes different result with different hadhoop.mr.rev
[ https://issues.apache.org/jira/browse/HIVE-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786033#comment-13786033 ] Hudson commented on HIVE-4690: -- FAILURE: Integrated in Hive-branch-0.12-hadoop1 #10 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop1/10/]) HIVE-4690 : stats_partscan_1.q makes different result with different hadhoop.mr.rev (add missing files) (Navis Brock Noland via Ashutosh Chauhan) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529055) * /hive/branches/branch-0.12/ql/src/test/queries/clientpositive/stats_partscan_1_23.q * /hive/branches/branch-0.12/ql/src/test/results/clientpositive/stats_partscan_1_23.q.out HIVE-4690 : stats_partscan_1.q makes different result with different hadhoop.mr.rev (Navis Brock Noland via Ashutosh Chauhan) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529054) * /hive/branches/branch-0.12/ql/src/test/queries/clientpositive/stats_partscan_1.q * /hive/branches/branch-0.12/ql/src/test/results/clientpositive/stats_partscan_1.q.out stats_partscan_1.q makes different result with different hadhoop.mr.rev Key: HIVE-4690 URL: https://issues.apache.org/jira/browse/HIVE-4690 Project: Hive Issue Type: Sub-task Affects Versions: 0.11.0 Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4690.2.patch, HIVE-4690.D11163.1.patch stats_partscan_1.q uses mapred.min/max.split.size and logs number of files, which can be different with different hadoop.mr.rev. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5429) HiveVarcharWritable length not reset when value is changed
[ https://issues.apache.org/jira/browse/HIVE-5429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786034#comment-13786034 ] Hudson commented on HIVE-5429: -- FAILURE: Integrated in Hive-branch-0.12-hadoop1 #10 (See [https://builds.apache.org/job/Hive-branch-0.12-hadoop1/10/]) HIVE-5429 : HiveVarcharWritable length not reset when value is changed (Jason Dere via Ashutosh Chauhan) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529057) * /hive/branches/branch-0.12/common/src/test/org/apache/hadoop/hive/common/type/TestHiveVarchar.java * /hive/branches/branch-0.12/serde/src/java/org/apache/hadoop/hive/serde2/io/HiveVarcharWritable.java * /hive/branches/branch-0.12/serde/src/test/org/apache/hadoop/hive/serde2/io/TestHiveVarcharWritable.java HiveVarcharWritable length not reset when value is changed -- Key: HIVE-5429 URL: https://issues.apache.org/jira/browse/HIVE-5429 Project: Hive Issue Type: Bug Components: Types Reporter: Jason Dere Assignee: Jason Dere Fix For: 0.12.0 Attachments: HIVE-5429.1.patch HiveVarcharWritable has a field to save the character length when it is determined the first time. There are a couple of setter methods where this length field is not reset when the string value is changed. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786035#comment-13786035
]
Hudson commented on HIVE-5364:
--
FAILURE: Integrated in Hive-branch-0.12-hadoop1 #10 (See
[https://builds.apache.org/job/Hive-branch-0.12-hadoop1/10/])
HIVE-5364 : NPE on some queries from partitioned orc table (Owen O'Malley via
Gunther Hagleitner) (thejas:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529098)
* /hive/branches/branch-0.12/data/files/orc_create_people.txt
*
/hive/branches/branch-0.12/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
*
/hive/branches/branch-0.12/ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java
* /hive/branches/branch-0.12/ql/src/test/queries/clientpositive/orc_create.q
* /hive/branches/branch-0.12/ql/src/test/results/clientpositive/orc_create.q.out
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5422) Upgrade Kyro to 2.22 now that it is released
[
https://issues.apache.org/jira/browse/HIVE-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786048#comment-13786048
]
Hive QA commented on HIVE-5422:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12606603/HIVE-5422.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 4051 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1029/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1029/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
Upgrade Kyro to 2.22 now that it is released
Key: HIVE-5422
URL: https://issues.apache.org/jira/browse/HIVE-5422
Project: Hive
Issue Type: Bug
Reporter: Brock Noland
Assignee: Brock Noland
Attachments: HIVE-5422.patch, HIVE-5422.patch
As noted
[here|https://issues.apache.org/jira/browse/HIVE-1511?focusedCommentId=13783990page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13783990]
v2.22 has been released. We should upgrade to that version as opposed to
using the snapshot.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5235) Infinite loop with ORC file and Hive 0.11
[
https://issues.apache.org/jira/browse/HIVE-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786053#comment-13786053
]
Pere Ferrera Bertran commented on HIVE-5235:
The data is not generated. But the data is nothing special, as the same error
happened when using different days of data.
I sent the corrupted ORC file to Owen. It's just a bunch of Integer columns so
as I said nothing special.
Infinite loop with ORC file and Hive 0.11
-
Key: HIVE-5235
URL: https://issues.apache.org/jira/browse/HIVE-5235
Project: Hive
Issue Type: Bug
Affects Versions: 0.11.0
Environment: Gentoo linux with Hortonworks Hadoop
hadoop-1.1.2.23.tar.gz and Apache Hive 0.11d
Reporter: Iván de Prado
Priority: Blocker
We are using Hive 0.11 with ORC file format and we get some tasks blocked in
some kind of infinite loop. They keep working indefinitely when we set a huge
task expiry timeout. If we the expiry time to 600 second, the taks fail
because of not reporting progress, and finally, the Job fails.
That is not consistent, and some times between jobs executions the behavior
changes. It happen for different queries.
We are using Hive 0.11 with Hadoop hadoop-1.1.2.23 from Hortonworks. The taks
that is blocked keeps consuming 100% of CPU usage, and the stack trace is
always the same consistently. Everything points to some kind of infinite
loop. My guessing is that it has some relation to the ORC file. Maybe some
pointer is not right when writing generating some kind of infinite loop when
reading. Or maybe there is a bug in the reading stage.
More information below. The stack trace:
{noformat}
main prio=10 tid=0x7f20a000a800 nid=0x1ed2 runnable [0x7f20a8136000]
java.lang.Thread.State: RUNNABLE
at java.util.zip.Inflater.inflateBytes(Native Method)
at java.util.zip.Inflater.inflate(Inflater.java:256)
- locked 0xf42a6ca0 (a java.util.zip.ZStreamRef)
at
org.apache.hadoop.hive.ql.io.orc.ZlibCodec.decompress(ZlibCodec.java:64)
at
org.apache.hadoop.hive.ql.io.orc.InStream$CompressedStream.readHeader(InStream.java:128)
at
org.apache.hadoop.hive.ql.io.orc.InStream$CompressedStream.read(InStream.java:143)
at
org.apache.hadoop.hive.ql.io.orc.SerializationUtils.readVulong(SerializationUtils.java:54)
at
org.apache.hadoop.hive.ql.io.orc.SerializationUtils.readVslong(SerializationUtils.java:65)
at
org.apache.hadoop.hive.ql.io.orc.RunLengthIntegerReader.readValues(RunLengthIntegerReader.java:66)
at
org.apache.hadoop.hive.ql.io.orc.RunLengthIntegerReader.next(RunLengthIntegerReader.java:81)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$IntTreeReader.next(RecordReaderImpl.java:332)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$StructTreeReader.next(RecordReaderImpl.java:802)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.next(RecordReaderImpl.java:1214)
at
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.next(OrcInputFormat.java:71)
at
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.next(OrcInputFormat.java:46)
at
org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:274)
at
org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:101)
at
org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:41)
at
org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:108)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.doNextWithExceptionHandler(HadoopShimsSecure.java:300)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.next(HadoopShimsSecure.java:218)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:236)
- eliminated 0xe1459700 (a
org.apache.hadoop.mapred.MapTask$TrackedRecordReader)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:216)
- locked 0xe1459700 (a
org.apache.hadoop.mapred.MapTask$TrackedRecordReader)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1178)
at
[jira] [Commented] (HIVE-4160) Vectorized Query Execution in Hive
[
https://issues.apache.org/jira/browse/HIVE-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786080#comment-13786080
]
Lars Francke commented on HIVE-4160:
This is a huge patch and it's hard to see if it changes anything for the end
user. As we'd like to keep the Wiki up-to-date it'd be great if someone could
comment whether there are any configuration options besides
{{hive.vectorized.execution.enabled}} or any other things that should be
documented.
Thanks!
Vectorized Query Execution in Hive
--
Key: HIVE-4160
URL: https://issues.apache.org/jira/browse/HIVE-4160
Project: Hive
Issue Type: New Feature
Reporter: Jitendra Nath Pandey
Assignee: Jitendra Nath Pandey
Attachments: Hive-Vectorized-Query-Execution-Design.docx,
Hive-Vectorized-Query-Execution-Design-rev10.docx,
Hive-Vectorized-Query-Execution-Design-rev10.docx,
Hive-Vectorized-Query-Execution-Design-rev10.pdf,
Hive-Vectorized-Query-Execution-Design-rev11.docx,
Hive-Vectorized-Query-Execution-Design-rev11.pdf,
Hive-Vectorized-Query-Execution-Design-rev2.docx,
Hive-Vectorized-Query-Execution-Design-rev3.docx,
Hive-Vectorized-Query-Execution-Design-rev3.docx,
Hive-Vectorized-Query-Execution-Design-rev3.pdf,
Hive-Vectorized-Query-Execution-Design-rev4.docx,
Hive-Vectorized-Query-Execution-Design-rev4.pdf,
Hive-Vectorized-Query-Execution-Design-rev5.docx,
Hive-Vectorized-Query-Execution-Design-rev5.pdf,
Hive-Vectorized-Query-Execution-Design-rev6.docx,
Hive-Vectorized-Query-Execution-Design-rev6.pdf,
Hive-Vectorized-Query-Execution-Design-rev7.docx,
Hive-Vectorized-Query-Execution-Design-rev8.docx,
Hive-Vectorized-Query-Execution-Design-rev8.pdf,
Hive-Vectorized-Query-Execution-Design-rev9.docx,
Hive-Vectorized-Query-Execution-Design-rev9.pdf
The Hive query execution engine currently processes one row at a time. A
single row of data goes through all the operators before the next row can be
processed. This mode of processing is very inefficient in terms of CPU usage.
Research has demonstrated that this yields very low instructions per cycle
[MonetDB X100]. Also currently Hive heavily relies on lazy deserialization
and data columns go through a layer of object inspectors that identify column
type, deserialize data and determine appropriate expression routines in the
inner loop. These layers of virtual method calls further slow down the
processing.
This work will add support for vectorized query execution to Hive, where,
instead of individual rows, batches of about a thousand rows at a time are
processed. Each column in the batch is represented as a vector of a primitive
data type. The inner loop of execution scans these vectors very fast,
avoiding method calls, deserialization, unnecessary if-then-else, etc. This
substantially reduces CPU time used, and gives excellent instructions per
cycle (i.e. improved processor pipeline utilization). See the attached design
specification for more details.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5440) HiveServer2 doesn't apply SQL operation's config property
[
https://issues.apache.org/jira/browse/HIVE-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786089#comment-13786089
]
Hive QA commented on HIVE-5440:
---
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12606746/HIVE-5440.1.patch
{color:green}SUCCESS:{color} +1 4052 tests passed
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1030/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1030/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
HiveServer2 doesn't apply SQL operation's config property
--
Key: HIVE-5440
URL: https://issues.apache.org/jira/browse/HIVE-5440
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 0.12.0
Reporter: Prasad Mujumdar
Assignee: Prasad Mujumdar
Attachments: HIVE-5440.1.patch
The HiveServer2 thrift IDL includes an optional config overlay map which is
currently not used.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HIVE-5422) Upgrade Kyro to 2.22 now that it is released
[ https://issues.apache.org/jira/browse/HIVE-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5422: --- Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Brock! Upgrade Kyro to 2.22 now that it is released Key: HIVE-5422 URL: https://issues.apache.org/jira/browse/HIVE-5422 Project: Hive Issue Type: Bug Reporter: Brock Noland Assignee: Brock Noland Fix For: 0.13.0 Attachments: HIVE-5422.patch, HIVE-5422.patch As noted [here|https://issues.apache.org/jira/browse/HIVE-1511?focusedCommentId=13783990page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13783990] v2.22 has been released. We should upgrade to that version as opposed to using the snapshot. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-4542) TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
[
https://issues.apache.org/jira/browse/HIVE-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-4542:
---
Resolution: Fixed
Fix Version/s: 0.13.0
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks, Vaibhav Thejas!
TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
---
Key: HIVE-4542
URL: https://issues.apache.org/jira/browse/HIVE-4542
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: D13269.1.patch, D13269.2.patch, HIVE-4542.1.patch,
HIVE-4542.2.patch
The check for database name in TestJdbcDriver2.testMetaDataGetSchemas fails
with the error -
{code}
junit.framework.ComparisonFailure: expected:...efault but was:...bname
{code}
ie, a database called dbname is found, which it does not expect. This failure
will happen depending on the order in which the function get the databases,
if default database is the first one, it succeeds.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5433) Fix varchar unit tests to work with hadoop-2.1.1
[
https://issues.apache.org/jira/browse/HIVE-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786147#comment-13786147
]
Hive QA commented on HIVE-5433:
---
{color:green}Overall{color}: +1 all checks pass
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12606758/HIVE-5433.1.patch
{color:green}SUCCESS:{color} +1 4051 tests passed
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1031/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1031/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
Fix varchar unit tests to work with hadoop-2.1.1
Key: HIVE-5433
URL: https://issues.apache.org/jira/browse/HIVE-5433
Project: Hive
Issue Type: Bug
Components: Tests
Reporter: Jason Dere
Assignee: Jason Dere
Attachments: HIVE-5433.1.patch, HIVE-5433.1.patch
A few of the varchar tests fail when testing against hadoop-2.1.1. It looks
like some of the input/output rows used in the tests need to be sorted so
that the results look consistent across hadoop versions.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-4388) HBase tests fail against Hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786154#comment-13786154 ] Ashutosh Chauhan commented on HIVE-4388: Any update on this? [~sushanth] / [~brocknoland] ? HBase tests fail against Hadoop 2 - Key: HIVE-4388 URL: https://issues.apache.org/jira/browse/HIVE-4388 Project: Hive Issue Type: Bug Components: HBase Handler Reporter: Gunther Hagleitner Assignee: Brock Noland Attachments: HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388-wip.txt Currently we're building by default against 0.92. When you run against hadoop 2 (-Dhadoop.mr.rev=23) builds fail because of: HBASE-5963. HIVE-3861 upgrades the version of hbase used. This will get you past the problem in HBASE-5963 (which was fixed in 0.94.1) but fails with: HBASE-6396. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4856) Upgrade HCat to 2.0.5-alpha
[ https://issues.apache.org/jira/browse/HIVE-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786156#comment-13786156 ] Ashutosh Chauhan commented on HIVE-4856: Is this still required given that Hive itself has moved to 2.1.0-beta? Upgrade HCat to 2.0.5-alpha --- Key: HIVE-4856 URL: https://issues.apache.org/jira/browse/HIVE-4856 Project: Hive Issue Type: Task Components: HCatalog Reporter: Brock Noland In HIVE-4756 we upgraded Hive to 2.0.5-alpha. I see that HCat specifies it's deps differently. We should probably keep them on the same version of Hadoop. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-4690) stats_partscan_1.q makes different result with different hadhoop.mr.rev
[ https://issues.apache.org/jira/browse/HIVE-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4690: --- Resolution: Fixed Status: Resolved (was: Patch Available) stats_partscan_1.q makes different result with different hadhoop.mr.rev Key: HIVE-4690 URL: https://issues.apache.org/jira/browse/HIVE-4690 Project: Hive Issue Type: Sub-task Affects Versions: 0.11.0 Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4690.2.patch, HIVE-4690.D11163.1.patch stats_partscan_1.q uses mapred.min/max.split.size and logs number of files, which can be different with different hadoop.mr.rev. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5372) Refactor TypeInfo and PrimitiveTypeEntry class hierachy to eliminate info repetition
[ https://issues.apache.org/jira/browse/HIVE-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-5372: -- Status: Patch Available (was: Open) Refactor TypeInfo and PrimitiveTypeEntry class hierachy to eliminate info repetition Key: HIVE-5372 URL: https://issues.apache.org/jira/browse/HIVE-5372 Project: Hive Issue Type: Improvement Components: Types Affects Versions: 0.12.0 Reporter: Xuefu Zhang Assignee: Xuefu Zhang Fix For: 0.13.0 Attachments: HIVE-5372.patch TypeInfo with its sub-classes and PrimititiveTypeEntry class seem having repetitive information, such as type names and type params. It will be good if we can streamline the information organization. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Resolved] (HIVE-3949) Some test failures in hadoop 23
[ https://issues.apache.org/jira/browse/HIVE-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved HIVE-3949. Resolution: Fixed Fix Version/s: 0.13.0 Marking this as resolved since all linked subtasks are now complete. HIVE-4388 tracks hbase failures. Some test failures in hadoop 23 --- Key: HIVE-3949 URL: https://issues.apache.org/jira/browse/HIVE-3949 Project: Hive Issue Type: Bug Reporter: Gang Tim Liu Assignee: Brock Noland Fix For: 0.13.0 This is follow up on hive-3873. We have fixed some test failures in 3873 and a few other jira issues. We will use this jira to track the rest failures: https://builds.apache.org/job/Hive-trunk-hadoop2/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4388) HBase tests fail against Hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786164#comment-13786164 ] Brock Noland commented on HIVE-4388: I assume that [~sushanth]'s patch is closer to a committable state. Is there anyway I can help worth through the hbase api changes? HBase tests fail against Hadoop 2 - Key: HIVE-4388 URL: https://issues.apache.org/jira/browse/HIVE-4388 Project: Hive Issue Type: Bug Components: HBase Handler Reporter: Gunther Hagleitner Assignee: Brock Noland Attachments: HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388-wip.txt Currently we're building by default against 0.92. When you run against hadoop 2 (-Dhadoop.mr.rev=23) builds fail because of: HBASE-5963. HIVE-3861 upgrades the version of hbase used. This will get you past the problem in HBASE-5963 (which was fixed in 0.94.1) but fails with: HBASE-6396. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4388) HBase tests fail against Hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786166#comment-13786166 ] Ashutosh Chauhan commented on HIVE-4388: Looks like hbase-0.96 is not released yet. HBase tests fail against Hadoop 2 - Key: HIVE-4388 URL: https://issues.apache.org/jira/browse/HIVE-4388 Project: Hive Issue Type: Bug Components: HBase Handler Reporter: Gunther Hagleitner Assignee: Brock Noland Attachments: HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388-wip.txt Currently we're building by default against 0.92. When you run against hadoop 2 (-Dhadoop.mr.rev=23) builds fail because of: HBASE-5963. HIVE-3861 upgrades the version of hbase used. This will get you past the problem in HBASE-5963 (which was fixed in 0.94.1) but fails with: HBASE-6396. -- This message was sent by Atlassian JIRA (v6.1#6144)
Review Request 14490: HIVE-5372: Refactor TypeInfo and PrimitiveTypeEntry class hierachy to eliminate info repetition
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14490/ --- Review request for hive and Ashutosh Chauhan. Bugs: HIVE-5372 https://issues.apache.org/jira/browse/HIVE-5372 Repository: hive-git Description --- See JIRA comment https://issues.apache.org/jira/browse/HIVE-5372?focusedCommentId=13785506page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13785506 Diffs - contrib/src/java/org/apache/hadoop/hive/contrib/util/typedbytes/TypedBytesRecordReader.java 8fcb3b3 ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java f8d1483 ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcStruct.java eb10360 ql/src/java/org/apache/hadoop/hive/ql/io/orc/WriterImpl.java 628efab ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 36034d6 ql/src/java/org/apache/hadoop/hive/ql/parse/ParseUtils.java c8c5f63 ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java af51072 ql/src/java/org/apache/hadoop/hive/ql/plan/ExprNodeConstantDesc.java 6538add ql/src/java/org/apache/hadoop/hive/ql/udf/SettableUDF.java 9225aa1 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFConcat.java 0ce1825 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLower.java 366d9e6 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFReflect2.java 5ba2ec5 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFToVarchar.java 509a392 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFUpper.java 1bb164a ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFUtils.java 6815195 serde/src/java/org/apache/hadoop/hive/serde2/RegexSerDe.java 5de5bd5 serde/src/java/org/apache/hadoop/hive/serde2/binarysortable/BinarySortableSerDe.java a206023 serde/src/java/org/apache/hadoop/hive/serde2/dynamic_type/DynamicSerDe.java ac81ab8 serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java 67f032c serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyHiveVarchar.java 1286cba serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java 214a3e7 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/AbstractPrimitiveLazyObjectInspector.java 29c8528 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyBinaryObjectInspector.java dbd60f7 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyBooleanObjectInspector.java 954f1d9 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyByteObjectInspector.java 57c5169 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyDateObjectInspector.java 679e5ea serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyDoubleObjectInspector.java 675333a serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyFloatObjectInspector.java 648b629 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyHiveDecimalObjectInspector.java 564a1aa serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyHiveVarcharObjectInspector.java e827e09 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyIntObjectInspector.java 81f6f05 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyLongObjectInspector.java 9455fbf serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyPrimitiveObjectInspectorFactory.java e28eef7 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyShortObjectInspector.java 78aba36 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyStringObjectInspector.java 2f31d18 serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyTimestampObjectInspector.java cc68e4f serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyVoidObjectInspector.java 019653a serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryHiveVarchar.java fb1b0ea serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorConverters.java c711c62 serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorUtils.java 404ce78 serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/PrimitiveObjectInspector.java 21947ff serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/AbstractPrimitiveJavaObjectInspector.java b2ae767 serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/AbstractPrimitiveObjectInspector.java af4109b serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/AbstractPrimitiveWritableObjectInspector.java
[jira] [Commented] (HIVE-5372) Refactor TypeInfo and PrimitiveTypeEntry class hierachy to eliminate info repetition
[ https://issues.apache.org/jira/browse/HIVE-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786170#comment-13786170 ] Ashutosh Chauhan commented on HIVE-5372: Good work, [~xuefuz] ! I will review it soon. [~jdere] It will be good that you also take a look. We want to get this patch in sooner than later since these large refactors tend to get stale pretty quickly. Refactor TypeInfo and PrimitiveTypeEntry class hierachy to eliminate info repetition Key: HIVE-5372 URL: https://issues.apache.org/jira/browse/HIVE-5372 Project: Hive Issue Type: Improvement Components: Types Affects Versions: 0.12.0 Reporter: Xuefu Zhang Assignee: Xuefu Zhang Fix For: 0.13.0 Attachments: HIVE-5372.patch TypeInfo with its sub-classes and PrimititiveTypeEntry class seem having repetitive information, such as type names and type params. It will be good if we can streamline the information organization. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HIVE-5443) Few hadoop2 .q.out needs to be updated
Ashutosh Chauhan created HIVE-5443: -- Summary: Few hadoop2 .q.out needs to be updated Key: HIVE-5443 URL: https://issues.apache.org/jira/browse/HIVE-5443 Project: Hive Issue Type: Task Affects Versions: 0.13.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan These hadoop2 only tests were not updated in HIVE-5223 -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5443) Few hadoop2 .q.out needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5443: --- Status: Patch Available (was: Open) Few hadoop2 .q.out needs to be updated -- Key: HIVE-5443 URL: https://issues.apache.org/jira/browse/HIVE-5443 Project: Hive Issue Type: Task Affects Versions: 0.13.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-5443.patch These hadoop2 only tests were not updated in HIVE-5223 -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5443) Few hadoop2 .q.out needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5443: --- Attachment: HIVE-5443.patch Only .q.out file changes Few hadoop2 .q.out needs to be updated -- Key: HIVE-5443 URL: https://issues.apache.org/jira/browse/HIVE-5443 Project: Hive Issue Type: Task Affects Versions: 0.13.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-5443.patch These hadoop2 only tests were not updated in HIVE-5223 -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5443) Few hadoop2 .q.out needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786204#comment-13786204 ] Brock Noland commented on HIVE-5443: +1 assuming tests pass Few hadoop2 .q.out needs to be updated -- Key: HIVE-5443 URL: https://issues.apache.org/jira/browse/HIVE-5443 Project: Hive Issue Type: Task Affects Versions: 0.13.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-5443.patch These hadoop2 only tests were not updated in HIVE-5223 -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5395) Various cleanup in ptf code
[ https://issues.apache.org/jira/browse/HIVE-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5395: --- Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available) Committed to trunk! Thank you very much for your contribution Edward! Various cleanup in ptf code --- Key: HIVE-5395 URL: https://issues.apache.org/jira/browse/HIVE-5395 Project: Hive Issue Type: Improvement Reporter: Edward Capriolo Assignee: Edward Capriolo Fix For: 0.13.0 Attachments: HIVE-5395.1.patch.txt, HIVE-5395.2.patch.txt, HIVE-5395.3.patch.txt, HIVE-5395.4.patch.txt Some minor issues: Implementing classes on left side of equals Stack used instead of ArrayDeque Classes defined statically inside other files (when they do not need to be Checkstyle errors like indenting -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4690) stats_partscan_1.q makes different result with different hadhoop.mr.rev
[ https://issues.apache.org/jira/browse/HIVE-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786210#comment-13786210 ] Hudson commented on HIVE-4690: -- FAILURE: Integrated in Hive-trunk-hadoop2 #474 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/474/]) HIVE-4690 : stats_partscan_1.q makes different result with different hadhoop.mr.rev (Navis Brock Noland via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529037) * /hive/trunk/ql/src/test/queries/clientpositive/stats_partscan_1.q * /hive/trunk/ql/src/test/queries/clientpositive/stats_partscan_1_23.q * /hive/trunk/ql/src/test/results/clientpositive/stats_partscan_1.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats_partscan_1_23.q.out stats_partscan_1.q makes different result with different hadhoop.mr.rev Key: HIVE-4690 URL: https://issues.apache.org/jira/browse/HIVE-4690 Project: Hive Issue Type: Sub-task Affects Versions: 0.11.0 Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4690.2.patch, HIVE-4690.D11163.1.patch stats_partscan_1.q uses mapred.min/max.split.size and logs number of files, which can be different with different hadoop.mr.rev. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5429) HiveVarcharWritable length not reset when value is changed
[ https://issues.apache.org/jira/browse/HIVE-5429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786211#comment-13786211 ] Hudson commented on HIVE-5429: -- FAILURE: Integrated in Hive-trunk-hadoop2 #474 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/474/]) HIVE-5429 : HiveVarcharWritable length not reset when value is changed (Jason Dere via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529038) * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/type/TestHiveVarchar.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/io/HiveVarcharWritable.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/io/TestHiveVarcharWritable.java HiveVarcharWritable length not reset when value is changed -- Key: HIVE-5429 URL: https://issues.apache.org/jira/browse/HIVE-5429 Project: Hive Issue Type: Bug Components: Types Reporter: Jason Dere Assignee: Jason Dere Fix For: 0.12.0 Attachments: HIVE-5429.1.patch HiveVarcharWritable has a field to save the character length when it is determined the first time. There are a couple of setter methods where this length field is not reset when the string value is changed. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5443) Few hadoop2 .q.out needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-5443: --- Attachment: HIVE-5443.2.patch There are few more. Few hadoop2 .q.out needs to be updated -- Key: HIVE-5443 URL: https://issues.apache.org/jira/browse/HIVE-5443 Project: Hive Issue Type: Task Affects Versions: 0.13.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-5443.2.patch, HIVE-5443.patch These hadoop2 only tests were not updated in HIVE-5223 -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5422) Upgrade Kyro to 2.22 now that it is released
[ https://issues.apache.org/jira/browse/HIVE-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786219#comment-13786219 ] Hudson commented on HIVE-5422: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #124 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/124/]) HIVE-5422 : Upgrade Kyro to 2.22 now that it is released (Brock Noland via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529158) * /hive/trunk/build.xml * /hive/trunk/hcatalog/pom.xml * /hive/trunk/ivy/ivysettings.xml * /hive/trunk/ivy/libraries.properties Upgrade Kyro to 2.22 now that it is released Key: HIVE-5422 URL: https://issues.apache.org/jira/browse/HIVE-5422 Project: Hive Issue Type: Bug Reporter: Brock Noland Assignee: Brock Noland Fix For: 0.13.0 Attachments: HIVE-5422.patch, HIVE-5422.patch As noted [here|https://issues.apache.org/jira/browse/HIVE-1511?focusedCommentId=13783990page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13783990] v2.22 has been released. We should upgrade to that version as opposed to using the snapshot. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4690) stats_partscan_1.q makes different result with different hadhoop.mr.rev
[ https://issues.apache.org/jira/browse/HIVE-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786221#comment-13786221 ] Hudson commented on HIVE-4690: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #124 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/124/]) HIVE-4690 : stats_partscan_1.q makes different result with different hadhoop.mr.rev (Navis Brock Noland via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529037) * /hive/trunk/ql/src/test/queries/clientpositive/stats_partscan_1.q * /hive/trunk/ql/src/test/queries/clientpositive/stats_partscan_1_23.q * /hive/trunk/ql/src/test/results/clientpositive/stats_partscan_1.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats_partscan_1_23.q.out stats_partscan_1.q makes different result with different hadhoop.mr.rev Key: HIVE-4690 URL: https://issues.apache.org/jira/browse/HIVE-4690 Project: Hive Issue Type: Sub-task Affects Versions: 0.11.0 Reporter: Navis Assignee: Navis Priority: Trivial Fix For: 0.12.0 Attachments: HIVE-4690.2.patch, HIVE-4690.D11163.1.patch stats_partscan_1.q uses mapred.min/max.split.size and logs number of files, which can be different with different hadoop.mr.rev. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5429) HiveVarcharWritable length not reset when value is changed
[ https://issues.apache.org/jira/browse/HIVE-5429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786222#comment-13786222 ] Hudson commented on HIVE-5429: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #124 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/124/]) HIVE-5429 : HiveVarcharWritable length not reset when value is changed (Jason Dere via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529038) * /hive/trunk/common/src/test/org/apache/hadoop/hive/common/type/TestHiveVarchar.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/io/HiveVarcharWritable.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/io/TestHiveVarcharWritable.java HiveVarcharWritable length not reset when value is changed -- Key: HIVE-5429 URL: https://issues.apache.org/jira/browse/HIVE-5429 Project: Hive Issue Type: Bug Components: Types Reporter: Jason Dere Assignee: Jason Dere Fix For: 0.12.0 Attachments: HIVE-5429.1.patch HiveVarcharWritable has a field to save the character length when it is determined the first time. There are a couple of setter methods where this length field is not reset when the string value is changed. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5426) TestThriftBinaryCLIService tests fail on branch 0.12
[ https://issues.apache.org/jira/browse/HIVE-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786224#comment-13786224 ] Hudson commented on HIVE-5426: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #124 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/124/]) HIVE-5426: TestThriftBinaryCLIService tests fail on branch 0.12 (Vaibhav Gumashta via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529063) * /hive/trunk/service/src/test/org/apache/hive/service/cli/CLIServiceTest.java * /hive/trunk/service/src/test/org/apache/hive/service/cli/thrift/ThriftCLIServiceTest.java TestThriftBinaryCLIService tests fail on branch 0.12 Key: HIVE-5426 URL: https://issues.apache.org/jira/browse/HIVE-5426 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Thejas M Nair Assignee: Vaibhav Gumashta Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5426.1.patch Two tests of TestThriftBinaryCLIService are failing in branch 0.12. See https://builds.apache.org/job/Hive-branch-0.12-hadoop1/lastCompletedBuild/testReport/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786223#comment-13786223
]
Hudson commented on HIVE-5364:
--
FAILURE: Integrated in Hive-trunk-hadoop2-ptest #124 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/124/])
HIVE-5364 : NPE on some queries from partitioned orc table (Owen O'Malley via
Gunther Hagleitner) (thejas:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529097)
* /hive/trunk/data/files/orc_create_people.txt
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java
* /hive/trunk/ql/src/test/queries/clientpositive/orc_create.q
* /hive/trunk/ql/src/test/results/clientpositive/orc_create.q.out
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-4542) TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
[
https://issues.apache.org/jira/browse/HIVE-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786220#comment-13786220
]
Hudson commented on HIVE-4542:
--
FAILURE: Integrated in Hive-trunk-hadoop2-ptest #124 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/124/])
HIVE-4542 : TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected
database (Vaibhav Gumashta Thejas Nair via Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529161)
* /hive/trunk/jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java
*
/hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker.java
TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
---
Key: HIVE-4542
URL: https://issues.apache.org/jira/browse/HIVE-4542
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: D13269.1.patch, D13269.2.patch, HIVE-4542.1.patch,
HIVE-4542.2.patch
The check for database name in TestJdbcDriver2.testMetaDataGetSchemas fails
with the error -
{code}
junit.framework.ComparisonFailure: expected:...efault but was:...bname
{code}
ie, a database called dbname is found, which it does not expect. This failure
will happen depending on the order in which the function get the databases,
if default database is the first one, it succeeds.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786234#comment-13786234
]
Hudson commented on HIVE-5364:
--
FAILURE: Integrated in Hive-trunk-hadoop2 #475 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2/475/])
HIVE-5364 : NPE on some queries from partitioned orc table (Owen O'Malley via
Gunther Hagleitner) (thejas:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529097)
* /hive/trunk/data/files/orc_create_people.txt
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java
* /hive/trunk/ql/src/test/queries/clientpositive/orc_create.q
* /hive/trunk/ql/src/test/results/clientpositive/orc_create.q.out
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-4388) HBase tests fail against Hadoop 2
[ https://issues.apache.org/jira/browse/HIVE-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786236#comment-13786236 ] Sushanth Sowmyan commented on HIVE-4388: Apologies on the delay on this, but with the hbase 0.96 #list api change back to the way it was, and HIVE-5112 being -1-ed for 0.12 and the number of other patches that caused conflicts with this, I'd put this on the back-burner. Given the bunch of other hbase-handler related changes, I think I still have something that's close to committable, but I'll need another day to get to this. I want to get a couple more last minute bugfixes into 0.12 first. :D HBase tests fail against Hadoop 2 - Key: HIVE-4388 URL: https://issues.apache.org/jira/browse/HIVE-4388 Project: Hive Issue Type: Bug Components: HBase Handler Reporter: Gunther Hagleitner Assignee: Brock Noland Attachments: HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388.patch, HIVE-4388-wip.txt Currently we're building by default against 0.92. When you run against hadoop 2 (-Dhadoop.mr.rev=23) builds fail because of: HBASE-5963. HIVE-3861 upgrades the version of hbase used. This will get you past the problem in HBASE-5963 (which was fixed in 0.94.1) but fails with: HBASE-6396. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5422) Upgrade Kyro to 2.22 now that it is released
[ https://issues.apache.org/jira/browse/HIVE-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786231#comment-13786231 ] Hudson commented on HIVE-5422: -- FAILURE: Integrated in Hive-trunk-hadoop2 #475 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/475/]) HIVE-5422 : Upgrade Kyro to 2.22 now that it is released (Brock Noland via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529158) * /hive/trunk/build.xml * /hive/trunk/hcatalog/pom.xml * /hive/trunk/ivy/ivysettings.xml * /hive/trunk/ivy/libraries.properties Upgrade Kyro to 2.22 now that it is released Key: HIVE-5422 URL: https://issues.apache.org/jira/browse/HIVE-5422 Project: Hive Issue Type: Bug Reporter: Brock Noland Assignee: Brock Noland Fix For: 0.13.0 Attachments: HIVE-5422.patch, HIVE-5422.patch As noted [here|https://issues.apache.org/jira/browse/HIVE-1511?focusedCommentId=13783990page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13783990] v2.22 has been released. We should upgrade to that version as opposed to using the snapshot. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4542) TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
[
https://issues.apache.org/jira/browse/HIVE-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786232#comment-13786232
]
Hudson commented on HIVE-4542:
--
FAILURE: Integrated in Hive-trunk-hadoop2 #475 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2/475/])
HIVE-4542 : TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected
database (Vaibhav Gumashta Thejas Nair via Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529161)
* /hive/trunk/jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java
*
/hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker.java
TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
---
Key: HIVE-4542
URL: https://issues.apache.org/jira/browse/HIVE-4542
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: D13269.1.patch, D13269.2.patch, HIVE-4542.1.patch,
HIVE-4542.2.patch
The check for database name in TestJdbcDriver2.testMetaDataGetSchemas fails
with the error -
{code}
junit.framework.ComparisonFailure: expected:...efault but was:...bname
{code}
ie, a database called dbname is found, which it does not expect. This failure
will happen depending on the order in which the function get the databases,
if default database is the first one, it succeeds.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5395) Various cleanup in ptf code
[ https://issues.apache.org/jira/browse/HIVE-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786233#comment-13786233 ] Hudson commented on HIVE-5395: -- FAILURE: Integrated in Hive-trunk-hadoop2 #475 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/475/]) HIVE-5395 - Various cleanup in ptf code (Edward Capriolo via Brock Noland) (brock: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529174) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/PTFOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/PTFInvocationSpec.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/PTFTranslator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PTFDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PTFDeserializer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/BoundaryDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/CurrentRowDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/OrderDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/OrderExpressionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PTFExpressionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PTFInputDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PTFQueryInputDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PartitionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PartitionedTableFunctionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/RangeBoundaryDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/ShapeDetails.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/ValueBoundaryDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowExpressionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowFrameDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowFunctionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowTableFunctionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/NPath.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/Noop.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/NoopWithMap.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/TableFunctionEvaluator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/TableFunctionResolver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/WindowingTableFunction.java Various cleanup in ptf code --- Key: HIVE-5395 URL: https://issues.apache.org/jira/browse/HIVE-5395 Project: Hive Issue Type: Improvement Reporter: Edward Capriolo Assignee: Edward Capriolo Fix For: 0.13.0 Attachments: HIVE-5395.1.patch.txt, HIVE-5395.2.patch.txt, HIVE-5395.3.patch.txt, HIVE-5395.4.patch.txt Some minor issues: Implementing classes on left side of equals Stack used instead of ArrayDeque Classes defined statically inside other files (when they do not need to be Checkstyle errors like indenting -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5426) TestThriftBinaryCLIService tests fail on branch 0.12
[ https://issues.apache.org/jira/browse/HIVE-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786235#comment-13786235 ] Hudson commented on HIVE-5426: -- FAILURE: Integrated in Hive-trunk-hadoop2 #475 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/475/]) HIVE-5426: TestThriftBinaryCLIService tests fail on branch 0.12 (Vaibhav Gumashta via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529063) * /hive/trunk/service/src/test/org/apache/hive/service/cli/CLIServiceTest.java * /hive/trunk/service/src/test/org/apache/hive/service/cli/thrift/ThriftCLIServiceTest.java TestThriftBinaryCLIService tests fail on branch 0.12 Key: HIVE-5426 URL: https://issues.apache.org/jira/browse/HIVE-5426 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Thejas M Nair Assignee: Vaibhav Gumashta Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5426.1.patch Two tests of TestThriftBinaryCLIService are failing in branch 0.12. See https://builds.apache.org/job/Hive-branch-0.12-hadoop1/lastCompletedBuild/testReport/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HIVE-5444) Test vectorized_rcfile_columnar.q is failing on trunk for hadoop2
Ashutosh Chauhan created HIVE-5444: -- Summary: Test vectorized_rcfile_columnar.q is failing on trunk for hadoop2 Key: HIVE-5444 URL: https://issues.apache.org/jira/browse/HIVE-5444 Project: Hive Issue Type: Task Components: Vectorization Affects Versions: 0.13.0 Reporter: Ashutosh Chauhan Assignee: Jitendra Nath Pandey Priority: Minor ant test -Dtestcase=TestCliDriver -Dmodule=ql -Dqfile=vectorized_rcfile_columnar.q -Dhadoop.mr.rev=23 -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5426) TestThriftBinaryCLIService tests fail on branch 0.12
[ https://issues.apache.org/jira/browse/HIVE-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786254#comment-13786254 ] Hudson commented on HIVE-5426: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #190 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/190/]) HIVE-5426: TestThriftBinaryCLIService tests fail on branch 0.12 (Vaibhav Gumashta via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529063) * /hive/trunk/service/src/test/org/apache/hive/service/cli/CLIServiceTest.java * /hive/trunk/service/src/test/org/apache/hive/service/cli/thrift/ThriftCLIServiceTest.java TestThriftBinaryCLIService tests fail on branch 0.12 Key: HIVE-5426 URL: https://issues.apache.org/jira/browse/HIVE-5426 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Thejas M Nair Assignee: Vaibhav Gumashta Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5426.1.patch Two tests of TestThriftBinaryCLIService are failing in branch 0.12. See https://builds.apache.org/job/Hive-branch-0.12-hadoop1/lastCompletedBuild/testReport/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5402) StorageBasedAuthorizationProvider is not correctly able to determine that it is running from client-side
[ https://issues.apache.org/jira/browse/HIVE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-5402: --- Attachment: HIVE-5402.2.patch StorageBasedAuthorizationProvider is not correctly able to determine that it is running from client-side Key: HIVE-5402 URL: https://issues.apache.org/jira/browse/HIVE-5402 Project: Hive Issue Type: Bug Components: Authorization Reporter: Sushanth Sowmyan Assignee: Sushanth Sowmyan Attachments: HIVE-5402.2.patch, HIVE-5402.patch HIVE-5048 tried to change the StorageBasedAuthorizationProvider (SBAP) so that it could be run from the client side as well. However, there is a bug that causes SBAP to incorrectly conclude that it's running from the metastore-side when it's actually running from the client-side that causes it to throw a IllegalStateException claiming the warehouse variable isn't set. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5395) Various cleanup in ptf code
[ https://issues.apache.org/jira/browse/HIVE-5395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786251#comment-13786251 ] Hudson commented on HIVE-5395: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #190 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/190/]) HIVE-5395 - Various cleanup in ptf code (Edward Capriolo via Brock Noland) (brock: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529174) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/PTFOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/PTFInvocationSpec.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/PTFTranslator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PTFDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PTFDeserializer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/BoundaryDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/CurrentRowDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/OrderDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/OrderExpressionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PTFExpressionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PTFInputDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PTFQueryInputDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PartitionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/PartitionedTableFunctionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/RangeBoundaryDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/ShapeDetails.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/ValueBoundaryDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowExpressionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowFrameDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowFunctionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ptf/WindowTableFunctionDef.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/NPath.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/Noop.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/NoopWithMap.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/TableFunctionEvaluator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/TableFunctionResolver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/WindowingTableFunction.java Various cleanup in ptf code --- Key: HIVE-5395 URL: https://issues.apache.org/jira/browse/HIVE-5395 Project: Hive Issue Type: Improvement Reporter: Edward Capriolo Assignee: Edward Capriolo Fix For: 0.13.0 Attachments: HIVE-5395.1.patch.txt, HIVE-5395.2.patch.txt, HIVE-5395.3.patch.txt, HIVE-5395.4.patch.txt Some minor issues: Implementing classes on left side of equals Stack used instead of ArrayDeque Classes defined statically inside other files (when they do not need to be Checkstyle errors like indenting -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4542) TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
[
https://issues.apache.org/jira/browse/HIVE-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786250#comment-13786250
]
Hudson commented on HIVE-4542:
--
FAILURE: Integrated in Hive-trunk-hadoop1-ptest #190 (See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/190/])
HIVE-4542 : TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected
database (Vaibhav Gumashta Thejas Nair via Ashutosh Chauhan) (hashutosh:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529161)
* /hive/trunk/jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java
*
/hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker.java
TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
---
Key: HIVE-4542
URL: https://issues.apache.org/jira/browse/HIVE-4542
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: D13269.1.patch, D13269.2.patch, HIVE-4542.1.patch,
HIVE-4542.2.patch
The check for database name in TestJdbcDriver2.testMetaDataGetSchemas fails
with the error -
{code}
junit.framework.ComparisonFailure: expected:...efault but was:...bname
{code}
ie, a database called dbname is found, which it does not expect. This failure
will happen depending on the order in which the function get the databases,
if default database is the first one, it succeeds.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5422) Upgrade Kyro to 2.22 now that it is released
[ https://issues.apache.org/jira/browse/HIVE-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786249#comment-13786249 ] Hudson commented on HIVE-5422: -- FAILURE: Integrated in Hive-trunk-hadoop1-ptest #190 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/190/]) HIVE-5422 : Upgrade Kyro to 2.22 now that it is released (Brock Noland via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529158) * /hive/trunk/build.xml * /hive/trunk/hcatalog/pom.xml * /hive/trunk/ivy/ivysettings.xml * /hive/trunk/ivy/libraries.properties Upgrade Kyro to 2.22 now that it is released Key: HIVE-5422 URL: https://issues.apache.org/jira/browse/HIVE-5422 Project: Hive Issue Type: Bug Reporter: Brock Noland Assignee: Brock Noland Fix For: 0.13.0 Attachments: HIVE-5422.patch, HIVE-5422.patch As noted [here|https://issues.apache.org/jira/browse/HIVE-1511?focusedCommentId=13783990page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13783990] v2.22 has been released. We should upgrade to that version as opposed to using the snapshot. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5426) TestThriftBinaryCLIService tests fail on branch 0.12
[ https://issues.apache.org/jira/browse/HIVE-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786248#comment-13786248 ] Hudson commented on HIVE-5426: -- FAILURE: Integrated in Hive-trunk-h0.21 #2379 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2379/]) HIVE-5426: TestThriftBinaryCLIService tests fail on branch 0.12 (Vaibhav Gumashta via Thejas Nair) (thejas: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529063) * /hive/trunk/service/src/test/org/apache/hive/service/cli/CLIServiceTest.java * /hive/trunk/service/src/test/org/apache/hive/service/cli/thrift/ThriftCLIServiceTest.java TestThriftBinaryCLIService tests fail on branch 0.12 Key: HIVE-5426 URL: https://issues.apache.org/jira/browse/HIVE-5426 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.12.0 Reporter: Thejas M Nair Assignee: Vaibhav Gumashta Priority: Blocker Fix For: 0.12.0 Attachments: HIVE-5426.1.patch Two tests of TestThriftBinaryCLIService are failing in branch 0.12. See https://builds.apache.org/job/Hive-branch-0.12-hadoop1/lastCompletedBuild/testReport/ -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786247#comment-13786247
]
Hudson commented on HIVE-5364:
--
FAILURE: Integrated in Hive-trunk-h0.21 #2379 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/2379/])
HIVE-5364 : NPE on some queries from partitioned orc table (Owen O'Malley via
Gunther Hagleitner) (thejas:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529097)
* /hive/trunk/data/files/orc_create_people.txt
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java
* /hive/trunk/ql/src/test/queries/clientpositive/orc_create.q
* /hive/trunk/ql/src/test/results/clientpositive/orc_create.q.out
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5364) NPE on some queries from partitioned orc table
[
https://issues.apache.org/jira/browse/HIVE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786253#comment-13786253
]
Hudson commented on HIVE-5364:
--
FAILURE: Integrated in Hive-trunk-hadoop1-ptest #190 (See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/190/])
HIVE-5364 : NPE on some queries from partitioned orc table (Owen O'Malley via
Gunther Hagleitner) (thejas:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529097)
* /hive/trunk/data/files/orc_create_people.txt
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java
* /hive/trunk/ql/src/test/queries/clientpositive/orc_create.q
* /hive/trunk/ql/src/test/results/clientpositive/orc_create.q.out
NPE on some queries from partitioned orc table
--
Key: HIVE-5364
URL: https://issues.apache.org/jira/browse/HIVE-5364
Project: Hive
Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.12.0
Attachments: D13215.1.patch
If you create a partitioned ORC table with:
{code}
create table A
...
PARTITIONED BY (
year int,
month int,
day int)
{code}
This query will fail:
select count from A where where year=2013 and month=9 and day=15;
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HIVE-5402) StorageBasedAuthorizationProvider is not correctly able to determine that it is running from client-side
[ https://issues.apache.org/jira/browse/HIVE-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-5402: --- Status: Patch Available (was: Open) Updated patch with tests. StorageBasedAuthorizationProvider is not correctly able to determine that it is running from client-side Key: HIVE-5402 URL: https://issues.apache.org/jira/browse/HIVE-5402 Project: Hive Issue Type: Bug Components: Authorization Reporter: Sushanth Sowmyan Assignee: Sushanth Sowmyan Attachments: HIVE-5402.2.patch, HIVE-5402.patch HIVE-5048 tried to change the StorageBasedAuthorizationProvider (SBAP) so that it could be run from the client side as well. However, there is a bug that causes SBAP to incorrectly conclude that it's running from the metastore-side when it's actually running from the client-side that causes it to throw a IllegalStateException claiming the warehouse variable isn't set. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-4669) Make username available to semantic analyzer hooks
[ https://issues.apache.org/jira/browse/HIVE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-4669: --- Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available) Committed to trunk! Thank you very much for your contribution Shreepadma! Make username available to semantic analyzer hooks -- Key: HIVE-4669 URL: https://issues.apache.org/jira/browse/HIVE-4669 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.10.0, 0.11.0 Reporter: Shreepadma Venugopalan Assignee: Shreepadma Venugopalan Fix For: 0.13.0 Attachments: HIVE-4669.1.patch, HIVE-4669.2.patch, HIVE-4669.3.patch, HIVE-4669.4.patch Make username available to the semantic analyzer hooks. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5235) Infinite loop with ORC file and Hive 0.11
[
https://issues.apache.org/jira/browse/HIVE-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786267#comment-13786267
]
Owen O'Malley commented on HIVE-5235:
-
Ok, here is the current state. We know that the problem is in the last
compression block of the last column's data stream in the first stripe. The
metadata is all consistent and the problem seems to be localized to that one
compression block. Based on all of this we know that the problem is somewhere
between rows 2177 and 2186. I'm going to try to localize the problem
further.
Infinite loop with ORC file and Hive 0.11
-
Key: HIVE-5235
URL: https://issues.apache.org/jira/browse/HIVE-5235
Project: Hive
Issue Type: Bug
Affects Versions: 0.11.0
Environment: Gentoo linux with Hortonworks Hadoop
hadoop-1.1.2.23.tar.gz and Apache Hive 0.11d
Reporter: Iván de Prado
Priority: Blocker
We are using Hive 0.11 with ORC file format and we get some tasks blocked in
some kind of infinite loop. They keep working indefinitely when we set a huge
task expiry timeout. If we the expiry time to 600 second, the taks fail
because of not reporting progress, and finally, the Job fails.
That is not consistent, and some times between jobs executions the behavior
changes. It happen for different queries.
We are using Hive 0.11 with Hadoop hadoop-1.1.2.23 from Hortonworks. The taks
that is blocked keeps consuming 100% of CPU usage, and the stack trace is
always the same consistently. Everything points to some kind of infinite
loop. My guessing is that it has some relation to the ORC file. Maybe some
pointer is not right when writing generating some kind of infinite loop when
reading. Or maybe there is a bug in the reading stage.
More information below. The stack trace:
{noformat}
main prio=10 tid=0x7f20a000a800 nid=0x1ed2 runnable [0x7f20a8136000]
java.lang.Thread.State: RUNNABLE
at java.util.zip.Inflater.inflateBytes(Native Method)
at java.util.zip.Inflater.inflate(Inflater.java:256)
- locked 0xf42a6ca0 (a java.util.zip.ZStreamRef)
at
org.apache.hadoop.hive.ql.io.orc.ZlibCodec.decompress(ZlibCodec.java:64)
at
org.apache.hadoop.hive.ql.io.orc.InStream$CompressedStream.readHeader(InStream.java:128)
at
org.apache.hadoop.hive.ql.io.orc.InStream$CompressedStream.read(InStream.java:143)
at
org.apache.hadoop.hive.ql.io.orc.SerializationUtils.readVulong(SerializationUtils.java:54)
at
org.apache.hadoop.hive.ql.io.orc.SerializationUtils.readVslong(SerializationUtils.java:65)
at
org.apache.hadoop.hive.ql.io.orc.RunLengthIntegerReader.readValues(RunLengthIntegerReader.java:66)
at
org.apache.hadoop.hive.ql.io.orc.RunLengthIntegerReader.next(RunLengthIntegerReader.java:81)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$IntTreeReader.next(RecordReaderImpl.java:332)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$StructTreeReader.next(RecordReaderImpl.java:802)
at
org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl.next(RecordReaderImpl.java:1214)
at
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.next(OrcInputFormat.java:71)
at
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$OrcRecordReader.next(OrcInputFormat.java:46)
at
org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:274)
at
org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:101)
at
org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.doNext(CombineHiveRecordReader.java:41)
at
org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveContextAwareRecordReader.java:108)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.doNextWithExceptionHandler(HadoopShimsSecure.java:300)
at
org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileRecordReader.next(HadoopShimsSecure.java:218)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:236)
- eliminated 0xe1459700 (a
org.apache.hadoop.mapred.MapTask$TrackedRecordReader)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:216)
- locked 0xe1459700 (a
org.apache.hadoop.mapred.MapTask$TrackedRecordReader)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at
[jira] [Commented] (HIVE-4669) Make username available to semantic analyzer hooks
[ https://issues.apache.org/jira/browse/HIVE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786278#comment-13786278 ] Hudson commented on HIVE-4669: -- FAILURE: Integrated in Hive-trunk-hadoop2 #476 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/476/]) HIVE-4669 - Make username available to semantic analyzer hooks (Shreepadma Venugopalan via Brock Noland) (brock: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529195) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContextImpl.java * /hive/trunk/service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java Make username available to semantic analyzer hooks -- Key: HIVE-4669 URL: https://issues.apache.org/jira/browse/HIVE-4669 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.10.0, 0.11.0 Reporter: Shreepadma Venugopalan Assignee: Shreepadma Venugopalan Fix For: 0.13.0 Attachments: HIVE-4669.1.patch, HIVE-4669.2.patch, HIVE-4669.3.patch, HIVE-4669.4.patch Make username available to the semantic analyzer hooks. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4160) Vectorized Query Execution in Hive
[ https://issues.apache.org/jira/browse/HIVE-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786285#comment-13786285 ] Eric Hanson commented on HIVE-4160: --- I've been planning to write some user documentation for this feature. Where do you think would be a good spot in the wiki to include it? Vectorized Query Execution in Hive -- Key: HIVE-4160 URL: https://issues.apache.org/jira/browse/HIVE-4160 Project: Hive Issue Type: New Feature Reporter: Jitendra Nath Pandey Assignee: Jitendra Nath Pandey Attachments: Hive-Vectorized-Query-Execution-Design.docx, Hive-Vectorized-Query-Execution-Design-rev10.docx, Hive-Vectorized-Query-Execution-Design-rev10.docx, Hive-Vectorized-Query-Execution-Design-rev10.pdf, Hive-Vectorized-Query-Execution-Design-rev11.docx, Hive-Vectorized-Query-Execution-Design-rev11.pdf, Hive-Vectorized-Query-Execution-Design-rev2.docx, Hive-Vectorized-Query-Execution-Design-rev3.docx, Hive-Vectorized-Query-Execution-Design-rev3.docx, Hive-Vectorized-Query-Execution-Design-rev3.pdf, Hive-Vectorized-Query-Execution-Design-rev4.docx, Hive-Vectorized-Query-Execution-Design-rev4.pdf, Hive-Vectorized-Query-Execution-Design-rev5.docx, Hive-Vectorized-Query-Execution-Design-rev5.pdf, Hive-Vectorized-Query-Execution-Design-rev6.docx, Hive-Vectorized-Query-Execution-Design-rev6.pdf, Hive-Vectorized-Query-Execution-Design-rev7.docx, Hive-Vectorized-Query-Execution-Design-rev8.docx, Hive-Vectorized-Query-Execution-Design-rev8.pdf, Hive-Vectorized-Query-Execution-Design-rev9.docx, Hive-Vectorized-Query-Execution-Design-rev9.pdf The Hive query execution engine currently processes one row at a time. A single row of data goes through all the operators before the next row can be processed. This mode of processing is very inefficient in terms of CPU usage. Research has demonstrated that this yields very low instructions per cycle [MonetDB X100]. Also currently Hive heavily relies on lazy deserialization and data columns go through a layer of object inspectors that identify column type, deserialize data and determine appropriate expression routines in the inner loop. These layers of virtual method calls further slow down the processing. This work will add support for vectorized query execution to Hive, where, instead of individual rows, batches of about a thousand rows at a time are processed. Each column in the batch is represented as a vector of a primitive data type. The inner loop of execution scans these vectors very fast, avoiding method calls, deserialization, unnecessary if-then-else, etc. This substantially reduces CPU time used, and gives excellent instructions per cycle (i.e. improved processor pipeline utilization). See the attached design specification for more details. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5365) Boolean constants in the query are not handled correctly.
[ https://issues.apache.org/jira/browse/HIVE-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HIVE-5365: --- Status: Open (was: Patch Available) Boolean constants in the query are not handled correctly. - Key: HIVE-5365 URL: https://issues.apache.org/jira/browse/HIVE-5365 Project: Hive Issue Type: Sub-task Reporter: Jitendra Nath Pandey Assignee: Jitendra Nath Pandey Attachments: HIVE-5365.1.patch, HIVE-5365.2.patch Boolean constants in the query are not handled correctly. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5365) Boolean constants in the query are not handled correctly.
[ https://issues.apache.org/jira/browse/HIVE-5365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HIVE-5365: --- Status: Patch Available (was: Open) Boolean constants in the query are not handled correctly. - Key: HIVE-5365 URL: https://issues.apache.org/jira/browse/HIVE-5365 Project: Hive Issue Type: Sub-task Reporter: Jitendra Nath Pandey Assignee: Jitendra Nath Pandey Attachments: HIVE-5365.1.patch, HIVE-5365.2.patch Boolean constants in the query are not handled correctly. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HIVE-5445) PTest2 should use testonly target
Brock Noland created HIVE-5445: -- Summary: PTest2 should use testonly target Key: HIVE-5445 URL: https://issues.apache.org/jira/browse/HIVE-5445 Project: Hive Issue Type: Improvement Reporter: Brock Noland Assignee: Brock Noland -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5383) PTest2 should allow you to specify ant properties which will only be added to the command when a test is executed
[ https://issues.apache.org/jira/browse/HIVE-5383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5383: --- Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available) Thank you!! PTest2 should allow you to specify ant properties which will only be added to the command when a test is executed - Key: HIVE-5383 URL: https://issues.apache.org/jira/browse/HIVE-5383 Project: Hive Issue Type: Improvement Affects Versions: 0.13.0 Reporter: Brock Noland Assignee: Brock Noland Priority: Minor Fix For: 0.13.0 Attachments: HIVE-5383.patch It'd be nice if we could specify things like: -DgrammarBuild.notRequired=true -Dskip.javadoc=true when we actually execute a test. NO PRECOMMIT TESTS -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Created] (HIVE-5446) Hive can CREATE an external table but not SELECT from it when file path have spaces
Shuaishuai Nie created HIVE-5446: Summary: Hive can CREATE an external table but not SELECT from it when file path have spaces Key: HIVE-5446 URL: https://issues.apache.org/jira/browse/HIVE-5446 Project: Hive Issue Type: Bug Reporter: Shuaishuai Nie Assignee: Shuaishuai Nie Attachments: HIVE-5446.1.patch Create external table table1 (age int, gender string, totBil float, dirBill float, alkphos int, sgpt int, sgot int, totProt float, aLB float, aG float, sel int) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION 'hdfs://namenodehost:9000/hive newtable'; select * from table1; return nothing even there is file in the target folder -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5446) Hive can CREATE an external table but not SELECT from it when file path have spaces
[ https://issues.apache.org/jira/browse/HIVE-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuaishuai Nie updated HIVE-5446: - Attachment: HIVE-5446.1.patch Hive can CREATE an external table but not SELECT from it when file path have spaces --- Key: HIVE-5446 URL: https://issues.apache.org/jira/browse/HIVE-5446 Project: Hive Issue Type: Bug Reporter: Shuaishuai Nie Assignee: Shuaishuai Nie Attachments: HIVE-5446.1.patch Create external table table1 (age int, gender string, totBil float, dirBill float, alkphos int, sgpt int, sgot int, totProt float, aLB float, aG float, sel int) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION 'hdfs://namenodehost:9000/hive newtable'; select * from table1; return nothing even there is file in the target folder -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HIVE-5446) Hive can CREATE an external table but not SELECT from it when file path have spaces
[ https://issues.apache.org/jira/browse/HIVE-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuaishuai Nie updated HIVE-5446: - Status: Patch Available (was: Open) Hive can CREATE an external table but not SELECT from it when file path have spaces --- Key: HIVE-5446 URL: https://issues.apache.org/jira/browse/HIVE-5446 Project: Hive Issue Type: Bug Reporter: Shuaishuai Nie Assignee: Shuaishuai Nie Attachments: HIVE-5446.1.patch Create external table table1 (age int, gender string, totBil float, dirBill float, alkphos int, sgpt int, sgot int, totProt float, aLB float, aG float, sel int) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION 'hdfs://namenodehost:9000/hive newtable'; select * from table1; return nothing even there is file in the target folder -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4542) TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
[
https://issues.apache.org/jira/browse/HIVE-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786347#comment-13786347
]
Thejas M Nair commented on HIVE-4542:
-
Vaibhav, Can you please create a hive 0.12 patch for this? This patch does not
apply cleanly. It would help in making the 0.12 tests more stable.
TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
---
Key: HIVE-4542
URL: https://issues.apache.org/jira/browse/HIVE-4542
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: D13269.1.patch, D13269.2.patch, HIVE-4542.1.patch,
HIVE-4542.2.patch
The check for database name in TestJdbcDriver2.testMetaDataGetSchemas fails
with the error -
{code}
junit.framework.ComparisonFailure: expected:...efault but was:...bname
{code}
ie, a database called dbname is found, which it does not expect. This failure
will happen depending on the order in which the function get the databases,
if default database is the first one, it succeeds.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HIVE-5432) self join for a table with serde definition fails with classNotFoundException, single queries work fine
[
https://issues.apache.org/jira/browse/HIVE-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang updated HIVE-5432:
--
Description:
Steps to reproduce
{code}
hive add jar /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar;
Added /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar to class path
Added resource: /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar
hive create table if not exists test(a string,b string) ROW FORMAT SERDE
'com.cloudera.hive.serde.JSONSerDe';
OK
Time taken: 0.159 seconds
hive load data local inpath '/tmp/1' overwrite into table test;
Copying data from file:/tmp/1
Copying file: file:/tmp/1
Loading data to table default.test
Table default.test stats: [num_partitions: 0, num_files: 1, num_rows: 0,
total_size: 51, raw_data_size: 0]
OK
Time taken: 0.659 seconds
hive select a from test;
Total MapReduce jobs = 1
Launching Job 1 out of 1
...
...
hive select * from (select b from test where a=test)x join (select b from
test where a=test1)y on (x.b = y.b);
Total MapReduce jobs = 1
setting HADOOP_USER_NAMEhive
Execution log at: /tmp/hive/.log
java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe
Continuing ...
2013-10-03 05:13:00 Starting to launch local task to process map join;
maximum memory = 1065484288
org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception
nulljava.lang.NullPointerException
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromTable(FetchOperator.java:230)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:595)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
Execution failed with exit status: 2
Obtaining error information
Task failed!
Task ID:
{code}
was:
Steps to reproduce
hive add jar /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar;
Added /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar to class path
Added resource: /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar
hive create table if not exists test(a string,b string) ROW FORMAT SERDE
'com.cloudera.hive.serde.JSONSerDe';
OK
Time taken: 0.159 seconds
hive load data local inpath '/tmp/1' overwrite into table test;
Copying data from file:/tmp/1
Copying file: file:/tmp/1
Loading data to table default.test
Table default.test stats: [num_partitions: 0, num_files: 1, num_rows: 0,
total_size: 51, raw_data_size: 0]
OK
Time taken: 0.659 seconds
hive select a from test;
Total MapReduce jobs = 1
Launching Job 1 out of 1
...
...
hive select * from (select b from test where a=test)x join (select b from
test where a=test1)y on (x.b = y.b);
Total MapReduce jobs = 1
setting HADOOP_USER_NAMEhive
Execution log at: /tmp/hive/.log
java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe
Continuing ...
2013-10-03 05:13:00 Starting to launch local task to process map join;
maximum memory = 1065484288
org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception
nulljava.lang.NullPointerException
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromTable(FetchOperator.java:230)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:595)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at
[jira] [Updated] (HIVE-5445) PTest2 should use testonly target
[ https://issues.apache.org/jira/browse/HIVE-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-5445: --- Description: NO PRECOMMIT TESTS PTest2 should use testonly target - Key: HIVE-5445 URL: https://issues.apache.org/jira/browse/HIVE-5445 Project: Hive Issue Type: Improvement Reporter: Brock Noland Assignee: Brock Noland Attachments: HIVE-5445.patch NO PRECOMMIT TESTS -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5385) StringUtils is not in commons codec 1.3
[ https://issues.apache.org/jira/browse/HIVE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786370#comment-13786370 ] Yin Huai commented on HIVE-5385: [~sarutak] right, that's the reason. Seems we still need to support 0.20.2 for a while. So, can you modify ivy.xml of shims to exclude 1.3 codec and to add 1.4 codec as a dependency? Then, you can check if 1.4 jar is placed in build/ivy/lib/hadoop0.20.shim/. Thanks :) StringUtils is not in commons codec 1.3 --- Key: HIVE-5385 URL: https://issues.apache.org/jira/browse/HIVE-5385 Project: Hive Issue Type: Bug Reporter: Yin Huai Priority: Trivial Attachments: HIVE-5385.1.patch In ThriftHttpServlet introduced by HIVE-4763, StringUtils is imported which was introduced by commons codec 1.4. But, our 0.20 shims depends on commons codec 1.3. Our eclipse classpath template is also using libs of 0.20 shims. So, we will get two errors in eclipse. Compiling hive will not have a problem because we are loading codec 1.4 for project service (1.4 is also used when -Dhadoop.version=0.20.2 -Dhadoop.mr.rev=20). -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Assigned] (HIVE-5432) self join for a table with serde definition fails with classNotFoundException, single queries work fine
[
https://issues.apache.org/jira/browse/HIVE-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang reassigned HIVE-5432:
-
Assignee: Xuefu Zhang
I'll take a look. However, feel free to grab it before I attach a patch.
self join for a table with serde definition fails with
classNotFoundException, single queries work fine
---
Key: HIVE-5432
URL: https://issues.apache.org/jira/browse/HIVE-5432
Project: Hive
Issue Type: Bug
Components: CLI
Affects Versions: 0.11.0
Environment: rhel6.4
Reporter: Nitin Pawar
Assignee: Xuefu Zhang
Steps to reproduce
{code}
hive add jar /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar;
Added /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar to class path
Added resource: /home/hive/udfs/hive-serdes-1.0-SNAPSHOT.jar
hive create table if not exists test(a string,b string) ROW FORMAT SERDE
'com.cloudera.hive.serde.JSONSerDe';
OK
Time taken: 0.159 seconds
hive load data local inpath '/tmp/1' overwrite into table test;
Copying data from file:/tmp/1
Copying file: file:/tmp/1
Loading data to table default.test
Table default.test stats: [num_partitions: 0, num_files: 1, num_rows: 0,
total_size: 51, raw_data_size: 0]
OK
Time taken: 0.659 seconds
hive select a from test;
Total MapReduce jobs = 1
Launching Job 1 out of 1
...
...
hive select * from (select b from test where a=test)x join (select b from
test where a=test1)y on (x.b = y.b);
Total MapReduce jobs = 1
setting HADOOP_USER_NAME hive
Execution log at: /tmp/hive/.log
java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe
Continuing ...
2013-10-03 05:13:00 Starting to launch local task to process map join;
maximum memory = 1065484288
org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception
nulljava.lang.NullPointerException
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromTable(FetchOperator.java:230)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:595)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:406)
at
org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:290)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
Execution failed with exit status: 2
Obtaining error information
Task failed!
Task ID:
{code}
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Updated] (HIVE-5385) StringUtils is not in commons codec 1.3
[ https://issues.apache.org/jira/browse/HIVE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5385: --- Assignee: Kousuke Saruta StringUtils is not in commons codec 1.3 --- Key: HIVE-5385 URL: https://issues.apache.org/jira/browse/HIVE-5385 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Kousuke Saruta Priority: Trivial Attachments: HIVE-5385.1.patch In ThriftHttpServlet introduced by HIVE-4763, StringUtils is imported which was introduced by commons codec 1.4. But, our 0.20 shims depends on commons codec 1.3. Our eclipse classpath template is also using libs of 0.20 shims. So, we will get two errors in eclipse. Compiling hive will not have a problem because we are loading codec 1.4 for project service (1.4 is also used when -Dhadoop.version=0.20.2 -Dhadoop.mr.rev=20). -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4669) Make username available to semantic analyzer hooks
[ https://issues.apache.org/jira/browse/HIVE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786375#comment-13786375 ] Shreepadma Venugopalan commented on HIVE-4669: -- Thank you Brock! Make username available to semantic analyzer hooks -- Key: HIVE-4669 URL: https://issues.apache.org/jira/browse/HIVE-4669 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.10.0, 0.11.0 Reporter: Shreepadma Venugopalan Assignee: Shreepadma Venugopalan Fix For: 0.13.0 Attachments: HIVE-4669.1.patch, HIVE-4669.2.patch, HIVE-4669.3.patch, HIVE-4669.4.patch Make username available to the semantic analyzer hooks. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-4542) TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
[
https://issues.apache.org/jira/browse/HIVE-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786388#comment-13786388
]
Vaibhav Gumashta commented on HIVE-4542:
Sure, I'll upload it here
TestJdbcDriver2.testMetaDataGetSchemas fails because of unexpected database
---
Key: HIVE-4542
URL: https://issues.apache.org/jira/browse/HIVE-4542
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: D13269.1.patch, D13269.2.patch, HIVE-4542.1.patch,
HIVE-4542.2.patch
The check for database name in TestJdbcDriver2.testMetaDataGetSchemas fails
with the error -
{code}
junit.framework.ComparisonFailure: expected:...efault but was:...bname
{code}
ie, a database called dbname is found, which it does not expect. This failure
will happen depending on the order in which the function get the databases,
if default database is the first one, it succeeds.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-5385) StringUtils is not in commons codec 1.3
[ https://issues.apache.org/jira/browse/HIVE-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786412#comment-13786412 ] Prasanth J commented on HIVE-5385: -- I hit the same issue yesterday and I added a new entry in eclipse-template/.classpath for commons-codec-1.4 from build/ivy/lib/default. Since hadoop-0.20.2 shims needs commons-codec-1.3 I added 1.4 as a separate classpath entry. That seemed to work fine for me. StringUtils is not in commons codec 1.3 --- Key: HIVE-5385 URL: https://issues.apache.org/jira/browse/HIVE-5385 Project: Hive Issue Type: Bug Reporter: Yin Huai Assignee: Kousuke Saruta Priority: Trivial Attachments: HIVE-5385.1.patch In ThriftHttpServlet introduced by HIVE-4763, StringUtils is imported which was introduced by commons codec 1.4. But, our 0.20 shims depends on commons codec 1.3. Our eclipse classpath template is also using libs of 0.20 shims. So, we will get two errors in eclipse. Compiling hive will not have a problem because we are loading codec 1.4 for project service (1.4 is also used when -Dhadoop.version=0.20.2 -Dhadoop.mr.rev=20). -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HIVE-5382) Allow strings represented as exponential notation to be typecasted to int/smallint/bigint/tinyint
[ https://issues.apache.org/jira/browse/HIVE-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786414#comment-13786414 ] Hudson commented on HIVE-5382: -- FAILURE: Integrated in Hive-trunk-hadoop2 #477 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/477/]) HIVE-5382 - PTest2 should allow you to specify ant properties which will only be added to the command when a test is executed (brock: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1529212) * /hive/trunk/testutils/ptest2/src/main/java/org/apache/hive/ptest/execution/PTest.java * /hive/trunk/testutils/ptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestConfiguration.java * /hive/trunk/testutils/ptest2/src/main/resources/batch-exec.vm * /hive/trunk/testutils/ptest2/src/test/java/org/apache/hive/ptest/execution/TestScripts.java * /hive/trunk/testutils/ptest2/src/test/java/org/apache/hive/ptest/execution/TestScripts.testAlternativeTestJVM.approved.txt * /hive/trunk/testutils/ptest2/src/test/java/org/apache/hive/ptest/execution/TestScripts.testBatch.approved.txt Allow strings represented as exponential notation to be typecasted to int/smallint/bigint/tinyint - Key: HIVE-5382 URL: https://issues.apache.org/jira/browse/HIVE-5382 Project: Hive Issue Type: Bug Reporter: Hari Sankar Sivarama Subramaniyan Assignee: Hari Sankar Sivarama Subramaniyan Attachments: HIVE-5382.1.patch Follow up jira for HIVE-5352 -- This message was sent by Atlassian JIRA (v6.1#6144)
