[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944592#comment-14944592
]
Hive QA commented on HIVE-11533:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765115/HIVE-11533.3.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 9562 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_date_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_interval_2
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_date_1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_interval_2
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.jdbc.TestSSL.testSSLVersion
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5544/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5544/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5544/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765115 - PreCommit-HIVE-TRUNK-Build
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch, HIVE-11533.2.patch,
> HIVE-11533.3.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColNotEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarNotEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColNotEqualLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-11301) thrift metastore issue when getting stats results in disconnect
[
https://issues.apache.org/jira/browse/HIVE-11301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-11301:
---
Fix Version/s: 1.0.2
> thrift metastore issue when getting stats results in disconnect
> ---
>
> Key: HIVE-11301
> URL: https://issues.apache.org/jira/browse/HIVE-11301
> Project: Hive
> Issue Type: Bug
> Components: Metastore
>Reporter: Sergey Shelukhin
>Assignee: Pengcheng Xiong
> Fix For: 1.3.0, 2.0.0, 1.0.2, 1.2.2
>
> Attachments: HIVE-11301.01.patch, HIVE-11301.02.patch
>
>
> On metastore side it looks like this:
> {noformat}
> 2015-07-17 20:32:27,795 ERROR [pool-3-thread-150]: server.TThreadPoolServer
> (TThreadPoolServer.java:run(294)) - Thrift error occurred during processing
> of message.
> org.apache.thrift.protocol.TProtocolException: Required field 'colStats' is
> unset! Struct:AggrStats(colStats:null, partsFound:0)
> at
> org.apache.hadoop.hive.metastore.api.AggrStats.validate(AggrStats.java:389)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result.validate(ThriftHiveMetastore.java)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result$get_aggr_stats_for_resultStandardScheme.write(ThriftHiveMetastore.java)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result$get_aggr_stats_for_resultStandardScheme.write(ThriftHiveMetastore.java)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result.write(ThriftHiveMetastore.java)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:53)
> at
> org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)
> at
> org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at
> org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> and then
> {noformat}
> 2015-07-17 20:32:27,796 WARN [pool-3-thread-150]:
> transport.TIOStreamTransport (TIOStreamTransport.java:close(112)) - Error
> closing output stream.
> java.net.SocketException: Socket closed
> at
> java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:116)
> at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
> at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
> at
> org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)
> at org.apache.thrift.transport.TSocket.close(TSocket.java:196)
> at
> org.apache.hadoop.hive.thrift.TFilterTransport.close(TFilterTransport.java:52)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> Which on client manifests as
> {noformat}
> 2015-07-17 20:32:27,796 WARN [main()]: metastore.RetryingMetaStoreClient
> (RetryingMetaStoreClient.java:invoke(187)) - MetaStoreClient lost connection.
> Attempting to reconnect.
> org.apache.thrift.transport.TTransportException
> at
> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
> at
> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_aggr_stats_for(ThriftHiveMetas
[jira] [Commented] (HIVE-11301) thrift metastore issue when getting stats results in disconnect
[
https://issues.apache.org/jira/browse/HIVE-11301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944581#comment-14944581
]
Lefty Leverenz commented on HIVE-11301:
---
Now the Fix Version/s should include 1.0.2 as well (commit
f1939cb5ad3e0a10736d986f3ed47b5577da2ef9).
> thrift metastore issue when getting stats results in disconnect
> ---
>
> Key: HIVE-11301
> URL: https://issues.apache.org/jira/browse/HIVE-11301
> Project: Hive
> Issue Type: Bug
> Components: Metastore
>Reporter: Sergey Shelukhin
>Assignee: Pengcheng Xiong
> Fix For: 1.3.0, 2.0.0, 1.2.2
>
> Attachments: HIVE-11301.01.patch, HIVE-11301.02.patch
>
>
> On metastore side it looks like this:
> {noformat}
> 2015-07-17 20:32:27,795 ERROR [pool-3-thread-150]: server.TThreadPoolServer
> (TThreadPoolServer.java:run(294)) - Thrift error occurred during processing
> of message.
> org.apache.thrift.protocol.TProtocolException: Required field 'colStats' is
> unset! Struct:AggrStats(colStats:null, partsFound:0)
> at
> org.apache.hadoop.hive.metastore.api.AggrStats.validate(AggrStats.java:389)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result.validate(ThriftHiveMetastore.java)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result$get_aggr_stats_for_resultStandardScheme.write(ThriftHiveMetastore.java)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result$get_aggr_stats_for_resultStandardScheme.write(ThriftHiveMetastore.java)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$get_aggr_stats_for_result.write(ThriftHiveMetastore.java)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:53)
> at
> org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)
> at
> org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at
> org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> and then
> {noformat}
> 2015-07-17 20:32:27,796 WARN [pool-3-thread-150]:
> transport.TIOStreamTransport (TIOStreamTransport.java:close(112)) - Error
> closing output stream.
> java.net.SocketException: Socket closed
> at
> java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:116)
> at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
> at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
> at
> org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110)
> at org.apache.thrift.transport.TSocket.close(TSocket.java:196)
> at
> org.apache.hadoop.hive.thrift.TFilterTransport.close(TFilterTransport.java:52)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:304)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> Which on client manifests as
> {noformat}
> 2015-07-17 20:32:27,796 WARN [main()]: metastore.RetryingMetaStoreClient
> (RetryingMetaStoreClient.java:invoke(187)) - MetaStoreClient lost connection.
> Attempting to reconnect.
> org.apache.thrift.transport.TTransportException
> at
> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
> at
> org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
> at
> org.apache.thrift.TServiceClient.receiveBase(TServiceClient.j
[jira] [Updated] (HIVE-11553) use basic file metadata cache in ETLSplitStrategy-related paths
[ https://issues.apache.org/jira/browse/HIVE-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-11553: -- Labels: TODOC2.0 (was: ) > use basic file metadata cache in ETLSplitStrategy-related paths > --- > > Key: HIVE-11553 > URL: https://issues.apache.org/jira/browse/HIVE-11553 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Labels: TODOC2.0 > Fix For: 2.0.0 > > Attachments: HIVE-11553.01.patch, HIVE-11553.02.patch, > HIVE-11553.03.patch, HIVE-11553.04.patch, HIVE-11553.06.patch, > HIVE-11553.07.patch, HIVE-11553.patch > > > This is the first step; uses the simple footer-getting API, without PPD. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11212) Create vectorized types for complex types
[ https://issues.apache.org/jira/browse/HIVE-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11212: - Attachment: HIVE-11212.patch I found a few more places where Hive is creating ColumnVectors. > Create vectorized types for complex types > - > > Key: HIVE-11212 > URL: https://issues.apache.org/jira/browse/HIVE-11212 > Project: Hive > Issue Type: Sub-task >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-11212.patch, HIVE-11212.patch > > > We need vectorized types for structs, maps, lists, and unions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11720) Allow HiveServer2 to set custom http request/response header size
[ https://issues.apache.org/jira/browse/HIVE-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944552#comment-14944552 ] Lefty Leverenz commented on HIVE-11720: --- Doc note: This adds configuration parameters *hive.server2.thrift.http.request.header.size* and *hive.server2.thrift.http.response.header.size* so they need to be documented in the wiki. * [Configuration Properties -- HiveServer2 | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-HiveServer2] > Allow HiveServer2 to set custom http request/response header size > - > > Key: HIVE-11720 > URL: https://issues.apache.org/jira/browse/HIVE-11720 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Reporter: Vaibhav Gumashta >Assignee: Vaibhav Gumashta > Labels: TODOC1.3 > Fix For: 1.3.0, 2.0.0 > > Attachments: HIVE-11720.1.patch, HIVE-11720.2.patch, > HIVE-11720.3.patch, HIVE-11720.4.patch, HIVE-11720.4.patch > > > In HTTP transport mode, authentication information is sent over as part of > HTTP headers. Sometimes (observed when Kerberos is used) the default buffer > size for the headers is not enough, resulting in an HTTP 413 FULL head error. > We can expose those as customizable params. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11720) Allow HiveServer2 to set custom http request/response header size
[ https://issues.apache.org/jira/browse/HIVE-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-11720: -- Labels: TODOC1.3 (was: ) > Allow HiveServer2 to set custom http request/response header size > - > > Key: HIVE-11720 > URL: https://issues.apache.org/jira/browse/HIVE-11720 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Reporter: Vaibhav Gumashta >Assignee: Vaibhav Gumashta > Labels: TODOC1.3 > Fix For: 1.3.0, 2.0.0 > > Attachments: HIVE-11720.1.patch, HIVE-11720.2.patch, > HIVE-11720.3.patch, HIVE-11720.4.patch, HIVE-11720.4.patch > > > In HTTP transport mode, authentication information is sent over as part of > HTTP headers. Sometimes (observed when Kerberos is used) the default buffer > size for the headers is not enough, resulting in an HTTP 413 FULL head error. > We can expose those as customizable params. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11212) Create vectorized types for complex types
[ https://issues.apache.org/jira/browse/HIVE-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-11212: - Attachment: HIVE-11212.patch Create the new vectorization columns. > Create vectorized types for complex types > - > > Key: HIVE-11212 > URL: https://issues.apache.org/jira/browse/HIVE-11212 > Project: Hive > Issue Type: Sub-task >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-11212.patch > > > We need vectorized types for structs, maps, lists, and unions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11642) LLAP: make sure tests pass #3
[
https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944519#comment-14944519
]
Hive QA commented on HIVE-11642:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765113/HIVE-11642.20.patch
{color:green}SUCCESS:{color} +1 due to 44 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 9750 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_orc_llap
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_explainuser_1
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.jdbc.TestSSL.testSSLVersion
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5543/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5543/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5543/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 4 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765113 - PreCommit-HIVE-TRUNK-Build
> LLAP: make sure tests pass #3
> -
>
> Key: HIVE-11642
> URL: https://issues.apache.org/jira/browse/HIVE-11642
> Project: Hive
> Issue Type: Sub-task
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
> Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch,
> HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch,
> HIVE-11642.20.patch, HIVE-11642.patch
>
>
> Tests should pass against the most recent branch and Tez 0.8.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-12032) Add unit test for HIVE-9855
[ https://issues.apache.org/jira/browse/HIVE-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944506#comment-14944506 ] Wei Zheng commented on HIVE-12032: -- [~jdere] Can you review this? Thanks! > Add unit test for HIVE-9855 > --- > > Key: HIVE-12032 > URL: https://issues.apache.org/jira/browse/HIVE-12032 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.0, 1.2.1 >Reporter: Wei Zheng >Assignee: Wei Zheng > Attachments: HIVE-12032.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12032) Add unit test for HIVE-9855
[
https://issues.apache.org/jira/browse/HIVE-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944452#comment-14944452
]
Hive QA commented on HIVE-12032:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765066/HIVE-12032.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9653 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.jdbc.TestSSL.testSSLVersion
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5541/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5541/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5541/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765066 - PreCommit-HIVE-TRUNK-Build
> Add unit test for HIVE-9855
> ---
>
> Key: HIVE-12032
> URL: https://issues.apache.org/jira/browse/HIVE-12032
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.0, 1.2.1
>Reporter: Wei Zheng
>Assignee: Wei Zheng
> Attachments: HIVE-12032.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teddy Choi updated HIVE-11533:
--
Description:
Long*CompareLong* classes can be optimized with subtraction and bitwise
operators for better SIMD optimization.
{code}
for(int i = 0; i != n; i++) {
outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
}
{code}
This issue will cover following classes;
- LongColEqualLongColumn
- LongColNotEqualLongColumn
- LongColGreaterLongColumn
- LongColGreaterEqualLongColumn
- LongColLessLongColumn
- LongColLessEqualLongColumn
- LongScalarEqualLongColumn
- LongScalarNotEqualLongColumn
- LongScalarGreaterLongColumn
- LongScalarGreaterEqualLongColumn
- LongScalarLessLongColumn
- LongScalarLessEqualLongColumn
- LongColEqualLongScalar
- LongColNotEqualLongScalar
- LongColGreaterLongScalar
- LongColGreaterEqualLongScalar
- LongColLessLongScalar
- LongColLessEqualLongScalar
was:
Long*CompareLong* classes can be optimized with subtraction and bitwise
operators for better SIMD optimization.
{code}
for(int i = 0; i != n; i++) {
outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
}
{code}
This issue will cover following classes;
- LongColEqualLongColumn
- LongColNotEqualLongColumn
- LongColGreaterLongColumn
- LongColGreaterEqualLongColumn
- LongColLessLongColumn
- LongColLessEqualLongColumn
- LongScalarEqualLongColumn
- LongScalarNotEqualLongColumn
- LongScalarGreaterLongColumn
- LongScalarGreaterEqualLongColumn
- LongScalarLessLongColumn
- LongScalarLessEqualLongColumn
- LongColEqualLongScalar
- LongColNotLongScalar
- LongColGreaterLongScalar
- LongColGreaterEqualLongScalar
- LongColLessLongScalar
- LongColLessEqualLongScalar
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch, HIVE-11533.2.patch,
> HIVE-11533.3.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColNotEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarNotEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColNotEqualLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teddy Choi updated HIVE-11533:
--
Description:
Long*CompareLong* classes can be optimized with subtraction and bitwise
operators for better SIMD optimization.
{code}
for(int i = 0; i != n; i++) {
outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
}
{code}
This issue will cover following classes;
- LongColEqualLongColumn
- LongColNotEqualLongColumn
- LongColGreaterLongColumn
- LongColGreaterEqualLongColumn
- LongColLessLongColumn
- LongColLessEqualLongColumn
- LongScalarEqualLongColumn
- LongScalarNotEqualLongColumn
- LongScalarGreaterLongColumn
- LongScalarGreaterEqualLongColumn
- LongScalarLessLongColumn
- LongScalarLessEqualLongColumn
- LongColEqualLongScalar
- LongColNotLongScalar
- LongColGreaterLongScalar
- LongColGreaterEqualLongScalar
- LongColLessLongScalar
- LongColLessEqualLongScalar
was:
Long*CompareLong* classes can be optimized with subtraction and bitwise
operators for better SIMD optimization.
{code}
for(int i = 0; i != n; i++) {
outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
}
{code}
This issue will cover following classes;
- LongColEqualLongColumn
- LongColGreaterLongColumn
- LongColGreaterEqualLongColumn
- LongColLessLongColumn
- LongColLessEqualLongColumn
- LongScalarEqualLongColumn
- LongScalarGreaterLongColumn
- LongScalarGreaterEqualLongColumn
- LongScalarLessLongColumn
- LongScalarLessEqualLongColumn
- LongColEqualLongScalar
- LongColGreaterLongScalar
- LongColGreaterEqualLongScalar
- LongColLessLongScalar
- LongColLessEqualLongScalar
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch, HIVE-11533.2.patch,
> HIVE-11533.3.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColNotEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarNotEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColNotLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teddy Choi updated HIVE-11533:
--
Description:
Long*CompareLong* classes can be optimized with subtraction and bitwise
operators for better SIMD optimization.
{code}
for(int i = 0; i != n; i++) {
outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
}
{code}
This issue will cover following classes;
- LongColEqualLongColumn
- LongColGreaterLongColumn
- LongColGreaterEqualLongColumn
- LongColLessLongColumn
- LongColLessEqualLongColumn
- LongScalarEqualLongColumn
- LongScalarGreaterLongColumn
- LongScalarGreaterEqualLongColumn
- LongScalarLessLongColumn
- LongScalarLessEqualLongColumn
- LongColEqualLongScalar
- LongColGreaterLongScalar
- LongColGreaterEqualLongScalar
- LongColLessLongScalar
- LongColLessEqualLongScalar
was:
Long*CompareLong* classes can be optimized with subtraction and bitwise
operators for better SIMD optimization.
{code}
for(int i = 0; i != n; i++) {
outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
}
{code}
This issue will cover following classes;
- LongColEqualLongColumn
- LongColGreaterLongColumn
- LongColGreaterEqualLongColumn
- LongColLessLongColumn
- LongColLessEqualLongColumn
- LongScalarEqualLongColumn
- LongScalarGreaterLongColumn
- LongScalarGreaterEqualLongColumn
- LongScalarLessLongColumn
- LongScalarLessEqualLongColumn
- LongColEqualLongScalar
- LongColGreaterLongScalar
- LongColGreaterEqualLongScalar
- LongColLessLongScalar
- LongColLessEqualLongScalar
- LongScalarEqualLongScalar
- LongScalarGreaterLongScalar
- LongScalarGreaterEqualLongScalar
- LongScalarLessLongScalar
- LongScalarLessEqualLongScalar
Scalar-scalar operations will not get performance gain from optimization.
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch, HIVE-11533.2.patch,
> HIVE-11533.3.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teddy Choi updated HIVE-11533:
--
Attachment: HIVE-11533.3.patch
Fixed bugs. Uploaded for automated testing.
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch, HIVE-11533.2.patch,
> HIVE-11533.3.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
> - LongScalarEqualLongScalar
> - LongScalarGreaterLongScalar
> - LongScalarGreaterEqualLongScalar
> - LongScalarLessLongScalar
> - LongScalarLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-12038) Fix the 'overall' section in the HiveQA report
[
https://issues.apache.org/jira/browse/HIVE-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated HIVE-12038:
-
Attachment: HIVE-12038.patch
Uploading patch.
NO PRECOMMIT TESTS
> Fix the 'overall' section in the HiveQA report
> --
>
> Key: HIVE-12038
> URL: https://issues.apache.org/jira/browse/HIVE-12038
> Project: Hive
> Issue Type: Improvement
> Components: Testing Infrastructure
>Reporter: Szehon Ho
>Assignee: Szehon Ho
>Priority: Minor
> Attachments: HIVE-12038.patch
>
>
> HIVE-11913 added a new review to HiveQA that checks for added unit tests,
> however this is not reflected in the 'Overall' review at the top of the JIRA
> comment. Example below:
> {color:red}Overall{color}: -1 at least one tests failed
> Here are the results of testing the latest attachment:
> https://issues.apache.org/jira/secure/attachment/12764994/HIVE-11976.03.patch
> {color:red}ERROR:{color} -1 due to no test(s) being added or modified.
> {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9645 tests
> executed
> *Failed tests:*
> {noformat}
> org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
> {noformat}
> Test results:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/testReport
> Console output:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/console
> Test logs:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5534/
> Messages:
> {noformat}
> Executing org.apache.hive.ptest.execution.TestCheckPhase
> Executing org.apache.hive.ptest.execution.PrepPhase
> Executing org.apache.hive.ptest.execution.ExecutionPhase
> Executing org.apache.hive.ptest.execution.ReportingPhase
> Tests exited with: TestsFailedException: 1 tests failed
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (HIVE-11676) implement metastore API to do file footer PPD
[ https://issues.apache.org/jira/browse/HIVE-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944397#comment-14944397 ] Sergey Shelukhin edited comment on HIVE-11676 at 10/6/15 2:03 AM: -- This patch will need a slight modification. If we send stripe boundaries in the PPD result, we don't need to return the footer at all. The rest can be reviewed. was (Author: sershe): This patch will need a slight modification. If we send stripe boundaries in the PPD result, we don't need to return the footer to AM at all. The rest can be reviewed. > implement metastore API to do file footer PPD > - > > Key: HIVE-11676 > URL: https://issues.apache.org/jira/browse/HIVE-11676 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11676.01.patch, HIVE-11676.patch > > > Need to pass on the expression/sarg, extract column stats from footer (at > write time?) and then apply one to the other. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11676) implement metastore API to do file footer PPD
[ https://issues.apache.org/jira/browse/HIVE-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944397#comment-14944397 ] Sergey Shelukhin commented on HIVE-11676: - This patch will need a slight modification. If we send stripe boundaries in the PPD result, we don't need to return the footer to AM at all. The rest can be reviewed. > implement metastore API to do file footer PPD > - > > Key: HIVE-11676 > URL: https://issues.apache.org/jira/browse/HIVE-11676 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11676.01.patch, HIVE-11676.patch > > > Need to pass on the expression/sarg, extract column stats from footer (at > write time?) and then apply one to the other. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11642: Attachment: (was: HIVE-11642.19.patch) > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.20.patch, HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11642: Attachment: HIVE-11642.20.patch Updated some files. Some I cannot repro. > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.20.patch, HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11969) start Tez session in background when starting CLI
[
https://issues.apache.org/jira/browse/HIVE-11969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944388#comment-14944388
]
Hive QA commented on HIVE-11969:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765062/HIVE-11969.04.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 9652 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.jdbc.TestJdbcWithLocalClusterSpark.testTempTable
org.apache.hive.jdbc.TestSSL.testSSLVersion
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5540/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5540/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5540/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765062 - PreCommit-HIVE-TRUNK-Build
> start Tez session in background when starting CLI
> -
>
> Key: HIVE-11969
> URL: https://issues.apache.org/jira/browse/HIVE-11969
> Project: Hive
> Issue Type: Bug
> Components: Tez
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
> Attachments: HIVE-11969.01.patch, HIVE-11969.02.patch,
> HIVE-11969.03.patch, HIVE-11969.04.patch, HIVE-11969.patch, Screen Shot
> 2015-10-02 at 14.23.17 .png
>
>
> Tez session spins up AM, which can cause delays, esp. if the cluster is very
> busy.
> This can be done in background, so the AM might get started while the user is
> running local commands and doing other things.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-12037) ORC: allow disabling orc meta index for large string type column
[ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944357#comment-14944357 ] Kshitiz Tripathi commented on HIVE-12037: - Sorry I meant large string or CLOB type, updated the description. > ORC: allow disabling orc meta index for large string type column > > > Key: HIVE-12037 > URL: https://issues.apache.org/jira/browse/HIVE-12037 > Project: Hive > Issue Type: Bug > Components: StorageHandler >Reporter: Kshitiz Tripathi > Labels: orcfile > > Our ORC table consist of a large string type field with average size >20KB. > The ORC meta explodes because of such field and we need a switch in hive to > disable meta generation for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12037) ORC: allow disabling orc meta index for large string type column
[ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kshitiz Tripathi updated HIVE-12037: Description: Our ORC table consist of a large string type field with average size >20KB. The ORC meta explodes because of such field and we need a switch in hive to disable meta generation for it. (was: Our ORC table consist of a clob type field with average size >20KB. The ORC meta explodes because of such field and we need a switch in hive to disable meta generation for it.) > ORC: allow disabling orc meta index for large string type column > > > Key: HIVE-12037 > URL: https://issues.apache.org/jira/browse/HIVE-12037 > Project: Hive > Issue Type: Bug > Components: StorageHandler >Reporter: Kshitiz Tripathi > Labels: orcfile > > Our ORC table consist of a large string type field with average size >20KB. > The ORC meta explodes because of such field and we need a switch in hive to > disable meta generation for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12037) ORC: allow disabling orc meta index for large string type column
[ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kshitiz Tripathi updated HIVE-12037: Summary: ORC: allow disabling orc meta index for large string type column (was: ORC: allow disabling orc meta index for clob type column) > ORC: allow disabling orc meta index for large string type column > > > Key: HIVE-12037 > URL: https://issues.apache.org/jira/browse/HIVE-12037 > Project: Hive > Issue Type: Bug > Components: StorageHandler >Reporter: Kshitiz Tripathi > Labels: orcfile > > Our ORC table consist of a clob type field with average size >20KB. The ORC > meta explodes because of such field and we need a switch in hive to disable > meta generation for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12037) ORC: allow disabling orc meta index for clob type column
[ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kshitiz Tripathi updated HIVE-12037: Summary: ORC: allow disabling orc meta index for clob type column (was: ORC: allow disabling orc meta index for blob type column) > ORC: allow disabling orc meta index for clob type column > > > Key: HIVE-12037 > URL: https://issues.apache.org/jira/browse/HIVE-12037 > Project: Hive > Issue Type: Bug > Components: StorageHandler >Reporter: Kshitiz Tripathi > Labels: orcfile > > Our ORC table consist of a blob type field with average size >20KB. The ORC > meta explodes because of such field and we need a switch in hive to disable > meta generation for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12037) ORC: allow disabling orc meta index for clob type column
[ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kshitiz Tripathi updated HIVE-12037: Description: Our ORC table consist of a clob type field with average size >20KB. The ORC meta explodes because of such field and we need a switch in hive to disable meta generation for it. (was: Our ORC table consist of a blob type field with average size >20KB. The ORC meta explodes because of such field and we need a switch in hive to disable meta generation for it.) > ORC: allow disabling orc meta index for clob type column > > > Key: HIVE-12037 > URL: https://issues.apache.org/jira/browse/HIVE-12037 > Project: Hive > Issue Type: Bug > Components: StorageHandler >Reporter: Kshitiz Tripathi > Labels: orcfile > > Our ORC table consist of a clob type field with average size >20KB. The ORC > meta explodes because of such field and we need a switch in hive to disable > meta generation for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12037) ORC: allow disabling orc meta index for blob type column
[ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944354#comment-14944354 ] Kshitiz Tripathi commented on HIVE-12037: - Its string but the values are typically > 20KB > ORC: allow disabling orc meta index for blob type column > > > Key: HIVE-12037 > URL: https://issues.apache.org/jira/browse/HIVE-12037 > Project: Hive > Issue Type: Bug > Components: StorageHandler >Reporter: Kshitiz Tripathi > Labels: orcfile > > Our ORC table consist of a blob type field with average size >20KB. The ORC > meta explodes because of such field and we need a switch in hive to disable > meta generation for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12017) Do not disable CBO by default when number of joins in a query is equal or less than 1
[ https://issues.apache.org/jira/browse/HIVE-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944296#comment-14944296 ] Sergey Shelukhin commented on HIVE-12017: - test failures might be related... > Do not disable CBO by default when number of joins in a query is equal or > less than 1 > - > > Key: HIVE-12017 > URL: https://issues.apache.org/jira/browse/HIVE-12017 > Project: Hive > Issue Type: Improvement > Components: CBO >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-12017.01.patch > > > Instead, we could disable some parts of CBO that are not relevant if the > query contains 1 or 0 joins. Implementation should be able to define easily > other query patterns for which we might disable some parts of CBO (in case we > want to do it in the future). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-8519) Hive metastore lock wait timeout
[ https://issues.apache.org/jira/browse/HIVE-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944297#comment-14944297 ] Sushanth Sowmyan commented on HIVE-8519: I notice a similar issue when I try to drop a table with about 5 partitions. Essentially, what seems to be happening with that flow is the following: a) Deleting a table requires deleting all partition objects for that table, Table->Partition is a 1:many mapping b) Deleting the partition objects requires deleting a all SD objects associated with the partitions, Partition->SD is a 1:1 mapping c) Deleting SD objects requires looking for all CDs pointed to by the SDs, and wherever a CD has no more SDs pointing to it, we need to drop the CD in question, SD->CD is a many:1 mapping. d) If a CD is to be deleted, we need to drop all List associated with it (COLUMNS_V2 where CD_ID in list of CDs to delete.) The big inefficiency here is that SD->CD is a many:1 mapping with a goal of reusing CDs for efficiency, but in practice, we don't. But the fact that it is many:1, not 1:1, means we need to do that additional check before dropping rather than simply dropping. This combination hits us in the worst way possible for both of those. We need to rethink the way we use our objects and either drop the many:1 intent or actually make sure that we create a unique CD for every SD, or this is not going to be scalable. Other solutions that bypass this wonky model may also exist that we have to work out. > Hive metastore lock wait timeout > > > Key: HIVE-8519 > URL: https://issues.apache.org/jira/browse/HIVE-8519 > Project: Hive > Issue Type: Bug > Components: Metastore >Affects Versions: 0.10.0 >Reporter: Liao, Xiaoge > > We got a lot of exception as below when doing a drop table partition, which > made hive query every every slow. For example, it will cost 250s while > executing use db_test; > Log: > 2014-10-17 04:04:46,873 ERROR Datastore.Persist (Log4JLogger.java:error(115)) > - Update of object > "org.apache.hadoop.hive.metastore.model.MStorageDescriptor@13c9c4b3" using > statement "UPDATE `SDS` SET `CD_ID`=? WHERE `SD_ID`=?" failed : > java.sql.SQLException: Lock wait timeout exceeded; try restarting transaction > at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1074) > at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4096) > at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4028) > at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2490) > at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2651) > at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2734) > at > com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155) > at > com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2458) > at > com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2375) > at > com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2359) > at > org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105) > at > org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105) > at > org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeUpdate(ParamLoggingPreparedStatement.java:399) > at > org.datanucleus.store.rdbms.SQLController.executeStatementUpdate(SQLController.java:439) > at > org.datanucleus.store.rdbms.request.UpdateRequest.execute(UpdateRequest.java:374) > at > org.datanucleus.store.rdbms.RDBMSPersistenceHandler.updateTable(RDBMSPersistenceHandler.java:417) > at > org.datanucleus.store.rdbms.RDBMSPersistenceHandler.updateObject(RDBMSPersistenceHandler.java:390) > at > org.datanucleus.state.JDOStateManager.flush(JDOStateManager.java:5012) > at org.datanucleus.FlushOrdered.execute(FlushOrdered.java:106) > at > org.datanucleus.ExecutionContextImpl.flushInternal(ExecutionContextImpl.java:4019) > at > org.datanucleus.ExecutionContextThreadedImpl.flushInternal(ExecutionContextThreadedImpl.java:450) > at org.datanucleus.store.query.Query.prepareDatastore(Query.java:1575) > at org.datanucleus.store.query.Query.executeQuery(Query.java:1760) > at org.datanucleus.store.query.Query.executeWithArray(Query.java:1672) > at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:243) > at > org.apache.hadoop.hive.metastore.ObjectStore.listStorageDescriptorsWithCD(ObjectStore.java:2185) > at > org.apache.hadoop.hive.metastore.ObjectStore.removeUnusedColumnDescriptor(ObjectStore.java:2131) > at > org.apache.hadoop.hive.metastore.ObjectSto
[jira] [Commented] (HIVE-12012) select query on json table with map containing numeric values fails
[
https://issues.apache.org/jira/browse/HIVE-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944293#comment-14944293
]
Jason Dere commented on HIVE-12012:
---
TestMTQueries seems to pass for me locally
> select query on json table with map containing numeric values fails
> ---
>
> Key: HIVE-12012
> URL: https://issues.apache.org/jira/browse/HIVE-12012
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
>Reporter: Jagruti Varia
>Assignee: Jason Dere
> Attachments: HIVE-12012.1.patch
>
>
> select query on json table throws this error if table contains map type
> column:
> {noformat}
> Failed with exception
> java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException:
> org.codehaus.jackson.JsonParseException: Current token (FIELD_NAME) not
> numeric, can not use numeric value accessors
> at [Source: java.io.ByteArrayInputStream@295f79b; line: 1, column: 26]
> {noformat}
> steps to reproduce the issue:
> {noformat}
> hive> create table c_complex(a array,b map) row format
> serde 'org.apache.hive.hcatalog.data.JsonSerDe';
> OK
> Time taken: 0.319 seconds
> hive> insert into table c_complex select array('aaa'),map('aaa',1) from
> studenttab10k limit 2;
> Query ID = hrt_qa_20150826183232_47deb33a-19c0-4d2b-a92f-726659eb9413
> Total jobs = 1
> Launching Job 1 out of 1
> Status: Running (Executing on YARN cluster with App id
> application_1440603993714_0010)
>
> VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED
> KILLED
>
> Map 1 .. SUCCEEDED 1 100 0
> 0
> Reducer 2 .. SUCCEEDED 1 100 0
> 0
>
> VERTICES: 02/02 [==>>] 100% ELAPSED TIME: 11.75 s
>
>
> Loading data to table default.c_complex
> Table default.c_complex stats: [numFiles=1, numRows=2, totalSize=56,
> rawDataSize=0]
> OK
> Time taken: 13.706 seconds
> hive> select * from c_complex;
> OK
> Failed with exception
> java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException:
> org.codehaus.jackson.JsonParseException: Current token (FIELD_NAME) not
> numeric, can not use numeric value accessors
> at [Source: java.io.ByteArrayInputStream@295f79b; line: 1, column: 26]
> Time taken: 0.115 seconds
> hive> select count(*) from c_complex;
> OK
> 2
> Time taken: 0.205 seconds, Fetched: 1 row(s)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (HIVE-12040) CBO: Use CBO, even for the 1 JOIN + GROUP BY case
[ https://issues.apache.org/jira/browse/HIVE-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-12040. Resolution: Duplicate > CBO: Use CBO, even for the 1 JOIN + GROUP BY case > - > > Key: HIVE-12040 > URL: https://issues.apache.org/jira/browse/HIVE-12040 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer >Affects Versions: 1.3.0, 2.0.0 >Reporter: Gopal V >Assignee: Gopal V > Fix For: 1.3.0, 2.0.0 > > > Hive CBO kicks in for a query only if a query has >1 joins, which is an > archaic result of only re-ordering joins in the original impl. > As more group-by & filter optimizers have been added, modify the CBO impl to > kick in even if the query has a single JOIN. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11676) implement metastore API to do file footer PPD
[ https://issues.apache.org/jira/browse/HIVE-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944288#comment-14944288 ] Sergey Shelukhin commented on HIVE-11676: - [~thejas] Sushanth suggested pinging you :) > implement metastore API to do file footer PPD > - > > Key: HIVE-11676 > URL: https://issues.apache.org/jira/browse/HIVE-11676 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11676.01.patch, HIVE-11676.patch > > > Need to pass on the expression/sarg, extract column stats from footer (at > write time?) and then apply one to the other. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HIVE-12040) CBO: Use CBO, even for the 1 JOIN + GROUP BY case
[ https://issues.apache.org/jira/browse/HIVE-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-12040: -- Assignee: Gopal V > CBO: Use CBO, even for the 1 JOIN + GROUP BY case > - > > Key: HIVE-12040 > URL: https://issues.apache.org/jira/browse/HIVE-12040 > Project: Hive > Issue Type: Improvement > Components: Logical Optimizer >Affects Versions: 1.3.0, 2.0.0 >Reporter: Gopal V >Assignee: Gopal V > Fix For: 1.3.0, 2.0.0 > > > Hive CBO kicks in for a query only if a query has >1 joins, which is an > archaic result of only re-ordering joins in the original impl. > As more group-by & filter optimizers have been added, modify the CBO impl to > kick in even if the query has a single JOIN. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11642) LLAP: make sure tests pass #3
[
https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944285#comment-14944285
]
Hive QA commented on HIVE-11642:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765060/HIVE-11642.19.patch
{color:green}SUCCESS:{color} +1 due to 44 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 9 failed/errored test(s), 9735 tests executed
*Failed tests:*
{noformat}
TestMiniTezCliDriver-vector_distinct_2.q-vector_interval_2.q-bucket3.q-and-12-more
- did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_auto_mult_tables
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_explainuser_1
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver_vectorized_dynamic_partition_pruning
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_groupby_reduce
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_index_bitmap_auto
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.jdbc.TestSSL.testSSLVersion
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5539/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5539/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5539/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 9 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765060 - PreCommit-HIVE-TRUNK-Build
> LLAP: make sure tests pass #3
> -
>
> Key: HIVE-11642
> URL: https://issues.apache.org/jira/browse/HIVE-11642
> Project: Hive
> Issue Type: Sub-task
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
> Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch,
> HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch,
> HIVE-11642.19.patch, HIVE-11642.patch
>
>
> Tests should pass against the most recent branch and Tez 0.8.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11489) Jenkins PreCommit-HIVE-SPARK-Build fails with TestCliDriver.initializationError
[
https://issues.apache.org/jira/browse/HIVE-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944278#comment-14944278
]
Hive QA commented on HIVE-11489:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765078/HIVE-11489.1-spark.patch
{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 7455 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.initializationError
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_vector_inner_join
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_vector_outer_join2
org.apache.hadoop.hive.cli.TestMinimrCliDriver.initializationError
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
org.apache.hive.hcatalog.streaming.TestStreaming.testRemainingTransactions
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/959/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/959/console
Test logs:
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-959/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765078 - PreCommit-HIVE-SPARK-Build
> Jenkins PreCommit-HIVE-SPARK-Build fails with
> TestCliDriver.initializationError
> ---
>
> Key: HIVE-11489
> URL: https://issues.apache.org/jira/browse/HIVE-11489
> Project: Hive
> Issue Type: Task
> Components: Testing Infrastructure
>Reporter: Sergio Peña
>Assignee: Sergio Peña
> Attachments: HIVE-11489.1-spark.patch
>
>
> The Jenkins job {{PreCommit-HIVE-SPARK-Build}} is failing due to many
> {{TestCliDriver.initializationError}} test results.
> {noformat}
> Error Message
> Unexpected exception java.io.FileNotFoundException:
> /data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCliDriverQFileNames.txt
> (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.(FileInputStream.java:146)
> at java.io.FileReader.(FileReader.java:72)
> at
> org.apache.hadoop.hive.ql.QTestUtil.addTestsToSuiteFromQfileNames(QTestUtil.java:2019)
> at org.apache.hadoop.hive.cli.TestCliDriver.suite(TestCliDriver.java:120)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.junit.internal.runners.SuiteMethod.testFromSuiteMethod(SuiteMethod.java:35)
> at org.junit.internal.runners.SuiteMethod.(SuiteMethod.java:24)
> at
> org.junit.internal.builders.SuiteMethodBuilder.runnerForClass(SuiteMethodBuilder.java:11)
> at
> org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder.java:59)
> at
> org.junit.internal.builders.AllDefaultPossibilitiesBuilder.runnerForClass(AllDefaultPossibilitiesBuilder.java:26)
> at
> org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder.java:59)
> at org.junit.internal.requests.ClassRequest.getRunner(ClassRequest.java:26)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:262)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
> at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
> Stacktrace
> junit.framework.AssertionFailedError: Unexpected exception
> java.io.FileNotFoundException:
> /data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCliDriverQFileNames.txt
> (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.(FileInputStream.java:146)
> at java.io.FileReader.(FileReader.java:72)
> at
> org.apache.hado
[jira] [Updated] (HIVE-12039) Fix TestSSL#testSSLVersion
[ https://issues.apache.org/jira/browse/HIVE-12039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-12039: Affects Version/s: 2.0.0 1.3.0 > Fix TestSSL#testSSLVersion > --- > > Key: HIVE-12039 > URL: https://issues.apache.org/jira/browse/HIVE-12039 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.3.0, 2.0.0 >Reporter: Vaibhav Gumashta >Assignee: Vaibhav Gumashta > > Looks like it's only run on Linux and failing after HIVE-11720. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12011) unable to create temporary table using CTAS if regular table with that name already exists
[
https://issues.apache.org/jira/browse/HIVE-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944256#comment-14944256
]
Laljo John Pullokkaran commented on HIVE-12011:
---
+1
> unable to create temporary table using CTAS if regular table with that name
> already exists
> --
>
> Key: HIVE-12011
> URL: https://issues.apache.org/jira/browse/HIVE-12011
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-12011.01.patch
>
>
> CTAS temporary table query fails if regular table with the same name already
> exists.
> Steps to reproduce the issue:
> {noformat}
> hive> use dbtemptable;
> OK
> Time taken: 0.273 seconds
> hive> create table a(i int);
> OK
> Time taken: 0.297 seconds
> hive> create temporary table a(i int);
> OK
> Time taken: 0.165 seconds
> hive> create table b(i int);
> OK
> Time taken: 0.212 seconds
> hive> create temporary table b as select * from a;
> FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException:
> Table already exists: dbtemptable.b
> hive> create table c(i int);
> OK
> Time taken: 0.264 seconds
> hive> create temporary table b as select * from c;
> FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException:
> Table already exists: dbtemptable.b
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11676) implement metastore API to do file footer PPD
[ https://issues.apache.org/jira/browse/HIVE-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944199#comment-14944199 ] Sushanth Sowmyan commented on HIVE-11676: - +cc [~mithun] who was interested in this sort of api a while back. > implement metastore API to do file footer PPD > - > > Key: HIVE-11676 > URL: https://issues.apache.org/jira/browse/HIVE-11676 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11676.01.patch, HIVE-11676.patch > > > Need to pass on the expression/sarg, extract column stats from footer (at > write time?) and then apply one to the other. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11676) implement metastore API to do file footer PPD
[ https://issues.apache.org/jira/browse/HIVE-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944178#comment-14944178 ] Sergey Shelukhin commented on HIVE-11676: - [~sushanth] [~alangates] can you take a look? https://reviews.apache.org/r/39026/ > implement metastore API to do file footer PPD > - > > Key: HIVE-11676 > URL: https://issues.apache.org/jira/browse/HIVE-11676 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11676.01.patch, HIVE-11676.patch > > > Need to pass on the expression/sarg, extract column stats from footer (at > write time?) and then apply one to the other. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11489) Jenkins PreCommit-HIVE-SPARK-Build fails with TestCliDriver.initializationError
[
https://issues.apache.org/jira/browse/HIVE-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergio Peña updated HIVE-11489:
---
Attachment: HIVE-11489.1-spark.patch
> Jenkins PreCommit-HIVE-SPARK-Build fails with
> TestCliDriver.initializationError
> ---
>
> Key: HIVE-11489
> URL: https://issues.apache.org/jira/browse/HIVE-11489
> Project: Hive
> Issue Type: Task
> Components: Testing Infrastructure
>Reporter: Sergio Peña
>Assignee: Sergio Peña
> Attachments: HIVE-11489.1-spark.patch
>
>
> The Jenkins job {{PreCommit-HIVE-SPARK-Build}} is failing due to many
> {{TestCliDriver.initializationError}} test results.
> {noformat}
> Error Message
> Unexpected exception java.io.FileNotFoundException:
> /data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCliDriverQFileNames.txt
> (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.(FileInputStream.java:146)
> at java.io.FileReader.(FileReader.java:72)
> at
> org.apache.hadoop.hive.ql.QTestUtil.addTestsToSuiteFromQfileNames(QTestUtil.java:2019)
> at org.apache.hadoop.hive.cli.TestCliDriver.suite(TestCliDriver.java:120)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.junit.internal.runners.SuiteMethod.testFromSuiteMethod(SuiteMethod.java:35)
> at org.junit.internal.runners.SuiteMethod.(SuiteMethod.java:24)
> at
> org.junit.internal.builders.SuiteMethodBuilder.runnerForClass(SuiteMethodBuilder.java:11)
> at
> org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder.java:59)
> at
> org.junit.internal.builders.AllDefaultPossibilitiesBuilder.runnerForClass(AllDefaultPossibilitiesBuilder.java:26)
> at
> org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder.java:59)
> at org.junit.internal.requests.ClassRequest.getRunner(ClassRequest.java:26)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:262)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
> at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
> Stacktrace
> junit.framework.AssertionFailedError: Unexpected exception
> java.io.FileNotFoundException:
> /data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCliDriverQFileNames.txt
> (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.(FileInputStream.java:146)
> at java.io.FileReader.(FileReader.java:72)
> at
> org.apache.hadoop.hive.ql.QTestUtil.addTestsToSuiteFromQfileNames(QTestUtil.java:2019)
> at
> org.apache.hadoop.hive.cli.TestCliDriver.suite(TestCliDriver.java:120)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.junit.internal.runners.SuiteMethod.testFromSuiteMethod(SuiteMethod.java:35)
> at org.junit.internal.runners.SuiteMethod.(SuiteMethod.java:24)
> at
> org.junit.internal.builders.SuiteMethodBuilder.runnerForClass(SuiteMethodBuilder.java:11)
> at
> org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder.java:59)
> at
> org.junit.internal.builders.AllDefaultPossibilitiesBuilder.runnerForClass(AllDefaultPossibilitiesBuilder.java:26)
> at
> org.junit.runners.model.RunnerBuilder.safeRunnerForClass(RunnerBuilder.java:59)
> at
> org.junit.internal.requests.ClassRequest.getRunner(ClassRequest.java:26)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:262)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.j
[jira] [Updated] (HIVE-11676) implement metastore API to do file footer PPD
[ https://issues.apache.org/jira/browse/HIVE-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11676: Description: Need to pass on the expression/sarg, extract column stats from footer (at write time?) and then apply one to the other. (was: Need to pass on the expression/sarg, extract column stats from footer (at write time?) and then apply one to the other. I may file a separate JIRA for ORC changes cause that is usually PITA NO PRECOMMIT TESTS) > implement metastore API to do file footer PPD > - > > Key: HIVE-11676 > URL: https://issues.apache.org/jira/browse/HIVE-11676 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11676.01.patch, HIVE-11676.patch > > > Need to pass on the expression/sarg, extract column stats from footer (at > write time?) and then apply one to the other. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11676) implement metastore API to do file footer PPD
[ https://issues.apache.org/jira/browse/HIVE-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11676: Attachment: HIVE-11676.01.patch Rebased the patch on master > implement metastore API to do file footer PPD > - > > Key: HIVE-11676 > URL: https://issues.apache.org/jira/browse/HIVE-11676 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11676.01.patch, HIVE-11676.patch > > > Need to pass on the expression/sarg, extract column stats from footer (at > write time?) and then apply one to the other. I may file a separate JIRA for > ORC changes cause that is usually PITA > NO PRECOMMIT TESTS -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12027) simplify file metadata cache ppd api
[ https://issues.apache.org/jira/browse/HIVE-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12027: Fix Version/s: 2.0.0 > simplify file metadata cache ppd api > > > Key: HIVE-12027 > URL: https://issues.apache.org/jira/browse/HIVE-12027 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Fix For: 2.0.0 > > Attachments: HIVE-12027.nogen.patch, HIVE-12027.patch > > > I made it unwieldy for iterator model when the number of files is too large. > Fix it. Not shipped anywhere yet. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12032) Add unit test for HIVE-9855
[ https://issues.apache.org/jira/browse/HIVE-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-12032: - Attachment: HIVE-12032.patch > Add unit test for HIVE-9855 > --- > > Key: HIVE-12032 > URL: https://issues.apache.org/jira/browse/HIVE-12032 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.0, 1.2.1 >Reporter: Wei Zheng >Assignee: Wei Zheng > Attachments: HIVE-12032.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10755) Rework on HIVE-5193 to enhance the column oriented table acess
[
https://issues.apache.org/jira/browse/HIVE-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944083#comment-14944083
]
Aihua Xu commented on HIVE-10755:
-
[~daijy] I'm working on adding the unit tests you mentioned to
TestHCatLoader.java. Actually I have problem to load complex_table with the
following code.
{noformat}
PigServer server = new PigServer(ExecType.LOCAL);
server.registerQuery("A = load '" + COMPLEX_TABLE + "' using
org.apache.hive.hcatalog.pig.HCatLoader();");
server.registerQuery("B = load '" + COMPLEX_TABLE + "' using
org.apache.hive.hcatalog.pig.HCatLoader();");
server.registerQuery("C = join A by name, B by name;");
server.registerQuery("D = foreach C generate B::studentid;");
{noformat}
{{Iterator iter = server.openIterator("A");}} won't be able to access
the data, while if I replace with basic_table it's fine.
Don't know too much pig/hcatalog. I'm wondering if I did anything wrong?
> Rework on HIVE-5193 to enhance the column oriented table acess
> --
>
> Key: HIVE-10755
> URL: https://issues.apache.org/jira/browse/HIVE-10755
> Project: Hive
> Issue Type: Sub-task
> Components: HCatalog
>Affects Versions: 1.2.0
>Reporter: Aihua Xu
>Assignee: Aihua Xu
> Fix For: 2.0.0
>
> Attachments: HIVE-10755.patch
>
>
> Add the support of column pruning for column oriented table access which was
> done in HIVE-5193 but was reverted due to the join issue in HIVE-10720.
> In 1.3.0, the patch posted by Viray didn't work, probably due to some jar
> reference. That seems to get fixed and that patch works in 2.0.0 now.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-12032) Add unit test for HIVE-9855
[ https://issues.apache.org/jira/browse/HIVE-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-12032: - Attachment: (was: HIVE-12032.patch) > Add unit test for HIVE-9855 > --- > > Key: HIVE-12032 > URL: https://issues.apache.org/jira/browse/HIVE-12032 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.0, 1.2.1 >Reporter: Wei Zheng >Assignee: Wei Zheng > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12037) ORC: allow disabling orc meta index for blob type column
[ https://issues.apache.org/jira/browse/HIVE-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944078#comment-14944078 ] Gopal V commented on HIVE-12037: [~kshitiz8]: BINARY columns already don't do that - what is the type of your BLOB column? > ORC: allow disabling orc meta index for blob type column > > > Key: HIVE-12037 > URL: https://issues.apache.org/jira/browse/HIVE-12037 > Project: Hive > Issue Type: Bug > Components: StorageHandler >Reporter: Kshitiz Tripathi > Labels: orcfile > > Our ORC table consist of a blob type field with average size >20KB. The ORC > meta explodes because of such field and we need a switch in hive to disable > meta generation for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HIVE-12038) Fix the 'overall' section in the HiveQA report
[
https://issues.apache.org/jira/browse/HIVE-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho reassigned HIVE-12038:
Assignee: Szehon Ho
> Fix the 'overall' section in the HiveQA report
> --
>
> Key: HIVE-12038
> URL: https://issues.apache.org/jira/browse/HIVE-12038
> Project: Hive
> Issue Type: Improvement
> Components: Testing Infrastructure
>Reporter: Szehon Ho
>Assignee: Szehon Ho
>
> HIVE-11913 added a new review to HiveQA that checks for added unit tests,
> however this is not reflected in the 'Overall' review at the top of the JIRA
> comment. Example below:
> {color:red}Overall{color}: -1 at least one tests failed
> Here are the results of testing the latest attachment:
> https://issues.apache.org/jira/secure/attachment/12764994/HIVE-11976.03.patch
> {color:red}ERROR:{color} -1 due to no test(s) being added or modified.
> {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9645 tests
> executed
> *Failed tests:*
> {noformat}
> org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
> {noformat}
> Test results:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/testReport
> Console output:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/console
> Test logs:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5534/
> Messages:
> {noformat}
> Executing org.apache.hive.ptest.execution.TestCheckPhase
> Executing org.apache.hive.ptest.execution.PrepPhase
> Executing org.apache.hive.ptest.execution.ExecutionPhase
> Executing org.apache.hive.ptest.execution.ReportingPhase
> Tests exited with: TestsFailedException: 1 tests failed
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-12038) Fix the 'overall' section in the HiveQA report
[
https://issues.apache.org/jira/browse/HIVE-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated HIVE-12038:
-
Priority: Minor (was: Major)
> Fix the 'overall' section in the HiveQA report
> --
>
> Key: HIVE-12038
> URL: https://issues.apache.org/jira/browse/HIVE-12038
> Project: Hive
> Issue Type: Improvement
> Components: Testing Infrastructure
>Reporter: Szehon Ho
>Assignee: Szehon Ho
>Priority: Minor
>
> HIVE-11913 added a new review to HiveQA that checks for added unit tests,
> however this is not reflected in the 'Overall' review at the top of the JIRA
> comment. Example below:
> {color:red}Overall{color}: -1 at least one tests failed
> Here are the results of testing the latest attachment:
> https://issues.apache.org/jira/secure/attachment/12764994/HIVE-11976.03.patch
> {color:red}ERROR:{color} -1 due to no test(s) being added or modified.
> {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9645 tests
> executed
> *Failed tests:*
> {noformat}
> org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
> {noformat}
> Test results:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/testReport
> Console output:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/console
> Test logs:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5534/
> Messages:
> {noformat}
> Executing org.apache.hive.ptest.execution.TestCheckPhase
> Executing org.apache.hive.ptest.execution.PrepPhase
> Executing org.apache.hive.ptest.execution.ExecutionPhase
> Executing org.apache.hive.ptest.execution.ReportingPhase
> Tests exited with: TestsFailedException: 1 tests failed
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-12038) Fix the 'overall' section in the HiveQA report
[
https://issues.apache.org/jira/browse/HIVE-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated HIVE-12038:
-
Description:
HIVE-11913 added a new review to HiveQA that checks for added unit tests,
however this is not reflected in the 'Overall' review at the top of the JIRA
comment. Example below:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12764994/HIVE-11976.03.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9645 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5534/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
was:HIVE-11913 added a new review to HiveQA that checks for added unit tests,
however this is not reflected in the 'Overall' review at the top of the JIRA
comment.
> Fix the 'overall' section in the HiveQA report
> --
>
> Key: HIVE-12038
> URL: https://issues.apache.org/jira/browse/HIVE-12038
> Project: Hive
> Issue Type: Improvement
> Components: Testing Infrastructure
>Reporter: Szehon Ho
>
> HIVE-11913 added a new review to HiveQA that checks for added unit tests,
> however this is not reflected in the 'Overall' review at the top of the JIRA
> comment. Example below:
> {color:red}Overall{color}: -1 at least one tests failed
> Here are the results of testing the latest attachment:
> https://issues.apache.org/jira/secure/attachment/12764994/HIVE-11976.03.patch
> {color:red}ERROR:{color} -1 due to no test(s) being added or modified.
> {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9645 tests
> executed
> *Failed tests:*
> {noformat}
> org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
> {noformat}
> Test results:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/testReport
> Console output:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/console
> Test logs:
> http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5534/
> Messages:
> {noformat}
> Executing org.apache.hive.ptest.execution.TestCheckPhase
> Executing org.apache.hive.ptest.execution.PrepPhase
> Executing org.apache.hive.ptest.execution.ExecutionPhase
> Executing org.apache.hive.ptest.execution.ReportingPhase
> Tests exited with: TestsFailedException: 1 tests failed
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[
https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944061#comment-14944061
]
Hive QA commented on HIVE-12033:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765052/HIVE-12033.1-spark.patch
{color:red}ERROR:{color} -1 due to 1425 failed/errored test(s), 9456 tests
executed
*Failed tests:*
{noformat}
TestCliDriverBase - did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_vector_inner_join
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_vector_outer_join2
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_index_bitmap_auto
org.apache.hive.TestCliDriver.org.apache.hive.TestCliDriver
org.apache.hive.TestCliDriver.test[testCliDriver_add_part_exist]
org.apache.hive.TestCliDriver.test[testCliDriver_alter1]
org.apache.hive.TestCliDriver.test[testCliDriver_alter2]
org.apache.hive.TestCliDriver.test[testCliDriver_alter3]
org.apache.hive.TestCliDriver.test[testCliDriver_alter4]
org.apache.hive.TestCliDriver.test[testCliDriver_alter5]
org.apache.hive.TestCliDriver.test[testCliDriver_alter_index]
org.apache.hive.TestCliDriver.test[testCliDriver_alter_rename_partition]
org.apache.hive.TestCliDriver.test[testCliDriver_authorization_5]
org.apache.hive.TestCliDriver.test[testCliDriver_authorization_show_grant]
org.apache.hive.TestCliDriver.test[testCliDriver_authorization_show_role_principals_v1]
org.apache.hive.TestCliDriver.test[testCliDriver_authorization_view_sqlstd]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join14]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join15]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join17]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join18]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join19]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join21]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join23]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join25]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join26]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join2]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join32]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join3]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join4]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join5]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join6]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join7]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join8]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join9]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join_reordering_values]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_join_stats]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_smb_mapjoin_14]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_sortmerge_join_13]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_sortmerge_join_2]
org.apache.hive.TestCliDriver.test[testCliDriver_auto_sortmerge_join_4]
org.apache.hive.TestCliDriver.test[testCliDriver_avro_add_column3]
org.apache.hive.TestCliDriver.test[testCliDriver_avro_charvarchar]
org.apache.hive.TestCliDriver.test[testCliDriver_avro_partitioned_native]
org.apache.hive.TestCliDriver.test[testCliDriver_ba_table_udfs]
org.apache.hive.TestCliDriver.test[testCliDriver_binary_output_format]
org.apache.hive.TestCliDriver.test[testCliDriver_binarysortable_1]
org.apache.hive.TestCliDriver.test[testCliDriver_bucket1]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketcontext_2]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin1]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin2]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin3]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin4]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin5]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin8]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin_negative2]
org.apache.hive.TestCliDriver.test[testCliDriver_bucketmapjoin_negative]
org.apache.hive.TestCliDriver.test[testCliDriver_case_sensitivity]
org.apache.hive.TestCliDriver.test[testCliDriver_cast1]
org.apache.hive.TestCliDriver.test[testCliDriver_cast_qualified_types]
org.apache.hive.TestCliDriver.test[testCliDriver_cbo_join]
org.apache.hive.TestCliDriver.test[testCliDriver_cbo_limit]
org.apache.hive.TestCliDriver.test[testCliDriver_cbo_rp_auto_join17]
org.apache.hive.TestCliDriver.test[testCliDriver_cbo_rp_cross_product_check_2]
org.apache.hive.TestCliDriver.test[testCliDriver_cbo_rp_join]
org.apache.hive.TestCliDriver.test[testCliDriver_cbo_rp_limit]
org.apache.hive.TestCliDriver.test[testCliDriver_cbo_rp_outer_join_ppr]
org.apache.hive.Tes
[jira] [Commented] (HIVE-12038) Fix the 'overall' section in the HiveQA report
[ https://issues.apache.org/jira/browse/HIVE-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944062#comment-14944062 ] Szehon Ho commented on HIVE-12038: -- I know the 'Overall' score is included in HadoopQA, but I am thinking to actually remove it. It's a bit unnecessary in my opinion, I'm not UX expert but if there is already some red '-1' in the report the reader will already look to that, there is no need for an addition red Overall '-1' that just reiterates the information and just detracts. > Fix the 'overall' section in the HiveQA report > -- > > Key: HIVE-12038 > URL: https://issues.apache.org/jira/browse/HIVE-12038 > Project: Hive > Issue Type: Improvement > Components: Testing Infrastructure >Reporter: Szehon Ho > > HIVE-11913 added a new review to HiveQA that checks for added unit tests, > however this is not reflected in the 'Overall' review at the top of the JIRA > comment. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11969) start Tez session in background when starting CLI
[ https://issues.apache.org/jira/browse/HIVE-11969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11969: Attachment: HIVE-11969.04.patch Updated patch. > start Tez session in background when starting CLI > - > > Key: HIVE-11969 > URL: https://issues.apache.org/jira/browse/HIVE-11969 > Project: Hive > Issue Type: Bug > Components: Tez >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11969.01.patch, HIVE-11969.02.patch, > HIVE-11969.03.patch, HIVE-11969.04.patch, HIVE-11969.patch, Screen Shot > 2015-10-02 at 14.23.17 .png > > > Tez session spins up AM, which can cause delays, esp. if the cluster is very > busy. > This can be done in background, so the AM might get started while the user is > running local commands and doing other things. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11969) start Tez session in background when starting CLI
[ https://issues.apache.org/jira/browse/HIVE-11969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944044#comment-14944044 ] Sergey Shelukhin commented on HIVE-11969: - Will do that... but that is actually dangerous for future use, since it's easy to introduce the same bug that the original patch had - call isOpen() and then open if false. > start Tez session in background when starting CLI > - > > Key: HIVE-11969 > URL: https://issues.apache.org/jira/browse/HIVE-11969 > Project: Hive > Issue Type: Bug > Components: Tez >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11969.01.patch, HIVE-11969.02.patch, > HIVE-11969.03.patch, HIVE-11969.patch, Screen Shot 2015-10-02 at 14.23.17 .png > > > Tez session spins up AM, which can cause delays, esp. if the cluster is very > busy. > This can be done in background, so the AM might get started while the user is > running local commands and doing other things. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11976) Extend CBO rules to being able to apply rules only once on a given operator
[ https://issues.apache.org/jira/browse/HIVE-11976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944036#comment-14944036 ] Laljo John Pullokkaran commented on HIVE-11976: --- [~jcamachorodriguez] Could we add a unit test to make sure that HivePreFilter doesn't get executed more than once (onMatch) and doesn't get fired on child? Otherwise looks good. > Extend CBO rules to being able to apply rules only once on a given operator > --- > > Key: HIVE-11976 > URL: https://issues.apache.org/jira/browse/HIVE-11976 > Project: Hive > Issue Type: New Feature > Components: CBO >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-11976.01.patch, HIVE-11976.02.patch, > HIVE-11976.03.patch, HIVE-11976.patch > > > Create a way to bail out quickly from HepPlanner if the rule has been already > applied on a certain operator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12032) Add unit test for HIVE-9855
[
https://issues.apache.org/jira/browse/HIVE-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944030#comment-14944030
]
Hive QA commented on HIVE-12032:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765037/HIVE-12032.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 9652 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoin_onesideskew
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5536/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5536/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5536/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765037 - PreCommit-HIVE-TRUNK-Build
> Add unit test for HIVE-9855
> ---
>
> Key: HIVE-12032
> URL: https://issues.apache.org/jira/browse/HIVE-12032
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 1.2.0, 1.2.1
>Reporter: Wei Zheng
>Assignee: Wei Zheng
> Attachments: HIVE-12032.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11473) Upgrade Spark dependency to 1.5 [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-11473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944018#comment-14944018 ] Xuefu Zhang commented on HIVE-11473: Hi [~lirui], precommit-test has been suffering some env related issues and we are looking into it. I will take a look at the parquet test problem. Thanks. > Upgrade Spark dependency to 1.5 [Spark Branch] > -- > > Key: HIVE-11473 > URL: https://issues.apache.org/jira/browse/HIVE-11473 > Project: Hive > Issue Type: Bug > Components: Spark >Reporter: Jimmy Xiang >Assignee: Rui Li > Attachments: HIVE-11473.1-spark.patch, HIVE-11473.2-spark.patch, > HIVE-11473.3-spark.patch, HIVE-11473.3-spark.patch > > > In Spark 1.5, SparkListener interface is changed. So HoS may fail to create > the spark client if the un-implemented event callback method is invoked. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11642: Attachment: (was: HIVE-11642.19.patch) > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.19.patch, HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11642: Attachment: HIVE-11642.19.patch > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.19.patch, HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12021) HivePreFilteringRule may introduce wrong common operands
[ https://issues.apache.org/jira/browse/HIVE-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943994#comment-14943994 ] Laljo John Pullokkaran commented on HIVE-12021: --- [~jcamachorodriguez] Because of the comparison restrictions I am not sure if this issue ever get exposed. You will have to explicitly specify the type of literal or it has to be comparisons on multiple cols. But its ok to separate these in to two different issues. > HivePreFilteringRule may introduce wrong common operands > > > Key: HIVE-12021 > URL: https://issues.apache.org/jira/browse/HIVE-12021 > Project: Hive > Issue Type: Bug > Components: CBO >Affects Versions: 1.3.0, 1.2.1, 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Fix For: 1.3.0, 2.0.0, 1.2.2 > > Attachments: HIVE-12021.01.patch, HIVE-12021.02.patch, > HIVE-12021.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12021) HivePreFilteringRule may introduce wrong common operands
[ https://issues.apache.org/jira/browse/HIVE-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943936#comment-14943936 ] Jesus Camacho Rodriguez commented on HIVE-12021: [~jpullokkaran], IMO we could solve the correctness issue in this JIRA case, and check it in 2.0, 1.3, and 1.2.2 asap. The rule, as it stands with the fix, will cover the same use cases that it originally covered. Then I could open another JIRA to extend the rule to cover more cases. > HivePreFilteringRule may introduce wrong common operands > > > Key: HIVE-12021 > URL: https://issues.apache.org/jira/browse/HIVE-12021 > Project: Hive > Issue Type: Bug > Components: CBO >Affects Versions: 1.3.0, 1.2.1, 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Fix For: 1.3.0, 2.0.0, 1.2.2 > > Attachments: HIVE-12021.01.patch, HIVE-12021.02.patch, > HIVE-12021.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12021) HivePreFilteringRule may introduce wrong common operands
[ https://issues.apache.org/jira/browse/HIVE-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943935#comment-14943935 ] Jesus Camacho Rodriguez commented on HIVE-12021: [~jpullokkaran], IMO we could solve the correctness issue in this JIRA case, and check it in 2.0, 1.3, and 1.2.2 asap. The rule, as it stands with the fix, will cover the same use cases that it originally covered. Then I could open another JIRA to extend the rule to cover more cases. > HivePreFilteringRule may introduce wrong common operands > > > Key: HIVE-12021 > URL: https://issues.apache.org/jira/browse/HIVE-12021 > Project: Hive > Issue Type: Bug > Components: CBO >Affects Versions: 1.3.0, 1.2.1, 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Fix For: 1.3.0, 2.0.0, 1.2.2 > > Attachments: HIVE-12021.01.patch, HIVE-12021.02.patch, > HIVE-12021.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[ https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-12033: --- Attachment: HIVE-12033.1-spark.patch > Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable > - > > Key: HIVE-12033 > URL: https://issues.apache.org/jira/browse/HIVE-12033 > Project: Hive > Issue Type: Improvement > Components: Test >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña >Priority: Minor > Attachments: HIVE-12033.1-spark.patch, HIVE-12033.1.patch > > > The ANT auto-generated test sources make TestCliDriver code a little > complicated to debug with IntelliJ and Eclipse. Remote debugging is the best > choice to do it. > There must be a new way to move out the ANT auto-generated source plug-in, > and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and > Eclipse. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[ https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-12033: --- Attachment: (was: HIVE-12033.1-spark.patch) > Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable > - > > Key: HIVE-12033 > URL: https://issues.apache.org/jira/browse/HIVE-12033 > Project: Hive > Issue Type: Improvement > Components: Test >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña >Priority: Minor > Attachments: HIVE-12033.1-spark.patch, HIVE-12033.1.patch > > > The ANT auto-generated test sources make TestCliDriver code a little > complicated to debug with IntelliJ and Eclipse. Remote debugging is the best > choice to do it. > There must be a new way to move out the ANT auto-generated source plug-in, > and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and > Eclipse. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[
https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergio Peña updated HIVE-12033:
---
Comment: was deleted
(was:
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765048/HIVE-12033.1-spark.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/957/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/957/console
Test logs:
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-957/
Messages:
{noformat}
This message was trimmed, see log for full details
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
queryDir =
/data/hive-ptest/working/apache-git-source-source/itests/qtest/../../ql/src/test/queries/negative
queryDir = ql/src/test/queries/negative/
Generated
/data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/ql/parse/TestParseNegative.java
from template TestParseNegative.vm
Template
Path:/data/hive-ptest/working/apache-git-source-source/ql/src/test/templates
Starting Generation of: TestCompareCliDriver
Include Files: null
Excluded Files: null
Query Files:
Query Files Regex:
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
queryDir =
/data/hive-ptest/working/apache-git-source-source/itests/qtest/../../ql/src/test/queries/clientcompare
queryDir = ql/src/test/queries/clientcompare/
Generated
/data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCompareCliDriver.java
from template TestCompareCliDriver.vm
Template
Path:/data/hive-ptest/working/apache-git-source-source/ql/src/test/templates
Starting Generation of: TestMinimrCliDriver
Include Files:
auto_sortmerge_join_16.q,bucket4.q,bucket5.q,bucket6.q,bucket_many.q,bucket_num_reducers.q,bucket_num_reducers2.q,bucketizedhiveinputformat.q,bucketmapjoin6.q,bucketmapjoin7.q,constprog_partitioner.q,disable_merge_for_bucketing.q,empty_dir_in_table.q,exchgpartition2lel.q,external_table_with_space_in_location_path.q,file_with_header_footer.q,groupby2.q,import_exported_table.q,index_bitmap3.q,index_bitmap_auto.q,infer_bucket_sort_bucketed_table.q,infer_bucket_sort_dyn_part.q,infer_bucket_sort_map_operators.q,infer_bucket_sort_merge.q,infer_bucket_sort_num_buckets.q,infer_bucket_sort_reducers_power_two.q,input16_cc.q,join1.q,leftsemijoin_mr.q,list_bucket_dml_10.q,load_fs2.q,load_hdfs_file_with_space_in_the_name.q,non_native_window_udf.q,
optrstat_groupby.q,parallel_orderby.q,ql_rewrite_gbtoidx.q,ql_rewrite_gbtoidx_cbo_1.q,ql_rewrite_gbtoidx_cbo_2.q,quotedid_smb.q,reduce_deduplicate.q,remote_script.q,root_dir_external_table.q,schemeAuthority.q,schemeAuthority2.q,scriptfile1.q,scriptfile1_win.q,smb_mapjoin_8.q,stats_counter.q,stats_counter_partitioned.q,table_nonprintable.q,temp_table_external.q,truncate_column_buckets.q,uber_reduce.q,udf_using.q
Excluded Files: null
Query Files:
Query Files Regex:
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
queryDir =
/data/hive-ptest/working/apache-git-source-source/itests/qtest/../../ql/src/test/queries/clientpositive
queryDir = ql/src/test/queries/clientpositive/
Generated
/data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestMinimrCliDriver.java
from template TestCliDriver.vm
Template
Path:/data/hive-ptest/working/apache-git-source-source/ql/src/test/templates
Starting Generation of: TestMiniTezCliDriver
Include Files:
bucket_map_join_tez1.q,bucket_map_join_tez2.q,constprog_dpp.q,dynamic_partition_pruning.q,dynamic_partition_pruning_2.q,explainuser_1.q,explainuser_2.q,explainuser_3.q,hybridgrace_hashjoin_1.q,hybridgrace_hashjoin_2.q,mapjoin_decimal.q,lvj_mapjoin.q,
mrr.q,orc_ppd_basic.q,tez_bmj_schema_evolution.q,tez_dml.q,tez_fsstat.q,tez_insert_overwrite_local_directory_1.q,tez_dynpart_hashjoin_1.q,tez_dynpart_hashjoin_2.q,tez_vector_dynpart_hashjoin_1.q,tez_vector_dynpart_hashjoin_2.q,tez_join_hash.q,tez_join_result_complex.q,tez_join_tests.q,tez_joins_explain.q,tez_schema_evolution.q,tez_self_join.q,tez_union.q,tez_union2.q,tez_union_dynamic_partition.q,tez_union_view.q,tez_union_decimal.q,tez_union_group_by.q,tez_smb_main.q,tez_smb_1.q,vectorized_dynamic_partition_pruning.q,tez_multi_union.q,tez_join.q,tez_union_multiinsert.q,alter_merge_2_orc.q,alter_merge_orc.q,alter_merge_stats_orc.q,auto_join0.q,auto_join1.q,bucket2.q,bucket3.q,bucket4.q,cbo_gby.q,cbo_gby_empty.q,cbo_join.q,cbo_limit.q,cbo_semijoin.q,cbo_simple_select.q,cbo_stats.q,cbo_subq_e
[jira] [Updated] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11642: Attachment: (was: HIVE-11642.17.patch) > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.19.patch, HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11642: Attachment: (was: HIVE-11642.18.patch) > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.17.patch, HIVE-11642.19.patch, HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-11642: Attachment: HIVE-11642.19.patch Merge from master and fix the issue > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.17.patch, HIVE-11642.18.patch, HIVE-11642.19.patch, > HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HIVE-12034) HIVE-4243 broke things for llap branch
[ https://issues.apache.org/jira/browse/HIVE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-12034. - Resolution: Fixed Fix Version/s: llap > HIVE-4243 broke things for llap branch > -- > > Key: HIVE-12034 > URL: https://issues.apache.org/jira/browse/HIVE-12034 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Fix For: llap > > Attachments: HIVE-12034.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HIVE-12036) LLAP: merge master into branch
[ https://issues.apache.org/jira/browse/HIVE-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-12036. - Resolution: Fixed > LLAP: merge master into branch > -- > > Key: HIVE-12036 > URL: https://issues.apache.org/jira/browse/HIVE-12036 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Fix For: llap > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12035) branch-1 build broken
[ https://issues.apache.org/jira/browse/HIVE-12035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943903#comment-14943903 ] Xuefu Zhang commented on HIVE-12035: +1 > branch-1 build broken > - > > Key: HIVE-12035 > URL: https://issues.apache.org/jira/browse/HIVE-12035 > Project: Hive > Issue Type: Bug >Affects Versions: 1.3.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman > Attachments: HIVE-12035.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12021) HivePreFilteringRule may introduce wrong common operands
[ https://issues.apache.org/jira/browse/HIVE-12021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943902#comment-14943902 ] Laljo John Pullokkaran commented on HIVE-12021: --- [~jcamachorodriguez] The logic of traversing expressions (ExtractCommonOperands) is not recursive and misses many of the use cases. I think it can be changed to traverse recursively. Also check for comparison need to take in to account functions (ex: ((x+y)=10 and z=1) or ((x+y)=10 and z=2) ). > HivePreFilteringRule may introduce wrong common operands > > > Key: HIVE-12021 > URL: https://issues.apache.org/jira/browse/HIVE-12021 > Project: Hive > Issue Type: Bug > Components: CBO >Affects Versions: 1.3.0, 1.2.1, 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Fix For: 1.3.0, 2.0.0, 1.2.2 > > Attachments: HIVE-12021.01.patch, HIVE-12021.02.patch, > HIVE-12021.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[
https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergio Peña updated HIVE-12033:
---
Comment: was deleted
(was:
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765039/HIVE-12033.1-spark.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/956/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/956/console
Test logs:
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-956/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
+ export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ export
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-SPARK-Build-956/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z spark ]]
+ [[ -d apache-git-source-source ]]
+ [[ ! -d apache-git-source-source/.git ]]
+ [[ ! -d apache-git-source-source ]]
+ cd apache-git-source-source
+ git fetch origin
>From https://github.com/apache/hive
67e33f3..57529a5 branch-1 -> origin/branch-1
37206a4..2414c35 branch-1.0 -> origin/branch-1.0
f428af1..d60f33c branch-1.2 -> origin/branch-1.2
7a3e745..c5ccf66 llap -> origin/llap
a4c43f0..0ca9ff8 master -> origin/master
+ git reset --hard HEAD
HEAD is now at 70eeadd HIVE-11844: Merge master to Spark branch 9/16/2015
[Spark Branch]
+ git clean -f -d
+ git checkout spark
Already on 'spark'
+ git reset --hard origin/spark
HEAD is now at 70eeadd HIVE-11844: Merge master to Spark branch 9/16/2015
[Spark Branch]
+ git merge --ff-only origin/spark
Already up-to-date.
+ git gc
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765039 - PreCommit-HIVE-SPARK-Build)
> Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
> -
>
> Key: HIVE-12033
> URL: https://issues.apache.org/jira/browse/HIVE-12033
> Project: Hive
> Issue Type: Improvement
> Components: Test
>Affects Versions: 1.2.1
>Reporter: Sergio Peña
>Assignee: Sergio Peña
>Priority: Minor
> Attachments: HIVE-12033.1-spark.patch, HIVE-12033.1.patch
>
>
> The ANT auto-generated test sources make TestCliDriver code a little
> complicated to debug with IntelliJ and Eclipse. Remote debugging is the best
> choice to do it.
> There must be a new way to move out the ANT auto-generated source plug-in,
> and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and
> Eclipse.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[
https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943883#comment-14943883
]
Hive QA commented on HIVE-12033:
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765048/HIVE-12033.1-spark.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/957/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/957/console
Test logs:
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-957/
Messages:
{noformat}
This message was trimmed, see log for full details
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
queryDir =
/data/hive-ptest/working/apache-git-source-source/itests/qtest/../../ql/src/test/queries/negative
queryDir = ql/src/test/queries/negative/
Generated
/data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/ql/parse/TestParseNegative.java
from template TestParseNegative.vm
Template
Path:/data/hive-ptest/working/apache-git-source-source/ql/src/test/templates
Starting Generation of: TestCompareCliDriver
Include Files: null
Excluded Files: null
Query Files:
Query Files Regex:
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
queryDir =
/data/hive-ptest/working/apache-git-source-source/itests/qtest/../../ql/src/test/queries/clientcompare
queryDir = ql/src/test/queries/clientcompare/
Generated
/data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCompareCliDriver.java
from template TestCompareCliDriver.vm
Template
Path:/data/hive-ptest/working/apache-git-source-source/ql/src/test/templates
Starting Generation of: TestMinimrCliDriver
Include Files:
auto_sortmerge_join_16.q,bucket4.q,bucket5.q,bucket6.q,bucket_many.q,bucket_num_reducers.q,bucket_num_reducers2.q,bucketizedhiveinputformat.q,bucketmapjoin6.q,bucketmapjoin7.q,constprog_partitioner.q,disable_merge_for_bucketing.q,empty_dir_in_table.q,exchgpartition2lel.q,external_table_with_space_in_location_path.q,file_with_header_footer.q,groupby2.q,import_exported_table.q,index_bitmap3.q,index_bitmap_auto.q,infer_bucket_sort_bucketed_table.q,infer_bucket_sort_dyn_part.q,infer_bucket_sort_map_operators.q,infer_bucket_sort_merge.q,infer_bucket_sort_num_buckets.q,infer_bucket_sort_reducers_power_two.q,input16_cc.q,join1.q,leftsemijoin_mr.q,list_bucket_dml_10.q,load_fs2.q,load_hdfs_file_with_space_in_the_name.q,non_native_window_udf.q,
optrstat_groupby.q,parallel_orderby.q,ql_rewrite_gbtoidx.q,ql_rewrite_gbtoidx_cbo_1.q,ql_rewrite_gbtoidx_cbo_2.q,quotedid_smb.q,reduce_deduplicate.q,remote_script.q,root_dir_external_table.q,schemeAuthority.q,schemeAuthority2.q,scriptfile1.q,scriptfile1_win.q,smb_mapjoin_8.q,stats_counter.q,stats_counter_partitioned.q,table_nonprintable.q,temp_table_external.q,truncate_column_buckets.q,uber_reduce.q,udf_using.q
Excluded Files: null
Query Files:
Query Files Regex:
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
hiveRootDir = /data/hive-ptest/working/apache-git-source-source
queryDir =
/data/hive-ptest/working/apache-git-source-source/itests/qtest/../../ql/src/test/queries/clientpositive
queryDir = ql/src/test/queries/clientpositive/
Generated
/data/hive-ptest/working/apache-git-source-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestMinimrCliDriver.java
from template TestCliDriver.vm
Template
Path:/data/hive-ptest/working/apache-git-source-source/ql/src/test/templates
Starting Generation of: TestMiniTezCliDriver
Include Files:
bucket_map_join_tez1.q,bucket_map_join_tez2.q,constprog_dpp.q,dynamic_partition_pruning.q,dynamic_partition_pruning_2.q,explainuser_1.q,explainuser_2.q,explainuser_3.q,hybridgrace_hashjoin_1.q,hybridgrace_hashjoin_2.q,mapjoin_decimal.q,lvj_mapjoin.q,
mrr.q,orc_ppd_basic.q,tez_bmj_schema_evolution.q,tez_dml.q,tez_fsstat.q,tez_insert_overwrite_local_directory_1.q,tez_dynpart_hashjoin_1.q,tez_dynpart_hashjoin_2.q,tez_vector_dynpart_hashjoin_1.q,tez_vector_dynpart_hashjoin_2.q,tez_join_hash.q,tez_join_result_complex.q,tez_join_tests.q,tez_joins_explain.q,tez_schema_evolution.q,tez_self_join.q,tez_union.q,tez_union2.q,tez_union_dynamic_partition.q,tez_union_view.q,tez_union_decimal.q,tez_union_group_by.q,tez_smb_main.q,tez_smb_1.q,vectorized_dynamic_partition_pruning.q,tez_multi_union.q,tez_join.q,tez_union_multiinsert.q,alter_merge_2_orc.q,alter_merge_orc.q,alter_merge_stats_orc.q,auto_join0.q,auto_join1.q,bucket2.q,bucket3.q,bucket4.q,cbo_gby.q,cbo_gby_empty.q,cbo_join.q,cbo_limit.q,cbo_semijoin.q,cbo_simple_select.q,cbo_
[jira] [Updated] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[ https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-12033: --- Attachment: HIVE-12033.1-spark.patch > Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable > - > > Key: HIVE-12033 > URL: https://issues.apache.org/jira/browse/HIVE-12033 > Project: Hive > Issue Type: Improvement > Components: Test >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña >Priority: Minor > Attachments: HIVE-12033.1-spark.patch, HIVE-12033.1.patch > > > The ANT auto-generated test sources make TestCliDriver code a little > complicated to debug with IntelliJ and Eclipse. Remote debugging is the best > choice to do it. > There must be a new way to move out the ANT auto-generated source plug-in, > and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and > Eclipse. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12034) HIVE-4243 broke things for llap branch
[ https://issues.apache.org/jira/browse/HIVE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943839#comment-14943839 ] Sergey Shelukhin commented on HIVE-12034: - Nm, branch patch, I didn't realize it was result of a merge > HIVE-4243 broke things for llap branch > -- > > Key: HIVE-12034 > URL: https://issues.apache.org/jira/browse/HIVE-12034 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-12034.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[ https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-12033: --- Attachment: HIVE-12033.1.patch > Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable > - > > Key: HIVE-12033 > URL: https://issues.apache.org/jira/browse/HIVE-12033 > Project: Hive > Issue Type: Improvement > Components: Test >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña >Priority: Minor > Attachments: HIVE-12033.1.patch > > > The ANT auto-generated test sources make TestCliDriver code a little > complicated to debug with IntelliJ and Eclipse. Remote debugging is the best > choice to do it. > There must be a new way to move out the ANT auto-generated source plug-in, > and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and > Eclipse. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[ https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-12033: --- Attachment: (was: HIVE-12033.1-spark.patch) > Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable > - > > Key: HIVE-12033 > URL: https://issues.apache.org/jira/browse/HIVE-12033 > Project: Hive > Issue Type: Improvement > Components: Test >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña >Priority: Minor > Attachments: HIVE-12033.1.patch > > > The ANT auto-generated test sources make TestCliDriver code a little > complicated to debug with IntelliJ and Eclipse. Remote debugging is the best > choice to do it. > There must be a new way to move out the ANT auto-generated source plug-in, > and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and > Eclipse. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12034) HIVE-4243 broke things for llap branch
[ https://issues.apache.org/jira/browse/HIVE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12034: Summary: HIVE-4243 broke things for llap branch (was: HIVE-4243 broke things) > HIVE-4243 broke things for llap branch > -- > > Key: HIVE-12034 > URL: https://issues.apache.org/jira/browse/HIVE-12034 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-12034.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11919) Hive Union Type Mismatch
[ https://issues.apache.org/jira/browse/HIVE-11919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943825#comment-14943825 ] Laljo John Pullokkaran commented on HIVE-11919: --- Test failure is unrelated. > Hive Union Type Mismatch > > > Key: HIVE-11919 > URL: https://issues.apache.org/jira/browse/HIVE-11919 > Project: Hive > Issue Type: Bug >Reporter: Laljo John Pullokkaran >Assignee: Laljo John Pullokkaran > Attachments: HIVE-11919.1.patch, HIVE-11919.2.patch > > > In Hive for union right most type wins out for most primitive types during > plan gen. However when union op gets initialized the type gets switched. > This could result in bad data & type exceptions. > This happens only in non cbo mode. > In CBO mode, Hive would add explicit type casts that would prevent such type > issues. > Sample Query: > select cd/sum(cd) over() from(select cd from u1 union all select cd from u2 > union all select cd from u3)u4; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[
https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943829#comment-14943829
]
Hive QA commented on HIVE-12033:
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765039/HIVE-12033.1-spark.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/956/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/956/console
Test logs:
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-956/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
+ export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
+ export
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+
PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-SPARK-Build-956/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z spark ]]
+ [[ -d apache-git-source-source ]]
+ [[ ! -d apache-git-source-source/.git ]]
+ [[ ! -d apache-git-source-source ]]
+ cd apache-git-source-source
+ git fetch origin
>From https://github.com/apache/hive
67e33f3..57529a5 branch-1 -> origin/branch-1
37206a4..2414c35 branch-1.0 -> origin/branch-1.0
f428af1..d60f33c branch-1.2 -> origin/branch-1.2
7a3e745..c5ccf66 llap -> origin/llap
a4c43f0..0ca9ff8 master -> origin/master
+ git reset --hard HEAD
HEAD is now at 70eeadd HIVE-11844: Merge master to Spark branch 9/16/2015
[Spark Branch]
+ git clean -f -d
+ git checkout spark
Already on 'spark'
+ git reset --hard origin/spark
HEAD is now at 70eeadd HIVE-11844: Merge master to Spark branch 9/16/2015
[Spark Branch]
+ git merge --ff-only origin/spark
Already up-to-date.
+ git gc
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0, p1, or p2
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765039 - PreCommit-HIVE-SPARK-Build
> Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
> -
>
> Key: HIVE-12033
> URL: https://issues.apache.org/jira/browse/HIVE-12033
> Project: Hive
> Issue Type: Improvement
> Components: Test
>Affects Versions: 1.2.1
>Reporter: Sergio Peña
>Assignee: Sergio Peña
>Priority: Minor
> Attachments: HIVE-12033.1-spark.patch
>
>
> The ANT auto-generated test sources make TestCliDriver code a little
> complicated to debug with IntelliJ and Eclipse. Remote debugging is the best
> choice to do it.
> There must be a new way to move out the ANT auto-generated source plug-in,
> and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and
> Eclipse.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11720) Allow HiveServer2 to set custom http request/response header size
[ https://issues.apache.org/jira/browse/HIVE-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943823#comment-14943823 ] Vaibhav Gumashta commented on HIVE-11720: - The first 3 are unrelated and 4 (org.apache.hive.jdbc.TestSSL.testSSLVersion) passes locally. [~thejas] good to go? > Allow HiveServer2 to set custom http request/response header size > - > > Key: HIVE-11720 > URL: https://issues.apache.org/jira/browse/HIVE-11720 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Reporter: Vaibhav Gumashta >Assignee: Vaibhav Gumashta > Attachments: HIVE-11720.1.patch, HIVE-11720.2.patch, > HIVE-11720.3.patch, HIVE-11720.4.patch, HIVE-11720.4.patch > > > In HTTP transport mode, authentication information is sent over as part of > HTTP headers. Sometimes (observed when Kerberos is used) the default buffer > size for the headers is not enough, resulting in an HTTP 413 FULL head error. > We can expose those as customizable params. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11720) Allow HiveServer2 to set custom http request/response header size
[ https://issues.apache.org/jira/browse/HIVE-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943826#comment-14943826 ] Thejas M Nair commented on HIVE-11720: -- yeah, looks good to go > Allow HiveServer2 to set custom http request/response header size > - > > Key: HIVE-11720 > URL: https://issues.apache.org/jira/browse/HIVE-11720 > Project: Hive > Issue Type: Improvement > Components: HiveServer2 >Reporter: Vaibhav Gumashta >Assignee: Vaibhav Gumashta > Attachments: HIVE-11720.1.patch, HIVE-11720.2.patch, > HIVE-11720.3.patch, HIVE-11720.4.patch, HIVE-11720.4.patch > > > In HTTP transport mode, authentication information is sent over as part of > HTTP headers. Sometimes (observed when Kerberos is used) the default buffer > size for the headers is not enough, resulting in an HTTP 413 FULL head error. > We can expose those as customizable params. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12035) branch-1 build broken
[ https://issues.apache.org/jira/browse/HIVE-12035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-12035: -- Attachment: HIVE-12035.patch > branch-1 build broken > - > > Key: HIVE-12035 > URL: https://issues.apache.org/jira/browse/HIVE-12035 > Project: Hive > Issue Type: Bug >Affects Versions: 1.3.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman > Attachments: HIVE-12035.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HIVE-12034) HIVE-4243 broke things
[ https://issues.apache.org/jira/browse/HIVE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943800#comment-14943800 ] Sergey Shelukhin edited comment on HIVE-12034 at 10/5/15 6:39 PM: -- [~owen.omalley] [~prasanth_j] [~alangates] can you take a look? was (Author: sershe): [~owen.omalley] can you take a look? > HIVE-4243 broke things > -- > > Key: HIVE-12034 > URL: https://issues.apache.org/jira/browse/HIVE-12034 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-12034.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HIVE-12034) HIVE-4243 broke things
[ https://issues.apache.org/jira/browse/HIVE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943798#comment-14943798 ] Sergey Shelukhin edited comment on HIVE-12034 at 10/5/15 6:40 PM: -- Tries to create an array of MAX_VALUE+1 values. I don't know how it ever works anywhere, failed bunch of tests in LLAP branch was (Author: sershe): Tries to create an array of infinite values. I don't know how it ever works anywhere, failed bunch of tests in LLAP branch > HIVE-4243 broke things > -- > > Key: HIVE-12034 > URL: https://issues.apache.org/jira/browse/HIVE-12034 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-12034.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12034) HIVE-4243 broke things
[ https://issues.apache.org/jira/browse/HIVE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943800#comment-14943800 ] Sergey Shelukhin commented on HIVE-12034: - [~owen.omalley] can you take a look? > HIVE-4243 broke things > -- > > Key: HIVE-12034 > URL: https://issues.apache.org/jira/browse/HIVE-12034 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-12034.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12033) Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable
[ https://issues.apache.org/jira/browse/HIVE-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-12033: --- Attachment: HIVE-12033.1-spark.patch Attach file to be run on Spark jenkins job. Jenkins has been failing with testInitializationError, and this patch might fix that. > Move TestCliDriver/TestNegativeCliDriver out of ANT and make it debugable > - > > Key: HIVE-12033 > URL: https://issues.apache.org/jira/browse/HIVE-12033 > Project: Hive > Issue Type: Improvement > Components: Test >Affects Versions: 1.2.1 >Reporter: Sergio Peña >Assignee: Sergio Peña >Priority: Minor > Attachments: HIVE-12033.1-spark.patch > > > The ANT auto-generated test sources make TestCliDriver code a little > complicated to debug with IntelliJ and Eclipse. Remote debugging is the best > choice to do it. > There must be a new way to move out the ANT auto-generated source plug-in, > and make TestCliDriver easy debuggable by current IDE, such as IntelliJ and > Eclipse. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12034) HIVE-4243 broke things
[ https://issues.apache.org/jira/browse/HIVE-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12034: Attachment: HIVE-12034.patch Tries to create an array of infinite values. I don't know how it ever works anywhere, failed bunch of tests in LLAP branch > HIVE-4243 broke things > -- > > Key: HIVE-12034 > URL: https://issues.apache.org/jira/browse/HIVE-12034 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-12034.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11642) LLAP: make sure tests pass #3
[ https://issues.apache.org/jira/browse/HIVE-11642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943796#comment-14943796 ] Sergey Shelukhin commented on HIVE-11642: - Broken by HIVE-4243 > LLAP: make sure tests pass #3 > - > > Key: HIVE-11642 > URL: https://issues.apache.org/jira/browse/HIVE-11642 > Project: Hive > Issue Type: Sub-task >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11642.01.patch, HIVE-11642.02.patch, > HIVE-11642.03.patch, HIVE-11642.04.patch, HIVE-11642.05.patch, > HIVE-11642.17.patch, HIVE-11642.18.patch, HIVE-11642.patch > > > Tests should pass against the most recent branch and Tez 0.8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12032) Add unit test for HIVE-9855
[ https://issues.apache.org/jira/browse/HIVE-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-12032: - Attachment: HIVE-12032.patch > Add unit test for HIVE-9855 > --- > > Key: HIVE-12032 > URL: https://issues.apache.org/jira/browse/HIVE-12032 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 1.2.0, 1.2.1 >Reporter: Wei Zheng >Assignee: Wei Zheng > Attachments: HIVE-12032.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11985) handle long typenames from Avro schema in metastore
[ https://issues.apache.org/jira/browse/HIVE-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943775#comment-14943775 ] Sergey Shelukhin commented on HIVE-11985: - The describe command correctly gets the type information from deserializer. I can increase the limit to 4000 (length of column); at that point it's no worse than having incorrect, truncated type info in terms of usage - if it's used for anything it will fail anyway. Throwing an error will make it impossible to use Hive with complex Avro schemas. > handle long typenames from Avro schema in metastore > --- > > Key: HIVE-11985 > URL: https://issues.apache.org/jira/browse/HIVE-11985 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Attachments: HIVE-11985.01.patch, HIVE-11985.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12018) beeline --help doesn't return to original prompt
[
https://issues.apache.org/jira/browse/HIVE-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943767#comment-14943767
]
Ashutosh Chauhan commented on HIVE-12018:
-
+1
> beeline --help doesn't return to original prompt
>
>
> Key: HIVE-12018
> URL: https://issues.apache.org/jira/browse/HIVE-12018
> Project: Hive
> Issue Type: Bug
> Components: Beeline
>Affects Versions: 1.2.0
>Reporter: Mohammad Kamrul Islam
>Assignee: Mohammad Kamrul Islam
>Priority: Minor
> Attachments: HIVE-12018.1.patch, HIVE-12018.2.patch
>
>
> "beeline --help" displays the help message and returns to beeline prompt.
> The common pattern is to return to the unix prompt. The intention of any
> command help is to relaunch the same command with correct parameters.
> One such output is :
> {quote}
> $ beeline --help
> Usage: java org.apache.hive.cli.beeline.BeeLine
>-uthe JDBC URL to connect to
>-nthe username to connect as
>-pthe password to connect as
> .
> Beeline version .. by Apache Hive
> beeline>
> {quote}
> The expected return prompt should be "$" (the unix prompt).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-12018) beeline --help doesn't return to original prompt
[
https://issues.apache.org/jira/browse/HIVE-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943740#comment-14943740
]
Mohammad Kamrul Islam commented on HIVE-12018:
--
Looks like, the test failures are not related to this patch.
> beeline --help doesn't return to original prompt
>
>
> Key: HIVE-12018
> URL: https://issues.apache.org/jira/browse/HIVE-12018
> Project: Hive
> Issue Type: Bug
> Components: Beeline
>Affects Versions: 1.2.0
>Reporter: Mohammad Kamrul Islam
>Assignee: Mohammad Kamrul Islam
>Priority: Minor
> Attachments: HIVE-12018.1.patch, HIVE-12018.2.patch
>
>
> "beeline --help" displays the help message and returns to beeline prompt.
> The common pattern is to return to the unix prompt. The intention of any
> command help is to relaunch the same command with correct parameters.
> One such output is :
> {quote}
> $ beeline --help
> Usage: java org.apache.hive.cli.beeline.BeeLine
>-uthe JDBC URL to connect to
>-nthe username to connect as
>-pthe password to connect as
> .
> Beeline version .. by Apache Hive
> beeline>
> {quote}
> The expected return prompt should be "$" (the unix prompt).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943676#comment-14943676
]
Hive QA commented on HIVE-11533:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12765013/HIVE-11533.2.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 8 failed/errored test(s), 9549 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_auto_partitioned
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_date_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_interval_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_case
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_date_funcs
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_date_1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_interval_2
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5535/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5535/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5535/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 8 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12765013 - PreCommit-HIVE-TRUNK-Build
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch, HIVE-11533.2.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
> - LongScalarEqualLongScalar
> - LongScalarGreaterLongScalar
> - LongScalarGreaterEqualLongScalar
> - LongScalarLessLongScalar
> - LongScalarLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11976) Extend CBO rules to being able to apply rules only once on a given operator
[ https://issues.apache.org/jira/browse/HIVE-11976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943665#comment-14943665 ] Jesus Camacho Rodriguez commented on HIVE-11976: [~jpullokkaran], test fail is unrelated, could you take a look? Thanks > Extend CBO rules to being able to apply rules only once on a given operator > --- > > Key: HIVE-11976 > URL: https://issues.apache.org/jira/browse/HIVE-11976 > Project: Hive > Issue Type: New Feature > Components: CBO >Affects Versions: 2.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-11976.01.patch, HIVE-11976.02.patch, > HIVE-11976.03.patch, HIVE-11976.patch > > > Create a way to bail out quickly from HepPlanner if the rule has been already > applied on a certain operator. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-11985) handle long typenames from Avro schema in metastore
[
https://issues.apache.org/jira/browse/HIVE-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943638#comment-14943638
]
Ashutosh Chauhan commented on HIVE-11985:
-
I would like to have other's opinion on this.
Patch arbitrarily replaces a long type name (> 2K chars) with a typename
{{struct<>}} for serde supplied schemas under the assumption that this typename
is not used for anything for query processing (now and in *future*). This
lossy information (stored permanently in metastore) for type might not be a
good idea, because this prevents us from using type information reliably in
future. We can never be sure whether type info is correct or truncated one.
Secondly, for its current use case (of describe table) it will atleast be
confusing for user to see struct<> in type info in describe output, as oppose
to actual type info.
IMHO, throwing an error for type name (> 2K) which is also part of the patch,
should be sufficient.
[~alangates] your thoughts?
> handle long typenames from Avro schema in metastore
> ---
>
> Key: HIVE-11985
> URL: https://issues.apache.org/jira/browse/HIVE-11985
> Project: Hive
> Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
> Attachments: HIVE-11985.01.patch, HIVE-11985.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-11976) Extend CBO rules to being able to apply rules only once on a given operator
[
https://issues.apache.org/jira/browse/HIVE-11976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943512#comment-14943512
]
Hive QA commented on HIVE-11976:
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12764994/HIVE-11976.03.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9645 tests executed
*Failed tests:*
{noformat}
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5534/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5534/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12764994 - PreCommit-HIVE-TRUNK-Build
> Extend CBO rules to being able to apply rules only once on a given operator
> ---
>
> Key: HIVE-11976
> URL: https://issues.apache.org/jira/browse/HIVE-11976
> Project: Hive
> Issue Type: New Feature
> Components: CBO
>Affects Versions: 2.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
> Attachments: HIVE-11976.01.patch, HIVE-11976.02.patch,
> HIVE-11976.03.patch, HIVE-11976.patch
>
>
> Create a way to bail out quickly from HepPlanner if the rule has been already
> applied on a certain operator.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teddy Choi updated HIVE-11533:
--
Attachment: (was: HIVE-11533.2.patch)
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
> - LongScalarEqualLongScalar
> - LongScalarGreaterLongScalar
> - LongScalarGreaterEqualLongScalar
> - LongScalarLessLongScalar
> - LongScalarLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in Long*CompareLong*
[
https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teddy Choi updated HIVE-11533:
--
Attachment: HIVE-11533.2.patch
> Loop optimization for SIMD in Long*CompareLong*
> ---
>
> Key: HIVE-11533
> URL: https://issues.apache.org/jira/browse/HIVE-11533
> Project: Hive
> Issue Type: Sub-task
> Components: Vectorization
>Reporter: Teddy Choi
>Assignee: Teddy Choi
>Priority: Minor
> Attachments: HIVE-11533.1.patch, HIVE-11533.2.patch
>
>
> Long*CompareLong* classes can be optimized with subtraction and bitwise
> operators for better SIMD optimization.
> {code}
> for(int i = 0; i != n; i++) {
> outputVector[i] = vector1[0] > vector2[i] ? 1 : 0;
> }
> {code}
> This issue will cover following classes;
> - LongColEqualLongColumn
> - LongColGreaterLongColumn
> - LongColGreaterEqualLongColumn
> - LongColLessLongColumn
> - LongColLessEqualLongColumn
> - LongScalarEqualLongColumn
> - LongScalarGreaterLongColumn
> - LongScalarGreaterEqualLongColumn
> - LongScalarLessLongColumn
> - LongScalarLessEqualLongColumn
> - LongColEqualLongScalar
> - LongColGreaterLongScalar
> - LongColGreaterEqualLongScalar
> - LongColLessLongScalar
> - LongColLessEqualLongScalar
> - LongScalarEqualLongScalar
> - LongScalarGreaterLongScalar
> - LongScalarGreaterEqualLongScalar
> - LongScalarLessLongScalar
> - LongScalarLessEqualLongScalar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
