[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-09 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319313#comment-16319313
 ] 

Sergey Shelukhin commented on HIVE-18384:
-

+1

> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch, 
> HIVE-18384.3.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at java.util.ArrayList$Itr.next(ArrayList.java:859) ~[?:1.8.0_152]
>   at 
> java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1042) 
> ~[?:1.8.0_152]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendCollection(ParameterFormatter.java:596)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendPotentiallyRecursiveValue(ParameterFormatter.java:504)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.recursiveDeepToString(ParameterFormatter.java:429)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.formatMessage2(ParameterFormatter.java:189)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.formatTo(ParameterizedMessage.java:224)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.getFormattedMessage(ParameterizedMessage.java:200)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setMessage(RingBufferLogEvent.java:126)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setValues(RingBufferLogEvent.java:104)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEventTranslator.translateTo(RingBufferLogEventTranslator.java:56)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEventTranslator.translateTo(RingBufferLogEventTranslator.java:34)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> com.lmax.disruptor.RingBuffer.translateAndPublish(RingBuffer.java:930) 
> ~[disruptor-3.3.0.jar:?]
>   at com.lmax.disruptor.RingBuffer.tryPublishEvent(RingBuffer.java:456) 
> ~[disruptor-3.3.0.jar:?]
>   at 
> org.apache.logging.log4j.core.async.AsyncLoggerDisruptor.tryPublish(AsyncLoggerDisruptor.java:190)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.publish(AsyncLogger.java:160) 
> ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.logWithThreadLocalTranslator(AsyncLogger.java:156)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.logMessage(AsyncLogger.java:126)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2011)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1884)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at org.apache.logging.slf4j.Log4jLogger.info(Log4jLogger.java:189) 
> ~[log4j-slf4j-impl-2.6.2.jar:2.6.2]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient.inner_go(KerberosHttpClient.java:96)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient.access$100(KerberosHttpClient.java:50)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient$2.onSuccess(KerberosHttpClient.java:144)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient$2.onSuccess(KerberosHttpClient.java:134)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$4.run(Futures.java:1181)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  ~[?:1.8.0_152]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  ~[?:1.8.0_152]
>   at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]
> {code}
> The fix for this went into 2.9.1 LOG4J2-1988 onwards. 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-09 Thread Prasanth Jayachandran (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319295#comment-16319295
 ] 

Prasanth Jayachandran commented on HIVE-18384:
--

[~sershe] Can you please take a look? Minor version upgrades.

> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch, 
> HIVE-18384.3.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at java.util.ArrayList$Itr.next(ArrayList.java:859) ~[?:1.8.0_152]
>   at 
> java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1042) 
> ~[?:1.8.0_152]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendCollection(ParameterFormatter.java:596)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendPotentiallyRecursiveValue(ParameterFormatter.java:504)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.recursiveDeepToString(ParameterFormatter.java:429)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.formatMessage2(ParameterFormatter.java:189)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.formatTo(ParameterizedMessage.java:224)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.getFormattedMessage(ParameterizedMessage.java:200)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setMessage(RingBufferLogEvent.java:126)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setValues(RingBufferLogEvent.java:104)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEventTranslator.translateTo(RingBufferLogEventTranslator.java:56)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEventTranslator.translateTo(RingBufferLogEventTranslator.java:34)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> com.lmax.disruptor.RingBuffer.translateAndPublish(RingBuffer.java:930) 
> ~[disruptor-3.3.0.jar:?]
>   at com.lmax.disruptor.RingBuffer.tryPublishEvent(RingBuffer.java:456) 
> ~[disruptor-3.3.0.jar:?]
>   at 
> org.apache.logging.log4j.core.async.AsyncLoggerDisruptor.tryPublish(AsyncLoggerDisruptor.java:190)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.publish(AsyncLogger.java:160) 
> ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.logWithThreadLocalTranslator(AsyncLogger.java:156)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.logMessage(AsyncLogger.java:126)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2011)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1884)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at org.apache.logging.slf4j.Log4jLogger.info(Log4jLogger.java:189) 
> ~[log4j-slf4j-impl-2.6.2.jar:2.6.2]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient.inner_go(KerberosHttpClient.java:96)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient.access$100(KerberosHttpClient.java:50)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient$2.onSuccess(KerberosHttpClient.java:144)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient$2.onSuccess(KerberosHttpClient.java:134)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$4.run(Futures.java:1181)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  ~[?:1.8.0_152]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  ~[?:1.8.0_152]
>   at java.lang.Thread.run(Thread.java:748) [?:1.8.0_152]
> 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-08 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315882#comment-16315882
 ] 

Hive QA commented on HIVE-18384:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12905012/HIVE-18384.3.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 16 failed/errored test(s), 11549 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_join25] (batchId=72)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[ppd_join5] (batchId=35)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucketsortoptimize_insert_2]
 (batchId=151)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[hybridgrace_hashjoin_2]
 (batchId=156)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_orig_table_use_metadata]
 (batchId=164)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid] 
(batchId=168)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid_fast]
 (batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[sysdb] 
(batchId=159)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_part]
 (batchId=93)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[ppd_join5] 
(batchId=120)
org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testTransactionalValidation
 (batchId=213)
org.apache.hadoop.hive.ql.io.TestDruidRecordWriter.testWrite (batchId=253)
org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testConstraints 
(batchId=225)
org.apache.hive.jdbc.TestSSL.testConnectionMismatch (batchId=231)
org.apache.hive.jdbc.TestSSL.testConnectionWrongCertCN (batchId=231)
org.apache.hive.jdbc.TestSSL.testMetastoreConnectionWrongCertCN (batchId=231)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8494/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8494/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8494/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 16 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12905012 - PreCommit-HIVE-Build

> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch, 
> HIVE-18384.3.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at java.util.ArrayList$Itr.next(ArrayList.java:859) ~[?:1.8.0_152]
>   at 
> java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1042) 
> ~[?:1.8.0_152]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendCollection(ParameterFormatter.java:596)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendPotentiallyRecursiveValue(ParameterFormatter.java:504)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.recursiveDeepToString(ParameterFormatter.java:429)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.formatMessage2(ParameterFormatter.java:189)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.formatTo(ParameterizedMessage.java:224)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.getFormattedMessage(ParameterizedMessage.java:200)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setMessage(RingBufferLogEvent.java:126)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setValues(RingBufferLogEvent.java:104)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEventTranslator.translateTo(RingBufferLogEventTranslator.java:56)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-08 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315850#comment-16315850
 ] 

Hive QA commented on HIVE-18384:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  1m 
49s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  4m 
30s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  5m 
16s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
21s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
26s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  4m 
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  4m 
24s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green}  0m  
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  5m  
2s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red}  0m 
12s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 32m 53s{color} | 
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests |  asflicense  javac  javadoc  xml  compile  |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh |
| git revision | master / a6b88d9 |
| Default Java | 1.8.0_111 |
| asflicense | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-8494/yetus/patch-asflicense-problems.txt
 |
| modules | C: . testutils/ptest2 U: . |
| Console output | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-8494/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |


This message was automatically generated.



> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch, 
> HIVE-18384.3.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at java.util.ArrayList$Itr.next(ArrayList.java:859) ~[?:1.8.0_152]
>   at 
> java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1042) 
> ~[?:1.8.0_152]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendCollection(ParameterFormatter.java:596)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendPotentiallyRecursiveValue(ParameterFormatter.java:504)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.recursiveDeepToString(ParameterFormatter.java:429)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.formatMessage2(ParameterFormatter.java:189)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.formatTo(ParameterizedMessage.java:224)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.getFormattedMessage(ParameterizedMessage.java:200)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-06 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314486#comment-16314486
 ] 

Hive QA commented on HIVE-18384:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12904850/HIVE-18384.2.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 38 failed/errored test(s), 11549 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_join25] (batchId=72)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[mapjoin_hook] 
(batchId=12)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[parquet_type_promotion] 
(batchId=84)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[ppd_join5] (batchId=35)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testProcessSelectDatabase 
(batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testQuit (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testRun (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testThatCliDriverPrintsHeaderForCommandsWithSchema
 (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testThatCliDriverPrintsNoHeaderForCommandsWithNoSchema
 (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testprocessInitFiles 
(batchId=184)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucketsortoptimize_insert_2]
 (batchId=151)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[hybridgrace_hashjoin_2]
 (batchId=156)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_orig_table_use_metadata]
 (batchId=164)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid] 
(batchId=168)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid_fast]
 (batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[sysdb] 
(batchId=159)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_part]
 (batchId=93)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[materialized_view_authorization_create_no_grant]
 (batchId=93)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[stats_aggregator_error_1]
 (batchId=93)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[stats_publisher_error_1]
 (batchId=93)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[ppd_join5] 
(batchId=120)
org.apache.hadoop.hive.conf.TestHiveAsyncLogging.testAsyncLoggingInitialization 
(batchId=255)
org.apache.hadoop.hive.conf.TestHiveLogging.testHiveLogging (batchId=255)
org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testTransactionalValidation
 (batchId=213)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapPlan1 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapPlan2 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan1 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan2 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan3 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan4 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan5 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan6 (batchId=278)
org.apache.hadoop.hive.ql.io.TestDruidRecordWriter.testWrite (batchId=253)
org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testConstraints 
(batchId=225)
org.apache.hive.hcatalog.cli.TestPermsGrp.testCustomPerms (batchId=192)
org.apache.hive.jdbc.TestSSL.testConnectionMismatch (batchId=231)
org.apache.hive.jdbc.TestSSL.testConnectionWrongCertCN (batchId=231)
org.apache.hive.jdbc.TestSSL.testMetastoreConnectionWrongCertCN (batchId=231)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8478/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8478/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8478/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 38 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12904850 - PreCommit-HIVE-Build

> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-06 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314480#comment-16314480
 ] 

Hive QA commented on HIVE-18384:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  1m 
20s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
 7s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  4m 
24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  4m 
58s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
18s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
14s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  4m 
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  4m 
31s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green}  0m  
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  4m 
59s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red}  0m 
11s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 31m 26s{color} | 
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests |  asflicense  javac  javadoc  xml  compile  |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh |
| git revision | master / a6b88d9 |
| Default Java | 1.8.0_111 |
| asflicense | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-8478/yetus/patch-asflicense-problems.txt
 |
| modules | C: . testutils/ptest2 U: . |
| Console output | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-8478/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |


This message was automatically generated.



> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at java.util.ArrayList$Itr.next(ArrayList.java:859) ~[?:1.8.0_152]
>   at 
> java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1042) 
> ~[?:1.8.0_152]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendCollection(ParameterFormatter.java:596)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendPotentiallyRecursiveValue(ParameterFormatter.java:504)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.recursiveDeepToString(ParameterFormatter.java:429)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.formatMessage2(ParameterFormatter.java:189)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.formatTo(ParameterizedMessage.java:224)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.getFormattedMessage(ParameterizedMessage.java:200)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-05 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314429#comment-16314429
 ] 

Hive QA commented on HIVE-18384:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12904850/HIVE-18384.2.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 35 failed/errored test(s), 11549 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2] 
(batchId=48)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[ppd_join5] (batchId=35)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testProcessSelectDatabase 
(batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testQuit (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testRun (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testThatCliDriverPrintsHeaderForCommandsWithSchema
 (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testThatCliDriverPrintsNoHeaderForCommandsWithNoSchema
 (batchId=184)
org.apache.hadoop.hive.cli.TestCliDriverMethods.testprocessInitFiles 
(batchId=184)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucketsortoptimize_insert_2]
 (batchId=151)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[hybridgrace_hashjoin_2]
 (batchId=156)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[insert_values_orig_table_use_metadata]
 (batchId=164)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid] 
(batchId=168)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[llap_acid_fast]
 (batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[sysdb] 
(batchId=159)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_part]
 (batchId=93)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[stats_aggregator_error_1]
 (batchId=93)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[ppd_join5] 
(batchId=120)
org.apache.hadoop.hive.conf.TestHiveAsyncLogging.testAsyncLoggingInitialization 
(batchId=255)
org.apache.hadoop.hive.conf.TestHiveLogging.testHiveLogging (batchId=255)
org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testTransactionalValidation
 (batchId=213)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapPlan1 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapPlan2 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan1 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan2 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan3 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan4 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan5 (batchId=278)
org.apache.hadoop.hive.ql.exec.TestExecDriver.testMapRedPlan6 (batchId=278)
org.apache.hadoop.hive.ql.io.TestDruidRecordWriter.testWrite (batchId=253)
org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2.testWriteSetTracking6 
(batchId=290)
org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testConstraints 
(batchId=225)
org.apache.hive.hcatalog.cli.TestPermsGrp.testCustomPerms (batchId=192)
org.apache.hive.jdbc.TestSSL.testConnectionMismatch (batchId=231)
org.apache.hive.jdbc.TestSSL.testConnectionWrongCertCN (batchId=231)
org.apache.hive.jdbc.TestSSL.testMetastoreConnectionWrongCertCN (batchId=231)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8476/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8476/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8476/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 35 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12904850 - PreCommit-HIVE-Build

> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-05 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314416#comment-16314416
 ] 

Hive QA commented on HIVE-18384:


| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  1m 
16s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  4m 
27s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  5m  
7s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 
21s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  5m 
17s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  4m 
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  4m 
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m 
 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green}  0m  
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  4m 
57s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red}  0m 
11s{color} | {color:red} The patch generated 3 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 31m 39s{color} | 
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests |  asflicense  javac  javadoc  xml  compile  |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 
3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /data/hiveptest/working/yetus/dev-support/hive-personality.sh |
| git revision | master / a6b88d9 |
| Default Java | 1.8.0_111 |
| asflicense | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-8476/yetus/patch-asflicense-problems.txt
 |
| modules | C: . testutils/ptest2 U: . |
| Console output | 
http://104.198.109.242/logs//PreCommit-HIVE-Build-8476/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |


This message was automatically generated.



> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at java.util.ArrayList$Itr.next(ArrayList.java:859) ~[?:1.8.0_152]
>   at 
> java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1042) 
> ~[?:1.8.0_152]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendCollection(ParameterFormatter.java:596)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendPotentiallyRecursiveValue(ParameterFormatter.java:504)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.recursiveDeepToString(ParameterFormatter.java:429)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.formatMessage2(ParameterFormatter.java:189)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.formatTo(ParameterizedMessage.java:224)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.getFormattedMessage(ParameterizedMessage.java:200)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> 

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-05 Thread Prasanth Jayachandran (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313762#comment-16313762
 ] 

Prasanth Jayachandran commented on HIVE-18384:
--

Encountered MSHADE-242 issue when upgrading the latest log4j2 version and when 
using -Dpackaging.minimizeJar=false in build.
Latest stable shade plugin seems to fix the issue.


> ConcurrentModificationException in log4j2.x library
> ---
>
> Key: HIVE-18384
> URL: https://issues.apache.org/jira/browse/HIVE-18384
> Project: Hive
>  Issue Type: Bug
>  Components: Logging
>Affects Versions: 3.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-18384.1.patch, HIVE-18384.2.patch
>
>
> In one of the internal testing, observed the following exception
> {code}
> java.util.ConcurrentModificationException
>   at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909) 
> ~[?:1.8.0_152]
>   at java.util.ArrayList$Itr.next(ArrayList.java:859) ~[?:1.8.0_152]
>   at 
> java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1042) 
> ~[?:1.8.0_152]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendCollection(ParameterFormatter.java:596)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.appendPotentiallyRecursiveValue(ParameterFormatter.java:504)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.recursiveDeepToString(ParameterFormatter.java:429)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterFormatter.formatMessage2(ParameterFormatter.java:189)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.formatTo(ParameterizedMessage.java:224)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.message.ParameterizedMessage.getFormattedMessage(ParameterizedMessage.java:200)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setMessage(RingBufferLogEvent.java:126)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEvent.setValues(RingBufferLogEvent.java:104)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEventTranslator.translateTo(RingBufferLogEventTranslator.java:56)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.RingBufferLogEventTranslator.translateTo(RingBufferLogEventTranslator.java:34)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> com.lmax.disruptor.RingBuffer.translateAndPublish(RingBuffer.java:930) 
> ~[disruptor-3.3.0.jar:?]
>   at com.lmax.disruptor.RingBuffer.tryPublishEvent(RingBuffer.java:456) 
> ~[disruptor-3.3.0.jar:?]
>   at 
> org.apache.logging.log4j.core.async.AsyncLoggerDisruptor.tryPublish(AsyncLoggerDisruptor.java:190)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.publish(AsyncLogger.java:160) 
> ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.logWithThreadLocalTranslator(AsyncLogger.java:156)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.core.async.AsyncLogger.logMessage(AsyncLogger.java:126)
>  ~[log4j-core-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2011)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at 
> org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1884)
>  ~[log4j-api-2.6.2.jar:2.6.2]
>   at org.apache.logging.slf4j.Log4jLogger.info(Log4jLogger.java:189) 
> ~[log4j-slf4j-impl-2.6.2.jar:2.6.2]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient.inner_go(KerberosHttpClient.java:96)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient.access$100(KerberosHttpClient.java:50)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient$2.onSuccess(KerberosHttpClient.java:144)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hadoop.hive.druid.security.KerberosHttpClient$2.onSuccess(KerberosHttpClient.java:134)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> org.apache.hive.druid.com.google.common.util.concurrent.Futures$4.run(Futures.java:1181)
>  ~[hive-druid-handler-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  ~[?:1.8.0_152]
>   at 
>