[jira] [Commented] (OOZIE-3516) Misleading warning: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: yarnRM
[ https://issues.apache.org/jira/browse/OOZIE-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869287#comment-16869287 ] Andras Salamon commented on OOZIE-3516: --- Thanks for the test and the contribution [~kmarton], +1, committed to master. > Misleading warning: java.lang.IllegalArgumentException: Does not contain a > valid host:port authority: yarnRM > > > Key: OOZIE-3516 > URL: https://issues.apache.org/jira/browse/OOZIE-3516 > Project: Oozie > Issue Type: Bug >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Attachments: OOZIE-3516-001.patch > > > Starting from 5.0.0 there is a misleading warning message in the Oozie logs: > {code} > 2019-06-17 05:30:19,335 WARN > org.apache.oozie.action.hadoop.HadoopTokenHelper: > SERVER[nightly6x-1.vpc.cloudera.com] USER[admin] GROUP[-] TOKEN[] APP[Batch > job for PySpark Pi Estimator Job] JOB[001-190617003335655-oozie-oozi-W] > ACTION[001-190617003335655-oozie-oozi-W@spark2-3833] An error happened > while trying to get server principal. Getting it from service principal > anyway. > java.lang.IllegalArgumentException: Does not contain a valid host:port > authority: yarnRM > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:213) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:153) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:73) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:51) > at > org.apache.oozie.action.hadoop.YarnRMCredentials.updateCredentials(YarnRMCredentials.java:55) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:1503) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1053) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1601) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:243) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:68) > at org.apache.oozie.command.XCommand.call(XCommand.java:291) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:363) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:292) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:210) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > {code} > This warning is harmless, but it can case misunderstandings. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3516) Misleading warning: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: yarnRM
[ https://issues.apache.org/jira/browse/OOZIE-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868464#comment-16868464 ] Julia Kinga Marton commented on OOZIE-3516: --- [~asalamon74], The log message is the following: {code:java} 2019-06-20 13:42:51,486 WARN [main] hadoop.HadoopTokenHelper (XLog.java:log(523)) - An error happened while trying to get server principal. Getting it from service principal anyway. 2019-06-20 13:42:51,487 TRACE [main] hadoop.HadoopTokenHelper (XLog.java:log(520)) - java.lang.IllegalArgumentException: Does not contain a valid host:port authority: rm-ha-uri java.lang.IllegalArgumentException: Does not contain a valid host:port authority: rm-ha-uri at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:212) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:153) at org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:73) at org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:51) at org.apache.oozie.action.hadoop.TestHadoopTokenHelper.testGetMRDelegationTokenRenewer(TestHadoopTokenHelper.java:42){code} > Misleading warning: java.lang.IllegalArgumentException: Does not contain a > valid host:port authority: yarnRM > > > Key: OOZIE-3516 > URL: https://issues.apache.org/jira/browse/OOZIE-3516 > Project: Oozie > Issue Type: Bug >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Attachments: OOZIE-3516-001.patch > > > Starting from 5.0.0 there is a misleading warning message in the Oozie logs: > {code} > 2019-06-17 05:30:19,335 WARN > org.apache.oozie.action.hadoop.HadoopTokenHelper: > SERVER[nightly6x-1.vpc.cloudera.com] USER[admin] GROUP[-] TOKEN[] APP[Batch > job for PySpark Pi Estimator Job] JOB[001-190617003335655-oozie-oozi-W] > ACTION[001-190617003335655-oozie-oozi-W@spark2-3833] An error happened > while trying to get server principal. Getting it from service principal > anyway. > java.lang.IllegalArgumentException: Does not contain a valid host:port > authority: yarnRM > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:213) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:153) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:73) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:51) > at > org.apache.oozie.action.hadoop.YarnRMCredentials.updateCredentials(YarnRMCredentials.java:55) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:1503) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1053) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1601) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:243) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:68) > at org.apache.oozie.command.XCommand.call(XCommand.java:291) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:363) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:292) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:210) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > {code} > This warning is harmless, but it can case misunderstandings. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3516) Misleading warning: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: yarnRM
[ https://issues.apache.org/jira/browse/OOZIE-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867740#comment-16867740 ] Andras Salamon commented on OOZIE-3516: --- [~kmarton] Are you sure that {{LOG.trace(iae);}} works correctly if you only specify the exception without an error message? Can you please test it. (Or just add please an error message if that's simpler). > Misleading warning: java.lang.IllegalArgumentException: Does not contain a > valid host:port authority: yarnRM > > > Key: OOZIE-3516 > URL: https://issues.apache.org/jira/browse/OOZIE-3516 > Project: Oozie > Issue Type: Bug >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Attachments: OOZIE-3516-001.patch > > > Starting from 5.0.0 there is a misleading warning message in the Oozie logs: > {code} > 2019-06-17 05:30:19,335 WARN > org.apache.oozie.action.hadoop.HadoopTokenHelper: > SERVER[nightly6x-1.vpc.cloudera.com] USER[admin] GROUP[-] TOKEN[] APP[Batch > job for PySpark Pi Estimator Job] JOB[001-190617003335655-oozie-oozi-W] > ACTION[001-190617003335655-oozie-oozi-W@spark2-3833] An error happened > while trying to get server principal. Getting it from service principal > anyway. > java.lang.IllegalArgumentException: Does not contain a valid host:port > authority: yarnRM > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:213) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:153) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:73) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:51) > at > org.apache.oozie.action.hadoop.YarnRMCredentials.updateCredentials(YarnRMCredentials.java:55) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:1503) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1053) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1601) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:243) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:68) > at org.apache.oozie.command.XCommand.call(XCommand.java:291) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:363) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:292) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:210) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > {code} > This warning is harmless, but it can case misunderstandings. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3516) Misleading warning: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: yarnRM
[ https://issues.apache.org/jira/browse/OOZIE-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867488#comment-16867488 ] Hadoop QA commented on OOZIE-3516: -- Testing JIRA OOZIE-3516 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any star imports .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:red}-1{color} There are [7] new bugs found below threshold in total that must be fixed. .{color:green}+1{color} There are no new bugs found in [examples]. .{color:red}-1{color} There are [7] new bugs found below threshold in [core] that must be fixed, listing only the first [5] ones. .You can find the SpotBugs diff here (look for the red and orange ones): core/findbugs-new.html .The top [5] most important SpotBugs errors are: .At BulkJPAExecutor.java:[line 207]: This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection .At BulkJPAExecutor.java:[line 177]: At BulkJPAExecutor.java:[line 176] .At BulkJPAExecutor.java:[line 206]: At BulkJPAExecutor.java:[line 200] .This use of javax/persistence/EntityManager.createQuery(Ljava/lang/String;)Ljavax/persistence/Query; can be vulnerable to SQL/JPQL injection: At BulkJPAExecutor.java:[line 207] .At BulkJPAExecutor.java:[line 112]: At BulkJPAExecutor.java:[line 128] .{color:green}+1{color} There are no new bugs found in [sharelib/distcp]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive]. .{color:green}+1{color} There are no new bugs found in [sharelib/pig]. .{color:green}+1{color} There are no new bugs found in [sharelib/spark]. .{color:green}+1{color} There are no new bugs found in [sharelib/hive2]. .{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. .{color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. .{color:green}+1{color} There are no new bugs found in [sharelib/oozie]. .{color:green}+1{color} There are no new bugs found in [sharelib/streaming]. .{color:green}+1{color} There are no new bugs found in [sharelib/git]. .{color:green}+1{color} There are no new bugs found in [webapp]. .{color:green}+1{color} There are no new bugs found in [tools]. .{color:green}+1{color} There are no new bugs found in [docs]. .{color:green}+1{color} There are no new bugs found in [server]. .{color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. .{color:green}+1{color} There are no new bugs found in [client]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3168 {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/1151/ > Misleading warning: java.lang.IllegalArgumentException: Does not contain a > valid host:port authority: yarnRM > > > Key: OOZIE-3516 > URL: https://issues.apache.org/jira/browse/OOZIE-3516 > Project: Oozie > Issue Type: Bug >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Attachments: OOZIE-3516-001.patch > > > Starting from 5.0.0 there is a misleading warning message in the Oozie logs: > {code} > 2019-06-17 05:30:19,335 WARN > org.apache.oozie.action.hadoop.HadoopTokenHelper: > SERVER[nightly6x-1
[jira] [Commented] (OOZIE-3516) Misleading warning: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: yarnRM
[ https://issues.apache.org/jira/browse/OOZIE-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867401#comment-16867401 ] Hadoop QA commented on OOZIE-3516: -- PreCommit-OOZIE-Build started > Misleading warning: java.lang.IllegalArgumentException: Does not contain a > valid host:port authority: yarnRM > > > Key: OOZIE-3516 > URL: https://issues.apache.org/jira/browse/OOZIE-3516 > Project: Oozie > Issue Type: Bug >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Attachments: OOZIE-3516-001.patch > > > Starting from 5.0.0 there is a misleading warning message in the Oozie logs: > {code} > 2019-06-17 05:30:19,335 WARN > org.apache.oozie.action.hadoop.HadoopTokenHelper: > SERVER[nightly6x-1.vpc.cloudera.com] USER[admin] GROUP[-] TOKEN[] APP[Batch > job for PySpark Pi Estimator Job] JOB[001-190617003335655-oozie-oozi-W] > ACTION[001-190617003335655-oozie-oozi-W@spark2-3833] An error happened > while trying to get server principal. Getting it from service principal > anyway. > java.lang.IllegalArgumentException: Does not contain a valid host:port > authority: yarnRM > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:213) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) > at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:153) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:73) > at > org.apache.oozie.action.hadoop.HadoopTokenHelper.getServerPrincipal(HadoopTokenHelper.java:51) > at > org.apache.oozie.action.hadoop.YarnRMCredentials.updateCredentials(YarnRMCredentials.java:55) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:1503) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1053) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1601) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:243) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:68) > at org.apache.oozie.command.XCommand.call(XCommand.java:291) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:363) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:292) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:210) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > {code} > This warning is harmless, but it can case misunderstandings. -- This message was sent by Atlassian JIRA (v7.6.3#76005)