[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151584#comment-16151584 ] Varun Saxena commented on YARN-6534: This needs to be backported to YARN-5355_branch too. Will cherry pick the commit. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha4 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Fix For: 3.0.0-alpha4 > > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987627#comment-15987627 ] Hudson commented on YARN-6534: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11643 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11643/]) YARN-6534. ResourceManager failed due to TimelineClient try to init (junping_du: rev 94607214ce87af871b024b4047ae3aa82058f9eb) * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestTimelineClient.java * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/api/impl/TimelineConnector.java > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987376#comment-15987376 ] Junping Du commented on YARN-6534: -- Trunk build get broken by HADOOP-13200. Will wait for build get recovered to commit. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987325#comment-15987325 ] Vrushali C commented on YARN-6534: -- Got it, thanks [~djp], please go ahead. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987322#comment-15987322 ] Junping Du commented on YARN-6534: -- I will go ahead to commit to trunk soon. Let me know if you have other comments/concerns. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987320#comment-15987320 ] Junping Du commented on YARN-6534: -- Thanks [~vrushalic] for review comments. I think this debug log is not necessary. The previous case is enabling ssl and fallback to default due to some exception (exception message is important). In case here, non-ssl configuration is used with intention so we don't need extra log. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987159#comment-15987159 ] Vrushali C commented on YARN-6534: -- +1 Patch looks good. Thanks [~rohithsharma] An extremely minor suggestion, perhaps can be done later, is adding a debug message like the following around line 111 may be a good idea. {code} LOG.debug("Not using ssl related configuration. " + "Fallback to system-generic settings."); {code} > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987081#comment-15987081 ] Junping Du commented on YARN-6534: -- Thanks [~rohithsharma] for delivering the patch. +1. Will commit it shortly. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Labels: yarn-5355-merge-blocker > Attachments: YARN-6534.0001.patch, YARN-6534.0002.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986641#comment-15986641 ] Hadoop QA commented on YARN-6534: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 13s{color} | {color:blue} Docker mode activated. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 1 new or modified test files. {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m 6s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 25s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 20s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 29s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 14s{color} | {color:green} trunk passed {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 54s{color} | {color:red} hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common in trunk has 2 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 23s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 23s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 22s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 22s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 15s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 25s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 58s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 24s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m 28s{color} | {color:green} hadoop-yarn-common in the patch passed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 18s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 23m 8s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | Image:yetus/hadoop:0ac17dc | | JIRA Issue | YARN-6534 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12865352/YARN-6534.0002.patch | | Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle | | uname | Linux 7266709109f6 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh | | git revision | trunk / 61cda39e | | Default Java | 1.8.0_121 | | findbugs | v3.1.0-RC1 | | findbugs | https://builds.apache.org/job/PreCommit-YARN-Build/15764/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common-warnings.html | | Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/15764/testReport/ | | modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common | | Console output | https://builds.apache.org/job/PreCommit-YARN-Build/15764/console | | Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org | This message was automatically generated. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986336#comment-15986336 ] Hadoop QA commented on YARN-6534: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 13s{color} | {color:blue} Docker mode activated. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m 0s{color} | {color:red} The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 14m 42s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 32s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 21s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 35s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 16s{color} | {color:green} trunk passed {color} | | {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m 9s{color} | {color:red} hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common in trunk has 2 extant Findbugs warnings. {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 33s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 33s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 32s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 32s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m 31s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 15s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 28s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} unit {color} | {color:red} 2m 24s{color} | {color:red} hadoop-yarn-common in the patch failed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 19s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 26m 19s{color} | {color:black} {color} | \\ \\ || Reason || Tests || | Failed junit tests | hadoop.yarn.client.api.impl.TestTimelineClient | \\ \\ || Subsystem || Report/Notes || | Docker | Image:yetus/hadoop:0ac17dc | | JIRA Issue | YARN-6534 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12865304/YARN-6534.0001.patch | | Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle | | uname | Linux 76718aa8bd95 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh | | git revision | trunk / 793bbf2 | | Default Java | 1.8.0_131 | | findbugs | v3.1.0-RC1 | | findbugs | https://builds.apache.org/job/PreCommit-YARN-Build/15759/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common-warnings.html | | unit | https://builds.apache.org/job/PreCommit-YARN-Build/15759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt | | Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/15759/testReport/ | | modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common | | Console output | https://builds.apache.org/job/PreCommit-YARN-Build/15759/console | | Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org | This message was
[jira] [Commented] (YARN-6534) ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled
[ https://issues.apache.org/jira/browse/YARN-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986225#comment-15986225 ] Rohith Sharma K S commented on YARN-6534: - Updated patch for creating sslfactory only if https is enabled. > ResourceManager failed due to TimelineClient try to init SSLFactory even > https is not enabled > - > > Key: YARN-6534 > URL: https://issues.apache.org/jira/browse/YARN-6534 > Project: Hadoop YARN > Issue Type: Bug >Affects Versions: 3.0.0-alpha3 >Reporter: Junping Du >Assignee: Rohith Sharma K S >Priority: Blocker > Attachments: YARN-6534.0001.patch > > > In a non-secured cluster, RM get failed consistently due to > TimelineServiceV1Publisher tries to init TimelineClient with SSLFactory > without any checking on if https get used. > {noformat} > 2017-04-26 21:09:10,683 FATAL resourcemanager.ResourceManager > (ResourceManager.java:main(1457)) - Error starting ResourceManager > org.apache.hadoop.service.ServiceStateException: > java.io.FileNotFoundException: /etc/security/clientKeys/all.jks (No such file > or directory) > at > org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.serviceInit(TimelineClientImpl.java:131) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.AbstractSystemMetricsPublisher.serviceInit(AbstractSystemMetricsPublisher.java:59) > at > org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV1Publisher.serviceInit(TimelineServiceV1Publisher.java:67) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1453) > Caused by: java.io.FileNotFoundException: /etc/security/clientKeys/all.jks > (No such file or directory) > at java.io.FileInputStream.open0(Native Method) > at java.io.FileInputStream.open(FileInputStream.java:195) > at java.io.FileInputStream.(FileInputStream.java:138) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:168) > at > org.apache.hadoop.security.ssl.ReloadingX509TrustManager.(ReloadingX509TrustManager.java:86) > at > org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:219) > at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:179) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.getSSLFactory(TimelineConnector.java:176) > at > org.apache.hadoop.yarn.client.api.impl.TimelineConnector.serviceInit(TimelineConnector.java:106) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > ... 11 more > {noformat} > CC [~rohithsharma] and [~gtCarrera9] -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org