[ https://issues.apache.org/jira/browse/SPARK-19374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Derek M Miller updated SPARK-19374: ----------------------------------- Description: I am currently getting an SSL error when turning on ssl. I have confirmed nothing is wrong the certificates as well. This is running on the emr and has the following configuration for spark-defaults (obviously changed the passwords and paths): {code} { "Classification": "spark-defaults", "Properties": { "spark.yarn.maxAppAttempts": "1", "spark.yarn.executor.memoryOverhead": "2048", "spark.ssl.enabled": "true", "spark.ssl.keyStore": "not_real_path/keystore.jks", "spark.ssl.keyStorePassword": "not_a_real_password", "spark.ssl.trustStore": "not_real_path/truststore.jks", "spark.ssl.trustStorePassword": "not_a_real_password" } } {code} and I am getting the following exception: {code} 17/01/26 20:02:31 INFO spark.SecurityManager: Changing view acls to: hadoop 17/01/26 20:02:31 INFO spark.SecurityManager: Changing modify acls to: hadoop 17/01/26 20:02:31 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); users with modify permissions: Set(hadoop) 17/01/26 20:02:31 INFO yarn.Client: Deleting staging directory .sparkStaging/application_1485460802835_0001 Exception in thread "main" java.security.KeyManagementException: Default SSLContext is initialized automatically at sun.security.ssl.SSLContextImpl$DefaultSSLContext.engineInit(SSLContextImpl.java:749) at javax.net.ssl.SSLContext.init(SSLContext.java:282) at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:284) at org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:881) at org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:142) at org.apache.spark.deploy.yarn.Client.run(Client.scala:1021) at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1081) at org.apache.spark.deploy.yarn.Client.main(Client.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 17/01/26 20:02:31 INFO util.ShutdownHookManager: Shutdown hook called {code} was: I am currently getting an SSL error when turning on ssl. I have confirmed nothing is wrong the certificates as well. This is running on the emr and has the following configuration for spark-defaults: {code} { "Classification": "spark-defaults", "Properties": { "spark.yarn.maxAppAttempts": "1", "spark.yarn.executor.memoryOverhead": "2048", "spark.ssl.enabled": "true", "spark.ssl.keyStore": "not_real_path/keystore.jks", "spark.ssl.keyStorePassword": "not_a_real_password", "spark.ssl.trustStore": "not_real_path/truststore.jks", "spark.ssl.trustStorePassword": "not_a_real_password" } } {code} and I am getting the following exception: {code} 17/01/26 20:02:31 INFO spark.SecurityManager: Changing view acls to: hadoop 17/01/26 20:02:31 INFO spark.SecurityManager: Changing modify acls to: hadoop 17/01/26 20:02:31 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); users with modify permissions: Set(hadoop) 17/01/26 20:02:31 INFO yarn.Client: Deleting staging directory .sparkStaging/application_1485460802835_0001 Exception in thread "main" java.security.KeyManagementException: Default SSLContext is initialized automatically at sun.security.ssl.SSLContextImpl$DefaultSSLContext.engineInit(SSLContextImpl.java:749) at javax.net.ssl.SSLContext.init(SSLContext.java:282) at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:284) at org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:881) at org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:142) at org.apache.spark.deploy.yarn.Client.run(Client.scala:1021) at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1081) at org.apache.spark.deploy.yarn.Client.main(Client.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 17/01/26 20:02:31 INFO util.ShutdownHookManager: Shutdown hook called {code} > java.security.KeyManagementException: Default SSLContext is initialized > automatically > ------------------------------------------------------------------------------------- > > Key: SPARK-19374 > URL: https://issues.apache.org/jira/browse/SPARK-19374 > Project: Spark > Issue Type: Bug > Reporter: Derek M Miller > > I am currently getting an SSL error when turning on ssl. I have confirmed > nothing is wrong the certificates as well. This is running on the emr and has > the following configuration for spark-defaults (obviously changed the > passwords and paths): > {code} > { > "Classification": "spark-defaults", > "Properties": { > "spark.yarn.maxAppAttempts": "1", > "spark.yarn.executor.memoryOverhead": "2048", > "spark.ssl.enabled": "true", > "spark.ssl.keyStore": "not_real_path/keystore.jks", > "spark.ssl.keyStorePassword": "not_a_real_password", > "spark.ssl.trustStore": "not_real_path/truststore.jks", > "spark.ssl.trustStorePassword": "not_a_real_password" > } > } > {code} > and I am getting the following exception: > {code} > 17/01/26 20:02:31 INFO spark.SecurityManager: Changing view acls to: hadoop > 17/01/26 20:02:31 INFO spark.SecurityManager: Changing modify acls to: hadoop > 17/01/26 20:02:31 INFO spark.SecurityManager: SecurityManager: authentication > disabled; ui acls disabled; users with view permissions: Set(hadoop); users > with modify permissions: Set(hadoop) > 17/01/26 20:02:31 INFO yarn.Client: Deleting staging directory > .sparkStaging/application_1485460802835_0001 > Exception in thread "main" java.security.KeyManagementException: Default > SSLContext is initialized automatically > at > sun.security.ssl.SSLContextImpl$DefaultSSLContext.engineInit(SSLContextImpl.java:749) > at javax.net.ssl.SSLContext.init(SSLContext.java:282) > at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:284) > at > org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:881) > at > org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:142) > at org.apache.spark.deploy.yarn.Client.run(Client.scala:1021) > at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1081) > at org.apache.spark.deploy.yarn.Client.main(Client.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731) > at > org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > 17/01/26 20:02:31 INFO util.ShutdownHookManager: Shutdown hook called > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org