[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http
[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806495#comment-16806495 ] Jorge Machado commented on SPARK-27208: --- Any help here please ? I really think this is broken . > RestSubmissionClient only supports http > --- > > Key: SPARK-27208 > URL: https://issues.apache.org/jira/browse/SPARK-27208 > Project: Spark > Issue Type: Bug > Components: Mesos >Affects Versions: 2.4.0 >Reporter: Jorge Machado >Priority: Minor > > As stand of now the class RestSubmissionClient does not support https, which > fails for example if we run mesos master with ssl and in cluster mode. > The spark-submit command fails with: Mesos cluster mode is only supported > through the REST submission API > > I create a PR for this which checks if the master endpoint given can speak > ssl before submitting the command. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http
[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796871#comment-16796871 ] Jorge Machado commented on SPARK-27208: --- Furthermore I'm getting the next error: ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master [mesos://host:5050/api] --deploy-mode cluster --conf spark.master.rest.enabled=true --total-executor-cores 4 --jars /home/machjor/spark-2.4.0-bin-hadoop2.7/examples/jars/spark-examples_2.11-2.4.0.jar /home/machjor/spark-2.4.0-bin-hadoop2.7/examples/jars/spark-examples_2.11-2.4.0.jar 10 2019-03-18 20:39:31 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-03-18 20:39:31 INFO RestSubmissionClient:54 - Submitting a request to launch an application in [mesos://host:5050/api]. 2019-03-18 20:39:32 ERROR RestSubmissionClient:70 - Server responded with error: Some(Failed to validate master::Call: Expecting 'type' to be present) 2019-03-18 20:39:32 ERROR RestSubmissionClient:70 - Error: Server responded with message of unexpected type ErrorResponse. 2019-03-18 20:39:32 INFO ShutdownHookManager:54 - Shutdown hook called 2019-03-18 20:39:32 INFO ShutdownHookManager:54 - Deleting directory /tmp/spark-259c0e66-c2ab-43b4-90df- > RestSubmissionClient only supports http > --- > > Key: SPARK-27208 > URL: https://issues.apache.org/jira/browse/SPARK-27208 > Project: Spark > Issue Type: Bug > Components: Mesos >Affects Versions: 2.4.0 >Reporter: Jorge Machado >Priority: Minor > > As stand of now the class RestSubmissionClient does not support https, which > fails for example if we run mesos master with ssl and in cluster mode. > The spark-submit command fails with: Mesos cluster mode is only supported > through the REST submission API > > I create a PR for this which checks if the master endpoint given can speak > ssl before submitting the command. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http
[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796860#comment-16796860 ] Jorge Machado commented on SPARK-27208: --- I would like to take this. > RestSubmissionClient only supports http > --- > > Key: SPARK-27208 > URL: https://issues.apache.org/jira/browse/SPARK-27208 > Project: Spark > Issue Type: Bug > Components: Mesos >Affects Versions: 2.4.0 >Reporter: Jorge Machado >Priority: Minor > > As stand of now the class RestSubmissionClient does not support https, which > fails for example if we run mesos master with ssl and in cluster mode. > The spark-submit command fails with: Mesos cluster mode is only supported > through the REST submission API > > I create a PR for this which checks if the master endpoint given can speak > ssl before submitting the command. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http
[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796544#comment-16796544 ] Jorge Machado commented on SPARK-27208: --- relates to this as the follow up error > RestSubmissionClient only supports http > --- > > Key: SPARK-27208 > URL: https://issues.apache.org/jira/browse/SPARK-27208 > Project: Spark > Issue Type: Bug > Components: Mesos >Affects Versions: 2.4.0 >Reporter: Jorge Machado >Priority: Minor > > As stand of now the class RestSubmissionClient does not support https, which > fails for example if we run mesos master with ssl and in cluster mode. > The spark-submit command fails with: Mesos cluster mode is only supported > through the REST submission API > > I create a PR for this which checks if the master endpoint given can speak > ssl before submitting the command. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
