Re: Zeppelin on Yarn : org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't running on a cluster. Deployment to YARN is not supported directly by SparkContext. Please use spark-submi
yarn-client still runs the executor tasks on the cluster, the main difference is where the driver job runs. Thanks, Ewan -- Original message-- From: shahab Date: Fri, 18 Sep 2015 13:11 To: Aniket Bhatnagar; Cc: user@spark.apache.org; Subject:Re: Zeppelin on Yarn : org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't running on a cluster. Deployment to YARN is not supported directly by SparkContext. Please use spark-submit. It works using yarn-client but I want to make it running on cluster. Is there any way to do so? best, /Shahab On Fri, Sep 18, 2015 at 12:54 PM, Aniket Bhatnagar mailto:aniket.bhatna...@gmail.com>> wrote: Can you try yarn-client mode? On Fri, Sep 18, 2015, 3:38 PM shahab mailto:shahab.mok...@gmail.com>> wrote: Hi, Probably I have wrong zeppelin configuration, because I get the following error when I execute spark statements in Zeppelin: org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't running on a cluster. Deployment to YARN is not supported directly by SparkContext. Please use spark-submit. Anyone knows What's the solution to this? best, /Shahab
Re: Zeppelin on Yarn : org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't running on a cluster. Deployment to YARN is not supported directly by SparkContext. Please use spark-submi
I don't think yarn-cluster mode is currently supported. You may want to ask zeppelin community for confirmation though. On Fri, Sep 18, 2015, 5:41 PM shahab wrote: > It works using yarn-client but I want to make it running on cluster. Is > there any way to do so? > > best, > /Shahab > > On Fri, Sep 18, 2015 at 12:54 PM, Aniket Bhatnagar < > aniket.bhatna...@gmail.com> wrote: > >> Can you try yarn-client mode? >> >> On Fri, Sep 18, 2015, 3:38 PM shahab wrote: >> >>> Hi, >>> >>> Probably I have wrong zeppelin configuration, because I get the >>> following error when I execute spark statements in Zeppelin: >>> >>> org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't >>> running on a cluster. Deployment to YARN is not supported directly by >>> SparkContext. Please use spark-submit. >>> >>> >>> Anyone knows What's the solution to this? >>> >>> best, >>> /Shahab >>> >> >
Re: Zeppelin on Yarn : org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't running on a cluster. Deployment to YARN is not supported directly by SparkContext. Please use spark-submi
It works using yarn-client but I want to make it running on cluster. Is there any way to do so? best, /Shahab On Fri, Sep 18, 2015 at 12:54 PM, Aniket Bhatnagar < aniket.bhatna...@gmail.com> wrote: > Can you try yarn-client mode? > > On Fri, Sep 18, 2015, 3:38 PM shahab wrote: > >> Hi, >> >> Probably I have wrong zeppelin configuration, because I get the >> following error when I execute spark statements in Zeppelin: >> >> org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't >> running on a cluster. Deployment to YARN is not supported directly by >> SparkContext. Please use spark-submit. >> >> >> Anyone knows What's the solution to this? >> >> best, >> /Shahab >> >
Re: Zeppelin on Yarn : org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't running on a cluster. Deployment to YARN is not supported directly by SparkContext. Please use spark-submi
Can you try yarn-client mode? On Fri, Sep 18, 2015, 3:38 PM shahab wrote: > Hi, > > Probably I have wrong zeppelin configuration, because I get the following > error when I execute spark statements in Zeppelin: > > org.apache.spark.SparkException: Detected yarn-cluster mode, but isn't > running on a cluster. Deployment to YARN is not supported directly by > SparkContext. Please use spark-submit. > > > Anyone knows What's the solution to this? > > best, > /Shahab >
