RE: Are we running SparkR tests in Jenkins?
I think that breaks sparkR, the commandline script, and Jenkins, in which run-test.sh is calling sparkR. I'll work on this - since this also affects my PR #10652... Date: Fri, 15 Jan 2016 15:33:13 -0800 Subject: Re: Are we running SparkR tests in Jenkins? From: zjf...@gmail.com To: shiva...@eecs.berkeley.edu CC: r...@databricks.com; hvanhov...@questtec.nl; dev@spark.apache.org; shivaram.venkatara...@gmail.com Created https://issues.apache.org/jira/browse/SPARK-12846 On Fri, Jan 15, 2016 at 3:29 PM, Jeff Zhang <zjf...@gmail.com> wrote: Right, I forget the documentation, will create a follow up jira. On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman <shiva...@eecs.berkeley.edu> wrote: Ah I see. I wasn't aware of that PR. We should do a find and replace in all the documentation and rest of the repository as well. Shivaram On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <r...@databricks.com> wrote: > +Shivaram > > Ah damn - we should fix it. > > This was broken by https://github.com/apache/spark/pull/10658 - which > removed a functionality that has been deprecated since Spark 1.0. > > > > > > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier > <hvanhov...@questtec.nl> wrote: >> >> Hi all, >> >> I just noticed the following log entry in Jenkins: >> >>> >>> Running SparkR tests >>> >>> Running R applications through 'sparkR' is not supported as of Spark 2.0. >>> Use ./bin/spark-submit >> >> >> Are we still running R tests? Or just saying that this will be deprecated? >> >> Kind regards, >> >> Herman van Hövell tot Westerflier >> > - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org -- Best Regards Jeff Zhang -- Best Regards Jeff Zhang
Re: Are we running SparkR tests in Jenkins?
+Shivaram Ah damn - we should fix it. This was broken by https://github.com/apache/spark/pull/10658 - which removed a functionality that has been deprecated since Spark 1.0. On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier < hvanhov...@questtec.nl> wrote: > Hi all, > > I just noticed the following log entry in Jenkins: > > >> Running SparkR tests >> >> Running R applications through 'sparkR' is not supported as of Spark 2.0. >> Use ./bin/spark-submit > > > Are we still running R tests? Or just saying that this will be deprecated? > > Kind regards, > > Herman van Hövell tot Westerflier > >
Re: Are we running SparkR tests in Jenkins?
Yes - we should be running R tests AFAIK. That error message is a deprecation warning about the script `bin/sparkR` which needs to be changed in https://github.com/apache/spark/blob/7cd7f2202547224593517b392f56e49e4c94cabc/R/run-tests.sh#L26 to bin/spark-submit. Thanks Shivaram On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflierwrote: > Hi all, > > I just noticed the following log entry in Jenkins: > >> >> Running SparkR tests >> >> Running R applications through 'sparkR' is not supported as of Spark 2.0. >> Use ./bin/spark-submit > > > Are we still running R tests? Or just saying that this will be deprecated? > > Kind regards, > > Herman van Hövell tot Westerflier > - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
Re: Are we running SparkR tests in Jenkins?
Created https://issues.apache.org/jira/browse/SPARK-12846 On Fri, Jan 15, 2016 at 3:29 PM, Jeff Zhangwrote: > Right, I forget the documentation, will create a follow up jira. > > On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman < > shiva...@eecs.berkeley.edu> wrote: > >> Ah I see. I wasn't aware of that PR. We should do a find and replace >> in all the documentation and rest of the repository as well. >> >> Shivaram >> >> On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin wrote: >> > +Shivaram >> > >> > Ah damn - we should fix it. >> > >> > This was broken by https://github.com/apache/spark/pull/10658 - which >> > removed a functionality that has been deprecated since Spark 1.0. >> > >> > >> > >> > >> > >> > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier >> > wrote: >> >> >> >> Hi all, >> >> >> >> I just noticed the following log entry in Jenkins: >> >> >> >>> >> >> >>> Running SparkR tests >> >>> >> >> >>> Running R applications through 'sparkR' is not supported as of Spark >> 2.0. >> >>> Use ./bin/spark-submit >> >> >> >> >> >> Are we still running R tests? Or just saying that this will be >> deprecated? >> >> >> >> Kind regards, >> >> >> >> Herman van Hövell tot Westerflier >> >> >> > >> >> - >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> For additional commands, e-mail: dev-h...@spark.apache.org >> >> > > > -- > Best Regards > > Jeff Zhang > -- Best Regards Jeff Zhang
Re: Are we running SparkR tests in Jenkins?
Ah I see. I wasn't aware of that PR. We should do a find and replace in all the documentation and rest of the repository as well. Shivaram On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xinwrote: > +Shivaram > > Ah damn - we should fix it. > > This was broken by https://github.com/apache/spark/pull/10658 - which > removed a functionality that has been deprecated since Spark 1.0. > > > > > > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier > wrote: >> >> Hi all, >> >> I just noticed the following log entry in Jenkins: >> >>> >>> Running SparkR tests >>> >>> Running R applications through 'sparkR' is not supported as of Spark 2.0. >>> Use ./bin/spark-submit >> >> >> Are we still running R tests? Or just saying that this will be deprecated? >> >> Kind regards, >> >> Herman van Hövell tot Westerflier >> > - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
Re: Are we running SparkR tests in Jenkins?
Right, I forget the documentation, will create a follow up jira. On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman < shiva...@eecs.berkeley.edu> wrote: > Ah I see. I wasn't aware of that PR. We should do a find and replace > in all the documentation and rest of the repository as well. > > Shivaram > > On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xinwrote: > > +Shivaram > > > > Ah damn - we should fix it. > > > > This was broken by https://github.com/apache/spark/pull/10658 - which > > removed a functionality that has been deprecated since Spark 1.0. > > > > > > > > > > > > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier > > wrote: > >> > >> Hi all, > >> > >> I just noticed the following log entry in Jenkins: > >> > >>> > > >>> Running SparkR tests > >>> > > >>> Running R applications through 'sparkR' is not supported as of Spark > 2.0. > >>> Use ./bin/spark-submit > >> > >> > >> Are we still running R tests? Or just saying that this will be > deprecated? > >> > >> Kind regards, > >> > >> Herman van Hövell tot Westerflier > >> > > > > - > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > > -- Best Regards Jeff Zhang