Spark uses more threads than specified in local[n]

2018-04-04 Thread Xiangyu Li
runner that prints `Thread.currentThread().getId()`, and there indeed prints out two thread ids. Is this some behavior from Spark's thread pool to improve performance? -- Sincerely Xiangyu Li <yisky...@gmail.com>

Re: scalastyle violation on mvn install but not on mvn package

2017-05-24 Thread Xiangyu Li
On Tue, May 23, 2017 at 7:48 AM, Xiangyu Li <yisky...@gmail.com> wrote: > >> Thank you for the answer. >> >> So basically it is not recommended to install Spark to your local maven >> repository? I thought if they wanted to enforce scalastyle for better open &g

Re: scalastyle violation on mvn install but not on mvn package

2017-05-23 Thread Xiangyu Li
ser List mailing list archive at Nabble.com. >> >> - >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> >> > -- Sincerely Xiangyu Li <yisky...@gmail.com>

Re: scalastyle violation on mvn install but not on mvn package

2017-05-23 Thread Xiangyu Li
-spark-user-list. > 1001560.n3.nabble.com/scalastyle-violation-on-mvn-install-but-not-on-mvn- > package-tp28693.html > > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > > > --------- > > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > > > > > -- > Marcelo > -- Sincerely Xiangyu Li <yisky...@gmail.com>