Thank you for confirming, Sean and Marcelo! Bests, Dongjoon.
On Tue, Aug 30, 2016 at 10:05 AM, Marcelo Vanzin <van...@cloudera.com> wrote: > A quick look shows that maybe dev/sparktestsupport/modules.py needs to > be modified, and a "build_profile_flags" added to the mesos section > (similar to hive / hive-thriftserver). > > Note not all PR builds will trigger mesos currently, since it's listed > as an independent module in the above file. > > On Tue, Aug 30, 2016 at 10:01 AM, Sean Owen <so...@cloudera.com> wrote: > > I have the heady power to modify Jenkins jobs now, so I will carefully > take > > a look at them and see if any of the config needs -Pmesos. But yeah I > > thought this should be baked into the script. > > > > On Tue, Aug 30, 2016 at 5:56 PM, Dongjoon Hyun <dongj...@apache.org> > wrote: > >> > >> Hi, Michael. > >> > >> It's a great news! > >> > >> BTW, I'm wondering if the Jenkins (SparkPullRequestBuilder) knows this > new > >> profile, -Pmesos. > >> > >> The PR was passed with the following Jenkins build arguments without > >> `-Pmesos` option. (at the last test) > >> ``` > >> [info] Building Spark (w/Hive 1.2.1) using SBT with these arguments: > >> -Pyarn -Phadoop-2.3 -Pkinesis-asl -Phive-thriftserver -Phive > test:package > >> streaming-kafka-0-8-assembly/assembly streaming-flume-assembly/assembly > >> streaming-kinesis-asl-assembly/assembly > >> ``` > >> > >> https://amplab.cs.berkeley.edu/jenkins/job/ > SparkPullRequestBuilder/64435/consoleFull > >> > >> Also, up to now, Jenkins seems not to use '-Pmesos' for all PRs. > >> > >> Bests, > >> Dongjoon. > >> > >> > >> On Fri, Aug 26, 2016 at 3:19 PM, Michael Gummelt < > mgumm...@mesosphere.io> > >> wrote: > >>> > >>> If it's separable, then sure. Consistency is nice. > >>> > >>> On Fri, Aug 26, 2016 at 2:14 PM, Jacek Laskowski <ja...@japila.pl> > wrote: > >>>> > >>>> Hi Michael, > >>>> > >>>> Congrats! > >>>> > >>>> BTW What I like about the change the most is that it uses the > >>>> pluggable interface for TaskScheduler and SchedulerBackend (as > >>>> introduced by YARN). Think Standalone should follow the steps. WDYT? > >>>> > >>>> Pozdrawiam, > >>>> Jacek Laskowski > >>>> ---- > >>>> https://medium.com/@jaceklaskowski/ > >>>> Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark > >>>> Follow me at https://twitter.com/jaceklaskowski > >>>> > >>>> > >>>> On Fri, Aug 26, 2016 at 10:20 PM, Michael Gummelt > >>>> <mgumm...@mesosphere.io> wrote: > >>>> > Hello devs, > >>>> > > >>>> > Much like YARN, Mesos has been refactored into a Maven module. So > >>>> > when > >>>> > building, you must add "-Pmesos" to enable Mesos support. > >>>> > > >>>> > The pre-built distributions from Apache will continue to enable > Mesos. > >>>> > > >>>> > PR: https://github.com/apache/spark/pull/14637 > >>>> > > >>>> > Cheers > >>>> > > >>>> > -- > >>>> > Michael Gummelt > >>>> > Software Engineer > >>>> > Mesosphere > >>> > >>> > >>> > >>> > >>> -- > >>> Michael Gummelt > >>> Software Engineer > >>> Mesosphere > >> > >> > > > > > > -- > Marcelo >
