A quick look shows that maybe dev/sparktestsupport/modules.py needs to be modified, and a "build_profile_flags" added to the mesos section (similar to hive / hive-thriftserver).
Note not all PR builds will trigger mesos currently, since it's listed as an independent module in the above file. On Tue, Aug 30, 2016 at 10:01 AM, Sean Owen <so...@cloudera.com> wrote: > I have the heady power to modify Jenkins jobs now, so I will carefully take > a look at them and see if any of the config needs -Pmesos. But yeah I > thought this should be baked into the script. > > On Tue, Aug 30, 2016 at 5:56 PM, Dongjoon Hyun <dongj...@apache.org> wrote: >> >> Hi, Michael. >> >> It's a great news! >> >> BTW, I'm wondering if the Jenkins (SparkPullRequestBuilder) knows this new >> profile, -Pmesos. >> >> The PR was passed with the following Jenkins build arguments without >> `-Pmesos` option. (at the last test) >> ``` >> [info] Building Spark (w/Hive 1.2.1) using SBT with these arguments: >> -Pyarn -Phadoop-2.3 -Pkinesis-asl -Phive-thriftserver -Phive test:package >> streaming-kafka-0-8-assembly/assembly streaming-flume-assembly/assembly >> streaming-kinesis-asl-assembly/assembly >> ``` >> >> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64435/consoleFull >> >> Also, up to now, Jenkins seems not to use '-Pmesos' for all PRs. >> >> Bests, >> Dongjoon. >> >> >> On Fri, Aug 26, 2016 at 3:19 PM, Michael Gummelt <mgumm...@mesosphere.io> >> wrote: >>> >>> If it's separable, then sure. Consistency is nice. >>> >>> On Fri, Aug 26, 2016 at 2:14 PM, Jacek Laskowski <ja...@japila.pl> wrote: >>>> >>>> Hi Michael, >>>> >>>> Congrats! >>>> >>>> BTW What I like about the change the most is that it uses the >>>> pluggable interface for TaskScheduler and SchedulerBackend (as >>>> introduced by YARN). Think Standalone should follow the steps. WDYT? >>>> >>>> Pozdrawiam, >>>> Jacek Laskowski >>>> ---- >>>> https://medium.com/@jaceklaskowski/ >>>> Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark >>>> Follow me at https://twitter.com/jaceklaskowski >>>> >>>> >>>> On Fri, Aug 26, 2016 at 10:20 PM, Michael Gummelt >>>> <mgumm...@mesosphere.io> wrote: >>>> > Hello devs, >>>> > >>>> > Much like YARN, Mesos has been refactored into a Maven module. So >>>> > when >>>> > building, you must add "-Pmesos" to enable Mesos support. >>>> > >>>> > The pre-built distributions from Apache will continue to enable Mesos. >>>> > >>>> > PR: https://github.com/apache/spark/pull/14637 >>>> > >>>> > Cheers >>>> > >>>> > -- >>>> > Michael Gummelt >>>> > Software Engineer >>>> > Mesosphere >>> >>> >>> >>> >>> -- >>> Michael Gummelt >>> Software Engineer >>> Mesosphere >> >> > -- Marcelo --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
