Re: Assembly build on spark 2.0.0

2016-08-26 Thread Srikanth Sampath
Hi, Thanks Radek. However mvn package does not build the uber jar. I am looking for an uber jar and not a distribution. I have seen references to the uber jar here What I see in the spark 2.0

Re: GraphFrames 0.2.0 released

2016-08-26 Thread Joseph Bradley
This should do it: https://github.com/graphframes/graphframes/releases/tag/release-0.2.0 Thanks for the reminder! Joseph On Wed, Aug 24, 2016 at 10:11 AM, Maciej Bryński wrote: > Hi, > Do you plan to add tag for this release on github ? >

Re: Mesos is now a maven module

2016-08-26 Thread Michael Gummelt
If it's separable, then sure. Consistency is nice. On Fri, Aug 26, 2016 at 2:14 PM, Jacek Laskowski wrote: > Hi Michael, > > Congrats! > > BTW What I like about the change the most is that it uses the > pluggable interface for TaskScheduler and SchedulerBackend (as >

Re: Mesos is now a maven module

2016-08-26 Thread Jacek Laskowski
Hi Michael, Congrats! BTW What I like about the change the most is that it uses the pluggable interface for TaskScheduler and SchedulerBackend (as introduced by YARN). Think Standalone should follow the steps. WDYT? Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering

Re: Mesos is now a maven module

2016-08-26 Thread Reynold Xin
This is great! On Fri, Aug 26, 2016 at 1:20 PM, Michael Gummelt wrote: > Hello devs, > > Much like YARN, Mesos has been refactored into a Maven module. So when > building, you must add "-Pmesos" to enable Mesos support. > > The pre-built distributions from Apache will

Mesos is now a maven module

2016-08-26 Thread Michael Gummelt
Hello devs, Much like YARN, Mesos has been refactored into a Maven module. So when building, you must add "-Pmesos" to enable Mesos support. The pre-built distributions from Apache will continue to enable Mesos. PR: https://github.com/apache/spark/pull/14637 Cheers -- Michael Gummelt

Re: Assembly build on spark 2.0.0

2016-08-26 Thread Radoslaw Gruchalski
mvn package might be the command you’re looking for. – Best regards, Radek Gruchalski ra...@gruchalski.com On August 26, 2016 at 3:59:24 PM, Srikanth Sampath ( ssampath.apa...@gmail.com) wrote: Hi, mvn assembly is creating a .tgz distribution. How can I create a plain jar archive? I would

Re: Insert non-null values from dataframe

2016-08-26 Thread Russell Spitzer
Cassandra does not differentiate between null and empty, so when reading from C* all empty values are reported as null. To avoid inserting nulls (avoiding tombstones) see https://github.com/datastax/spark-cassandra-connector/blob/master/doc/5_saving.md#globally-treating-all-nulls-as-unset This

Assembly build on spark 2.0.0

2016-08-26 Thread Srikanth Sampath
Hi, mvn assembly is creating a .tgz distribution. How can I create a plain jar archive? I would like to create a spark-assembly-.jar -Srikanth