Mailing lists matching spark.apache.org

commits spark.apache.org
dev spark.apache.org
issues spark.apache.org
reviews spark.apache.org
user spark.apache.org


Git Push Summary

2015-08-24 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.0-rc2 [deleted] e2569282a

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-10-22 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.5.2-rc1 [created] ad6ade124

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-12 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6-snapshot0-test [created] 609d6e87a

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-16 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-preview [created] 31db36100

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-10 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.2-rc2 [deleted] 49c30c1f6

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-09 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.4.2-rc1 [deleted] 0b22a3c7a

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-09 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.2-rc1 [deleted] ad6ade124

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-09 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.3.2-rc1 [deleted] 5a139750b

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-09 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.2 [created] 5cf17f954

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

execute native system commands in Spark

2015-11-02 Thread patcharee 

Hi,

Is it possible to execute native system commands (in parallel) Spark, 
like scala.sys.process ?


Best,
Patcharee

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

JMX with Spark

2015-11-05 Thread Yogesh Vyas 
Hi,
How we can use JMX and JConsole to monitor our Spark applications?

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: Master build fails ?

2015-11-05 Thread Ted Yu 
build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver
-Dhadoop.version=2.6.0 -DskipTests assembly

The above command fails on Mac.

build/sbt -Pyarn -Phadoop-2.2 -Phive -Phive-thriftserver -Pkinesis-asl
-DskipTests assembly

The above command, used by Jenkins, passes.
That's why the build error wasn't caught.

FYI

On Thu, Nov 5, 2015 at 11:07 AM, Dilip Biswal <dbis...@us.ibm.com> wrote:

> Hello Ted,
>
> Thanks for your response.
>
> Here is the command i used :
>
> build/sbt clean
> build/sbt -Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver
> -Dhadoop.version=2.6.0 -DskipTests assembly
>
> I am building on CentOS and on master branch.
>
> One other thing, i was able to build fine with the above command up until
> recently. I think i have stared
> to have problem after SPARK-11073 where the HashCodes import was added.
>
> Regards,
> Dilip Biswal
> Tel: 408-463-4980
> dbis...@us.ibm.com
>
>
>
> From:Ted Yu <yuzhih...@gmail.com>
> To:Dilip Biswal/Oakland/IBM@IBMUS
> Cc:    Jean-Baptiste Onofré <j...@nanthrax.net>, "dev@spark.apache.org"
> <dev@spark.apache.org>
> Date:11/05/2015 10:46 AM
> Subject:Re: Master build fails ?
> --
>
>
>
> Dilip:
> Can you give the command you used ?
>
> Which release were you building ?
> What OS did you build on ?
>
> Cheers
>
> On Thu, Nov 5, 2015 at 10:21 AM, Dilip Biswal <*dbis...@us.ibm.com*
> <dbis...@us.ibm.com>> wrote:
> Hello,
>
> I am getting the same build error about not being able tofind
> com.google.common.hash.HashCodes.
>
>
> Is there a solution to this ?
>
> Regards,
> Dilip Biswal
> Tel: *408-463-4980* <408-463-4980>
> *dbis...@us.ibm.com* <dbis...@us.ibm.com>
>
>
>
> From:Jean-Baptiste Onofré <*j...@nanthrax.net* <j...@nanthrax.net>>
> To:Ted Yu <*yuzhih...@gmail.com* <yuzhih...@gmail.com>>
> Cc:"*dev@spark.apache.org* <dev@spark.apache.org>" <
> *dev@spark.apache.org* <dev@spark.apache.org>>
> Date:11/03/2015 07:20 AM
> Subject:Re: Master build fails ?
> --
>
>
>
> Hi Ted,
>
> thanks for the update. The build with sbt is in progress on my box.
>
> Regards
> JB
>
> On 11/03/2015 03:31 PM, Ted Yu wrote:
> > Interesting, Sbt builds were not all failing:
> >
> > *https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/*
> <https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/>
> >
> > FYI
> >
> > On Tue, Nov 3, 2015 at 5:58 AM, Jean-Baptiste Onofré <*j...@nanthrax.net*
> <j...@nanthrax.net>
> > <*mailto:j...@nanthrax.net* <j...@nanthrax.net>>> wrote:
>
> >
> > Hi Jacek,
> >
> > it works fine with mvn: the problem is with sbt.
> >
> > I suspect a different reactor order in sbt compare to mvn.
> >
> > Regards
> > JB
> >
> > On 11/03/2015 02:44 PM, Jacek Laskowski wrote:
> >
> > Hi,
> >
> > Just built the sources using the following command and it worked
> > fine.
> >
> > ➜  spark git:(master) ✗ ./build/mvn -Pyarn -Phadoop-2.6
> > -Dhadoop.version=2.7.1 -Dscala-2.11 -Phive -Phive-thriftserver
> > -DskipTests clean install
> > ...
> > [INFO]
> >
> 
> > [INFO] BUILD SUCCESS
> > [INFO]
> >
> 
> > [INFO] Total time: 14:15 min
> > [INFO] Finished at: 2015-11-03T14:40:40+01:00
> > [INFO] Final Memory: 438M/1972M
> > [INFO]
> >
> 
> >
> > ➜  spark git:(master) ✗ java -version
> > java version "1.8.0_66"
> > Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> > Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
> >
> > I'm on Mac OS.
> >
> > Pozdrawiam,
> > Jacek
> >
> > --
> > Jacek Laskowski |
> *http://blog.japila.pl* <http://blog.japila.pl/>|
> > *http://blog.jaceklaskowski.pl* <http://blog.jaceklaskowski.pl/>
>
> > Follow me at *https://twitter.com/jaceklaskowski*
> <https://twitter.com/jaceklaskowski>
> > Upvote at
> *htt

Git Push Summary

2015-11-05 Thread marmbrus 
Repository: spark
Updated Branches:
  refs/heads/branch-1.6 [created] f80f7b69a

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-03 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.5.2-rc2 [created] 49c30c1f6

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-07-08 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.4.1-rc4 [created] dbaa5c294

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

How to effieciently write sorted neighborhood in pyspark

2015-08-25 Thread shahid qadri 
I would like to implement sorted neighborhood approach in spark, what is the 
best way to write that in pyspark.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Git Push Summary

2015-08-31 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.5.0-rc3 [created] 908e37bcc

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Custom Partitioner

2015-09-01 Thread shahid qadri 
Hi Sparkians

How can we create a customer partition in pyspark

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Git Push Summary

2015-09-08 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.2.0-snapshot0 [deleted] bc0987579
  refs/tags/v1.2.0-snapshot1 [deleted] 38c1fbd96

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-08 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.3.1-rc1 [deleted] 0dcb5d9f3
  refs/tags/v1.3.1-rc2 [deleted] 7c4473aa5

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-08-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.4.1-rc3 [deleted] 3e8ae3894

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-08-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.4.1-rc1 [deleted] 60e08e507

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-08-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.4.1-rc4 [deleted] dbaa5c294

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-08-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.4.1-rc2 [deleted] 07b95c7ad

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-08-25 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.5.0-rc2 [created] 727771352

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Call Site - Spark Context

2015-10-01 Thread Sandip Mehta 
Hi,

I wanted to understand what is the purpose of Call Site in Spark Context?

Regards
SM

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Git Push Summary

2015-09-27 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.1-rc1 [deleted] 4df97937d

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-27 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.1 [created] 4f894dd69

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Re: unsubscribe

2015-09-18 Thread Richard Hillegas 

To unsubscribe from the user list, please send a message to
user-unsubscr...@spark.apache.org as described here:
http://spark.apache.org/community.html#mailing-lists.

Thanks,
-Rick

Re: unsubscribe

2015-09-23 Thread Akhil Das 
To unsubscribe, you need to send an email to
user-unsubscr...@spark.apache.org as described here
http://spark.apache.org/community.html

Thanks
Best Regards

On Wed, Sep 23, 2015 at 1:23 AM, Stuart Layton <stuart.lay...@gmail.com>
wrote:

>
>
> --
> Stuart Layton
>

Git Push Summary

2015-09-23 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.5.1-rc1 [created] 4df97937d

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-24 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.0-rc1 [deleted] 4c56ad772

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-24 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.0-rc3 [deleted] 908e37bcc

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-24 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.0-rc2 [deleted] 727771352

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-23 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.1-rc1 [deleted] 20db8186d

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-23 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.5.1-rc1 [created] 4f894dd69

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-23 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.4.2-rc1 [created] 0b22a3c7a

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-23 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.5.1-rc1 [created] 20db8186d

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-23 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.3.2-rc1 [created] 5a139750b

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-23 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.5.1-rc1 [deleted] 4f894dd69

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Re: unsubscribe

2015-09-25 Thread Akhil Das 
Send an email to dev-unsubscr...@spark.apache.org instead of
dev@spark.apache.org

Thanks
Best Regards

On Fri, Sep 25, 2015 at 4:00 PM, Nirmal R Kumar <nimmoa...@hotmail.com>
wrote:

>

Git Push Summary

2015-12-02 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc1 [created] bf525845c

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Spark applications metrics

2015-12-04 Thread patcharee 

Hi

How can I see the summary of data read / write, shuffle read / write, 
etc of an Application, not per stage?


Thanks,
Patcharee

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

how create hbase connect?

2015-12-07 Thread censj 
hi all,
  I want to update row on base. how to create connecting base on Rdd?

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[spark] Git Push Summary

2015-12-16 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc3 [created] 168c89e07

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2015-12-16 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc3 [deleted] 00a39d9c0

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2015-12-15 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc3 [created] 00a39d9c0

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2015-12-11 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc2 [deleted] 3e39925f9

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2015-12-11 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc2 [created] 23f8dfd45

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Automated close of PR's ?

2015-12-30 Thread Mridul Muralidharan 
Is there a script running to close "old" PR's ? I was not aware of any
discussion about this in dev list.

- Mridul

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Dr.appointment this afternoon and WFH tomorrow for another Dr. appointment (EOM)

2016-01-07 Thread Zhan Zhang 


-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

[spark] Git Push Summary

2015-12-27 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc4 [deleted] 4062cda30

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2015-12-27 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.0 [created] 4062cda30

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2015-12-21 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc4 [created] 4062cda30

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

data local read counter

2015-11-25 Thread Patcharee Thongtra 

Hi,

Is there a counter for data local read? I understood that it is locality 
level counter, but it seems not.


Thanks,
Patcharee

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

custom inputformat recordreader

2015-11-26 Thread Patcharee Thongtra 

Hi,

In python how to use inputformat/custom recordreader?

Thanks,
Patcharee


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Git Push Summary

2015-11-20 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-preview1 [created] 7582425d1

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-11-22 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-preview2 [created] 308381420

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Serializing DataSets

2016-01-12 Thread Simon Hafner 
What's the proper way to write DataSets to disk? Convert them to a
DataFrame and use the writers there?

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Handle empty kafka in Spark Streaming

2016-06-15 Thread Yogesh Vyas 
Hi,

Does anyone knows how to handle empty Kafka while Spark Streaming job
is running ?

Regards,
Yogesh

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Spark 2.0.0-preview artifacts still not available in Maven

2016-06-01 Thread Sean Owen 
Just checked and they are still not published this week. Can these be
published ASAP to complete the 2.0.0-preview release?

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

[spark] Git Push Summary

2016-06-16 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.2 [created] f16649304

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-06-16 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.2 [deleted] f16649304

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-06-21 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc1 [created] 0c66ca41a

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-06-19 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.2-rc2 [created] 54b1121f3

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Unsubscribe

2016-06-16 Thread Sanjeev Sagar 
Unsubscribe 

Sent from my iPhone

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[spark] Git Push Summary

2016-01-13 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-preview [deleted] 31db36100

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-01-13 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc1 [deleted] bf525845c

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-01-13 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc3 [deleted] 168c89e07

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-01-13 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.0-rc2 [deleted] 23f8dfd45

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Monitoring Spark with Ganglia on ElCapo

2016-01-17 Thread william tellme 
Does anyone have a link handy that describes configuring Ganglia on the mac?

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[spark] Git Push Summary

2016-06-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.2-rc1 [deleted] 4168d9c94

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-06-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.2 [created] 54b1121f3

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-06-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v1.6.2-rc2 [deleted] 54b1121f3

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Unsubscribe

2016-06-25 Thread Shivpriya Tamboskar 
Unsubscribe

Sent from my iPhone

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Pyspark filter not empty

2016-01-29 Thread patcharee 

Hi,

In pyspark how to filter if a column of dataframe is not empty?

I tried:

dfNotEmpty = df.filter(df['msg']!='')

It did not work.

Thanks,
Patcharee

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[spark] Git Push Summary

2016-02-26 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.1-rc1 [deleted] 152252f15

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-02-26 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v1.6.1-rc1 [created] 15de51c23

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

dataframe access hive complex type

2016-01-19 Thread pth001 

Hi,

How dataframe (What API) can access hive complex type (Struct, Array, Maps)?

Thanks,
Patcharee

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

visualize data from spark streaming

2016-01-20 Thread patcharee 

Hi,

How to visualize realtime data (in graph/chart) from spark streaming? 
Any tools?


Best,
Patcharee

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[spark] Git Push Summary

2016-03-09 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.1-rc1 [deleted] 15de51c23

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-03-09 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.1 [created] 152252f15

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-03-09 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.1 [deleted] 152252f15

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-03-09 Thread marmbrus 
Repository: spark
Updated Tags:  refs/tags/v1.6.1 [created] 15de51c23

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Unsubscribe

2016-04-08 Thread Db-Blog 

Unsubscribe


> On 06-Apr-2016, at 5:40 PM, Brian London <brianmlon...@gmail.com> wrote:
> 
> unsubscribe

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[spark] Git Push Summary

2016-05-17 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/2.0.0-preview [created] 8f5a04b62

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-05-01 Thread rxin 
Repository: spark
Updated Branches:
  refs/heads/branch-2.0 [created] a6428292f

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Save DataFrame to HBase

2016-04-21 Thread Benjamin Kim 
Has anyone found an easy way to save a DataFrame into HBase?

Thanks,
Ben


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Accumulators displayed in SparkUI in 1.4.1?

2016-05-25 Thread Daniel Barclay 

Was the feature of displaying accumulators in the Spark UI implemented in Spark 
1.4.1, or was that added later?

Thanks,
Daniel




-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc2 [deleted] 4a55b2326

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc3 [deleted] 48d1fa3e7

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc1 [deleted] 0c66ca41a

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v2.0.0 [created] 13650fc58

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc5 [deleted] 13650fc58

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-25 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc4 [deleted] e5f8c1117

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

Spark 2.0 just released

2016-07-26 Thread Chanh Le 
Its official now http://spark.apache.org/releases/spark-release-2-0-0.html 
<http://spark.apache.org/releases/spark-release-2-0-0.html>
Everyone should check it out.

[spark] Git Push Summary

2016-07-14 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc4 [created] e5f8c1117

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-13 Thread rxin 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc3 [deleted] 47eb9a621

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-13 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc3 [created] 47eb9a621

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-07-13 Thread pwendell 
Repository: spark
Updated Tags:  refs/tags/v2.0.0-rc3 [created] 48d1fa3e7

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

<    1   2   3   4   5   6   7   8   9   10   >