Re: SparkR broadcast variables

2015-08-03 Thread Deborah Siegel
I think I just answered my own question. The privitization of the RDD API
might have resulted in my error, because this worked:

 randomMatBr - SparkR:::broadcast(sc, randomMat)

On Mon, Aug 3, 2015 at 4:59 PM, Deborah Siegel deborah.sie...@gmail.com
wrote:

 Hello,

 In looking at the SparkR codebase, it seems as if broadcast variables
 ought to be working based on the tests.

 I have tried the following in sparkR shell, and similar code in RStudio,
 but in both cases got the same message

  randomMat - matrix(nrow=10, ncol=10, data=rnorm(100))
  randomMatBr - broadcast(sc, randomMat)

 *Error: could not find function broadcast*
 Does someone know how to use broadcast variables on SparkR?
 Thanks,
 Deb



SparkR broadcast variables

2015-08-03 Thread Deborah Siegel
Hello,

In looking at the SparkR codebase, it seems as if broadcast variables ought
to be working based on the tests.

I have tried the following in sparkR shell, and similar code in RStudio,
but in both cases got the same message

 randomMat - matrix(nrow=10, ncol=10, data=rnorm(100))
 randomMatBr - broadcast(sc, randomMat)

*Error: could not find function broadcast*
Does someone know how to use broadcast variables on SparkR?
Thanks,
Deb