n Wed, Dec 7, 2016 at 11:31 AM, Teng Long <[hidden email]
> > wrote:
> Hi Holden,
>
> Can you please tell me how to edit version numbers efficiently? the correct
> way? I'm really struggling with this and don't know where to look.
>
> Thanks,
> T
Hi Holden,
Can you please tell me how to edit version numbers efficiently? the correct
way? I'm really struggling with this and don't know where to look.
Thanks,
Teng
> On Dec 6, 2016, at 4:02 PM, Teng Long wrote:
>
> Hi Jakob,
>
> It seems like I’ll have to e
spark's root
> pom.xml should be sufficient. However, keep in mind that you'll also
> need to publish spark locally before you can access it in your test
> application.
>
> On Tue, Dec 6, 2016 at 2:50 AM, Teng Long <[hidden email]
> > wrote:
>
Thank you Jokob for clearing things up for me.
Before, I thought my application was compiled against my local build since I
can get all the logs I just added in spark-core. But it was all along using
spark downloaded from remote maven repository, and that’s why I “cannot" add
new RDD methods i
k.rdd”. It seems like my import statement is
wrong, but I don’t know how?
Thanks!
> On Dec 5, 2016, at 5:14 PM, Teng Long wrote:
>
> I’m trying to implement a transformation that can merge partitions (to align
> with GPU specs) and move them onto GPU memory, for example rdd.toG
;
> case class WordCount(word: String, count: Long)
>
> val collection = sc.parallelize(Seq(WordCount("dog", 50), WordCount("cow",
> 60)))
>
> collection.saveToCassandra("test", "words", SomeColumns("word", "count"))
>
ext
>
> <http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.rdd.RDD@sparkContext:org.apache.spark.SparkContext>
>
> On Mon, Dec 5, 2016 at 1:04 PM, Teng Long <mailto:longteng...@gmail.com>> wrote:
> Thank you for providing another answer, Holden.
>
&g
Thank you for providing another answer, Holden.
So I did what Tarun and Michal suggested, and it didn’t work out as I want to
have a new transformation method in RDD class, and need to use that RDD’s spark
context which is private. So I guess the only thing I can do now is to sbt
publishLocal?
