Hello!
I am experiencing an issue [1] with Word2VecModel#save. It appears to
exceed spark.akka.frameSize (see stack trace [3]).
Setting the frameSize is not really an option because that would just
limit me to 2GB so I wonder if there is anything I can do to make this
work even if the model is larger.
Am I doing something wrong here or is this some kind of bug?
BR; Stefan
[1]
http://stackoverflow.com/questions/36692386/exceeding-spark-akka-framesize-when-saving-word2vecmodel
[2]
https://github.com/apache/spark/blob/master/mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala#L646
[3] http://pastebin.com/1gM63ynm
--
Stefan R. Falk
Know-Center Graz
Inffeldgasse 13 / 6. Stock
8010 Graz, Austria
Email : sf...@know-center.at
Tel: +43 316 873 30869
http://www.know-center.at
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
