Do you have multiple disks? Maybe your work directory is not in the right
disk?

On Wed, Apr 29, 2015 at 4:43 PM, Selim Namsi <[email protected]> wrote:

> Hi,
>
> I'm using spark (1.3.1) MLlib to run random forest algorithm on tfidf
> output,the training data is a file containing 156060 (size 8.1M).
>
> The problem is that when trying to presist a partition into memory and
> there
> is not enought memory, the partition is persisted on disk and despite
> Having
> 229G of free disk space, I got " No space left on device"..
>
> This is how I'm running the program :
>
> ./spark-submit --class com.custom.sentimentAnalysis.MainPipeline --master
> local[2] --driver-memory 5g ml_pipeline.jar labeledTrainData.tsv
> testData.tsv
>
> And this is a part of the log:
>
>
>
> If you need more informations, please let me know.
> Thanks
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/java-io-IOException-No-space-left-on-device-tp22702.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>
>

Reply via email to