[
https://issues.apache.org/jira/browse/SPARK-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15426798#comment-15426798
]
Shivaram Venkataraman commented on SPARK-6832:
----------------------------------------------
I think we can add a new method `readBinFully` and then replace calls to
`readBin` with that method.
Regarding simulating this -- I think you could try to manually send a signal
(using something like kill -s SIGCHLD) to an R process while it is reading a
large amount of data using readBin.
> Handle partial reads in SparkR JVM to worker communication
> ----------------------------------------------------------
>
> Key: SPARK-6832
> URL: https://issues.apache.org/jira/browse/SPARK-6832
> Project: Spark
> Issue Type: Improvement
> Components: SparkR
> Reporter: Shivaram Venkataraman
> Priority: Minor
>
> After we move to use socket between R worker and JVM, it's possible that
> readBin() in R will return partial results (for example, interrupted by
> signal).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
