Ted Yu created SPARK-10546:
------------------------------
Summary: Check partitionId's range in ExternalSorter#spill()
Key: SPARK-10546
URL: https://issues.apache.org/jira/browse/SPARK-10546
Project: Spark
Issue Type: Improvement
Affects Versions: 1.4.1
Reporter: Ted Yu
Priority: Minor
See this thread for background:
http://search-hadoop.com/m/q3RTt0rWvIkHAE81
We should check the range of partition Id and provide meaningful message
through exception.
Alternatively, we can use abs() and modulo to force the partition Id into
legitimate range. However, expectation is that user should correct the logic
error in his / her code.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
