David Tolpin created SPARK-11904:
------------------------------------
Summary: pyspark reduceByKeyAndWindow with invFunc=None requires
checkpointing
Key: SPARK-11904
URL: https://issues.apache.org/jira/browse/SPARK-11904
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 1.5.2
Reporter: David Tolpin
When invFunc argument of reduceByKeyAndWindow is None, checkpointing should not
be required. Scala implementation of reduceByKeyAndWindow handles this
correctly and does not require checkpointing. Python version requires that
checkpoint directory be specified, it is a bug.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
