Repository: spark Updated Branches: refs/heads/branch-1.3 387d81891 -> 6ddde8eda
[SPARK-13464][STREAMING][PYSPARK] Fix failed streaming in pyspark in branch 1.3 JIRA: https://issues.apache.org/jira/browse/SPARK-13464 ## What changes were proposed in this pull request? During backport a mllib feature, I found that the clearly checkouted branch-1.3 codebase would fail at the test `test_reduce_by_key_and_window_with_none_invFunc` in pyspark/streaming. We should fix it. ## How was the this patch tested? Unit test `test_reduce_by_key_and_window_with_none_invFunc` is fixed. Author: Liang-Chi Hsieh <vii...@gmail.com> Closes #11339 from viirya/fix-streaming-test-branch-1.3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6ddde8ed Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/6ddde8ed Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6ddde8ed Branch: refs/heads/branch-1.3 Commit: 6ddde8eda28538e8f899912477a821f8193262ba Parents: 387d818 Author: Liang-Chi Hsieh <vii...@gmail.com> Authored: Thu Feb 25 12:28:50 2016 -0800 Committer: Shixiong Zhu <shixi...@databricks.com> Committed: Thu Feb 25 12:28:50 2016 -0800 ---------------------------------------------------------------------- python/pyspark/streaming/tests.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/6ddde8ed/python/pyspark/streaming/tests.py ---------------------------------------------------------------------- diff --git a/python/pyspark/streaming/tests.py b/python/pyspark/streaming/tests.py index c136bf1..12293a0 100644 --- a/python/pyspark/streaming/tests.py +++ b/python/pyspark/streaming/tests.py @@ -423,7 +423,7 @@ class WindowFunctionTests(PySparkStreamingTestCase): .reduceByKeyAndWindow(operator.add, None, 5, 1)\ .filter(lambda kv: kv[1] > 0).count() - expected = [[2], [4], [6], [6], [6], [6]] + expected = [[1], [2], [3], [4], [5], [6]] self._test_func(input, func, expected) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
