HyukjinKwon commented on a change in pull request #30346:
URL: https://github.com/apache/spark/pull/30346#discussion_r522723304
##########
File path: python/pyspark/streaming/dstream.py
##########
@@ -522,17 +551,25 @@ def reduceByKeyAndWindow(self, func, invFunc,
windowDuration, slideDuration=None
`invFunc` can be None, then it will reduce all the RDDs in window,
could be slower
than having `invFunc`.
- :param func: associative and commutative reduce function
- :param invFunc: inverse function of `reduceFunc`
- :param windowDuration: width of the window; must be a multiple of this
DStream's
- batching interval
- :param slideDuration: sliding interval of the window (i.e., the
interval after which
- the new DStream will generate RDDs); must be a
multiple of this
- DStream's batching interval
- :param numPartitions: number of partitions of each RDD in the new
DStream.
- :param filterFunc: function to filter expired key-value pairs;
- only pairs that satisfy the function are retained
- set this to null if you do not want to filter
+ Parameters
+ ----------
+ func : function
+ associative and commutative reduce function
+ invFunc : function
+ inverse function of `reduceFunc`
+ windowDuration : int
+ width of the window; must be a multiple of this DStream's
+ batching interval
+ slideDuration : int, optional
+ sliding interval of the window (i.e., the interval after which
+ the new DStream will generate RDDs); must be a multiple of this
+ DStream's batching interval
+ numPartitions : int, optional
+ number of partitions of each RDD in the new DStream.
+ filterFunc : func, optional
Review comment:
```suggestion
filterFunc : function, optional
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
