Github user marmbrus commented on a diff in the pull request:
https://github.com/apache/spark/pull/16758#discussion_r98776316
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ---
@@ -219,6 +219,160 @@ class KeyValueGroupedDataset[K, V] private[sql](
}
/**
+ * ::Experimental::
+ * (Scala-specific)
+ * Applies the given function to each group of data, while using an
additional keyed state.
+ * For each unique group, the function will be passed the group key and
an iterator that contains
--- End diff --
I would consider breaking this up to make it a little easier to follow:
```
For each unique group, the given function will be invoked with the
following arguments:
- The key of the group.
- A user-defined state object set by previous invocations of the given
function. Note that, for batch queries, there is only ever one invocation and
thus the state object will always be empty.
- An iterator containing all the values for this key.
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
