Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21571#discussion_r195597051
--- Diff: python/pyspark/sql/tests.py ---
@@ -269,6 +269,7 @@ def test_struct_field_type_name(self):
struct_field = StructField("a",
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21571#discussion_r195597031
--- Diff: python/pyspark/sql/streaming.py ---
@@ -854,6 +856,20 @@ def trigger(self, processingTime=None, once=None,
continuous=None):
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21571#discussion_r195596984
--- Diff: dev/sparktestsupport/modules.py ---
@@ -389,19 +389,19 @@ def __hash__(self):
"python/pyspark/sql"
],
GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/21571
[WIP][SPARK-24565][SS] Add API for in Structured Streaming for exposing
output rows of each microbatch as a DataFrame
## What changes were proposed in this pull request?
Currently, the
