Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/13286#discussion_r64490527
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ---
@@ -77,7 +77,50 @@ final class DataFrameWriter private[sql](df: DataFrame) {
case "ignore" => SaveMode.Ignore
case "error" | "default" => SaveMode.ErrorIfExists
case _ => throw new IllegalArgumentException(s"Unknown save mode:
$saveMode. " +
- "Accepted modes are 'overwrite', 'append', 'ignore', 'error'.")
+ "Accepted save modes are 'overwrite', 'append', 'ignore',
'error'.")
+ }
+ this
+ }
+
+ /**
+ * Specifies how data of a streaming DataFrame/Dataset is written to a
streaming sink.
+ * - `OutputMode.Append`: only the new rows in the streaming
DataFrame/Dataset will be
+ * written to the sink
+ * - `OutputMode.Update`: only the changed rows in the streaming
DataFrame/Dataset will be
+ * written to the sink every time there is
some updates
+ * - `OutputMode.Complete`: all the rows in the streaming
DataFrame/Dataset will be written
+ * to the sink every time these is some
updates
+ *
+ * @since 2.0.0
+ */
+ @Experimental
+ def outputMode(outputMode: OutputMode): DataFrameWriter = {
+ assertStreaming("outputMode() can only be called on continuous
queries")
+ this.outputMode = outputMode
+ this
+ }
+
--- End diff --
nit: extra line.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
