This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push:
new ce55a8f787b [SPARK-38017][FOLLOWUP][3.2] Hide TimestampNTZ in the doc
ce55a8f787b is described below
commit ce55a8f787b0453132bca06089da99462f61617a
Author: Kousuke Saruta <saru...@oss.nttdata.com>
AuthorDate: Thu Sep 15 09:27:20 2022 +0900
[SPARK-38017][FOLLOWUP][3.2] Hide TimestampNTZ in the doc
### What changes were proposed in this pull request?
This PR removes `TimestampNTZ` from the doc about `TimeWindow` and
`SessionWIndow`.
### Why are the changes needed?
As we discussed, it's better to hide `TimestampNTZ` from the doc.
https://github.com/apache/spark/pull/35313#issuecomment-1185192162
### Does this PR introduce _any_ user-facing change?
The document will be changed, but there is no compatibility problem.
### How was this patch tested?
Built the doc with `SKIP_RDOC=1 SKIP_SQLDOC=1 bundle exec jekyll build` at
`doc` directory.
Then, confirmed the generated HTML.
Closes #37883 from sarutak/fix-window-doc-3.2.
Authored-by: Kousuke Saruta <saru...@oss.nttdata.com>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
python/pyspark/sql/functions.py | 2 +-
sql/core/src/main/scala/org/apache/spark/sql/functions.scala | 6 +++---
2 files changed, 4 insertions(+), 4 deletions(-)
diff --git a/python/pyspark/sql/functions.py b/python/pyspark/sql/functions.py
index 1aeafd85ade..ea59c45c4f5 100644
--- a/python/pyspark/sql/functions.py
+++ b/python/pyspark/sql/functions.py
@@ -2307,7 +2307,7 @@ def window(timeColumn, windowDuration,
slideDuration=None, startTime=None):
----------
timeColumn : :class:`~pyspark.sql.Column`
The column or the expression to use as the timestamp for windowing by
time.
- The time column must be of TimestampType or TimestampNTZType.
+ The time column must be of TimestampType.
windowDuration : str
A string specifying the width of the window, e.g. `10 minutes`,
`1 second`. Check `org.apache.spark.unsafe.types.CalendarInterval` for
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/functions.scala
b/sql/core/src/main/scala/org/apache/spark/sql/functions.scala
index f4801eec060..a4c77b20c65 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/functions.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/functions.scala
@@ -3517,7 +3517,7 @@ object functions {
* processing time.
*
* @param timeColumn The column or the expression to use as the timestamp
for windowing by time.
- * The time column must be of TimestampType or
TimestampNTZType.
+ * The time column must be of TimestampType.
* @param windowDuration A string specifying the width of the window, e.g.
`10 minutes`,
* `1 second`. Check
`org.apache.spark.unsafe.types.CalendarInterval` for
* valid duration identifiers. Note that the duration
is a fixed length of
@@ -3573,7 +3573,7 @@ object functions {
* processing time.
*
* @param timeColumn The column or the expression to use as the timestamp
for windowing by time.
- * The time column must be of TimestampType or
TimestampNTZType.
+ * The time column must be of TimestampType.
* @param windowDuration A string specifying the width of the window, e.g.
`10 minutes`,
* `1 second`. Check
`org.apache.spark.unsafe.types.CalendarInterval` for
* valid duration identifiers. Note that the duration
is a fixed length of
@@ -3618,7 +3618,7 @@ object functions {
* processing time.
*
* @param timeColumn The column or the expression to use as the timestamp
for windowing by time.
- * The time column must be of TimestampType or
TimestampNTZType.
+ * The time column must be of TimestampType.
* @param windowDuration A string specifying the width of the window, e.g.
`10 minutes`,
* `1 second`. Check
`org.apache.spark.unsafe.types.CalendarInterval` for
* valid duration identifiers.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
