[spark] branch master updated (246c398 -> bda0669)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 246c398 [SPARK-30435][DOC] Update doc of Supported Hive Features add bda0669 [SPARK-30665][DOCS][BUILD][PYTHON] Eliminate pypandoc dependency No new revisions were added by this update. Summary of changes: dev/create-release/spark-rm/Dockerfile | 4 ++-- dev/requirements.txt | 1 - dev/run-pip-tests | 2 +- docs/README.md | 22 ++ python/setup.py| 13 +++-- 5 files changed, 24 insertions(+), 18 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (246c398 -> bda0669)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 246c398 [SPARK-30435][DOC] Update doc of Supported Hive Features add bda0669 [SPARK-30665][DOCS][BUILD][PYTHON] Eliminate pypandoc dependency No new revisions were added by this update. Summary of changes: dev/create-release/spark-rm/Dockerfile | 4 ++-- dev/requirements.txt | 1 - dev/run-pip-tests | 2 +- docs/README.md | 22 ++ python/setup.py| 13 +++-- 5 files changed, 24 insertions(+), 18 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (c228810 -> 246c398)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c228810 [SPARK-30672][BUILD] Add numpy to API docs readme add 246c398 [SPARK-30435][DOC] Update doc of Supported Hive Features No new revisions were added by this update. Summary of changes: docs/sql-migration-guide.md | 27 ++- 1 file changed, 26 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (b1f81f0 -> c228810)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from b1f81f0 [MINOR][SQL][DOCS] Fix typos in scaladoc strings of higher order functions add c228810 [SPARK-30672][BUILD] Add numpy to API docs readme No new revisions were added by this update. Summary of changes: docs/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated (b93f250 -> eeef0e7)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from b93f250 [SPARK-29367][DOC][2.4] Add compatibility note for Arrow 0.15.0 to SQL guide add eeef0e7 [SPARK-29578][TESTS][2.4] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8 No new revisions were added by this update. Summary of changes: .../scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (e5c7f89 -> b1f81f0)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e5c7f89 [SPARK-30529][CORE] Improve error messages when Executor dies before registering with driver add b1f81f0 [MINOR][SQL][DOCS] Fix typos in scaladoc strings of higher order functions No new revisions were added by this update. Summary of changes: sql/core/src/main/scala/org/apache/spark/sql/functions.scala | 10 +- 1 file changed, 5 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (e5c7f89 -> b1f81f0)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e5c7f89 [SPARK-30529][CORE] Improve error messages when Executor dies before registering with driver add b1f81f0 [MINOR][SQL][DOCS] Fix typos in scaladoc strings of higher order functions No new revisions were added by this update. Summary of changes: sql/core/src/main/scala/org/apache/spark/sql/functions.scala | 10 +- 1 file changed, 5 insertions(+), 5 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (7173786 -> e5c7f89)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 7173786 [SPARK-29543][SS][UI] Structured Streaming Web UI add e5c7f89 [SPARK-30529][CORE] Improve error messages when Executor dies before registering with driver No new revisions were added by this update. Summary of changes: .../org/apache/spark/executor/CoarseGrainedExecutorBackend.scala | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated (c7c9f9e -> b93f250)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from c7c9f9e [SPARK-30310][CORE][2.4] Resolve missing match case in SparkUncaughtExceptionHandler and added tests add b93f250 [SPARK-29367][DOC][2.4] Add compatibility note for Arrow 0.15.0 to SQL guide No new revisions were added by this update. Summary of changes: docs/sql-pyspark-pandas-with-arrow.md | 17 + 1 file changed, 17 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated (12f4492 -> c7c9f9e)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 12f4492 [SPARK-30512] Added a dedicated boss event loop group add c7c9f9e [SPARK-30310][CORE][2.4] Resolve missing match case in SparkUncaughtExceptionHandler and added tests No new revisions were added by this update. Summary of changes: .../spark/util/SparkUncaughtExceptionHandler.scala | 19 +++- .../util/SparkUncaughtExceptionHandlerSuite.scala | 108 + 2 files changed, 125 insertions(+), 2 deletions(-) create mode 100644 core/src/test/scala/org/apache/spark/util/SparkUncaughtExceptionHandlerSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated (12f4492 -> c7c9f9e)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 12f4492 [SPARK-30512] Added a dedicated boss event loop group add c7c9f9e [SPARK-30310][CORE][2.4] Resolve missing match case in SparkUncaughtExceptionHandler and added tests No new revisions were added by this update. Summary of changes: .../spark/util/SparkUncaughtExceptionHandler.scala | 19 +++- .../util/SparkUncaughtExceptionHandlerSuite.scala | 108 + 2 files changed, 125 insertions(+), 2 deletions(-) create mode 100644 core/src/test/scala/org/apache/spark/util/SparkUncaughtExceptionHandlerSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated: [SPARK-29543][SS][UI] Structured Streaming Web UI
This is an automated email from the ASF dual-hosted git repository. zsxwing pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7173786 [SPARK-29543][SS][UI] Structured Streaming Web UI 7173786 is described below commit 71737861531180bbda9aec8d241b1428fe91cab2 Author: uncleGen AuthorDate: Wed Jan 29 13:43:51 2020 -0800 [SPARK-29543][SS][UI] Structured Streaming Web UI ### What changes were proposed in this pull request? This PR adds two pages to Web UI for Structured Streaming: - "/streamingquery": Streaming Query Page, providing some aggregate information for running/completed streaming queries. - "/streamingquery/statistics": Streaming Query Statistics Page, providing detailed information for streaming query, including `Input Rate`, `Process Rate`, `Input Rows`, `Batch Duration` and `Operation Duration` ![Screen Shot 2020-01-29 at 1 38 00 PM](https://user-images.githubusercontent.com/1000778/73399837-cd01cc80-429c-11ea-9d4b-1d200a41b8d5.png) ![Screen Shot 2020-01-29 at 1 39 16 PM](https://user-images.githubusercontent.com/1000778/73399838-cd01cc80-429c-11ea-8185-4e56db6866bd.png) ### Why are the changes needed? It helps users to better monitor Structured Streaming query. ### Does this PR introduce any user-facing change? No ### How was this patch tested? - new added and existing UTs - manual test Closes #26201 from uncleGen/SPARK-29543. Lead-authored-by: uncleGen Co-authored-by: Yuanjian Li Co-authored-by: Genmao Yu Signed-off-by: Shixiong Zhu --- .../org/apache/spark}/ui/static/streaming-page.css | 0 .../org/apache/spark}/ui/static/streaming-page.js | 0 .../spark/ui/static/structured-streaming-page.js | 171 + .../resources/org/apache/spark/ui/static/webui.js | 2 + .../scala/org/apache/spark/ui/GraphUIData.scala| 169 + .../main/scala/org/apache/spark/ui/UIUtils.scala | 91 +++ .../scala/org/apache/spark/ui/jobs/StagePage.scala | 14 +- .../org/apache/spark/ui/jobs/StageTable.scala | 14 +- project/MimaExcludes.scala | 5 +- .../org/apache/spark/sql/internal/SQLConf.scala| 16 ++ .../sql/execution/streaming/ProgressReporter.scala | 5 +- .../sql/execution/streaming/StreamExecution.scala | 3 +- .../apache/spark/sql/internal/SharedState.scala| 19 +- .../sql/streaming/StreamingQueryListener.scala | 4 +- .../sql/streaming/StreamingQueryManager.scala | 6 +- .../org/apache/spark/sql/streaming/progress.scala | 2 + .../sql/streaming/ui/StreamingQueryPage.scala | 147 +++ .../ui/StreamingQueryStatisticsPage.scala | 271 + .../ui/StreamingQueryStatusListener.scala | 122 ++ .../spark/sql/streaming/ui/StreamingQueryTab.scala | 33 +-- .../apache/spark/sql/streaming/ui/UIUtils.scala| 60 + .../streaming/StreamingQueryListenerSuite.scala| 10 +- .../StreamingQueryStatusAndProgressSuite.scala | 2 + .../spark/sql/streaming/StreamingQuerySuite.scala | 14 +- .../sql/streaming/ui/StreamingQueryPageSuite.scala | 125 ++ .../ui/StreamingQueryStatusListenerSuite.scala | 101 .../spark/sql/streaming/ui/UIUtilsSuite.scala | 41 .../hive/thriftserver/ui/ThriftServerPage.scala| 16 +- .../apache/spark/streaming/dstream/DStream.scala | 4 +- .../spark/streaming/scheduler/JobScheduler.scala | 4 +- .../spark/streaming/ui/AllBatchesTable.scala | 2 +- .../org/apache/spark/streaming/ui/BatchPage.scala | 2 +- .../apache/spark/streaming/ui/StreamingPage.scala | 125 +- .../apache/spark/streaming/ui/StreamingTab.scala | 2 +- .../org/apache/spark/streaming/ui/UIUtils.scala| 71 +- .../apache/spark/streaming/DStreamScopeSuite.scala | 6 +- .../apache/spark/streaming/ui/UIUtilsSuite.scala | 12 +- 37 files changed, 1408 insertions(+), 283 deletions(-) diff --git a/streaming/src/main/resources/org/apache/spark/streaming/ui/static/streaming-page.css b/core/src/main/resources/org/apache/spark/ui/static/streaming-page.css similarity index 100% rename from streaming/src/main/resources/org/apache/spark/streaming/ui/static/streaming-page.css rename to core/src/main/resources/org/apache/spark/ui/static/streaming-page.css diff --git a/streaming/src/main/resources/org/apache/spark/streaming/ui/static/streaming-page.js b/core/src/main/resources/org/apache/spark/ui/static/streaming-page.js similarity index 100% rename from streaming/src/main/resources/org/apache/spark/streaming/ui/static/streaming-page.js rename to core/src/main/resources/org/apache/spark/ui/static/streaming-page.js diff --git a/core/src/main/resources/org/apache/spark/ui/static/structured-streaming-page.js
[spark] branch branch-2.4 updated: [SPARK-30512] Added a dedicated boss event loop group
This is an automated email from the ASF dual-hosted git repository. tgraves pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 12f4492 [SPARK-30512] Added a dedicated boss event loop group 12f4492 is described below commit 12f449220dde0b8476f58806f7dee06fcb54da87 Author: Chandni Singh AuthorDate: Wed Jan 29 15:02:48 2020 -0600 [SPARK-30512] Added a dedicated boss event loop group ### What changes were proposed in this pull request? Adding a dedicated boss event loop group to the Netty pipeline in the External Shuffle Service to avoid the delay in channel registration. ``` EventLoopGroup bossGroup = NettyUtils.createEventLoop(ioMode, 1, conf.getModuleName() + "-boss"); EventLoopGroup workerGroup = NettyUtils.createEventLoop(ioMode, conf.serverThreads(), conf.getModuleName() + "-server"); bootstrap = new ServerBootstrap() .group(bossGroup, workerGroup) .channel(NettyUtils.getServerChannelClass(ioMode)) .option(ChannelOption.ALLOCATOR, allocator) ``` ### Why are the changes needed? We have been seeing a large number of SASL authentication (RPC requests) timing out with the external shuffle service. ``` java.lang.RuntimeException: java.util.concurrent.TimeoutException: Timeout waiting for task. at org.spark-project.guava.base.Throwables.propagate(Throwables.java:160) at org.apache.spark.network.client.TransportClient.sendRpcSync(TransportClient.java:278) at org.apache.spark.network.sasl.SaslClientBootstrap.doBootstrap(SaslClientBootstrap.java:80) at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:228) at org.apache.spark.network.client.TransportClientFactory.createUnmanagedClient(TransportClientFactory.java:181) at org.apache.spark.network.shuffle.ExternalShuffleClient.registerWithShuffleServer(ExternalShuffleClient.java:141) at org.apache.spark.storage.BlockManager$$anonfun$registerWithExternalShuffleServer$1.apply$mcVI$sp(BlockManager.scala:218) ``` The investigation that we have done is described here: https://github.com/netty/netty/issues/9890 After adding `LoggingHandler` to the netty pipeline, we saw that the registration of the channel was getting delay which is because the worker threads are busy with the existing channels. ### Does this PR introduce any user-facing change? No ### How was this patch tested? We have tested the patch on our clusters and with a stress testing tool. After this change, we didn't see any SASL requests timing out. Existing unit tests pass. Closes #27240 from otterc/SPARK-30512. Authored-by: Chandni Singh Signed-off-by: Thomas Graves (cherry picked from commit 6b47ace27d04012bcff47951ea1eea2aa6fb7d60) Signed-off-by: Thomas Graves --- .../main/java/org/apache/spark/network/server/TransportServer.java | 7 --- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java b/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java index 9c85ab2..da3fe30 100644 --- a/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java +++ b/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java @@ -91,9 +91,10 @@ public class TransportServer implements Closeable { private void init(String hostToBind, int portToBind) { IOMode ioMode = IOMode.valueOf(conf.ioMode()); -EventLoopGroup bossGroup = - NettyUtils.createEventLoop(ioMode, conf.serverThreads(), conf.getModuleName() + "-server"); -EventLoopGroup workerGroup = bossGroup; +EventLoopGroup bossGroup = NettyUtils.createEventLoop(ioMode, 1, + conf.getModuleName() + "-boss"); +EventLoopGroup workerGroup = NettyUtils.createEventLoop(ioMode, conf.serverThreads(), + conf.getModuleName() + "-server"); PooledByteBufAllocator allocator = NettyUtils.createPooledByteBufAllocator( conf.preferDirectBufs(), true /* allowCache */, conf.serverThreads()); - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated: [SPARK-30512] Added a dedicated boss event loop group
This is an automated email from the ASF dual-hosted git repository. tgraves pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6b47ace [SPARK-30512] Added a dedicated boss event loop group 6b47ace is described below commit 6b47ace27d04012bcff47951ea1eea2aa6fb7d60 Author: Chandni Singh AuthorDate: Wed Jan 29 15:02:48 2020 -0600 [SPARK-30512] Added a dedicated boss event loop group ### What changes were proposed in this pull request? Adding a dedicated boss event loop group to the Netty pipeline in the External Shuffle Service to avoid the delay in channel registration. ``` EventLoopGroup bossGroup = NettyUtils.createEventLoop(ioMode, 1, conf.getModuleName() + "-boss"); EventLoopGroup workerGroup = NettyUtils.createEventLoop(ioMode, conf.serverThreads(), conf.getModuleName() + "-server"); bootstrap = new ServerBootstrap() .group(bossGroup, workerGroup) .channel(NettyUtils.getServerChannelClass(ioMode)) .option(ChannelOption.ALLOCATOR, allocator) ``` ### Why are the changes needed? We have been seeing a large number of SASL authentication (RPC requests) timing out with the external shuffle service. ``` java.lang.RuntimeException: java.util.concurrent.TimeoutException: Timeout waiting for task. at org.spark-project.guava.base.Throwables.propagate(Throwables.java:160) at org.apache.spark.network.client.TransportClient.sendRpcSync(TransportClient.java:278) at org.apache.spark.network.sasl.SaslClientBootstrap.doBootstrap(SaslClientBootstrap.java:80) at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:228) at org.apache.spark.network.client.TransportClientFactory.createUnmanagedClient(TransportClientFactory.java:181) at org.apache.spark.network.shuffle.ExternalShuffleClient.registerWithShuffleServer(ExternalShuffleClient.java:141) at org.apache.spark.storage.BlockManager$$anonfun$registerWithExternalShuffleServer$1.apply$mcVI$sp(BlockManager.scala:218) ``` The investigation that we have done is described here: https://github.com/netty/netty/issues/9890 After adding `LoggingHandler` to the netty pipeline, we saw that the registration of the channel was getting delay which is because the worker threads are busy with the existing channels. ### Does this PR introduce any user-facing change? No ### How was this patch tested? We have tested the patch on our clusters and with a stress testing tool. After this change, we didn't see any SASL requests timing out. Existing unit tests pass. Closes #27240 from otterc/SPARK-30512. Authored-by: Chandni Singh Signed-off-by: Thomas Graves --- .../main/java/org/apache/spark/network/server/TransportServer.java | 7 --- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java b/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java index 8396e69..f0ff9f5 100644 --- a/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java +++ b/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java @@ -100,9 +100,10 @@ public class TransportServer implements Closeable { private void init(String hostToBind, int portToBind) { IOMode ioMode = IOMode.valueOf(conf.ioMode()); -EventLoopGroup bossGroup = - NettyUtils.createEventLoop(ioMode, conf.serverThreads(), conf.getModuleName() + "-server"); -EventLoopGroup workerGroup = bossGroup; +EventLoopGroup bossGroup = NettyUtils.createEventLoop(ioMode, 1, + conf.getModuleName() + "-boss"); +EventLoopGroup workerGroup = NettyUtils.createEventLoop(ioMode, conf.serverThreads(), + conf.getModuleName() + "-server"); bootstrap = new ServerBootstrap() .group(bossGroup, workerGroup) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3e203c9 -> d0f635e)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3e203c9 [SPARK-28801][DOC][FOLLOW-UP] Setup links and address other review comments add d0f635e [SPARK-30582][WEBUI] Spark UI is not showing Aggregated Metrics by Executor in stage page No new revisions were added by this update. Summary of changes: .../org/apache/spark/ui/static/stagepage.js| 42 +++--- 1 file changed, 20 insertions(+), 22 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ec1fb6b -> 3e203c9)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ec1fb6b [SPARK-30234][SQL][FOLLOWUP] Add `.enabled` in the suffix of the ADD FILE legacy option add 3e203c9 [SPARK-28801][DOC][FOLLOW-UP] Setup links and address other review comments No new revisions were added by this update. Summary of changes: docs/_data/menu-sql.yaml| 32 + docs/sql-ref-syntax-qry-select-clusterby.md | 17 ++--- docs/sql-ref-syntax-qry-select-distribute-by.md | 14 +-- docs/sql-ref-syntax-qry-select-groupby.md | 27 ++--- docs/sql-ref-syntax-qry-select-having.md| 27 ++--- docs/sql-ref-syntax-qry-select-limit.md | 29 +++--- docs/sql-ref-syntax-qry-select-orderby.md | 14 +-- docs/sql-ref-syntax-qry-select-sortby.md| 13 +- docs/sql-ref-syntax-qry-select-where.md | 19 +++ docs/sql-ref-syntax-qry-select.md | 10 docs/sql-ref-syntax-qry.md | 25 ++- 11 files changed, 164 insertions(+), 63 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ec1fb6b -> 3e203c9)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ec1fb6b [SPARK-30234][SQL][FOLLOWUP] Add `.enabled` in the suffix of the ADD FILE legacy option add 3e203c9 [SPARK-28801][DOC][FOLLOW-UP] Setup links and address other review comments No new revisions were added by this update. Summary of changes: docs/_data/menu-sql.yaml| 32 + docs/sql-ref-syntax-qry-select-clusterby.md | 17 ++--- docs/sql-ref-syntax-qry-select-distribute-by.md | 14 +-- docs/sql-ref-syntax-qry-select-groupby.md | 27 ++--- docs/sql-ref-syntax-qry-select-having.md| 27 ++--- docs/sql-ref-syntax-qry-select-limit.md | 29 +++--- docs/sql-ref-syntax-qry-select-orderby.md | 14 +-- docs/sql-ref-syntax-qry-select-sortby.md| 13 +- docs/sql-ref-syntax-qry-select-where.md | 19 +++ docs/sql-ref-syntax-qry-select.md | 10 docs/sql-ref-syntax-qry.md | 25 ++- 11 files changed, 164 insertions(+), 63 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org