[spark] branch branch-3.2 updated: [SPARK-34399][SQL][3.2] Add commit duration to SQL tab's graph node

2021-07-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new a96e9e1 [SPARK-34399][SQL][3.2] Add

[spark] branch branch-3.2 updated: [SPARK-35806][PYTHON][FOLLOW-UP] Mapping the mode argument to pandas in DataFrame.to_csv

2021-07-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 26b8297

[spark] branch master updated (0ece865 -> 94cb2bb)

2021-07-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0ece865 [SPARK-36136][SQL][TESTS] Refactor PruneFileSourcePartitionsSuite etc to a different package add

[GitHub] [spark-website] yutoacts edited a comment on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
yutoacts edited a comment on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889578852 Thanks for the suggestions. If it goes in main docs, should it be documented in `docs/spark-standalone.md` or `docs/submitting-applications.md` (as my initial PR:

[GitHub] [spark-website] yutoacts edited a comment on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
yutoacts edited a comment on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889578852 Thanks for the suggestions. If it goes in main docs, should it be documented in `docs/spark-standalone.md` or `docs/submitting-applications.md` (as my initial PR:

[GitHub] [spark-website] yutoacts commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
yutoacts commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889578852 Thanks for the suggestions. If it goes in main docs, should it be documented in `docs/spark-standalone.md` or `docs/submitting-applications.md` (as my initial PR:

[GitHub] [spark-website] HyukjinKwon commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
HyukjinKwon commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889574165 I am fine either way, no big deal. I will defer to @srowen and @tgravescs. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark-website] yutoacts commented on a change in pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
yutoacts commented on a change in pull request #350: URL: https://github.com/apache/spark-website/pull/350#discussion_r679593398 ## File path: site/sitemap.xml ## @@ -907,10 +907,6 @@ https://spark.apache.org/mllib/ weekly - Review comment: Reverted. Thank you.

[spark] branch branch-3.2 updated: [SPARK-36136][SQL][TESTS] Refactor PruneFileSourcePartitionsSuite etc to a different package

2021-07-29 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 8c20327 [SPARK-36136][SQL][TESTS]

[spark] branch master updated (900b38d -> 0ece865)

2021-07-29 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 900b38d [SPARK-36344][CORE][SHUFFLE] Fix some typos in ShuffleBlockPusher class add 0ece865

[spark] branch branch-3.2 updated: [SPARK-36344][CORE][SHUFFLE] Fix some typos in ShuffleBlockPusher class

2021-07-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new d37f732 [SPARK-36344][CORE][SHUFFLE]

[spark] branch master updated (4d11b0d -> 900b38d)

2021-07-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4d11b0d [SPARK-36341][SQL] Aggregated Metrics by Executor link should wrap with add 900b38d

[spark] branch master updated (07ed82b -> 4d11b0d)

2021-07-29 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 07ed82b [SPARK-36333][PYTHON] Reuse isnull where the null check is needed add 4d11b0d [SPARK-36341][SQL]

[spark] branch branch-3.2 updated: [SPARK-36333][PYTHON] Reuse isnull where the null check is needed

2021-07-29 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 359dfd7 [SPARK-36333][PYTHON] Reuse

[spark] branch master updated: [SPARK-36333][PYTHON] Reuse isnull where the null check is needed

2021-07-29 Thread ueshin
This is an automated email from the ASF dual-hosted git repository. ueshin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 07ed82b [SPARK-36333][PYTHON] Reuse isnull

[spark] branch branch-3.2 updated: [SPARK-36347][SS] Upgrade the RocksDB version to 6.20.3

2021-07-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new e8462a5 [SPARK-36347][SS] Upgrade the

[spark] branch master updated (f8535a6 -> 4cd5fa9)

2021-07-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from f8535a6 [SPARK-36326][SQL] Use computeIfAbsent to simplify the process of put a absent value into Map add

[spark] branch master updated (69c4543 -> f8535a6)

2021-07-29 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 69c4543 [SPARK-36175][SQL] Support TimestampNTZ in Avro data source add f8535a6 [SPARK-36326][SQL] Use

[GitHub] [spark-website] HyukjinKwon commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
HyukjinKwon commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889188101 My only concern about documenting in the main docs is that it happens to force us to investigate/document it together whenever a cluster related feature (like archive,

[GitHub] [spark-website] tgravescs commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
tgravescs commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889173380 Note if others disagree, I'm fine with leaving here in developer docs. I would rather see it go in common docs where we describe all run modes or in developer docs to

[GitHub] [spark-website] tgravescs commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
tgravescs commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889172500 so I guess it isn't that big of deal because we don't do document it now and doesn't seem to have been a big problem, but I assume this issue was filed for a reason and

[GitHub] [spark-website] srowen commented on a change in pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
srowen commented on a change in pull request #350: URL: https://github.com/apache/spark-website/pull/350#discussion_r679162872 ## File path: site/sitemap.xml ## @@ -907,10 +907,6 @@ https://spark.apache.org/mllib/ weekly - Review comment: (Revert this change)

[GitHub] [spark-website] srowen commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
srowen commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889154172 I see, if this is really intended as a developer tool, this would be the right place. The very old SPARK-595 thread suggests it isn't totally for testing. -- This is an

[GitHub] [spark-website] HyukjinKwon commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
HyukjinKwon commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889145171 I actually suggested to avoid documenting it in the main docs because local-cluster is test-only mode. But I am fine with doing it in `docs/spark-standalone.md` too.

[GitHub] [spark-website] srowen commented on pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
srowen commented on pull request #350: URL: https://github.com/apache/spark-website/pull/350#issuecomment-889139082 This doesn't quite feel like the right place to document this. How about docs/spark-standalone.md in the main Spark project docs? -- This is an automated message from the

[spark] branch master updated (a07df1a -> 69c4543)

2021-07-29 Thread gengliang
This is an automated email from the ASF dual-hosted git repository. gengliang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a07df1a [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function add 69c4543

[spark] branch branch-3.2 updated: [SPARK-36161][PYTHON] Add type check on dropDuplicates pyspark function

2021-07-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new e423249 [SPARK-36161][PYTHON] Add

[spark] branch master updated (86c4227 -> a07df1a)

2021-07-29 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 86c4227 [SPARK-36334][K8S] Add a new conf to allow K8s API server-side caching for pod listing add a07df1a

[spark] branch master updated (db18866 -> 86c4227)

2021-07-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from db18866 [SPARK-36323][SQL] Support ANSI interval literals for TimeWindow add 86c4227 [SPARK-36334][K8S] Add

[GitHub] [spark-website] yutoacts opened a new pull request #350: [SPARK-36335] Add local-cluster docs to developer-tools.md

2021-07-29 Thread GitBox
yutoacts opened a new pull request #350: URL: https://github.com/apache/spark-website/pull/350 Document "local-cluster" mode on developer-tools.md. Related links: https://github.com/apache/spark/pull/33568 https://github.com/apache/spark/pull/33537