[spark] branch master updated: [SPARK-38033][SS] The SS processing cannot be started because the com…

2022-02-28 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6aa83e7 [SPARK-38033][SS] The SS processing

[spark] branch master updated (9758d55 -> b8b1fbc)

2022-02-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 9758d55 [SPARK-38303][BUILD] Upgrade `ansi-regex` from 5.0.0 to 5.0.1 in /dev add b8b1fbc [SPARK-38275][SS

[spark] branch master updated: [SPARK-38206][SS] Ignore nullability on comparing the data type of join keys on stream-stream join

2022-02-21 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5ebf793 [SPARK-38206][SS] Ignore nullability

[spark] branch master updated (f82cf9e -> e86c8e2)

2022-02-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from f82cf9e [SPARK-34378][SQL][AVRO] Loosen AvroSerializer validation to allow extra nullable user-provided fields

[spark] branch SPARK-38237 created (now ae1ebe0)

2022-02-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch SPARK-38237 in repository https://gitbox.apache.org/repos/asf/spark.git. at ae1ebe0 [SPARK-38237][SQL] Rename back StatefulOpClusteredDistribution to HashClusteredDistribution No new

[spark] branch master updated (ece34f0 -> 39166ed)

2022-02-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ece34f0 [SPARK-38130][SQL] Remove array_sort orderable entries check add 39166ed [SPARK-38124][SS][FOLLOWUP

[spark] branch master updated: [SPARK-38124][SS][FOLLOWUP] Document the current challenge on fixing distribution of stateful operator

2022-02-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0be132c [SPARK-38124][SS][FOLLOWUP] Document

[spark] branch master updated: [SPARK-38056][WEB UI] Fix issue of Structured streaming not working in history server when using LevelDB

2022-02-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dee294b [SPARK-38056][WEB UI] Fix issue

[spark] branch master updated (5b02a34 -> 43cce92)

2022-02-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 5b02a34 [SPARK-38142][SQL][TESTS] Move `ArrowColumnVectorSuite` to `org.apache.spark.sql.vectorized` add

[spark] branch master updated (c69f08f8 -> 899d3bb)

2022-02-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c69f08f8 [SPARK-34826][SHUFFLE] Adaptively fetch shuffle mergers for push based shuffle add 899d3bb [SPARK

[spark] branch branch-3.2 updated: [SPARK-38046][SS][TEST] Fix KafkaSource/KafkaMicroBatch flaky test due to non-deterministic timing

2022-02-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 34c474a [SPARK-38046][SS][TEST] Fix

[spark] branch master updated: [SPARK-38046][SS][TEST] Fix KafkaSource/KafkaMicroBatch flaky test due to non-deterministic timing

2022-02-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e98f13e [SPARK-38046][SS][TEST] Fix

[spark] branch branch-3.2 updated: [SPARK-38045][SS][TEST][3.2] More strict validation on plan check for stream-stream join unit test

2022-01-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 89a988c [SPARK-38045][SS][TEST][3.2

[spark] branch branch-3.2 updated: [SPARK-37987][SS] Fix flaky test StreamingAggregationSuite.changing schema of state when restarting query

2022-01-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 988439d [SPARK-37987][SS] Fix flaky

[spark] branch master updated (47276ab -> 3b540ad)

2022-01-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 47276ab [SPARK-37990][SQL] Support TimestampNTZ in RowToColumnConverter add 3b540ad [SPARK-37987][SS] Fix

[spark] branch master updated: [SPARK-37224][SS][FOLLOWUP] Clarify the guide doc and fix the method doc

2021-11-18 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b14fc2d [SPARK-37224][SS][FOLLOWUP] Clarify

[spark] branch master updated (99d2d57 -> 1c26113)

2021-11-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 99d2d57 [SPARK-37368][SQL][TESTS] Explicit GC for TPC-DS query runs add 1c26113 [SPARK-37224][SS] Optimize

[spark] branch master updated (bb9e1d9 -> f43d8b5)

2021-11-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from bb9e1d9 [SPARK-37319][K8S] Support K8s image building with Java 17 add f43d8b5 [SPARK-36533][SS][FOLLOWUP

[spark] branch master updated: [SPARK-36533][SS][FOLLOWUP] Support Trigger.AvailableNow in PySpark

2021-11-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new edbc7cf [SPARK-36533][SS][FOLLOWUP] Support

[spark] branch WIP-optimize-eviction-in-rocksdb-state-store updated: WIP still adding tests and addressing TODOs

2021-11-06 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch WIP-optimize-eviction-in-rocksdb-state-store in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/WIP-optimize-eviction-in-rocksdb-state

[spark] branch WIP-optimize-eviction-in-rocksdb-state-store created (now 88187c6)

2021-11-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch WIP-optimize-eviction-in-rocksdb-state-store in repository https://gitbox.apache.org/repos/asf/spark.git. at 88187c6 WIP still need to add e2e test and address FIXME/TODOs This branch

[spark] 02/02: WIP still need to add e2e test and address FIXME/TODOs

2021-11-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch WIP-optimize-eviction-in-rocksdb-state-store in repository https://gitbox.apache.org/repos/asf/spark.git commit 88187c64d70a5566bb8f07ce4b133a33e63ce5fc Author: Jungtaek Lim AuthorDate: Fri Nov

[spark] 01/02: WIP: benchmark test code done

2021-11-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch WIP-optimize-eviction-in-rocksdb-state-store in repository https://gitbox.apache.org/repos/asf/spark.git commit 21d4f96c6c7a56acce30d485a0747e1d62d7ad27 Author: Jungtaek Lim AuthorDate: Thu Sep

[spark] branch master updated: [SPARK-37062][SS] Introduce a new data source for providing consistent set of rows per microbatch

2021-11-01 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 70fde44 [SPARK-37062][SS] Introduce a new data

[spark] branch branch-3.2 updated: [MINOR][SS] Remove unused config "pauseBackgroundWorkForCommit" from RocksDB

2021-10-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 67abd7a [MINOR][SS] Remove unused

[spark] branch master updated: [MINOR][SS] Remove unused config "pauseBackgroundWorkForCommit" from RocksDB

2021-10-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 00d9ed5 [MINOR][SS] Remove unused config

[spark] branch branch-3.2 updated: [SPARK-37147][SS] MetricsReporter producing NullPointerException when element 'triggerExecution' not present in Map[]

2021-10-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 574a43b [SPARK-37147][SS

[spark] branch master updated: [SPARK-37147][SS] MetricsReporter producing NullPointerException when element 'triggerExecution' not present in Map[]

2021-10-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 547996e [SPARK-37147][SS] MetricsReporter

[spark] branch branch-3.2 updated: [SPARK-36865][PYTHON][DOCS] Add PySpark API document of session_window

2021-09-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 8b2b6bb [SPARK-36865][PYTHON][DOCS

[spark] branch master updated (17e3ca6 -> 5a32e41)

2021-09-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 17e3ca6 [SPARK-36899][R] Support ILIKE API on R add 5a32e41 [SPARK-36865][PYTHON][DOCS] Add PySpark API

[spark] branch master updated: [SPARK-36737][BUILD][CORE][SQL][SS] Upgrade Apache commons-io to 2.11.0 and revert change of SPARK-36456

2021-09-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 119ddd7 [SPARK-36737][BUILD][CORE][SQL][SS

[spark] branch master updated (23794fb -> 375ca94)

2021-09-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 23794fb [SPARK-34952][SQL][FOLLOWUP] Change column type to be NamedReference add 375ca94 [SPARK-36690][SS

[spark] branch master updated: [SPARK-36533][SS] Trigger.AvailableNow for running streaming queries like Trigger.Once in multiple batches

2021-09-01 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e33cdfb [SPARK-36533][SS] Trigger.AvailableNow

[spark] branch master updated: [SPARK-36576][SS] Improve range split calculation for Kafka Source minPartitions option

2021-08-29 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7d1be37 [SPARK-36576][SS] Improve range split

[spark] branch branch-3.2 updated: [SPARK-36595][SQL][SS][DOCS] Document window & session_window function in SQL API doc

2021-08-26 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 118a53d [SPARK-36595][SQL][SS][DOCS

[spark] branch master updated (dd3f0fa -> bc32144)

2021-08-26 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from dd3f0fa [SPARK-35611][SS][FOLLOW-UP] Improve the user guide document add bc32144 [SPARK-36595][SQL][SS][DOCS

[spark] branch branch-3.2 updated: [SPARK-35312][SS][FOLLOW-UP] More documents and checking logic for the new options

2021-08-19 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 36c24a0 [SPARK-35312][SS][FOLLOW-UP

[spark] branch master updated: [SPARK-35312][SS][FOLLOW-UP] More documents and checking logic for the new options

2021-08-19 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a0b2401 [SPARK-35312][SS][FOLLOW-UP] More

[spark] branch branch-3.2 updated: [SPARK-36465][SS] Dynamic gap duration in session window

2021-08-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 3aa933b [SPARK-36465][SS] Dynamic gap

[spark] branch master updated: [SPARK-36465][SS] Dynamic gap duration in session window

2021-08-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8b8d91c [SPARK-36465][SS] Dynamic gap duration

[spark] branch branch-3.2 updated: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

2021-08-10 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 161908c [SPARK-36463][SS] Prohibit

[spark] branch master updated: [SPARK-36463][SS] Prohibit update mode in streaming aggregation with session window

2021-08-10 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ed60aaa [SPARK-36463][SS] Prohibit update mode

[spark] branch branch-3.2 updated: [SPARK-36455][SS] Provide an example of complex session window via flatMapGroupsWithState

2021-08-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 9dc8d0c [SPARK-36455][SS] Provide

[spark] branch master updated (900908b -> 004b87d)

2021-08-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 900908b [SPARK-36410][CORE][SQL][STRUCTURED STREAMING][EXAMPLES] Replace anonymous classes with lambda expressions

[spark] branch branch-3.1 updated: [SPARK-36354][CORE] EventLogFileReader should skip rolling event log directories with no logs

2021-08-04 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 6924e70 [SPARK-36354][CORE

[spark] branch branch-3.2 updated: [SPARK-36354][CORE] EventLogFileReader should skip rolling event log directories with no logs

2021-08-04 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 7d685df [SPARK-36354][CORE

[spark] branch master updated (d816949 -> 28a2a22)

2021-08-04 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from d816949 [SPARK-32923][FOLLOW-UP] Clean up older shuffleMergeId shuffle files when finalize request for higher

[spark] branch branch-3.2 updated: [SPARK-36172][SS] Document session window into Structured Streaming guide doc

2021-07-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new e264c21 [SPARK-36172][SS] Document

[spark] branch master updated (376fadc -> 0eb31a0)

2021-07-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 376fadc [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex add

[spark] branch branch-3.2 updated: [SPARK-34893][SS] Support session window natively

2021-07-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 4bfcdf3 [SPARK-34893][SS] Support

[spark] branch master updated (c1b3f86 -> f2bf8b0)

2021-07-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c1b3f86 [SPARK-35710][SQL] Support DPP + AQE when there is no reused broadcast exchange add f2bf8b0 [SPARK

[spark] branch branch-3.2 updated: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new dcee7a6 [SPARK-34892][SS] Introduce

[spark] branch master updated: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 12a576f [SPARK-34892][SS] Introduce

[spark] branch branch-3.2 updated: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

2021-07-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 097b667 [SPARK-35988][SS

[spark] branch master updated: [SPARK-35988][SS] The implementation for RocksDBStateStoreProvider

2021-07-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0621e78 [SPARK-35988][SS] The implementation

[spark] branch branch-3.2 updated: [SPARK-35788][SS] Metrics support for RocksDB instance

2021-07-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 22b303a [SPARK-35788][SS] Metrics

[spark] branch master updated (8b46e26 -> 9544277)

2021-07-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 8b46e26 [SPARK-34302][SQL][FOLLOWUP] More code cleanup add 9544277 [SPARK-35788][SS] Metrics support

[spark] branch branch-3.2 updated (c1d8178 -> ae8f917)

2021-07-02 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git. from c1d8178 [SPARK-35968][SQL] Make sure partitions are not too small in AQE partition coalescing add ae8f917

[spark] branch master updated: [SPARK-35896][SS] Include more granular metrics for stateful operators in StreamingQueryProgress

2021-06-29 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 24b67ca [SPARK-35896][SS] Include more

[spark] branch master updated: [SPARK-35880][SS] Track the duplicates dropped count in dedupe operator

2021-06-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0da463e [SPARK-35880][SS] Track the duplicates

[spark] branch master updated (939ea3d -> 67eddf2)

2021-06-25 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 939ea3d [SPARK-35863][BUILD] Update Ivy to 2.5.0 add 67eddf2 [SPARK-35894][BUILD] Introduce new style enforce

[spark] branch master updated (c0cfbb1 -> f2029e7)

2021-06-25 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c0cfbb1 [SPARK-35884][SQL] EXPLAIN FORMATTED for AQE add f2029e7 [SPARK-35628][SS] RocksDBFileManager - load

[spark] branch branch-3.1 updated (cd68b92 -> 2c20b49)

2021-06-22 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git. from cd68b92 [SPARK-35700][SQL] Read char/varchar orc table with created and written by external systems add

[spark] branch master updated (89dbf51 -> d4d11cf)

2021-06-21 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 89dbf51 [SPARK-35850][BUILD] Upgrade scala-maven-plugin to 4.5.3 add d4d11cf [SPARK-35799][SS] Fix

[spark] branch master updated (c879510 -> 882122d)

2021-06-18 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c879510 [SPARK-35478][PYTHON][FOLLOWUP] Fix Jenkins' linter add 882122d [SPARK-35565][SS] Add config

[spark] branch master updated: [SPARK-35763][SS] Remove the StateStoreCustomMetric subclass enumeration dependency

2021-06-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8e594f0 [SPARK-35763][SS] Remove

[spark] branch branch-3.1 updated: [SPARK-35689][SS] Add log warn when keyWithIndexToValue returns null value

2021-06-11 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 8cf6041 [SPARK-35689][SS] Add log warn

[spark] branch master updated (4d21b94 -> 703376e)

2021-06-11 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4d21b94 [SPARK-35475][PYTHON] Fix disallow_untyped_defs mypy checks add 703376e [SPARK-35689][SS] Add log

[spark] branch master updated (8013f98 -> 9f010a8)

2021-06-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 8013f98 [SPARK-35378][SQL] Eagerly execute commands in QueryExecution instead of caller sides add 9f010a8

[spark] branch branch-3.1 updated: [SPARK-35602][SS] Update state schema to be able to accept long length JSON

2021-06-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new e7c1700 [SPARK-35602][SS] Update state

[spark] branch master updated (66e38f4 -> 93a9dc4)

2021-06-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 66e38f4 [SPARK-35384][SQL][FOLLOWUP] Fix Scala doc for removed method parameters add 93a9dc4 [SPARK-35602

[spark] branch master updated (921abc5 -> 2a33117)

2021-06-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 921abc5 [SPARK-35636][PYTHON][DOCS][FOLLOW-UP] Restructure reference API files according to the layout add

[spark] branch master updated (52a1f8c -> f98a063)

2021-05-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 52a1f8c [SPARK-33428][SQL] Match the behavior of conv function to MySQL's add f98a063 [SPARK-35172][SS

[spark] branch master updated (58d4da1 -> a57afd4)

2021-05-25 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 58d4da1 [SPARK-35486][CORE] TaskMemoryManager: retry if other task takes memory freed by partial self-spill

[spark] branch master updated (9eb45ec -> 7c13636)

2021-05-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 9eb45ec [SPARK-35408][PYTHON] Improve parameter validation in DataFrame.show add 7c13636 [SPARK-34888][SS

[spark] branch master updated (8fa739f -> b6a0a7e)

2021-05-13 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 8fa739f [SPARK-35329][SQL] Split generated switch code into pieces in ExpandExec add b6a0a7e [SPARK-35311

[spark] branch master updated (6cd5cf5 -> dfb3343)

2021-05-06 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6cd5cf5 [SPARK-35215][SQL] Update custom metric per certain rows and at the end of the task add dfb3343

[spark] branch master updated: [SPARK-34854][SQL][SS] Expose source metrics via progress report and add Kafka use-case to report delay

2021-05-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bbdbe0f [SPARK-34854][SQL][SS] Expose source

[spark-website] branch asf-site updated: change organization

2021-05-04 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new bc33167 change organization

[spark] branch branch-3.0 updated: [SPARK-28247][SS][TEST] Fix flaky test "query without test harness" on ContinuousSuite

2021-04-26 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new ae57b2a [SPARK-28247][SS][TEST] Fix

[spark] branch branch-3.1 updated: [SPARK-28247][SS][TEST] Fix flaky test "query without test harness" on ContinuousSuite

2021-04-26 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 526490f [SPARK-28247][SS][TEST] Fix

[spark] branch master updated (1b609c7 -> 0df3b50)

2021-04-26 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1b609c7 [SPARK-35060][SQL] Group exception messages in sql/types add 0df3b50 [SPARK-28247][SS][TEST] Fix

[spark] branch branch-3.1 updated: [SPARK-34471][SS][DOCS] Document Streaming Table APIs in Structured Streaming Programming Guide

2021-02-19 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 62d2810 [SPARK-34471][SS][DOCS

[spark] branch master updated (4dc16f2 -> 489d32a)

2021-02-19 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4dc16f2 [SPARK-24818][CORE] Support delay scheduling for barrier execution add 489d32a [SPARK-34471][SS

[spark] branch branch-3.1 updated: [SPARK-34446][SS][DOCS] Update doc for stream-stream join (full outer + left semi)

2021-02-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new dd6b286 [SPARK-34446][SS][DOCS] Update

[spark] branch master updated: [SPARK-34446][SS][DOCS] Update doc for stream-stream join (full outer + left semi)

2021-02-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a575e80 [SPARK-34446][SS][DOCS] Update doc

[spark] branch master updated (1a11fe5 -> 5f91245)

2021-02-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1a11fe5 [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

[spark] branch master updated: [SPARK-34355][CORE][SQL][FOLLOWUP] Log commit time in all File Writer

2021-02-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7ea3a33 [SPARK-34355][CORE][SQL][FOLLOWUP] Log

[spark] branch master updated (b344e91 -> 9270238)

2021-02-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from b344e91 [SPARK-34375][CORE][K8S][TEST] Replaces 'Mockito.initMocks' with 'Mockito.openMocks' add 9270238

[spark] branch branch-3.1 updated: [SPARK-34326][CORE][SQL] Fix UTs added in SPARK-31793 depending on the length of temp path

2021-02-03 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new a3e2197 [SPARK-34326][CORE][SQL] Fix

[spark] branch master updated: [SPARK-34326][CORE][SQL] Fix UTs added in SPARK-31793 depending on the length of temp path

2021-02-03 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 44dcf00 [SPARK-34326][CORE][SQL] Fix UTs added

[spark] branch branch-3.1 updated: [SPARK-34326][CORE][SQL] Fix UTs added in SPARK-31793 depending on the length of temp path

2021-02-02 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new d9e5438 [SPARK-34326][CORE][SQL] Fix

[spark] branch master updated (cadca8d -> 63866025)

2021-02-02 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cadca8d [SPARK-34324][SQL] FileTable should not list TRUNCATE in capabilities by default add 63866025 [SPARK

[spark] branch branch-2.4 updated (7ae6c8d -> e0e1e21)

2021-01-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 7ae6c8d [SPARK-34118][CORE][SQL][2.4] Replaces filter and check for emptiness with exists or forall add

[spark] branch branch-3.0 updated (dc1816d -> d81f482)

2021-01-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git. from dc1816d [SPARK-34118][CORE][SQL][3.0] Replaces filter and check for emptiness with exists or forall add

[spark] branch master updated (0f8e5dd -> 71d261a)

2021-01-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0f8e5dd [SPARK-34003][SQL] Fix Rule conflicts between PaddingAndLengthCheckForCharVarchar

[spark] branch branch-3.1 updated: [SPARK-33836][SS][PYTHON][FOLLOW-UP] Use test utils and clean up doctests in table and toTable

2020-12-21 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new d5231f5 [SPARK-33836][SS][PYTHON

[spark] branch master updated (38bbcca -> 4106731)

2020-12-21 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 38bbcca [SPARK-33869][PYTHON][SQL][TESTS] Have a separate metastore directory for each PySpark test job add

[spark] branch master updated (6315118 -> 42e1831)

2020-12-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6315118 [SPARK-33824][PYTHON][DOCS] Restructure and improve Python package management page add 42e1831

[spark] branch master updated (477046c -> 0c12900)

2020-12-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 477046c [SPARK-33775][BUILD] Suppress sbt compilation warnings in Scala 2.13 add 0c12900 [SPARK-33790][CORE

<    1   2   3   4   5   6   >