(spark) branch master updated: [SPARK-45833][SS][DOCS] Document the new introduction of state data source

2023-11-28 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 04c9583cecdf [SPARK-45833][SS][DOCS] Document

(spark) branch branch-3.4 updated: [SPARK-46062][SQL] Sync the isStreaming flag between CTE definition and reference

2023-11-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new e87d166a81c [SPARK-46062][SQL] Sync

(spark) branch branch-3.5 updated: [SPARK-46062][SQL] Sync the isStreaming flag between CTE definition and reference

2023-11-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new a8552627cdc [SPARK-46062][SQL] Sync

(spark) branch master updated: [SPARK-46062][SQL] Sync the isStreaming flag between CTE definition and reference

2023-11-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 43046631a5d [SPARK-46062][SQL] Sync

(spark) branch branch-3.4 updated: [SPARK-46064][SQL][SS] Move out EliminateEventTimeWatermark to the analyzer and change to only take effect on resolved child

2023-11-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new cfe072a904b [SPARK-46064][SQL][SS] Move

(spark) branch branch-3.5 updated: [SPARK-46064][SQL][SS] Move out EliminateEventTimeWatermark to the analyzer and change to only take effect on resolved child

2023-11-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new c3671942abb [SPARK-46064][SQL][SS] Move

(spark) branch master updated: [SPARK-46064][SQL][SS] Move out EliminateEventTimeWatermark to the analyzer and change to only take effect on resolved child

2023-11-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a703dace0aa [SPARK-46064][SQL][SS] Move out

(spark) branch master updated: [SPARK-45511][SS] Fix state reader suite flakiness by clean up resources after each test run

2023-11-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aff9eab9039 [SPARK-45511][SS] Fix state reader

(spark) branch master updated: [SPARK-45946][SS] Fix use of deprecated FileUtils write to pass default charset in RocksDBSuite

2023-11-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bbe95cfcd05 [SPARK-45946][SS] Fix use

(spark) branch master updated: [SPARK-45747][SS] Use prefix key information in state metadata to handle reading state for session window aggregation

2023-11-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bd14136b397 [SPARK-45747][SS] Use prefix key

(spark) branch master updated: [SPARK-45511][SS] State Data Source - Reader

2023-11-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 74a9c6cfc6ea [SPARK-45511][SS] State Data

(spark) branch master updated (961dcdfb9845 -> ac293423543f)

2023-11-13 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 961dcdfb9845 [SPARK-45882][SQL] BroadcastHashJoinExec propagate partitioning should respect

(spark) branch master updated: [SPARK-45655][SQL][SS] Allow non-deterministic expressions inside AggregateFunctions in CollectMetrics

2023-11-11 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2605b87990c [SPARK-45655][SQL][SS] Allow non

(spark) branch master updated: [SPARK-45794][SS] Introduce state metadata source to query the streaming state metadata information

2023-11-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 44522756382d [SPARK-45794][SS] Introduce state

(spark) branch master updated: [SPARK-45727][SS] Remove unused map in watermark propagation simulation

2023-10-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fc6a5cca06c [SPARK-45727][SS] Remove unused map

[spark] branch master updated: [SPARK-45677] Better error logging for Observation API

2023-10-26 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d948be6c963 [SPARK-45677] Better error logging

[spark] branch master updated: [SPARK-38723][SS][TESTS] Add test for streaming query resume race condition

2023-10-25 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7d7afb06f68 [SPARK-38723][SS][TESTS] Add test

[spark] branch branch-3.4 updated: [SPARK-45588][SPARK-45640][SQL][TESTS][3.4] Fix flaky ProtobufCatalystDataConversionSuite

2023-10-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new c730365827dc [SPARK-45588][SPARK-45640

[spark] branch master updated: [SPARK-45503][SS] Add Conf to Set RocksDB Compression

2023-10-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4eac0244c765 [SPARK-45503][SS] Add Conf to Set

[spark] branch branch-3.5 updated: [SPARK-45631][SS][PYSPARK] Remove @abstractmethod from onQueryIdle in PySpark StreamingQueryListener

2023-10-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 06f48855d7b9 [SPARK-45631][SS][PYSPARK

[spark] branch master updated: [SPARK-45631][SS][PYSPARK] Remove @abstractmethod from onQueryIdle in PySpark StreamingQueryListener

2023-10-23 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 75bc5ac9f2b0 [SPARK-45631][SS][PYSPARK] Remove

[spark] branch master updated: [SPARK-45588][PROTOBUF][CONNECT][MINOR] Scaladoc improvement for StreamingForeachBatchHelper

2023-10-18 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e359f210c45 [SPARK-45588][PROTOBUF][CONNECT

[spark] branch master updated: [SPARK-45582][SS] Ensure that store instance is not used after calling commit within output mode streaming aggregation

2023-10-18 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b42ac52e787 [SPARK-45582][SS] Ensure that store

[spark] branch master updated: [SPARK-45558][SS] Introduce a metadata file for streaming stateful operator

2023-10-18 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3005dc89084 [SPARK-45558][SS] Introduce

[spark] branch master updated: [SPARK-45539][SS] Add assert and log to indicate watermark definition is required for streaming aggregation queries in append mode

2023-10-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c35ca7cab62 [SPARK-45539][SS] Add assert

[spark] branch master updated: [SPARK-45415] Allow selective disabling of "fallocate" in RocksDB statestore

2023-10-11 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a5f019554991 [SPARK-45415] Allow selective

[spark] branch master updated: [SPARK-45472][SS] RocksDB State Store Doesn't Need to Recheck checkpoint path existence

2023-10-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 08640961e3b [SPARK-45472][SS] RocksDB State

[spark] branch branch-3.5 updated: [SPARK-45419][SS] Avoid reusing rocksdb sst files in a dfferent rocksdb instance

2023-10-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new ac4b9154b58 [SPARK-45419][SS] Avoid

[spark] branch master updated: [SPARK-45419][SS] Avoid reusing rocksdb sst files in a dfferent rocksdb instance

2023-10-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff87c0958f7 [SPARK-45419][SS] Avoid reusing

[spark] branch master updated: [SPARK-45138][SS] Define a new error class and apply it when checkpointing state to DFS fails

2023-09-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4531d710ba79 [SPARK-45138][SS] Define a new

[spark] branch master updated: [SPARK-45178][SS] Fallback to execute a single batch for Trigger.AvailableNow with unsupported sources rather than using wrapper

2023-09-19 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 227e26202522 [SPARK-45178][SS] Fallback

[spark] branch master updated: [SPARK-45084][SS] StateOperatorProgress to use accurate effective shuffle partition number

2023-09-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 25c624f269b [SPARK-45084][SS

[spark] branch master updated: [SPARK-45080][SS] Explicitly call out support for columnar in DSv2 streaming data sources

2023-09-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0e6e15ca633 [SPARK-45080][SS] Explicitly call

[spark] branch master updated (e82805da876 -> a0a78b6081f)

2023-09-06 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e82805da876 [SPARK-45050][SQL][CONNECT] Improve error message for UNKNOWN io.grpc.StatusRuntimeException add

[spark] branch branch-3.5 updated: [SPARK-45045][SS] Revert back the behavior of idle progress for StreamingQuery API from SPARK-43183

2023-09-03 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 44ab0fc0068 [SPARK-45045][SS] Revert

[spark] branch master updated (5b609598503 -> cf0a5cb472e)

2023-09-03 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5b609598503 [SPARK-45052][SQL][PYTHON][CONNECT] Make function aliases output column name consistent with SQL

[spark] branch master updated: [SPARK-45002][SS] Avoid uncaught exception from state store maintenance task thread on error to prevent executor being killed

2023-08-29 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b939acd9072 [SPARK-45002][SS] Avoid uncaught

[spark] branch master updated: [SPARK-44878][SS] Disable strict limit for RocksDB write manager to avoid insertion exception on cache full

2023-08-22 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a0c029c18b0 [SPARK-44878][SS] Disable strict

[spark] branch master updated: [SPARK-44809][SS] Remove unused RocksDB custom metrics for pause/writeBatch

2023-08-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2be20e54a22 [SPARK-44809][SS] Remove unused

[spark] branch master updated (590b77f7628 -> b4b91212b1d)

2023-08-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 590b77f7628 [SPARK-44005][PYTHON] Improve error messages for regular Python UDTFs that return non-tuple values

[spark] branch branch-3.5 updated: [SPARK-44683][SS] Logging level isn't passed to RocksDB state store provider correctly

2023-08-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 19c8001dacb [SPARK-44683][SS] Logging

[spark] branch master updated: [SPARK-44683][SS] Logging level isn't passed to RocksDB state store provider correctly

2023-08-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 630b1777904 [SPARK-44683][SS] Logging level

[spark] branch master updated: [SPARK-44480][SS] Use thread pool to perform maintenance activity for hdfs/rocksdb state store providers

2023-08-01 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9e42805f77c [SPARK-44480][SS] Use thread pool

[spark] branch branch-3.5 updated: [SPARK-42944][SS][PYTHON][CONNECT][FOLLOWUP] Streaming ForeachBatch in Python followups

2023-07-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new a93b4a1f9d7 [SPARK-42944][SS][PYTHON

[spark] branch master updated: [SPARK-42944][SS][PYTHON][CONNECT][FOLLOWUP] Streaming ForeachBatch in Python followups

2023-07-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cfc279c6c0f [SPARK-42944][SS][PYTHON][CONNECT

[spark] branch master updated: [SPARK-44484][SS] Add batchDuration to StreamingQueryProgress json method

2023-07-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7606ad32d61 [SPARK-44484][SS] Add batchDuration

[spark] branch branch-3.5 updated: [SPARK-44504][SS] Unload provider thereby forcing DB instance close and releasing resources on maintenance task error

2023-07-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 86237bba262 [SPARK-44504][SS] Unload

[spark] branch master updated: [SPARK-44504][SS] Unload provider thereby forcing DB instance close and releasing resources on maintenance task error

2023-07-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8c26c014f11 [SPARK-44504][SS] Unload provider

[spark] branch master updated: [SPARK-44252][SS] Define a new error class and apply for the case where loading state from DFS fails

2023-07-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bde87d66d0d [SPARK-44252][SS] Define a new

[spark] branch branch-3.5 updated: [SPARK-44464][SS] Implement applyInPandasWithState in PySpark

2023-07-18 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e718d0d4dc5 [SPARK-44464][SS] Implement

[spark] branch master updated: [SPARK-44464][SS] Implement applyInPandasWithState in PySpark

2023-07-18 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6cebd97f467 [SPARK-44464][SS] Implement

[spark] branch master updated: [SPARK-44438][SS] Shutdown scheduled executor used for maintenance task if an error is reported

2023-07-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5f73b405b25 [SPARK-44438][SS] Shutdown

[spark] branch master updated: [SPARK-44288][SS] Set the column family options before passing to DBOptions in RocksDB state store provider

2023-07-03 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b573cca90ea [SPARK-44288][SS] Set the column

[spark] branch master updated: [SPARK-44248][SS][SQL][KAFKA] Add preferred location in kafka source v2

2023-06-29 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7142e04639c [SPARK-44248][SS][SQL][KAFKA] Add

[spark] branch master updated: [SPARK-44012][SS] KafkaDataConsumer to print some read status

2023-06-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ef8f22e53d3 [SPARK-44012][SS] KafkaDataConsumer

[spark] branch branch-3.4 updated: [SPARK-43404][SS][3.4] Skip reusing sst file for same version of RocksDB state store to avoid id mismatch error

2023-06-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 238da78766f [SPARK-43404][SS][3.4] Skip

[spark] branch master updated: [SPARK-43421][SS] Implement Changelog based Checkpointing for RocksDB State Store Provider

2023-05-31 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c02c8be43c6 [SPARK-43421][SS] Implement

[spark] branch master updated: [SPARK-43128][CONNECT][SS] Make `recentProgress` and `lastProgress` return `StreamingQueryProgress` consistent with the native Scala Api

2023-05-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d44e073f0cd [SPARK-43128][CONNECT][SS] Make

[spark] branch master updated (b23185080cc -> 81b93e98b01)

2023-05-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b23185080cc [SPARK-43489][BUILD] Remove protobuf 2.5.0 add 81b93e98b01 [MINOR][CONNECT][SS][TESTS] Increase

[spark] branch master updated: [SPARK-42668][SS][FOLLOW-UP] Do not add file scheme to the Windows path

2023-05-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3cdbc176337 [SPARK-42668][SS][FOLLOW-UP] Do

[spark] branch master updated (062ac987063 -> 6337e470627)

2023-05-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 062ac987063 [SPARK-43296][CONNECT][PYTHON] Migrate Spark Connect session errors into error class add

[spark] branch master updated (175fcfd2106 -> d3b9f4e7b1b)

2023-05-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 175fcfd2106 [SPARK-43414][TESTS] Fix flakiness in Kafka RDD suites due to port binding configuration issue add

[spark] branch master updated (63cb0939679 -> 45a1935fe38)

2023-05-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 63cb0939679 [SPARK-43362][SQL] Special handling of JSON type for MySQL connector add 45a1935fe38 [SPARK-43364

[spark] branch master updated: [SPARK-43328][SS] Add latest timestamp on no-execution trigger for Idle event in streaming query listener

2023-05-01 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ae6288bdf8b [SPARK-43328][SS] Add latest

[spark] branch master updated (18c578d4f7b -> ca6f0a36b82)

2023-05-01 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 18c578d4f7b [SPARK-43206][SS][CONNECT] StreamingQuery exception() include stack trace add ca6f0a36b82 [SPARK

[spark] branch master updated: [SPARK-43134][CONNECT][SS] JVM client StreamingQuery exception() API

2023-04-26 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 466a2155ebf [SPARK-43134][CONNECT][SS] JVM

[spark] branch master updated: [SPARK-43233][SS] Add logging for Kafka Batch Reading for topic partition, offset range and task ID

2023-04-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 82138f4b430 [SPARK-43233][SS] Add logging

[spark] branch master updated (47ac097f61c -> 217876916cd)

2023-04-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 47ac097f61c [SPARK-43207][CONNECT] Add helper functions to extract value from literal expression add

[spark] branch master updated: [SPARK-43120][SS] Add support for tracking pinned blocks memory usage for RocksDB state store

2023-04-13 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ace85f25d11 [SPARK-43120][SS] Add support

[spark] branch master updated (0f8218c4324 -> 891a142b914)

2023-04-13 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0f8218c4324 [SPARK-42916][SQL] JDBCTableCatalog Keeps Char/Varchar meta on the read-side add 891a142b914 [SPARK

[spark] branch master updated (a03a9ea86f0 -> 5becb896603)

2023-04-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a03a9ea86f0 [SPARK-42987][DOCS] Correction of protobuf sql documentation add 5becb896603 [SPARK-43056][SS

[spark] branch master updated: [SPARK-43007][TESTS][FOLLOWUP] Regenerate benchmark results of `StateStoreBasicOperationsBenchmark`

2023-04-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d67f2813944 [SPARK-43007][TESTS][FOLLOWUP

[spark] branch branch-3.4 updated: [SPARK-43067][SS] Correct the location of error class resource file in Kafka connector

2023-04-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 66b11477201 [SPARK-43067][SS] Correct

[spark] branch master updated (0e9e34c1bd9 -> 7434702a120)

2023-04-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0e9e34c1bd9 [SPARK-42931][SS] Introduce dropDuplicatesWithinWatermark add 7434702a120 [SPARK-43067][SS] Correct

[spark] branch master updated: [SPARK-42931][SS] Introduce dropDuplicatesWithinWatermark

2023-04-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0e9e34c1bd9 [SPARK-42931][SS] Introduce

[spark] branch master updated: [SPARK-42968][SS] Add option to skip commit coordinator as part of StreamingWrite API for DSv2 sources/sinks

2023-03-30 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 122a88c4941 [SPARK-42968][SS] Add option

[spark] branch master updated: [SPARK-42819][SS] Add support for setting max_write_buffer_number and write_buffer_size for RocksDB used in streaming

2023-03-16 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bafb953f32e [SPARK-42819][SS] Add support

[spark] branch master updated: [SPARK-42792][SS] Add support for WRITE_FLUSH_BYTES for RocksDB used in streaming stateful operators

2023-03-15 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6259b97855d [SPARK-42792][SS] Add support

[spark] branch master updated (e251bfaea3f -> 9f15173146a)

2023-03-14 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e251bfaea3f [SPARK-42796][SQL] Support accessing TimestampNTZ columns in CachedBatch add 9f15173146a [SPARK

[spark] branch master updated: [SPARK-42591][SS][DOCS] Add examples of unblocked workloads after SPARK-42376

2023-03-07 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 27c34bd978f [SPARK-42591][SS][DOCS] Add

[spark] branch master updated: [SPARK-42376][SS] Introduce watermark propagation among operators

2023-03-06 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8e3b9d40dca [SPARK-42376][SS] Introduce

[spark] branch master updated (9bf174f9722 -> 46b82c721c5)

2023-03-06 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9bf174f9722 [SPARK-42559][CONNECT] Implement DataFrameNaFunctions add 46b82c721c5 [SPARK-42687][SS] Better error

[spark] branch master updated (db171551d39 -> 252e7a3bba6)

2023-03-06 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from db171551d39 [SPARK-42677][SQL][TESTS] Fix the invalid tests for broadcast hint add 252e7a3bba6 [SPARK-42668][SS

[spark] branch master updated (60534836b76 -> 8eb8de1bab8)

2023-03-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 60534836b76 [SPARK-41874][CONNECT][PYTHON] Support SameSemantics in Spark Connect add 8eb8de1bab8 [SPARK-42676

[spark] branch branch-3.4 updated: [SPARK-42592][SS][DOCS][FOLLOWUP] Add missed commit on reflecting review comment

2023-02-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new da353e56a6d [SPARK-42592][SS][DOCS

[spark] branch master updated: [SPARK-42592][SS][DOCS][FOLLOWUP] Add missed commit on reflecting review comment

2023-02-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c3347aee976 [SPARK-42592][SS][DOCS][FOLLOWUP

[spark] branch master updated: [SPARK-42572][SQL][SS] Fix behavior for StateStoreProvider.validateStateRowFormat

2023-02-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5e1776051ac [SPARK-42572][SQL][SS] Fix behavior

[spark] branch branch-3.4 updated: [SPARK-42592][SS][DOCS] Document how to perform chained time window aggregations

2023-02-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 2ce9fc33e0f [SPARK-42592][SS][DOCS

[spark] branch master updated: [SPARK-42592][SS][DOCS] Document how to perform chained time window aggregations

2023-02-27 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f3ede854d70 [SPARK-42592][SS][DOCS] Document

[spark] branch master updated: [SPARK-42567][SS][SQL] Track load time for state store provider and log warning if it exceeds threshold

2023-02-25 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6b71f71e196 [SPARK-42567][SS][SQL] Track load

[spark] branch master updated: [SPARK-42566][SS] RocksDB StateStore lock acquisition should happen after getting input iterator from inputRDD

2023-02-25 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 72f56f73840 [SPARK-42566][SS] RocksDB

[spark] branch master updated: [SPARK-42565][SS] Error log improvement for the lock acquisition of RocksDB state store instance

2023-02-24 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ac30e9312a8 [SPARK-42565][SS] Error log

[spark] branch master updated (201a91bab0e -> 004731ee111)

2023-02-09 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 201a91bab0e [SPARK-42366][SHUFFLE] Log shuffle data corruption diagnose cause add 004731ee111 [SPARK-42353][SS

[spark] branch master updated: [SPARK-42379][SS] Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-08 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a76bd9dcf96 [SPARK-42379][SS] Use

[spark] branch branch-3.4 updated: [SPARK-39347][SS] Bug fix for time window calculation when event time < 0

2023-02-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new c3bd9fe292c [SPARK-39347][SS] Bug fix

[spark] branch master updated: [SPARK-39347][SS] Bug fix for time window calculation when event time < 0

2023-02-05 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 87d4eb609d7 [SPARK-39347][SS] Bug fix for time

[spark] branch master updated (db06f3e0030 -> ec424c5b0e3)

2023-01-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from db06f3e0030 [SPARK-42105][SS][DOCS] Reflect the change of SPARK-40925 to SS guide doc add ec424c5b0e3 [SPARK

[spark] branch master updated (9c5384595c8 -> db06f3e0030)

2023-01-20 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9c5384595c8 [SPARK-41976][SQL] Improve error message for `INDEX_NOT_FOUND` add db06f3e0030 [SPARK-42105][SS

[spark] branch master updated: [SPARK-41596][SS][DOCS] Document the new feature "Async Progress Tracking" to Structured Streaming guide doc

2023-01-17 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 51615b62007 [SPARK-41596][SS][DOCS] Document

[spark] branch master updated: [SPARK-41996][SQL][SS] Fix kafka test to verify lost partitions to account for slow Kafka operations

2023-01-11 Thread kabhwan
This is an automated email from the ASF dual-hosted git repository. kabhwan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d7a5fdf1dd [SPARK-41996][SQL][SS] Fix kafka

<    1   2   3   4   5   6   >