(spark) branch master updated: [SPARK-47253][CORE] Allow LiveEventBus to stop without the completely draining of event queue

2024-04-12 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b53c6f9d1225 [SPARK-47253][CORE] Allow

(spark) branch master updated (3d2b7fea7fe0 -> c3cc38bae6e7)

2024-04-11 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3d2b7fea7fe0 [SPARK-4][PYTHON][SS][TESTS] Add spark connect test for python streaming data source add

(spark) branch branch-3.4 updated: [SPARK-47146][CORE][3.5] Possible thread leak when doing sort merge join

2024-03-05 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 6ebfadf29bb6 [SPARK-47146][CORE][3.5

(spark) branch branch-3.5 updated (14762b372dd6 -> e9f7d36797c4)

2024-03-05 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from 14762b372dd6 [SPARK-47177][SQL] Cached SQL plan do not display final AQE plan in explain string add

(spark) branch master updated: [SPARK-47146][CORE] Possible thread leak when doing sort merge join

2024-03-04 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dfb35bed522c [SPARK-47146][CORE] Possible

(spark) branch master updated: [SPARK-46512][CORE] Optimize shuffle reading when both sort and combine are used

2024-02-04 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ef3bc41336d7 [SPARK-46512][CORE] Optimize

(spark) branch master updated: [SPARK-46733][CORE] Simplify the BlockManager by the exit operation only depend on interrupt thread

2024-01-23 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ee6ed43aa046 [SPARK-46733][CORE] Simplify

(spark) branch master updated: [SPARK-46696][CORE] In ResourceProfileManager, function calls should occur after variable declarations

2024-01-18 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 38fc127a232e [SPARK-46696][CORE

(spark) branch master updated: [SPARK-46623][CORE][MLLIB][SQL] Replace SimpleDateFormat with DateTimeFormatter

2024-01-18 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bede6141a639 [SPARK-46623][CORE][MLLIB][SQL

(spark) branch master updated: [SPARK-46399][CORE] Add exit status to the Application End event for the use of Spark Listener

2023-12-20 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f9e468eafdf0 [SPARK-46399][CORE] Add exit

(spark) branch master updated: [SPARK-46132][CORE] Support key password for JKS keys for RPC SSL

2023-12-12 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 83434af22284 [SPARK-46132][CORE] Support key

(spark) branch master updated: [SPARK-46058][CORE] Add separate flag for privateKeyPassword

2023-12-06 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9c9020ebafd [SPARK-46058][CORE] Add separate

(spark) branch master updated: [SPARK-45762][CORE] Support shuffle managers defined in user jars by changing startup order

2023-11-16 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7c146c925b3 [SPARK-45762][CORE] Support

(spark) branch master updated: [SPARK-45911][CORE] Make TLS1.3 the default for RPC SSL

2023-11-14 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f8ccf20360df [SPARK-45911][CORE] Make TLS1.3

(spark) branch master updated (5a49af205411 -> bfcd2c47742d)

2023-11-07 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5a49af205411 [SPARK-4][PYTHON] Includes a debuggable object for failed assertion add bfcd2c47742d [SPARK

(spark) branch master updated: [SPARK-45730][CORE] Make ReloadingX509TrustManagerSuite less flaky

2023-11-02 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0ebfa691fc8e [SPARK-45730][CORE] Make

(spark) branch master updated: [SPARK-45544][CORE] Integrate SSL support into TransportContext

2023-10-29 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 884f6f71172 [SPARK-45544][CORE] Integrate SSL

[spark] branch master updated: [SPARK-45545][CORE] Pass SSLOptions wherever we create a SparkTransportConf

2023-10-25 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 08c7bacb4f9 [SPARK-45545][CORE] Pass

[spark] branch master updated: [SPARK-45541][CORE] Add SSLFactory

2023-10-22 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2709426f0f6 [SPARK-45541][CORE] Add

[spark] branch master updated: [SPARK-45534][CORE] Use java.lang.ref.Cleaner instead of finalize for RemoteBlockPushResolver

2023-10-18 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b1e57a2b359 [SPARK-45534][CORE] Use

[spark] branch master updated: [SPARK-45576][CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

2023-10-17 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4901548d4c3 [SPARK-45576][CORE] Remove

[spark] branch master updated: [SPARK-45429][CORE] Add helper classes for SSL RPC communication

2023-10-14 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 41420ca1033 [SPARK-45429][CORE] Add helper

[spark] branch master updated: [SPARK-45427][CORE] Add RPC SSL settings to SSLOptions and SparkTransportConf

2023-10-14 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 26aaf1ca04c [SPARK-45427][CORE] Add RPC SSL

[spark] branch master updated: [SPARK-45439][SQL][UI] Reduce memory usage of LiveStageMetrics.accumIdsToMetricType

2023-10-14 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2f6cca55286 [SPARK-45439][SQL][UI] Reduce

[spark] branch master updated: [SPARK-45426][CORE] Add support for a ReloadingX509TrustManager

2023-10-13 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bc7094e168f [SPARK-45426][CORE] Add support

[spark] branch master updated: [SPARK-45408][CORE] Add RPC SSL settings to TransportConf

2023-10-05 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f1e9dc2a4b3 [SPARK-45408][CORE] Add RPC SSL

[spark] branch master updated: [SPARK-45283][CORE][TESTS] Make StatusTrackerSuite less fragile

2023-10-03 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ee2eeb70a58 [SPARK-45283][CORE][TESTS] Make

[spark] branch master updated: [SPARK-45376][CORE] Add netty-tcnative-boringssl-static dependency

2023-10-03 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4f09b6cc101 [SPARK-45376][CORE] Add netty

[spark] branch master updated: [SPARK-45250][CORE] Support stage level task resource profile for yarn cluster when dynamic allocation disabled

2023-10-02 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5b80639e643 [SPARK-45250][CORE] Support stage

[spark] branch master updated: [SPARK-45378][CORE] Add convertToNettyForSsl to ManagedBuffer

2023-10-02 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b01dce2b2a5 [SPARK-45378][CORE] Add

[spark] branch branch-3.3 updated: [SPARK-45227][CORE] Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend

2023-09-30 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new a837105631ec [SPARK-45227][CORE] Fix

[spark] branch branch-3.4 updated: [SPARK-45227][CORE] Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new e706ba1cd4b [SPARK-45227][CORE] Fix

[spark] branch branch-3.5 updated: [SPARK-45227][CORE] Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 5cdb4ab6f0b [SPARK-45227][CORE] Fix

[spark] branch master updated: [SPARK-45227][CORE] Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8e6b1603a66 [SPARK-45227][CORE] Fix a subtle

[spark] branch branch-3.4 updated: [SPARK-45057][CORE] Avoid acquire read lock when keepReadLock is false

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 68db395867a [SPARK-45057][CORE] Avoid

[spark] branch master updated: [SPARK-45057][CORE] Avoid acquire read lock when keepReadLock is false

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0d6fda5bbee [SPARK-45057][CORE] Avoid acquire

[spark] branch branch-3.3 updated: [SPARK-45057][CORE] Avoid acquire read lock when keepReadLock is false

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 48138eb1a35 [SPARK-45057][CORE] Avoid

[spark] branch branch-3.5 updated: [SPARK-45057][CORE] Avoid acquire read lock when keepReadLock is false

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new aeba488ccd9 [SPARK-45057][CORE] Avoid

[spark] branch master updated: [SPARK-44937][CORE] Add test keys for SSL functionality

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d52561cfb1f [SPARK-44937][CORE] Add test keys

[spark] branch branch-3.3 updated: [SPARK-44937][CORE] Mark connection as timedOut in TransportClient.close

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new e965cc835c9 [SPARK-44937][CORE] Mark

[spark] branch branch-3.4 updated: [SPARK-44937][CORE] Mark connection as timedOut in TransportClient.close

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 85bf705a93f [SPARK-44937][CORE] Mark

[spark] branch master updated: [SPARK-44937][CORE] Mark connection as timedOut in TransportClient.close

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2a88feadd4b [SPARK-44937][CORE] Mark

[spark] branch branch-3.5 updated: [SPARK-44937][CORE] Mark connection as timedOut in TransportClient.close

2023-09-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 3a723a171b1 [SPARK-44937][CORE] Mark

[spark] branch master updated: [SPARK-44756][CORE] Executor hangs when RetryingBlockTransferor fails to initiate retry

2023-09-26 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff084d2852e [SPARK-44756][CORE] Executor

[spark] branch master updated: [SPARK-44306][YARN] Group FileStatus with few RPC calls within Yarn Client

2023-09-19 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1fdd46f173f7 [SPARK-44306][YARN] Group

[spark] branch master updated: [SPARK-44845][YARN][DEPLOY] Fix file system uri comparison function

2023-09-06 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 622bbf2e292 [SPARK-44845][YARN][DEPLOY] Fix

[spark] branch master updated: [SPARK-44238][CORE][SQL] Introduce a new `readFrom` method with byte array input for `BloomFilter`

2023-08-31 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fd7acd32895 [SPARK-44238][CORE][SQL

[spark] branch master updated: [SPARK-44162][CORE] Support G1GC in spark metrics

2023-08-31 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 74447ab5817 [SPARK-44162][CORE] Support G1GC

[spark] branch master updated (1d02ca49976 -> 567823eb81b)

2023-08-11 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1d02ca49976 [SPARK-43987][SHUFFLE] Separate finalizeShuffleMerge Processing to Dedicated Thread Pools add

[spark] branch master updated: [SPARK-43987][SHUFFLE] Separate finalizeShuffleMerge Processing to Dedicated Thread Pools

2023-08-11 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1d02ca49976 [SPARK-43987][SHUFFLE] Separate

[spark] branch branch-3.5 updated: [SPARK-44272][YARN] Path Inconsistency when Operating statCache within Yarn Client

2023-07-19 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 3c07a3e7e5d [SPARK-44272][YARN] Path

[spark] branch master updated (9b43a9f3ea5 -> 0879a25c4c2)

2023-07-19 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9b43a9f3ea5 [SPARK-44361][SQL] Use PartitionEvaluator API in MapInBatchExec add 0879a25c4c2 [SPARK-44272

[spark] branch branch-3.3 updated: [SPARK-44215][3.3][SHUFFLE] If num chunks are 0, then server should throw a RuntimeException

2023-07-05 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new edc13fdb5bb [SPARK-44215][3.3

[spark] branch master updated: [SPARK-44215][SHUFFLE] If num chunks are 0, then server should throw a RuntimeException

2023-07-04 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3e72806bb42 [SPARK-44215][SHUFFLE] If num

[spark] branch branch-3.4 updated: [SPARK-44215][SHUFFLE] If num chunks are 0, then server should throw a RuntimeException

2023-07-04 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 85d41757e85 [SPARK-44215][SHUFFLE

[spark] branch branch-3.3 updated: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

2023-06-30 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new e9b525e2054 [SPARK-42784] should

[spark] branch branch-3.4 updated: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

2023-06-30 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 9ec84ca47d8 [SPARK-42784] should

[spark] branch master updated: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

2023-06-30 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 35d51571a80 [SPARK-42784] should still create

[spark] branch master updated (f6e4b778ed9 -> 1c713dbacc5)

2023-04-28 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f6e4b778ed9 [SPARK-43270][PYTHON] Implement `__dir__()` in `pyspark.sql.dataframe.DataFrame` to include columns

[spark] branch master updated: [SPARK-43052][CORE] Handle stacktrace with null file name in event log

2023-04-26 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5a7d9103d6f [SPARK-43052][CORE] Handle

[spark] branch master updated: [SPARK-43179][SHUFFLE] Allowing apps to control whether their metadata gets saved in the db by the External Shuffle Service

2023-04-21 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 958a7d594d4 [SPARK-43179][SHUFFLE] Allowing

[spark] branch master updated (51e947d6a02 -> d407a42090d)

2023-04-21 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 51e947d6a02 [SPARK-43192][CONNECT] Remove user agent charset validation add d407a42090d [SPARK-43191][CORE

[spark] branch master updated (76e4425efc2 -> 8b436b3ab00)

2023-03-21 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 76e4425efc2 [SPARK-42753] ReusedExchange refers to non-existent nodes add 8b436b3ab00 [SPARK-40082] Schedule

[spark] branch master updated: [SPARK-42577][CORE] Add max attempts limitation for stages to avoid potential infinite retry

2023-03-13 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9c7aa90c771 [SPARK-42577][CORE] Add max

[spark] branch master updated: [SPARK-42719][CORE] `MapOutputTracker#getMapLocation` should respect `spark.shuffle.reduceLocality.enabled`

2023-03-09 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 60849b78204 [SPARK-42719][CORE

[spark] branch master updated: [SPARK-42689][CORE][SHUFFLE] Allow ShuffleDriverComponent to declare if shuffle data is reliably stored

2023-03-08 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 30ff2c77043 [SPARK-42689][CORE][SHUFFLE

[spark] branch master updated (2e6ce42585c -> fd500434031)

2023-03-02 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2e6ce42585c [SPARK-42640][CONNECT] Remove stale entries from the excluding rules for CompatibilitySuite add

[spark] branch master updated: [SPARK-42366][SHUFFLE] Log shuffle data corruption diagnose cause

2023-02-09 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 201a91bab0e [SPARK-42366][SHUFFLE] Log

[spark] branch branch-3.4 updated: [SPARK-33573][CORE][FOLLOW-UP] Enhance ignoredBlockBytes in pushMergeMetrics to cover more scenarios

2023-01-27 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 2f11896886e [SPARK-33573][CORE

[spark] branch master updated: [SPARK-33573][CORE][FOLLOW-UP] Enhance ignoredBlockBytes in pushMergeMetrics to cover more scenarios

2023-01-27 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ddd867056f9 [SPARK-33573][CORE][FOLLOW-UP

[spark] branch branch-3.3 updated (0fff27ddc33 -> b5cbee8e3c9)

2023-01-24 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git from 0fff27ddc33 [MINOR][K8S][DOCS] Add all resource managers in `Scheduling Within an Application` section

[spark] branch branch-3.2 updated: [SPARK-42090][3.2] Introduce sasl retry count in RetryingBlockTransferor

2023-01-24 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new fed407a4de2 [SPARK-42090][3.2

[spark] branch master updated: [SPARK-42149][YARN] Remove the env `SPARK_USE_CONC_INCR_GC` used to enable CMS GC for Yarn AM

2023-01-21 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dd4f112a3f3 [SPARK-42149][YARN] Remove

[spark] branch branch-3.2 updated (68fb5c423a8 -> 1a26c7be56b)

2023-01-20 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git from 68fb5c423a8 [SPARK-40817][K8S][3.2] `spark.files` should preserve remote files add 1a26c7be56b [SPARK

[spark] branch branch-3.3 updated (8f09a699025 -> b7ababfdca7)

2023-01-20 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git from 8f09a699025 [SPARK-42134][SQL] Fix getPartitionFiltersAndDataFilters() to handle filters without referenced

[spark] branch master updated (43d6b70a416 -> f1a3f4aa0df)

2023-01-16 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 43d6b70a416 [SPARK-42097][CORE] Register `SerializedLambda` and `BitSet` to KryoSerializer add f1a3f4aa0df

[spark] branch master updated: [SPARK-41415] SASL Request Retries

2023-01-14 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2878cd84d5d [SPARK-41415] SASL Request

[spark] branch master updated: [SPARK-40480][SHUFFLE] Remove push-based shuffle data after query finished

2023-01-14 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e424499917f [SPARK-40480][SHUFFLE] Remove

[spark] branch master updated: [SPARK-33573][SHUFFLE][YARN] Shuffle server side metrics for Push-based shuffle

2023-01-11 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e26fa3fef27 [SPARK-33573][SHUFFLE][YARN

[spark] branch master updated (99739ae068d -> fb67ce26800)

2023-01-06 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 99739ae068d [SPARK-41840][CONNECT][TESTS] Remove the invalid JIRA in the comment add fb67ce26800 [SPARK-36620

[spark] branch master updated: [SPARK-41792][SHUFFLE] Fix DB update for push based shuffle when newer shuffle merge is received

2023-01-01 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5d6b69fbc46 [SPARK-41792][SHUFFLE] Fix DB

[spark] branch master updated: [SPARK-41469][CORE] Avoid unnecessary task rerun on decommissioned executor lost if shuffle data migrated

2022-12-27 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b219f27586b [SPARK-41469][CORE] Avoid

[spark] branch master updated: [SPARK-41192][CORE] Remove unscheduled speculative tasks when task finished to obtain better dynamic

2022-12-20 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 801e07996a4 [SPARK-41192][CORE] Remove

[spark] branch branch-3.2 updated: [SPARK-41360][CORE] Avoid BlockManager re-registration if the executor has been lost

2022-12-12 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 63a7b0b3a68 [SPARK-41360][CORE] Avoid

[spark] branch branch-3.3 updated: [SPARK-41360][CORE] Avoid BlockManager re-registration if the executor has been lost

2022-12-12 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new b9a1b7105f6 [SPARK-41360][CORE] Avoid

[spark] branch master updated: [SPARK-41360][CORE] Avoid BlockManager re-registration if the executor has been lost

2022-12-12 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c3f46d5c6d6 [SPARK-41360][CORE] Avoid

[spark] branch branch-3.3 updated: [SPARK-41187][CORE] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-12-11 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 1c6cb350051 [SPARK-41187][CORE

[spark] branch master updated: [SPARK-41187][CORE] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

2022-12-11 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7e7bc940dcb [SPARK-41187][CORE] LiveExecutor

[spark] branch branch-3.2 updated: [SPARK-40987][CORE] `BlockManager#removeBlockInternal` should ensure the lock is unlocked gracefully

2022-11-29 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new b95a77107a6 [SPARK-40987][CORE

[spark] branch branch-3.3 updated: [SPARK-40987][CORE] `BlockManager#removeBlockInternal` should ensure the lock is unlocked gracefully

2022-11-29 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 3f7ff3507c3 [SPARK-40987][CORE

[spark] branch master updated: [SPARK-40987][CORE] `BlockManager#removeBlockInternal` should ensure the lock is unlocked gracefully

2022-11-29 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bbab0afb9a6 [SPARK-40987][CORE] `BlockManager

[spark] branch master updated: [SPARK-40872] Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

2022-11-20 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 72cce5c39da [SPARK-40872] Fallback

[spark] branch master updated: [SPARK-40979][CORE] Keep removed executor info due to decommission

2022-11-16 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a428e44dbc3 [SPARK-40979][CORE] Keep removed

[spark] branch master updated: [SPARK-40622][SQL][CORE] Remove the limitation that single task result must fit in 2GB

2022-11-15 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c23245d78e2 [SPARK-40622][SQL][CORE] Remove

[spark] branch master updated: [SPARK-40901][CORE] Unable to store Spark Driver logs with Absolute Hadoop based URI FS Path

2022-11-10 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b5fbdeb5483 [SPARK-40901][CORE] Unable

[spark] branch master updated: [SPARK-41051][CORE] Optimize ProcfsMetrics file acquisition

2022-11-08 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1d29403bf0f [SPARK-41051][CORE] Optimize

[spark] branch master updated: [SPARK-40096][CORE][TESTS][FOLLOW-UP] Fix flaky test case

2022-11-08 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0b770e18bd7 [SPARK-40096][CORE][TESTS][FOLLOW

[spark] branch master updated: [SPARK-40950][CORE] Fix isRemoteAddressMaxedOut performance overhead on scala 2.13

2022-11-04 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 66c6aab8f8b [SPARK-40950][CORE] Fix

[spark] branch master updated: [SPARK-40968] Fix a few wrong/misleading comments in DAGSchedulerSuite

2022-11-01 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b9380589a1c [SPARK-40968] Fix a few wrong

[spark] branch master updated: [SPARK-40320][CORE] Executor should exit when initialization failed for fatal error

2022-10-26 Thread mridulm80
This is an automated email from the ASF dual-hosted git repository. mridulm80 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aaba0e0eb72 [SPARK-40320][CORE] Executor

  1   2   3   >