Izek Greenfield created SPARK-44472:
---------------------------------------
Summary: change the external catalog thread safety way
Key: SPARK-44472
URL: https://issues.apache.org/jira/browse/SPARK-44472
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.4.1
Reporter: Izek Greenfield
We test changing the sync of the external catalog to use thread-local instead
of the synchronized methods.
in our tests, it improve the runtime of parallel actions by about 45% for
certain workload ** (time reduced from ~15min to ~9min)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
