Maxim Gekk created SPARK-26504:
----------------------------------

             Summary: Rope-wise dumping of Spark plans 
                 Key: SPARK-26504
                 URL: https://issues.apache.org/jira/browse/SPARK-26504
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.0
            Reporter: Maxim Gekk


Currently, Spark plans are converted to string via StringBuilderWriter when 
memory for strings are allocated sequentially as soon as elements of plans are 
added to the StringBuilder.

Proposed improvement is StringRope which has 2 methods:
1. append(s: String): Unit - adds the string to internal list and increases 
total size
2. toString: String - converts the list of strings to strings



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to