Maxim Gekk created SPARK-26504: ---------------------------------- Summary: Rope-wise dumping of Spark plans Key: SPARK-26504 URL: https://issues.apache.org/jira/browse/SPARK-26504 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.4.0 Reporter: Maxim Gekk
Currently, Spark plans are converted to string via StringBuilderWriter when memory for strings are allocated sequentially as soon as elements of plans are added to the StringBuilder. Proposed improvement is StringRope which has 2 methods: 1. append(s: String): Unit - adds the string to internal list and increases total size 2. toString: String - converts the list of strings to strings -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org