[ https://issues.apache.org/jira/browse/SPARK-26504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Herman van Hovell resolved SPARK-26504. --------------------------------------- Resolution: Fixed Fix Version/s: 3.0.0 > Rope-wise dumping of Spark plans > --------------------------------- > > Key: SPARK-26504 > URL: https://issues.apache.org/jira/browse/SPARK-26504 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.4.0 > Reporter: Maxim Gekk > Assignee: Maxim Gekk > Priority: Minor > Fix For: 3.0.0 > > > Currently, Spark plans are converted to string via StringBuilderWriter when > memory for strings are allocated sequentially as soon as elements of plans > are added to the StringBuilder. > Proposed improvement is StringRope which has 2 methods: > 1. append(s: String): Unit - adds the string to internal list and increases > total size > 2. toString: String - converts the list of strings to strings -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org