[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740018#comment-17740018 ]
7mming7 edited comment on SPARK-44305 at 7/5/23 7:35 AM: --------------------------------------------------------- cc [~yuming] [~r...@databricks.com] was (Author: 7mming7): cc [~yuming] > Broadcast operation is not required when no parameters are specified > -------------------------------------------------------------------- > > Key: SPARK-44305 > URL: https://issues.apache.org/jira/browse/SPARK-44305 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.2.0 > Reporter: 7mming7 > Priority: Minor > Attachments: image-2023-07-05-11-51-41-708.png > > > The ability introduced by SPARK-14912, we can broadcast the parameters of the > data source to the read and write operations, but if the user does not > specify a specific parameter, the propagation operation will also be > performed, which affects the performance has a greater impact, so we need to > avoid broadcasting the full Hadoop parameters when the user does not specify > a specific parameter > > !image-2023-07-05-11-51-41-708.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org