Wenchen Fan created SPARK-25187: ----------------------------------- Summary: Revisit the life cycle of ReadSupport instances. Key: SPARK-25187 URL: https://issues.apache.org/jira/browse/SPARK-25187 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 2.4.0 Reporter: Wenchen Fan
Currently the life cycle is bound to the batch/stream query. This fits streaming very well but may not be perfect for batch source. We can also consider to let {{ReadSupport.newScanConfigBuilder}} take {{DataSourceOptions}} as parameter, if we decide to change the life cycle. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org