[jira] [Updated] (SPARK-40466) Improve the error message if the DSv2 source is disabled but DSv1 streaming source is not available
[ https://issues.apache.org/jira/browse/SPARK-40466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40466: - Fix Version/s: (was: 3.4.0) > Improve the error message if the DSv2 source is disabled but DSv1 streaming > source is not available > --- > > Key: SPARK-40466 > URL: https://issues.apache.org/jira/browse/SPARK-40466 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming >Affects Versions: 3.4.0 >Reporter: Huanli Wang >Priority: Minor > > If the V2 data source is disabled, current behavior will fallback to use V1 > data source. But it will throw error when the DSv1 is not available. Update > the error message to indicate what config variable > (spark.sql.streaming.disabledV2MicroBatchReaders) needs to be modified in > order to enable the V2 data source. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40466) Improve the error message if the DSv2 source is disabled but DSv1 streaming source is not available
[ https://issues.apache.org/jira/browse/SPARK-40466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huanli Wang updated SPARK-40466: Shepherd: (was: Huanli Wang) > Improve the error message if the DSv2 source is disabled but DSv1 streaming > source is not available > --- > > Key: SPARK-40466 > URL: https://issues.apache.org/jira/browse/SPARK-40466 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming >Affects Versions: 3.4.0 >Reporter: Huanli Wang >Priority: Minor > Fix For: 3.4.0 > > > If the V2 data source is disabled, current behavior will fallback to use V1 > data source. But it will throw error when the DSv1 is not available. Update > the error message to indicate what config variable > (spark.sql.streaming.disabledV2MicroBatchReaders) needs to be modified in > order to enable the V2 data source. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-40466) Improve the error message if the DSv2 source is disabled but DSv1 streaming source is not available
[ https://issues.apache.org/jira/browse/SPARK-40466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huanli Wang updated SPARK-40466: Shepherd: Huanli Wang > Improve the error message if the DSv2 source is disabled but DSv1 streaming > source is not available > --- > > Key: SPARK-40466 > URL: https://issues.apache.org/jira/browse/SPARK-40466 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming >Affects Versions: 3.4.0 >Reporter: Huanli Wang >Priority: Minor > Fix For: 3.4.0 > > > If the V2 data source is disabled, current behavior will fallback to use V1 > data source. But it will throw error when the DSv1 is not available. Update > the error message to indicate what config variable > (spark.sql.streaming.disabledV2MicroBatchReaders) needs to be modified in > order to enable the V2 data source. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
