[jira] [Commented] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628472#comment-17628472 ] Wei Liu commented on SPARK-40940: - PR in: https://github.com/apache/spark/pull/38503 > Fix the unsupported ops checker to allow chaining of stateful operators > --- > > Key: SPARK-40940 > URL: https://issues.apache.org/jira/browse/SPARK-40940 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming >Affects Versions: 3.4.0 >Reporter: Alex Balikov >Priority: Major > > This is follow up ticket on https://issues.apache.org/jira/browse/SPARK-40925 > - once we allow chaining of stateful operators in Spark SS, we need to fix > the unsupported ops checker to allow these (currently they are blocked and > require setting spark.sql.streaming.unsupportedOperationCheck to false -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628474#comment-17628474 ] Apache Spark commented on SPARK-40940: -- User 'WweiL' has created a pull request for this issue: https://github.com/apache/spark/pull/38503 > Fix the unsupported ops checker to allow chaining of stateful operators > --- > > Key: SPARK-40940 > URL: https://issues.apache.org/jira/browse/SPARK-40940 > Project: Spark > Issue Type: Improvement > Components: Structured Streaming >Affects Versions: 3.4.0 >Reporter: Alex Balikov >Priority: Major > > This is follow up ticket on https://issues.apache.org/jira/browse/SPARK-40925 > - once we allow chaining of stateful operators in Spark SS, we need to fix > the unsupported ops checker to allow these (currently they are blocked and > require setting spark.sql.streaming.unsupportedOperationCheck to false -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
