Jungtaek Lim created SPARK-40431: ------------------------------------ Summary: Introduce "Arbitrary Stateful Processing" in Structured Streaming with Python Key: SPARK-40431 URL: https://issues.apache.org/jira/browse/SPARK-40431 Project: Spark Issue Type: Umbrella Components: Structured Streaming Affects Versions: 3.4.0 Reporter: Jungtaek Lim
This is a part of effort for SPARK-39590, python API parity in Structured Streaming. Most of public APIs are available in both Scala/Java Spark and PySpark, but we have a huge gap on streaming workload in PySpark as we don't have matching API for flatMapGroupsWithState in PySpark. This ticket is to track the effort. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org