Raghu Angadi created SPARK-43128: ------------------------------------ Summary: Streaming progress struct (especially in Scala) Key: SPARK-43128 URL: https://issues.apache.org/jira/browse/SPARK-43128 Project: Spark Issue Type: Task Components: Connect, Structured Streaming Affects Versions: 3.5.0 Reporter: Raghu Angadi
Streaming spark connect transfers streaming progress as full “json”. This works ok for Python since it does not have any schema defined. But in Scala, it is a full fledged class. We need to decide if we want to match legacy Progress struct in spark-connect. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org