HeartSaVioR edited a comment on pull request #31600: URL: https://github.com/apache/spark/pull/31600#issuecomment-783057670
Given we assume that the code might have a bug, it may not be safe if we try to answer the question based on current code. Probably we'd need to try to ask and figure about the "historical" information what sparkSessionForStream is for, and why sparkSession should be co-used even after cloning the session. Once we figure out and make clear, we would have to document it into StreamExecution for further references. cc. @mukulmurthy @zsxwing @jose-torres who authored/reviewed SPARK-26586. also @tdas who may likely have context. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
