Stuart Macdonald created IGNITE-9180:
----------------------------------------
Summary: IgniteSparkSession Should Copy State on cloneSession()
Key: IGNITE-9180
URL: https://issues.apache.org/jira/browse/IGNITE-9180
Project: Ignite
Issue Type: Bug
Components: spark
Reporter: Stuart Macdonald
The IgniteSparkSession object extends SparkState and overrides the
cloneSession() method. The contract for cloneSession() explicitly states that
it should clone all state (ie. the sharedState and sessionState fields),
however the IgniteSparkSession implementation doesn't clone its state fields.
This has the side-effect of breaking stateful operations for anything which
uses cloneSession(), for example a Spark streaming job will not be able to use
cached data across streaming microbatches, which is a significant issue for
such applications.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
