Siyuan,,, Questions inline
Thanks - Gaurav > On Jan 5, 2016, at 11:02 AM, Siyuan Hua <[email protected]> wrote: > > I can think of 3 use case: > 1. I want to expose some runtime property through REST API (isAlive, > isWaiting etc) When you say runtime properties, do they not automatically qualify for being transient? > 2. Some properties need to be set only once at the beginning of the > application based on some condition (we don't need checkpoint such kind of > properties) How would recovery work? > 3. Some properties are calculated in AM(definePartition etc.). They are not > necessarily checkpointable but need to be serialized to individual instance. > Again same question, how would recovery work? > It may only have negligible improvement in performance, but it helps to > understand the scope of the state of the operator: Not all non-transient > state needs to be persistent. > > > Any thoughts?
