[Discuss] Some problem Unit test

2017-01-23 Thread sjk
Hi, all Surefire plugin default execute `default-test` when mvn test. There two execution in Flink’s surefire plugin configure, default-test and integration-tests. I have three problem about unit test: 1. As default-test and integration-tests are mutual exclusion, when I local execute “mvn cle

[DISCUSS] schedule for execution from different list of ExecutionJobVertex

2016-12-30 Thread sjk
Hi, all On [FLINK-1425][1] add executeMode supporting by Ufuk Celebi . I want to know why two loop using different list object: task.value() and getVerticesTopologically(). task and getVerticesTopologically() all filled in attachJobGraph function: public void attachJobGraph(List topologiallyS

Re: [DISCUSS] Hold copies in HeapStateBackend

2016-11-23 Thread sjk
that was initially > copied. > > I think the savings of reusing the object in each invocation of the > ReduceFunction and not creating a new object should amortize the one-time > object copy. > > Fabian > > 2016-11-23 3:04 GMT+01:00 sjk : > >> Hi, Fabian >&g

[DISCUSS] deprecated function need more detail

2016-11-22 Thread sjk
Hi, all Let’s have look at Checkpointed interface below. It declared deprecated but have no detail for why, when and how replace this function. It’s a big trouble for the users. @Deprecated @PublicEvolving public interface Checkpointed extends CheckpointedRestoring { I think we should have

Re: [DISCUSS] Hold copies in HeapStateBackend

2016-11-22 Thread sjk
Hi, Fabian So much code changes. Can you show us the key changes code for the object copy? Object reference maybe hold more deep reference, it can be a bomb. Can we renew a object with its data or direct use kryo for object serialization? I’m not prefer object copy. > On Nov 22, 2016, at 20:33,

Re: [Discuss] State Backend use external HBase storage

2016-11-17 Thread sjk
Hi, Chen Qin I fount this issue. Does it kicked off? What’s the current progress? https://issues.apache.org/jira/browse/FLINK-4266 > On Nov 16, 2016, at 19:35, Till Rohrmann wrote: > > Hi Jinkui, > > the file system state backend and the Rock