Re: Some questions about storm metrics

2015-09-21 Thread Matthias J. Sax
Hi, there is no need to apologize :) If I understand you correctly, you need access to RuntimeContext within FlinkTopologyContext. FlinkTopologyContext in created within StormWrapperSetupHelper.convertToTopologyContext which has already access to StreamingRuntimeContext (which is just a special R

[jira] [Created] (FLINK-2719) ProcessFailureStreamingRecoveryITCase>AbstractProcessFailureRecoveryTest.testTaskManagerProcessFailure failed on Travis

2015-09-21 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2719: Summary: ProcessFailureStreamingRecoveryITCase>AbstractProcessFailureRecoveryTest.testTaskManagerProcessFailure failed on Travis Key: FLINK-2719 URL: https://issues.apache.org/ji

[jira] [Created] (FLINK-2720) Add Storm-CountMetric in flink-stormcompatibility

2015-09-21 Thread Huang Wei (JIRA)
Huang Wei created FLINK-2720: Summary: Add Storm-CountMetric in flink-stormcompatibility Key: FLINK-2720 URL: https://issues.apache.org/jira/browse/FLINK-2720 Project: Flink Issue Type: New Featu

Re: Some questions about storm metrics

2015-09-21 Thread huangwei (G)
@Matthias Thanks for the advice. I opened a JIRA and a PR for the first step about the storm metrics. If you think this is OK, I'll do a integrated test and add all the storm metrics in future. Greetings, Wei Huang = Hi, there is no need to apol

[jira] [Created] (FLINK-2721) Add Tuple meta information

2015-09-21 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-2721: -- Summary: Add Tuple meta information Key: FLINK-2721 URL: https://issues.apache.org/jira/browse/FLINK-2721 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-2722) Use InetAddress.getLocalHost() first when detecting TaskManager IP address

2015-09-21 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2722: - Summary: Use InetAddress.getLocalHost() first when detecting TaskManager IP address Key: FLINK-2722 URL: https://issues.apache.org/jira/browse/FLINK-2722 Project: F

[jira] [Created] (FLINK-2723) CopyableValue method to copy into new instance

2015-09-21 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2723: - Summary: CopyableValue method to copy into new instance Key: FLINK-2723 URL: https://issues.apache.org/jira/browse/FLINK-2723 Project: Flink Issue Type: New Featur

[jira] [Created] (FLINK-2724) Object reuse not respected in GroupReduceCombineDriver and ReduceCombineDriver

2015-09-21 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2724: --- Summary: Object reuse not respected in GroupReduceCombineDriver and ReduceCombineDriver Key: FLINK-2724 URL: https://issues.apache.org/jira/browse/FLINK-2724 Project: F

Build get stuck at BarrierBufferMassiveRandomTest

2015-09-21 Thread Vasiliki Kalavri
Hi squirrels, I've been meaning to merge a PR (#1520), but my local maven build gets stuck at org.apache.flink.streaming.runtime.io.BarrierBufferMassiveRandomTest. It looks like a deadlock.. The build just hangs there and top shows no CPU/memory load. Anyone else has experienced the same? I'm on O

[jira] [Created] (FLINK-2725) Max/Min/Sum Aggregation of mutable types

2015-09-21 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2725: - Summary: Max/Min/Sum Aggregation of mutable types Key: FLINK-2725 URL: https://issues.apache.org/jira/browse/FLINK-2725 Project: Flink Issue Type: Improvement

Re: Build get stuck at BarrierBufferMassiveRandomTest

2015-09-21 Thread Stephan Ewen
This happened locally on your machine? Can you dump the stack-trace and post it? "jps > stacktrace.txt" or so... On Mon, Sep 21, 2015 at 10:09 PM, Vasiliki Kalavri < vasilikikala...@gmail.com> wrote: > Hi squirrels, > > I've been meaning to merge a PR (#1520), but my local maven build gets > st

Re: Build get stuck at BarrierBufferMassiveRandomTest

2015-09-21 Thread Vasiliki Kalavri
Locally yes. Here's the stack trace: 2015-09-21 22:22:46 Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.75-b04 mixed mode): "Attach Listener" daemon prio=5 tid=0x7ff9d104e800 nid=0x4013 waiting on condition [0x] java.lang.Thread.State: RUNNABLE "Service Thread" d

Re: Build get stuck at BarrierBufferMassiveRandomTest

2015-09-21 Thread Stephan Ewen
I am actually very happy that it is not the "BarrierBufferMassiveRandomTest", that would be hell to debug... On Mon, Sep 21, 2015 at 10:51 PM, Stephan Ewen wrote: > Ah, actually it is a different test. I think you got confused by the > sysout log, because multiple parallel tests print there (tha

Re: Build get stuck at BarrierBufferMassiveRandomTest

2015-09-21 Thread Stephan Ewen
Ah, actually it is a different test. I think you got confused by the sysout log, because multiple parallel tests print there (that makes it not always obvious which one hangs). The test is the "SocketClientSinkTest.testSocketSinkRetryAccess()" test. You can see that by looking in which test case t

Re: Build get stuck at BarrierBufferMassiveRandomTest

2015-09-21 Thread Vasiliki Kalavri
Yes, you're right. BarrierBufferMassiveRandomTest has actually finished :-) Sorry for the confusion! I'll wait for your fix then, thanks! On 21 September 2015 at 22:51, Stephan Ewen wrote: > I am actually very happy that it is not the > "BarrierBufferMassiveRandomTest", that would be hell to deb

Re: EventTime in streaming

2015-09-21 Thread Aljoscha Krettek
Hi Martin, first of all, sorry for taking so long to write a response. This is valuable feedback that is quite helpful to us. I don't see, however, how this is not related to our current work of improving the windowing system. If I understood it correctly all of your issues should be addressed by