Hi Shannon,
That's right. This FLIP aims to boost TPS of the task workers with async
i/o operation.
As what Stephan has mentioned, by placing static attribute to shared
resources(like event pool, connection), it is possible to share those
resources among different slots in the same JVM.
I will m
Hi, Stephan
Thanks for your reply.
In my mind, Maven-shade-plugin and sbt-assembly both default exclude test code
for the fat jar.
In fact, unit tests are use to test the main code, ensure our code logic fit
our expect . This is general convention. I think. Flink has be a top apache
project.
Hi Vasia,
I have uploaded these tests on github:
https://github.com/OlgaGolovneva/MST/tree/master/tests
I have also uploaded source code, but I'm still working on it:
https://github.com/OlgaGolovneva/MST/tree/master/src
>I think you cannot add attachments to the mailing list. Could you upload
>
Hi Olga,
On 21 September 2016 at 18:50, Olga Golovneva wrote:
> Hi devs,
>
> I was working on (FLINK-1526) "Add Minimum Spanning Tree library method
> and example" issue. I've developed (Java) code that implements distributed
> Boruvka's algorithm in Gelly library. I've run several tests and it
Zhenzhong Xu created FLINK-4660:
---
Summary: HadoopFileSystem (with S3A) may leak connections, which
cause job to stuck in a restarting loop
Key: FLINK-4660
URL: https://issues.apache.org/jira/browse/FLINK-4660
Hi Sean
My goal here is to get User Accumulators. I know there exists the REST
Calls. But since i am running my code in the same JVM, i wanted to avoid
go over HTTP. I saw this code in JobAccumulatorsHandler and tried to use
this. Would you suggest some alternative approach to avoid this over
Memory pre-allocation is generally not a good idea, unless you want to run
iterative batch jobs.
For example when you run RocksDB, it needs its own memory pool and Flink's
memory pool remains empty. So in that case, pre-allocating memory just
"steals" it away from other important consumers.
On We
Between two different actor systems in the same JVM, messages are still
serialized (they go through a local socket, I think).
Getting the execution graph is not easily possible, and not intended, as it
actually contains RPC resources, etc.
What do you need from the execution graph? Maybe there is
My only 2 cents is that when I started to turn the mem pre-allocation param, to
true & #slots & #buffersI started to get all kinds of Akka & Disassociated
exceptions thrown by the JM regarding the TMs...So yes, since I am also not
well aware of Akka internals...I went back to my previous con
Ted Yu created FLINK-4659:
-
Summary: Potential resource leak due to unclosed InputStream in
SecurityContext#populateSystemSecurityProperties()
Key: FLINK-4659
URL: https://issues.apache.org/jira/browse/FLINK-4659
Hi Chesney
I am actually running this code in the same JVM as the WebInterface and
JobManager. I am programmatically, starting the JobManager. and then
running this code in same JVM to query metrics. Only difference could be
that i am creating a new Akka ActorSystem, and ActorGateway. Not sure
@Shannon: One could have a "static" broker to share the same netty across
slots in the same JVM. Implicitly, Flink does the same with broadcast
variables.
On Wed, Sep 21, 2016 at 5:04 PM, Shannon Carey wrote:
> David,
>
> I just wanted to say "thanks" for making this proposal! I'm also
> interes
Hi devs,
I was working on (FLINK-1526) "Add Minimum Spanning Tree library method
and example" issue. I've developed (Java) code that implements distributed
Boruvka's algorithm in Gelly library. I've run several tests and it seems
to work fine, although I didn't test it on extremely large input gr
Till Rohrmann created FLINK-4658:
Summary: Allow RpcService to execute Callables in the RpcService
executor
Key: FLINK-4658
URL: https://issues.apache.org/jira/browse/FLINK-4658
Project: Flink
David,
I just wanted to say "thanks" for making this proposal! I'm also interested in
performing nonblocking I/O (multiplexing threads/reactive programming) within
Flink operators so that we can, for example, communicate with external web
services with Netty/RxNetty without blocking an entire F
Kurt Young created FLINK-4657:
-
Summary: Implement HighAvailabilityServices based on zookeeper
Key: FLINK-4657
URL: https://issues.apache.org/jira/browse/FLINK-4657
Project: Flink
Issue Type: New
I would like Robert to comment on this.
I think there was a reason to have different modules, which had again
something to do with the Maven Shade Plugin
Dependencies and shading really seem the trickiest thing in bigger
Java/Scala projects ;-)
On Wed, Sep 21, 2016 at 11:04 AM, shijinkui wrote:
Till Rohrmann created FLINK-4656:
Summary: Port existing code to use Flink's future abstraction
Key: FLINK-4656
URL: https://issues.apache.org/jira/browse/FLINK-4656
Project: Flink
Issue Type
Timo Walther created FLINK-4655:
---
Summary: Add tests for validation of Expressions
Key: FLINK-4655
URL: https://issues.apache.org/jira/browse/FLINK-4655
Project: Flink
Issue Type: Test
David Anderson created FLINK-4654:
-
Summary: clean up docs
Key: FLINK-4654
URL: https://issues.apache.org/jira/browse/FLINK-4654
Project: Flink
Issue Type: Improvement
Components: D
zhangjing created FLINK-4653:
Summary: Refactor JobClientActor to adapt to the new Rpc framework
and new cluster managerment
Key: FLINK-4653
URL: https://issues.apache.org/jira/browse/FLINK-4653
Project:
Hi, All
There too much module in the root. There are no necessary to separate the test
code from sub-module.
I never see such design: two modules, one is main code, the other is test code.
Is there some special reason?
>From Jinkui Shi
Kristian Frøhlich Hansen created FLINK-4652:
---
Summary: Don't pass credentials explicitly to AmazonClient - use
credentials provider instead
Key: FLINK-4652
URL: https://issues.apache.org/jira/browse/FLIN
Kostas Kloudas created FLINK-4651:
-
Summary: Re-register processing time timers at the WindowOperator
upon recovery.
Key: FLINK-4651
URL: https://issues.apache.org/jira/browse/FLINK-4651
Project: Flin
Hello,
this is a rather subtle issue you stumbled upon here.
The ExecutionGraph is not serializable. The only reason why the
WebInterface can access it is because it runs in the same JVM as the
JobManager.
I'm not sure if there is a way for what you are trying to do.
Regards,
Chesnay
On 21
Nagarjun Guraja created FLINK-4650:
--
Summary: Frequent task manager disconnects from JobManager
Key: FLINK-4650
URL: https://issues.apache.org/jira/browse/FLINK-4650
Project: Flink
Issue Typ
26 matches
Mail list logo
