Liwei Lin created FLINK-4638:
Summary: Fix exception message for MemorySegment
Key: FLINK-4638
URL: https://issues.apache.org/jira/browse/FLINK-4638
Project: Flink
Issue Type: Improvement
Hi Greg,Setting "taskmanager.memory.preallocate" to true caused "Association
with remote system [akka.tcp://flink@" "has failed" "[Disassociated]" on all
TMs.Changed it back to false.I increased the NW buffers to 1 G & started to get
TM slots exceptions.
So I am going incremental with that va
I’m not a Storm user, but from the discussion in the Storm version survey it
seems like
most of the users that are still using 0.9 or 0.10 are planning to upgrade to
1.0.
Also, the Storm community seems to be planning to end support for older Storm
versions.
Because of the complete package rena
Hi Fabian,
Thanks for your review.
- It would be good to make the number of concurrent AsyncFunction calls
configurable. Maybe overload the unorderedWait and orderedWait methods with
an additional int parameter?
*That is right, the concurrent number is confiurable. I have updated the
FLIP to pro
Hello all,
I have recently been working on adding bulk iterations to the Python API of
Flink in order to facilitate a research project I am working on. The
current changes can be seen in this GitHub diff:
https://github.com/apache/flink/compare/master...GEOFBOT:e8c9833b43675af66ce897da9880c4f8cd16
Hi David,
thanks for the FLIP! It looks pretty good. A few questions / suggestions:
- It would be good to make the number of concurrent AsyncFunction calls
configurable. Maybe overload the unorderedWait and orderedWait methods with
an additional int parameter?
- Do you plan to also add a RichFunc
My thought would be to compare the data rate and buffer sizes which gives a
refresh interval. For example, if you are transmitting 1 GB/s on 128 MiB of
network buffers then the refresh rate is at most 1/8 second. There is the
same consideration with spill files if the system does not have sufficien
Thanks Greg."Your setting of 4096 is only 128 MiB."...Correct. Cz I followed
that formula :-)))I can bump it up to twice as much like what the example is
doing to for instance 300 MiB.Is this reasonable? what do you suggest as a
reasonable range?Thanks Greg
From: Greg Hogan
To: dev@flin
Excellent!
On Mon, Sep 19, 2016 at 3:43 PM, Chesnay Schepler
wrote:
> It is normal that you don't see it in the WebInterface.
>
> FLINK-4389 was only about exposing metrics *to* the WebInterface, not
> exposing them *from* it.
>
> Essentially, a metric travels from TaskManager -> WebInterface ->
You will need to add the configuration parameters to your flink-conf.yaml.
I believe the intent is that all configuration parameters should be listed
at
https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#full-reference
My understanding is that the Flink buffers are currently
It is normal that you don't see it in the WebInterface.
FLINK-4389 was only about exposing metrics *to* the WebInterface, not
exposing them *from* it.
Essentially, a metric travels from TaskManager -> WebInterface -> User.
FLINK-4389 was about the first arrow, which is a prerequisite step for
The nightly snapshots now include "[FLINK-4389] Expose metrics to
WebFrontend":
https://flink.apache.org/contribute-code.html#snapshots-nightly-builds
For 1.2 we have metrics for "AvailableMemorySegments" and
"TotalMemorySegments":
https://ci.apache.org/projects/flink/flink-docs-master/monitori
Hi Greg,In the same Flink config link below, there are parameters that dont
even exist in flink-conf.yaml.Are they defined somewhere else?I grepped the
followings & none existed in any of the files under conf
folder."taskmanager.memory.fraction", taskmanager.memory.off-heap,
taskmanager.memory.
Vijay Srinivasaraghavan created FLINK-4637:
--
Summary: Address Yarn proxy incompatibility with Flink Web UI when
service level authorization is enabled
Key: FLINK-4637
URL: https://issues.apache.org/jira/b
Vijay Srinivasaraghavan created FLINK-4635:
--
Summary: Implement Data Transfer Authentication using shared
secret configuration
Key: FLINK-4635
URL: https://issues.apache.org/jira/browse/FLINK-4635
Fabian Hueske created FLINK-4636:
Summary: AbstractCEPPatternOperator fails to restore state
Key: FLINK-4636
URL: https://issues.apache.org/jira/browse/FLINK-4636
Project: Flink
Issue Type: B
Hi Greg,I used this guideline to calculate
"taskmanager.network.numberOfBuffers":Apache Flink 1.2-SNAPSHOT Documentation:
Configuration
|
|
|
| ||
|
|
|
| |
Apache Flink 1.2-SNAPSHOT Documentation: Configuration
| |
|
|
4096 = (16x16)x4x4 where 16 is
Hi Amir,
You may see improved performance setting "taskmanager.memory.preallocate:
true" in order to use off-heap memory.
Also, your number of buffers looks quite low and you may want to increase
"taskmanager.network.numberOfBuffers". Your setting of 4096 is only 128 MiB.
As this is a only bench
To sum up the activity in https://issues.apache.org/jira/browse/INFRA-12456:
Bit of a bummer, we will have to work on the Perl script which
publishes the notifications. If I find some time I might do that but
volunteers are welcome:
https://git-wip-us.apache.org/repos/infra?p=asfgit-admin.git;a=bl
Robert Metzger created FLINK-4634:
-
Summary: TaskStopTest.testStopExecution() times out
Key: FLINK-4634
URL: https://issues.apache.org/jira/browse/FLINK-4634
Project: Flink
Issue Type: Bug
Hi Jark,
yes I think enough time has passed. We can start implementing the
changes. What do you think Fabian?
If there are no objections, I will create the subtasks in Jira today.
For FLIP-11/1 I already have implemented a prototype, I just have to do
some refactoring/documentation before op
21 matches
Mail list logo
