[
https://issues.apache.org/jira/browse/FLINK-2090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stephan Ewen resolved FLINK-2090.
---------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
Fixed via b5d58934d7124e0076e588e74485a60e7c1f484b
Thank you for the contribution
> toString of CollectionInputFormat takes long time when the collection is huge
> -----------------------------------------------------------------------------
>
> Key: FLINK-2090
> URL: https://issues.apache.org/jira/browse/FLINK-2090
> Project: Flink
> Issue Type: Improvement
> Reporter: Till Rohrmann
> Assignee: Ivan Mushketyk
> Priority: Minor
> Fix For: 1.2.0
>
>
> The {{toString}} method of {{CollectionInputFormat}} calls {{toString}} on
> its underlying {{Collection}}. Thus, {{toString}} is called for each element
> of the collection. If the {{Collection}} contains many elements or the
> individual {{toString}} calls for each element take a long time, then the
> string generation can take a considerable amount of time. [~mikiobraun]
> noticed that when he inserted several jBLAS matrices into Flink.
> The {{toString}} method is mainly used for logging statements in
> {{DataSourceNode}}'s {{computeOperatorSpecificDefaultEstimates}} method and
> in {{JobGraphGenerator.getDescriptionForUserCode}}. I'm wondering whether it
> is necessary to print the complete content of the underlying {{Collection}}
> or if it's not enough to print only the first 3 elements in the {{toString}}
> method.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
