[
https://issues.apache.org/jira/browse/FLINK-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058673#comment-14058673
]
Stephan Ewen commented on FLINK-834:
------------------------------------
{{this$0}} is the enclosing class of a non static subclass. Anonymous
subclasses are always non static.
The plan object (which encloses in the second case) is probably serializable,
the DataSet (DataSource / DataSink) classes are not.
Please DO NOT use anonymous classes in the API internals. They always add
overhead (cpu and size of shipped code) when serialized, because they always
serialize the enclosing objects as well. Worst case, they serialize possible
collections that are used as data inputs as well.
> Extend writeAsText with custom formatting function.
> ---------------------------------------------------
>
> Key: FLINK-834
> URL: https://issues.apache.org/jira/browse/FLINK-834
> Project: Flink
> Issue Type: Improvement
> Reporter: GitHub Import
> Assignee: Chesnay Schepler
> Labels: github-import, starter
> Fix For: pre-apache
>
>
> Currently, write as text uses the `toString()` method of data types to
> serialize the output as text. Alternatively, we have a CSV format that writes
> Tuple Datasets by using the `toString()` methods of the individual fields.
> Since Tuple's `toString()` method cannot be adapted without extending the
> class, it is not easily possible to define a custom output format of data
> sets which include Tuples.
> I think it would be good to have a way to explicitly format a text output.
> We could add a formatting function that returns a String for an input
> element, such as
> ```
> DataSet<Tuple2<String, MyPojo>> myDS;
> myDS.writeAsFormattedText("hdfs:///myOutPath",
> new TextFormatter<Tuple2<String, MyPojo>>() {
> @Override
> public String format(Tuple2<String, MyPojo> input) {
> return input.f0+" -> "+
> input.f1.getWhatEver()+" and "+
> input.f1.getSomethingElse();
> });
> ```
> Internally, we would use the default TextOutputFormat but with a previous Map
> for formatting.
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/834
> Created by: [fhueske|https://github.com/fhueske]
> Labels: enhancement, java api, simple-issue, user satisfaction,
> Milestone: Release 0.6 (unplanned)
> Created at: Mon May 19 14:39:51 CEST 2014
> State: open
--
This message was sent by Atlassian JIRA
(v6.2#6252)
