vinoyang created FLINK-12003:
--------------------------------
Summary: Revert the config option about mapreduce.output.basename
in HadoopOutputFormatBase
Key: FLINK-12003
URL: https://issues.apache.org/jira/browse/FLINK-12003
Project: Flink
Issue Type: Improvement
Components: Connectors / Hadoop Compatibility
Reporter: vinoyang
Assignee: vinoyang
In {{HadoopOutputFormatBase}} open method, the config option
{{mapreduce.output.basename}} was changed to "tmp" and there is not any
documentation state this change.
By default, HDFS will use this format "part-x-yyyyy" to name its file, the x
and y means :
* {{x}} is either 'm' or 'r', depending on whether the job was a map only job,
or reduce
* {{yyyyy}} is the mapper or reducer task number (zero based)
The keyword "part" has used in many place in user's business logic to match the
hdfs's file name. So I suggest to revert this config option or document it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
