Re: Understanding task commit/abort protocol

2017-02-13 Thread Chris Douglas
IIRC the call to commit is correct, if the OutputCommitter supports partial commit. That was the idea: checkpoint the state of the reducer and promote its output, so it picks up from that point when rescheduled. It worked well in our experiments. This also included changes that allow intermediate

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2017-02-13 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/228/ [Feb 13, 2017 5:18:20 AM] (kai.zheng) HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed [Feb 13, 2017 5:21:44 AM] (kai.zheng) HADOOP-13769. AliyunOSS: update oss sdk version. Contrib

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-02-13 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/316/ [Feb 13, 2017 5:18:20 AM] (kai.zheng) HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed [Feb 13, 2017 5:21:44 AM] (kai.zheng) HADOOP-13769. AliyunOSS: update oss sdk version. Contrib