Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Allen Wittenauer
> On Mar 28, 2017, at 5:09 PM, Chris Douglas wrote: > > I haven't seen data identifying PB as a bottleneck, but the > non-x86/non-Linux and dev setup arguments may make this worthwhile. -C FWIW, we have the same problem with leveldbjni-all. (See the ASF PowerPC build logs) I keep meani

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Tsuyoshi Ozawa
> We can define protobuf's version by using syntax = "proto2" or syntax > = "proto3" in proto files with proto3 compiler. I think this is what > Stack mentioned as compatibility mode. I mean, "We can define protobuf's 'specification' 'version at compilation time by using syntax = "proto2""... - T

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Tsuyoshi Ozawa
> Stack mentioned a compatibility mode that uses the proto2 semantics. We can define protobuf's version by using syntax = "proto2" or syntax = "proto3" in proto files with proto3 compiler. I think this is what Stack mentioned as compatibility mode. https://github.com/golang/protobuf/blob/master/p

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Chris Douglas
On Tue, Mar 28, 2017 at 4:18 PM, Andrew Wang wrote: > Unfortunately, it sounds like these are intrinsic differences with PB3. That's too bad... but possibly not fatal: most of the data we proxy through client code is, if not opaque, it's at least immutable (particularly tokens). If PB3 does suppo

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Andrew Wang
> > > If unknown fields are dropped, then applications proxying tokens and > other > >> data between servers will effectively corrupt those messages, unless we > >> make everything opaque bytes, which- absent the convenient, prenominate > >> semantics managing the conversion- obviate the compatibil

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Chris Douglas
On Tue, Mar 28, 2017 at 3:04 PM, Andrew Wang wrote: > There's no mention of the convenient "Embedded messages are compatible with >> bytes if the bytes contain an encoded version of the message" semantics in >> proto3. > > > I checked the proto3 guide, and I think this is supported: > https://deve

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Andrew Wang
I've been investigating this a bit. I'm hoping Chris can ring in, since he's identified wire compatibility issues. Replying inline to Chris' comment

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-03-28 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/359/ [Mar 27, 2017 11:23:37 AM] (yqlin) HDFS-11555. Fix typos in class OfflineImageReconstructor. Contributed by [Mar 27, 2017 12:23:45 PM] (weichiu) HDFS-10506. Addendum patch to include missing changes. Contr

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2017-03-28 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/271/ [Mar 27, 2017 4:01:48 PM] (jeagles) Delay construction of PreCondition.check failure message in [Mar 27, 2017 5:48:44 PM] (jeagles) Configuration#get return value optimization (jeagles) [Mar 27, 2017 8:29:

[jira] [Created] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

2017-03-28 Thread Zhe Zhang (JIRA)
Zhe Zhang created MAPREDUCE-6870: Summary: Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers) Key: MAPREDUCE-6870 URL: https://issues.apache.org/jira/browse/MAPRED

[jira] [Resolved] (MAPREDUCE-6869) org.apache.hadoop.mapred.ShuffleHandler: Shuffle error in populating headers :

2017-03-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6869. --- Resolution: Not A Bug Closing this since it does not appear to be a problem in Hadoop. Pl