[
https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881916#comment-16881916
]
Zhenyu Zheng edited comment on HADOOP-13363 at 7/10/19 10:04 AM:
-----------------------------------------------------------------
Steve Loughran, Hi, thanks for the reply, I've tested what you have suggested,
and encountered some problem: When I try with protobuf=2.6.1 using -D option I
failed to build trunk branch due to:
2019-07-10 09:43:03.803715 | ubuntu-xenial-arm64 | [ERROR] Failed to execute
goal org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.1:compile (default)
on project hadoop-yarn-csi: protoc did not exit cleanly. Review output for more
information. -> [Help 1]
2019-07-10 09:43:03.804110 | ubuntu-xenial-arm64 | [ERROR]
2019-07-10 09:43:03.805475 | ubuntu-xenial-arm64 | [ERROR] To see the full
stack trace of the errors, re-run Maven with the -e switch.
2019-07-10 09:43:03.806682 | ubuntu-xenial-arm64 | [ERROR] Re-run Maven using
the -X switch to enable full debug logging.
2019-07-10 09:43:03.806989 | ubuntu-xenial-arm64 | [ERROR]
2019-07-10 09:43:03.808426 | ubuntu-xenial-arm64 | [ERROR] For more information
about the errors and possible solutions, please read the following articles:
2019-07-10 09:43:03.809936 | ubuntu-xenial-arm64 | [ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
2019-07-10 09:43:03.810460 | ubuntu-xenial-arm64 | [ERROR]
2019-07-10 09:43:03.811584 | ubuntu-xenial-arm64 | [ERROR] After correcting the
problems, you can resume the build with the command
2019-07-10 09:43:03.812624 | ubuntu-xenial-arm64 | [ERROR] mvn <goals> -rf
:hadoop-yarn-csi
Maybe this is due to that grpc requires protobuf 3.6.1?
(https://github.com/apache/hadoop/blob/993dc8726b7d40ac832ae3e23b64e8541b62c4bd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/pom.xml#L29)
And when I try to use protobuf 3.6.1 directly, something else failed to build:
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile(default-compile)on
project hadoop-hdfs: Compilation failure
[ERROR]
/home/zuul/src/github.com/ZhengZhenyu/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatProtobuf.java:[468,39]
incompatible types:
org.apache.hadoop.hdfs.server.namenode.FsImageProto.FileSummary cannot be
converted to com.google.protobuf.GeneratedMessage[m
[ERROR] Help
[ERROR] To see the full stack trace of the errors, re-run Maven with the switch.
[ERROR] Re-run Maven using the [1m-X[m switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] Help 1
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs
seems due to this part of the code is not compatiable for protobuf v3?
Any suggestion on these?
was (Author: kevin_zheng):
Steve Loughran, Hi, thanks for the reply, I've tested what you have suggested,
and encountered some problem: When I try with protobuf=2.6.1 using -D option I
failed to build trunk branch due to:
2019-07-10 09:43:03.803715 | ubuntu-xenial-arm64 | [ERROR] Failed to execute
goal org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.1:compile (default)
on project hadoop-yarn-csi: protoc did not exit cleanly. Review output for more
information. -> [Help 1]
2019-07-10 09:43:03.804110 | ubuntu-xenial-arm64 | [ERROR]
2019-07-10 09:43:03.805475 | ubuntu-xenial-arm64 | [ERROR] To see the full
stack trace of the errors, re-run Maven with the -e switch.
2019-07-10 09:43:03.806682 | ubuntu-xenial-arm64 | [ERROR] Re-run Maven using
the -X switch to enable full debug logging.
2019-07-10 09:43:03.806989 | ubuntu-xenial-arm64 | [ERROR]
2019-07-10 09:43:03.808426 | ubuntu-xenial-arm64 | [ERROR] For more information
about the errors and possible solutions, please read the following articles:
2019-07-10 09:43:03.809936 | ubuntu-xenial-arm64 | [ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
2019-07-10 09:43:03.810460 | ubuntu-xenial-arm64 | [ERROR]
2019-07-10 09:43:03.811584 | ubuntu-xenial-arm64 | [ERROR] After correcting the
problems, you can resume the build with the command
2019-07-10 09:43:03.812624 | ubuntu-xenial-arm64 | [ERROR] mvn <goals> -rf
:hadoop-yarn-csi
Maybe this is due to that grpc requires protobuf 3.6.1?
(https://github.com/apache/hadoop/blob/993dc8726b7d40ac832ae3e23b64e8541b62c4bd/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/pom.xml#L29)
And when I try to use protobuf 3.6.1 directly, something else failed to build:
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:compile(default-compile)on
project hadoop-hdfs: Compilation failure
[ERROR]
/home/zuul/src/github.com/ZhengZhenyu/hadoop/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatProtobuf.java:[468,39]
incompatible types:
org.apache.hadoop.hdfs.server.namenode.FsImageProto.FileSummary cannot be
converted to com.google.protobuf.GeneratedMessage[m
[ERROR] Help
[ERROR] To see the full stack trace of the errors, re-run Maven with the switch.
[ERROR] Re-run Maven using the [1m-X[m switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] Help 1
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs
seems due to this part of the code is not compatiable for protobuf v3?
Any suggestion on these?
> Upgrade protobuf from 2.5.0 to something newer
> ----------------------------------------------
>
> Key: HADOOP-13363
> URL: https://issues.apache.org/jira/browse/HADOOP-13363
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Affects Versions: 3.0.0-alpha1, 3.0.0-alpha2
> Reporter: Allen Wittenauer
> Priority: Major
> Labels: security
> Attachments: HADOOP-13363.001.patch, HADOOP-13363.002.patch,
> HADOOP-13363.003.patch, HADOOP-13363.004.patch, HADOOP-13363.005.patch
>
>
> Standard protobuf 2.5.0 does not work properly on many platforms. (See, for
> example, https://gist.github.com/BennettSmith/7111094 ). In order for us to
> avoid crazy work arounds in the build environment and the fact that 2.5.0 is
> starting to slowly disappear as a standard install-able package for even
> Linux/x86, we need to either upgrade or self bundle or something else.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
