[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608945#comment-16608945
]
Yuqi Gu edited comment on HBASE-19146 at 9/10/18 9:56 AM:
--
Hi [~stack],
Thanks for your comments.!
Protoc aarch64 binaries have been published since version 3.5.0.
>From protobuf side, it seems that there are no wire compatibility issues with
>upgrading protobuf to a newer version.
So Google guys are reluctant to go back and do a new minor release on the
version 2.5.0 that old. See the issue
[#5115|https://github.com/protocolbuffers/protobuf/issues/5115]
If upgrading to new protobuf from 2.5.0 in Hbase, are there many efforts to
make the compatibility between hbase1.x client and hbase2 cluster ?
Thanks!
was (Author: yqgu):
Hi [~stack],
Thanks for your comments.!
Protoc aarch64 binaries have been published since version 3.5.0.
>From protobuf side, it seems that there are no wire compatibility issues with
>upgrading protobuf to a newer version.
So Google guys are reluctant to go back and do a new minor release on the
version 2.5.0 that old. Issue
[#5115|https://github.com/protocolbuffers/protobuf/issues/5115]
If upgrading to new protobuf from 2.5.0 in Hbase, are there many efforts to
make the compatibility between hbase1.x client and hbase2 cluster ?
Thanks!
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>Priority: Major
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> -
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248627#comment-16248627
]
stack edited comment on HBASE-19146 at 11/11/17 7:12 PM:
-
[~yqGu]
bq. Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
Yes. Hopefully it is sooner rather than later.
bq. How do you like to upgrade Protoc-2.5.0 to 2.5.1?
Perhaps. If it happens soon. Would have to see what changed in 2.5.0. If it
only arm support then that should be fine.
We continue to support 2.5.0 so that Coprocessor Endpoints continue to work
when an hbase1.x client is going against an hbase2 cluster (Coprocessor
Endpoints use Protobuf Service to describe the methods they implement).
was (Author: stack):
[~yqGu]
bq. Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
Yes. Hopefully it is sooner rather than later.
bq. How do you like to upgrade Protoc-2.5.0 to 2.5.1?
Perhaps. If it happens soon. Would have to see what changed in 2.5.0. If it
only arm support then that should be fine.
We continue to support 2.5.0 so that Coprocessor Endpoints continue to work
when an hbase1.x client is going against an hbase2 cluster.
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247024#comment-16247024
]
Yuqi Gu edited comment on HBASE-19146 at 11/10/17 8:17 AM:
---
stack- Yes, protoc 3.5.0 that we need is not released yet.
Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
It is noted that protoc-2.5.0 is also used for external version in hbase.
But Google guys are not able to modify the already closed/published maven
repos.(https://github.com/google/protobuf/issues/3844#issuecomment-343355946).
So they can not published aarch64-linux protoc-2.5.0 to maven central.
They will make a 2.5.1 minor release for this issue.
How do you like to upgrade Protoc-2.5.0 to 2.5.1?
Thanks!
was (Author: yqgu):
stack- Yes, protoc 3.5.0 that we need is not released yet.
Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
It is noted that protoc-2.5.0 is also used for external version in hbase.
But Google guys are not able to modify the already closed/published maven
repos.(https://github.com/google/protobuf/issues/3844#issuecomment-343355946).
So they can not published aarch64-linux protoc-2.5.0 to maven central.
Would you like to tell us why hbase do not upgrade Protoc-2.5.0 to 2.5.1?
Thanks!
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247024#comment-16247024
]
Yuqi Gu edited comment on HBASE-19146 at 11/10/17 7:44 AM:
---
stack- Yes, protoc 3.5.0 that we need is not released yet.
Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
It is noted that protoc-2.5.0 is also used for external version in hbase.
But Google guys are not able to modify the already closed/published maven
repos.(https://github.com/google/protobuf/issues/3844#issuecomment-343355946).
So they can not published aarch64-linux protoc-2.5.0 to maven central.
Would you like to tell us why hbase do not upgrade Protoc-2.5.0 to 2.5.1?
Thanks!
was (Author: yqgu):
stack- Yes, protoc 3.5.0 that we need is not released yet.
Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
It is noted that protoc-2.5.0 is also used for external version in hbase.
But Google guys are not able to modify the already closed/published maven
repos.(https://github.com/google/protobuf/issues/3844#issuecomment-343355946).
So they can not published aarch64-linux protoc-2.5.0 to maven central.
Would you like to tell us why hbase do not upgrade Protoc-2.5.0 to 3.x?
Thanks!
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247024#comment-16247024
]
Yuqi Gu edited comment on HBASE-19146 at 11/10/17 6:45 AM:
---
stack- Yes, protoc 3.5.0 that we need is not released yet.
Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
It is noted that protoc-2.5.0 is also used for external version in hbase.
But Google guys are not able to modify the already closed/published maven
repos.(https://github.com/google/protobuf/issues/3844#issuecomment-343355946).
So they can not published aarch64-linux protoc-2.5.0 to maven central.
Would you like to tell us why hbase do not upgrade Protoc-2.5.0 to 3.x?
Thanks!
was (Author: yqgu):
stack- Yes, protoc 3.5.0 that we need is not release yet.
Could you please upgrade protoc version to 3.5.0 that is used for
hbase-protocol-shaded when google release it?
It is noted that protoc-2.5.0 is also used for external version in hbase.
But Google guys are not able to modify the already closed/published maven
repos.(https://github.com/google/protobuf/issues/3844#issuecomment-343355946).
So they can not published aarch64-linux protoc-2.5.0 to maven central.
Would you like to tell us why hbase do not upgrade Protoc-2.5.0 to 3.x?
Thanks!
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246970#comment-16246970
]
Ed Vielmetti edited comment on HBASE-19146 at 11/10/17 3:29 AM:
The ticket in https://github.com/google/protobuf/issues/3844 reports a patch
from the maintainer that has been merged today to support arm64 at the 3.5.0
release in protobuf / protoc, when that is released in the future.
was (Author: ed.packet):
The ticket in https://github.com/google/protobuf/issues/3844 reports a patch
from the maintainer that has been merged today to support arm64 at the 3.5.0
release in protobuf / protoc.
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241363#comment-16241363
]
Yuqi Gu edited comment on HBASE-19146 at 11/7/17 2:22 AM:
--
There are no Arm64 binaries on Maven Central.(
https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/)
I raise a [ticket |https://github.com/google/protobuf/issues/3844]in protobuf
project and ask them to include Arm64 binaries in the next release.
Then ' ' in pom.xml will be modified for called Arm64 protoc.
was (Author: yqgu):
There are no Arm64 binaries on Maven Central.(
https://repo.maven.apache.org/maven2/com/google/protobuf/protoc/)
I raise a [ticket |https://github.com/google/protobuf/issues/3844]in protobuf
project and ask them to include AARCH64 binaries in the next release.
Then ' ' in pom.xml will be modified for called Arm64 protoc.
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233743#comment-16233743
]
Yuqi Gu edited comment on HBASE-19146 at 11/1/17 7:38 AM:
--
I fix it by installing two protocbuf version(2.5.0/3.3.0) on host.
The protocbuf 2.5.0 is installed in "/usr/bin/protoc "for
"external.protobuf.version".
And 3.3.0 is in "/usr/local/bin/protoc" for " internal.protobuf.version ".
So, the patch is like as follows:
SRC_HOME/pom.xml；
{code:java}
protobuf-maven-plugin
${protobuf.plugin.version}
-
com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
+/usr/local/bin/protoc
${basedir}/src/main/protobuf/
false
{code}
SRC_HOME/hbase-protocol-shaded/pom.xml
{code:java}
compile
-
com.google.protobuf:protoc:${internal.protobuf.version}:exe:${os.detected.classifier}
+ /usr/local/bin/protoc
false
true
{code}
Obviously, it is a workaround to build hbase on AARCH64.
Any other way to fix it?
was (Author: yqgu):
I fix it by installing two protocbuf version(2.5.0/3.3.0) on host.
protocbuf 2.5.0 is installed in "/usr/bin/protoc "for
"external.protobuf.version".
And 3.3.0 is in "/usr/local/bin/protoc" for " internal.protobuf.version ".
So, the patch is like as follows:
SRC_HOME/pom.xml；
{code:java}
protobuf-maven-plugin
${protobuf.plugin.version}
-
com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
+/usr/local/bin/protoc
${basedir}/src/main/protobuf/
false
{code}
SRC_HOME/hbase-protocol-shaded/pom.xml
{code:java}
compile
-
com.google.protobuf:protoc:${internal.protobuf.version}:exe:${os.detected.classifier}
+ /usr/local/bin/protoc
false
true
{code}
Obviously, it is a workaround to build hbase on AARCH64.
Any other way to fix it?
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>Priority: Major
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Comment Edited] (HBASE-19146) Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
[
https://issues.apache.org/jira/browse/HBASE-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233743#comment-16233743
]
Yuqi Gu edited comment on HBASE-19146 at 11/1/17 7:37 AM:
--
I fix it by installing two protocbuf version(2.5.0/3.3.0) on host.
protocbuf 2.5.0 is installed in "/usr/bin/protoc "for
"external.protobuf.version".
And 3.3.0 is in "/usr/local/bin/protoc" for " internal.protobuf.version ".
So, the patch is like as follows:
SRC_HOME/pom.xml；
{code:java}
protobuf-maven-plugin
${protobuf.plugin.version}
-
com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
+/usr/local/bin/protoc
${basedir}/src/main/protobuf/
false
{code}
SRC_HOME/hbase-protocol-shaded/pom.xml
{code:java}
compile
-
com.google.protobuf:protoc:${internal.protobuf.version}:exe:${os.detected.classifier}
+ /usr/local/bin/protoc
false
true
{code}
Obviously, it is a workaround to build hbase on AARCH64.
Any other way to fix it?
was (Author: yqgu):
I fix it by install two different protocbuf version on host.
protocbuf 2.5.0 is installed in "/usr/bin/protoc "for
"external.protobuf.version".
And 3.3.0 is in "/usr/local/bin/protoc" for " internal.protobuf.version ".
So, the patch is like as follows:
SRC_HOME/pom.xml；
{code:java}
protobuf-maven-plugin
${protobuf.plugin.version}
-
com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
+/usr/local/bin/protoc
${basedir}/src/main/protobuf/
false
{code}
SRC_HOME/hbase-protocol-shaded/pom.xml
{code:java}
compile
-
com.google.protobuf:protoc:${internal.protobuf.version}:exe:${os.detected.classifier}
+ /usr/local/bin/protoc
false
true
{code}
Obviously, it is a workaround to build hbase on AARCH64.
Any other way to fix it?
> Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)
> --
>
> Key: HBASE-19146
> URL: https://issues.apache.org/jira/browse/HBASE-19146
> Project: HBase
> Issue Type: Bug
> Components: build, pom
>Affects Versions: 3.0.0
> Environment: OS: Ubuntu 16.04.3
> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
> Hw platform: AARCH64
>Reporter: Yuqi Gu
>Priority: Major
>
> We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
> It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:
> {code:java}
>
>org.xolstice.maven.plugins
>protobuf-maven-plugin
>${protobuf.plugin.version}
>
> com.google.protobuf:protoc:${external.protobuf.version}:
> exe:${os.detected.classifier}
>
> com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}
>
>false
>true
>
>
> {code}
> So the build is failed.
> {code:java}
> [INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @
> hbase-protocol-shaded ---
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> Failed to execute goal
> org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile
> (compile-protoc) on project hbase-protocol-shaded: Missing:
> {code}
> Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:
> {code:java}
> - ${basedir}/src/main/protobuf/
> + /usr/local/bin/protoc
> {code}
> The build is also failed:
> {code:java}
> [INFO] Compiling 32 proto file(s) to
> /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
> [ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax
> identifier "proto3". This parser only recognizes "proto2".
> {code}
> It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.
> How to fix it? Thanks!
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
