Hi Allesio and Eli,
Compiling with "mvn -Phadoop_yarn -Dhadoop.version=2.6.0 clean" will
avoid the below "SASL_PROPS" compilation error if you remove the
STATIC_SASL_SYMBOL from the munge.symbols of the hadoop_yarn profile as
follows:
diff --git a/pom.xml b/pom.xml
index cf0e1f9..8c2a561 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1194,7 +1194,7 @@ under the License.
</modules>
<properties>
<hadoop.version>SET_HADOOP_VERSION_USING_MVN_DASH_D_OPTION</hadoop.version>
- <munge.symbols>PURE_YARN,STATIC_SASL_SYMBOL</munge.symbols>
+ <munge.symbols>PURE_YARN</munge.symbols>
<!-- TODO: add these checks eventually -->
<project.enforcer.skip>true</project.enforcer.skip>
<giraph.maven.dependency.plugin.skip>true</giraph.maven.dependency.plugin.skip>
In other words, when compiling Giraph against newer releases of Hadoop,
there is no need for this munge symbol.
The distinction between newer and older seems to be release 2.4.0 of
Hadoop, as given here:
https://issues.apache.org/jira/browse/HADOOP-10221 " Add a plugin to
specify SaslProperties for RPC protocol based on connection properties".
It seems like we need to add some additional profiles to make the
pre-2.4 Hadoop (which requires the munge symbol STATIC_SASL_SYMBOL) and
newer (which should not).
-Eugene
On 1/8/15, 11:13 PM, Eugene Koontz wrote:
Hi Alessio,
I am able to reproduce your problem:
https://gist.github.com/ekoontz/7dbaaf6218abb4fd7832
I'll try building Hadoop 2.6.0 and getting Giraph to work with it.
-Eugene
On 1/8/15, 10:55 AM, Eli Reisman wrote:
This looks like a munge symbol that needs to be added to the
hadoop_yarn profile in the pom.xml. I'm thinking this is an issue a
couple people have been having on 2.5 and 2.6 trying to build the
hadoop_yarn profile?
On Thu, Dec 4, 2014 at 1:01 PM, Dr. Alessio Arleo
<ingar...@icloud.com <mailto:ingar...@icloud.com>> wrote:
Hello everybody
I am trying to compile Giraph release-1.1 for Hadoop 2.5.x and
Hadoop 2.6.0 with Maven profile hadoop_yarn. It works fine up to
Hadoop 2.4.1, but when trying with a newer version of Hadoop the
following error comes up. I am working with jdk 1.7 and Maven 3.2.1.
ST
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR]
/home/hadoop/git/giraph/1.1/giraph-core/target/munged/main/org/apache/giraph/comm/netty/SaslNettyClient.java:[84,68]
cannot find symbol
symbol: variable SASL_PROPS
location: class org.apache.hadoop.security.SaslRpcServer
[ERROR]
/home/hadoop/git/giraph/1.1/giraph-core/target/munged/main/org/apache/giraph/comm/netty/SaslNettyServer.java:[105,62]
cannot find symbol
symbol: variable SASL_PROPS
location: class org.apache.hadoop.security.SaslRpcServer
Do you have any suggestions? Any would be much appreciated :)
Kind regards,
Alessio
