I see more and more people getting into this. I guess whether we should add the fix to the pure_yarn profile by default, as it feel it's going to stay. Ideas?
On Sat, Jan 10, 2015 at 7:38 PM, Eugene Koontz <ekoo...@hiro-tan.org> wrote: > Hi Allesio and Eli, > > Compiling with "mvn -Phadoop_yarn -Dhadoop.version=2.6.0 clean" will avoid > the below "SASL_PROPS" compilation error if you remove the > STATIC_SASL_SYMBOL from the munge.symbols of the hadoop_yarn profile as > follows: > > diff --git a/pom.xml b/pom.xml > index cf0e1f9..8c2a561 100644 > --- a/pom.xml > +++ b/pom.xml > @@ -1194,7 +1194,7 @@ under the License. > </modules> > <properties> > > <hadoop.version>SET_HADOOP_VERSION_USING_MVN_DASH_D_OPTION</hadoop.version> > - <munge.symbols>PURE_YARN,STATIC_SASL_SYMBOL</munge.symbols> > + <munge.symbols>PURE_YARN</munge.symbols> > <!-- TODO: add these checks eventually --> > <project.enforcer.skip>true</project.enforcer.skip> > > <giraph.maven.dependency.plugin.skip>true</giraph.maven.dependency.plugin.skip> > > In other words, when compiling Giraph against newer releases of Hadoop, > there is no need for this munge symbol. > > The distinction between newer and older seems to be release 2.4.0 of > Hadoop, as given here: > > https://issues.apache.org/jira/browse/HADOOP-10221 " Add a plugin to > specify SaslProperties for RPC protocol based on connection properties". > > It seems like we need to add some additional profiles to make the pre-2.4 > Hadoop (which requires the munge symbol STATIC_SASL_SYMBOL) and newer > (which should not). > > -Eugene > > > On 1/8/15, 11:13 PM, Eugene Koontz wrote: > > Hi Alessio, > > I am able to reproduce your problem: > > https://gist.github.com/ekoontz/7dbaaf6218abb4fd7832 > > I'll try building Hadoop 2.6.0 and getting Giraph to work with it. > > -Eugene > > > On 1/8/15, 10:55 AM, Eli Reisman wrote: > > This looks like a munge symbol that needs to be added to the hadoop_yarn > profile in the pom.xml. I'm thinking this is an issue a couple people have > been having on 2.5 and 2.6 trying to build the hadoop_yarn profile? > > On Thu, Dec 4, 2014 at 1:01 PM, Dr. Alessio Arleo <ingar...@icloud.com> > wrote: > >> Hello everybody >> >> I am trying to compile Giraph release-1.1 for Hadoop 2.5.x and Hadoop >> 2.6.0 with Maven profile hadoop_yarn. It works fine up to Hadoop 2.4.1, but >> when trying with a newer version of Hadoop the following error comes up. I >> am working with jdk 1.7 and Maven 3.2.1. >> ST >> [ERROR] COMPILATION ERROR : >> [INFO] ------------------------------------------------------------- >> [ERROR] >> /home/hadoop/git/giraph/1.1/giraph-core/target/munged/main/org/apache/giraph/comm/netty/SaslNettyClient.java:[84,68] >> cannot find symbol >> symbol: variable SASL_PROPS >> location: class org.apache.hadoop.security.SaslRpcServer >> [ERROR] >> /home/hadoop/git/giraph/1.1/giraph-core/target/munged/main/org/apache/giraph/comm/netty/SaslNettyServer.java:[105,62] >> cannot find symbol >> symbol: variable SASL_PROPS >> location: class org.apache.hadoop.security.SaslRpcServer >> >> Do you have any suggestions? Any would be much appreciated :) >> >> Kind regards, >> Alessio >> > > > > -- Claudio Martella
