[
https://issues.apache.org/jira/browse/FALCON-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215734#comment-14215734
]
Shwetha G S commented on FALCON-824:
------------------------------------
bq. One workaround that I tested is following. All required jar files are
copied to hadooplibs directory. If we add this dir to the classpath along with
hadoop classpath, everything seem to work for me.
[~bvellanki], this is same as bundling hadooplibs in falcon war. Thats exactly
what I am trying
bq. Why is sections of oozie-site removed?
[~svenkat], Just like any site.xml config file, its supposed to contain only
the overridden properties. It had even the defaults which are not required.
Hence removed it.
bq. I need the ability for falcon to work with any hadoop version
[~svenkat], falcon can still build with custom hadoop version with
-Dhadoop.version. Instead of adding all un-necessary hadoop jars in falcon
classpath and create issues(I need to depend on commons-lang which is bundled
in hadoop always), we can bundle only the required hadoop libraries into falcon
war itself.
bq. To package from test source is risky. If changes are made to oozie-site to
support a test case, it might inadvertently get packaged and we might not know
till after a user reports issues
[~sriksun], makes sense. I saw that we are bundling oozie-el-extensions jar as
part of falcon package. So, wanted to add oozie-site.xml as well. Will create
another oozie-site.xml for the falcon package
> Remove usage of Hadoop incompatible API
> ---------------------------------------
>
> Key: FALCON-824
> URL: https://issues.apache.org/jira/browse/FALCON-824
> Project: Falcon
> Issue Type: Bug
> Components: feed
> Affects Versions: 0.6
> Reporter: Suhas Vasu
> Assignee: Shwetha G S
> Priority: Critical
> Fix For: 0.6
>
> Attachments: FALCON-824.patch, FALCON-824.patch
>
>
> Feed submission is failing in falcon with the latest build from trunk.
> Its failing with error -
> {noformat}
> java.lang.NoSuchMethodError:
> org.apache.hadoop.fs.permission.FsPermission.getDirDefault()Lorg/apache/hadoop/fs/permission/FsPermission;
> at
> org.apache.falcon.hadoop.HadoopClientFactory.getDirDefaultPermission(HadoopClientFactory.java:218)
> at
> org.apache.falcon.hadoop.HadoopClientFactory.mkdirsWithDefaultPerms(HadoopClientFactory.java:226)
> at
> org.apache.falcon.workflow.engine.OozieWorkflowEngine.prepareEntityBuildPath(OozieWorkflowEngine.java:179)
> at
> org.apache.falcon.workflow.engine.OozieWorkflowEngine.schedule(OozieWorkflowEngine.java:152)
> at
> org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:76)
> at
> org.apache.falcon.resource.AbstractSchedulableEntityManager.schedule(AbstractSchedulableEntityManager.java:63)
> at
> org.apache.falcon.resource.SchedulableEntityManager.schedule(SchedulableEntityManager.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$7.doExecute(SchedulableEntityManagerProxy.java:321)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:447)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.schedule_aroundBody10(SchedulableEntityManagerProxy.java:323)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure11.run(SchedulableEntityManagerProxy.java:1)
> at
> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
> at
> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.schedule(SchedulableEntityManagerProxy.java:307)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.schedule_aroundBody14(SchedulableEntityManagerProxy.java:339)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure15.run(SchedulableEntityManagerProxy.java:1)
> at
> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
> at
> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submitAndSchedule_aroundBody16(SchedulableEntityManagerProxy.java:339)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure17.run(SchedulableEntityManagerProxy.java:1)
> at
> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
> at
> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submitAndSchedule(SchedulableEntityManagerProxy.java:332)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> {noformat}
> I am using hadoop version - Hadoop 2.0.0-mr1-cdh4.6.0
> Am I missing something ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
