Are you sure you are using hadoop3.0.0?
------------------ ???????? ------------------
??????:
"user"
<subharaj.ma...@gmail.com>;
????????: 2020??7??22??(??????) ????3:17
??????: "Hbase-User"<user@hbase.apache.org>;
????: Re: HBase 2.1.0 - NoSuchMethodException
org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Thanks for the pointer.
One more query in I am getting this error from CommonFSUtils.
invokeSetStoragePolicy()
<https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>.
I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem
extends from) I do see the method setStoragePolicy
<https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637>
.
Can someone explain how is this NoSuchMethodException is being thrown or I
am looking at the wrong code path for LocalFileSystem?
On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey <bus...@apache.org> wrote:
> that is the detail message of why it determined that the FileSystem
> doesn't support setStoragePolicy. As opposed to e.g. a security
> manager denying access to introspect the methods available.
>
> On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna <subharaj.ma...@gmail.com>
> wrote:
> >
> > I understood the "util.CommonFSUtils: FileSystem doesn't support
> > setStoragePolicy;" part.
> >
> > Can you let me know why it is saying "java.lang.NoSuchMethodException:
> > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20
> > 06:02:24,859 WARN [StoreOpener-1588230740-1]" ?
> >
> >
> > On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031...@qq.com> wrote:
> >
> > > This log info just as a warning that cant make it disappear for
now,
> but
> > > will not impact anything, so you can just ignore it in local
mode.
> > >
> > >
> > > ------------------&nbsp;????????&nbsp;------------------
> > > ??????:
> >
>
"user"
> >
>
<
> > > subharaj.ma...@gmail.com&gt;;
> > > ????????:&nbsp;2020??7??21??(??????) ????9:19
> > > ??????:&nbsp;"Hbase-User"<user@hbase.apache.org&gt;;
> > >
> > > ????:&nbsp;Re: HBase 2.1.0 - NoSuchMethodException
> > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > >
> > >
> > >
> > > Thanks for replying.
> > >
> > > Yes it is a single node hbase cluster. I am not specifying any
storage
> > > policy. Looking at the HStore
> > > <
> > >
>
https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274&gt
> > > ;
> > > code it appears even if no storage policy is specified it will
take
> HOT.
> > >
> > > Can you explain this a bit more how can I get around this error
or in a
> > > single node hbase cluster I should be ignoring this?
> > >
> > >
> > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang
<18031...@qq.com&gt; wrote:
> > >
> > > &gt; LocalFileSystem? The&amp;nbsp;setStoragePolicy
could only be used
> in
> > > &gt; distributed hdfs.
> > > &gt; &amp;nbsp;
> > > &gt;
> > > &gt;
> > > &gt;
------------------&amp;nbsp;????????&amp;nbsp;------------------
> > > &gt; ??????:
> > >
>
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > > "user"
> > >
>
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > > <
> > > &gt; subharaj.ma...@gmail.com&amp;gt;;
> > > &gt; ????????:&amp;nbsp;2020??7??21??(??????) ????5:58
> > > &gt;
??????:&amp;nbsp;"Hbase-User"<user@hbase.apache.org&amp;gt;;
> > > &gt;
> > > &gt; ????:&amp;nbsp;HBase 2.1.0 - NoSuchMethodException
> > > &gt; org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > > &gt;
> > > &gt;
> > > &gt;
> > > &gt; Hi
> > > &gt;
> > > &gt; I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase
master logs I
> am
> > > &gt; seeing a warning like below
> > > &gt;
> > > &gt; 2020-07-20 06:02:24,859 WARN&amp;nbsp;
[StoreOpener-1588230740-1]
> > > &gt; util.CommonFSUtils: FileSystem doesn't support
setStoragePolicy;
> > > &gt; HDFS-6584, HDFS-9345 not available. This is normal and
expected on
> > > &gt; earlier Hadoop versions.
> > > &gt; java.lang.NoSuchMethodException:
> > > &gt;
> > > &gt;
> > >
>
org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path,
> > > &gt; java.lang.String)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt; java.lang.Class.getDeclaredMethod(Class.java:2130)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:526)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:194)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
org.apache.hadoop.hbase.regionserver.HStore.<init&amp;gt;(HStore.java:264)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5731)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1059)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1056)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt; java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt; java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt;
> > >
>
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> > > &gt;
> > >
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> at
> > > &gt; java.lang.Thread.run(Thread.java:748)
> > > &gt;
> > > &gt; As per my understanding, this error should not be
coming with
> Hadoop
> > > &gt; 3.0.0. Can someone let me know if my understanding is
correct or
> what
> > > &gt; could be going wrong here?
>
>
>
> --
> Sean
>
