Are you sure you are using hadoop3.0.0?
------------------ ???????? ------------------ ??????: "user" <subharaj.ma...@gmail.com>; ????????: 2020??7??22??(??????) ????3:17 ??????: "Hbase-User"<user@hbase.apache.org>; ????: Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy Thanks for the pointer. One more query in I am getting this error from CommonFSUtils. invokeSetStoragePolicy() <https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>. I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem extends from) I do see the method setStoragePolicy <https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637> . Can someone explain how is this NoSuchMethodException is being thrown or I am looking at the wrong code path for LocalFileSystem? On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey <bus...@apache.org> wrote: > that is the detail message of why it determined that the FileSystem > doesn't support setStoragePolicy. As opposed to e.g. a security > manager denying access to introspect the methods available. > > On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna <subharaj.ma...@gmail.com> > wrote: > > > > I understood the "util.CommonFSUtils: FileSystem doesn't support > > setStoragePolicy;" part. > > > > Can you let me know why it is saying "java.lang.NoSuchMethodException: > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20 > > 06:02:24,859 WARN [StoreOpener-1588230740-1]" ? > > > > > > On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031...@qq.com> wrote: > > > > > This log info just as a warning that cant make it disappear for now, > but > > > will not impact anything, so you can just ignore it in local mode. > > > > > > > > > ------------------&nbsp;????????&nbsp;------------------ > > > ??????: > > > "user" > > > < > > > subharaj.ma...@gmail.com&gt;; > > > ????????:&nbsp;2020??7??21??(??????) ????9:19 > > > ??????:&nbsp;"Hbase-User"<user@hbase.apache.org&gt;; > > > > > > ????:&nbsp;Re: HBase 2.1.0 - NoSuchMethodException > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > > > > > > > > > Thanks for replying. > > > > > > Yes it is a single node hbase cluster. I am not specifying any storage > > > policy. Looking at the HStore > > > < > > > > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274&gt > > > ; > > > code it appears even if no storage policy is specified it will take > HOT. > > > > > > Can you explain this a bit more how can I get around this error or in a > > > single node hbase cluster I should be ignoring this? > > > > > > > > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang <18031...@qq.com&gt; wrote: > > > > > > &gt; LocalFileSystem? The&amp;nbsp;setStoragePolicy could only be used > in > > > &gt; distributed hdfs. > > > &gt; &amp;nbsp; > > > &gt; > > > &gt; > > > &gt; ------------------&amp;nbsp;????????&amp;nbsp;------------------ > > > &gt; ??????: > > > > &gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; > > > "user" > > > > &gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; > > > < > > > &gt; subharaj.ma...@gmail.com&amp;gt;; > > > &gt; ????????:&amp;nbsp;2020??7??21??(??????) ????5:58 > > > &gt; ??????:&amp;nbsp;"Hbase-User"<user@hbase.apache.org&amp;gt;; > > > &gt; > > > &gt; ????:&amp;nbsp;HBase 2.1.0 - NoSuchMethodException > > > &gt; org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > &gt; > > > &gt; > > > &gt; > > > &gt; Hi > > > &gt; > > > &gt; I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase master logs I > am > > > &gt; seeing a warning like below > > > &gt; > > > &gt; 2020-07-20 06:02:24,859 WARN&amp;nbsp; [StoreOpener-1588230740-1] > > > &gt; util.CommonFSUtils: FileSystem doesn't support setStoragePolicy; > > > &gt; HDFS-6584, HDFS-9345 not available. This is normal and expected on > > > &gt; earlier Hadoop versions. > > > &gt; java.lang.NoSuchMethodException: > > > &gt; > > > &gt; > > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, > > > &gt; java.lang.String) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; java.lang.Class.getDeclaredMethod(Class.java:2130) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:526) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:194) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > org.apache.hadoop.hbase.regionserver.HStore.<init&amp;gt;(HStore.java:264) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5731) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1059) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1056) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; java.util.concurrent.FutureTask.run(FutureTask.java:266) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; java.util.concurrent.FutureTask.run(FutureTask.java:266) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > > > &gt; > > > &amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp; > at > > > &gt; java.lang.Thread.run(Thread.java:748) > > > &gt; > > > &gt; As per my understanding, this error should not be coming with > Hadoop > > > &gt; 3.0.0. Can someone let me know if my understanding is correct or > what > > > &gt; could be going wrong here? > > > > -- > Sean >