Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Thanks all my doubts are resolved now. On Wed, Jul 22, 2020 at 4:46 PM zheng wang <18031...@qq.com> wrote: > AndgetMethod does. > > > > > --原始邮件-- > 发件人: > "user" > < > subharaj.ma...@gmail.com; > 发送时间:2020年7月22日(星期三) 晚上6:44 > 收件人:"Hbase-User" > 主题:Re: HBase 2.1.0 - NoSuchMethodException > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > Yes I am using hadoop 3.0.0. > > On Wed, Jul 22, 2020 at 12:31 PM zheng wang <18031...@qq.com wrote: > > Are you sure you are using hadoop3.0.0? > > > > > --nbsp;原始邮件nbsp;-- > 发件人: > > "user" > > < > subharaj.ma...@gmail.comgt;; > 发送时间:nbsp;2020年7月22日(星期三) 凌晨3:17 > 收件人:nbsp;"Hbase-User" > 主题:nbsp;Re: HBase 2.1.0 - NoSuchMethodException > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > Thanks for the pointer. > > One more query in I am getting this error from CommonFSUtils. > invokeSetStoragePolicy() > < > > https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533gt > > <https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533gt>; > ;. > I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem > extends from) I do see the methodnbsp; setStoragePolicy > < > > https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637gt > > <https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637gt>; > ; > . > > Can someone explain how is this NoSuchMethodException is being thrown > or I > am looking at the wrong code path for LocalFileSystem? > > On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey wrote: > > gt; that is the detail message of why it determined that the > FileSystem > gt; doesn't support setStoragePolicy. As opposed to e.g. a > security > gt; manager denying access to introspect the methods available. > gt; > gt; On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna < > subharaj.ma...@gmail.comgt; > gt; wrote: > gt; gt; > gt; gt; I understood the "util.CommonFSUtils: FileSystem > doesn't support > gt; gt; setStoragePolicy;" part. > gt; gt; > gt; gt; Can you let me know why it is saying > "java.lang.NoSuchMethodException: > gt; gt; > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20 > gt; gt; 06:02:24,859 WARNnbsp; > [StoreOpener-1588230740-1]" ? > gt; gt; > gt; gt; > gt; gt; On Tue, Jul 21, 2020 at 6:43 PM zheng wang < > 18031...@qq.comgt; > wrote: > gt; gt; > gt; gt; gt; This log info just as a warning that cant > make it disappear > for now, > gt; but > gt; gt; gt; will not impact anything, so you can just > ignore it in > local mode. > gt; gt; gt; > gt; gt; gt; > gt; gt; gt; > --amp;nbsp;原始邮件amp;nbsp;-- > gt; gt; gt; 发件人: > gt; gt; > > gt;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; > "user" > gt; gt; > > gt;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; > < > gt; gt; gt; subharaj.ma...@gmail.comamp;gt;; > gt; gt; gt; 发送时间:amp;nbsp;2020年7月21日(星期二) 晚上9:19 > gt; gt; gt; 收件人:amp;nbsp;"Hbase-User"< > user@hbase.apache.orgamp;gt;; > gt; gt; gt; > gt; gt; gt; 主题:amp;nbsp;Re: HBase 2.1.0 - > NoSuchMethodException > gt; gt; gt; > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > gt; gt; gt; > gt; gt; gt; > gt; gt; gt; > gt; gt; gt; Thanks for replying. > gt; gt; gt; > gt; gt; gt; Yes it is a single node hbase cluster. I > am not specifying > any storage > gt; gt; gt; policy. Looking at the HStore > gt; gt; gt; < > gt; gt; gt; > gt; > > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/ha
?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
AndgetMethod does. ---- ??: "user" https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533gt ;. I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem extends from) I do see the methodnbsp; setStoragePolicy < https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637gt ; . Can someone explain how is this NoSuchMethodException is being thrown or I am looking at the wrong code path for LocalFileSystem? On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274amp;gt gt
?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
SeemsgetDeclaredMethod does not include the methods that extends from parent. ---- ??: "user" https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533gt ;. I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem extends from) I do see the methodnbsp; setStoragePolicy < https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637gt ; . Can someone explain how is this NoSuchMethodException is being thrown or I am looking at the wrong code path for LocalFileSystem? On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274amp;gt gt
Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Yes I am using hadoop 3.0.0. On Wed, Jul 22, 2020 at 12:31 PM zheng wang <18031...@qq.com> wrote: > Are you sure you are using hadoop3.0.0? > > > > > --原始邮件-- > 发件人: > "user" > < > subharaj.ma...@gmail.com; > 发送时间:2020年7月22日(星期三) 凌晨3:17 > 收件人:"Hbase-User" > 主题:Re: HBase 2.1.0 - NoSuchMethodException > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > Thanks for the pointer. > > One more query in I am getting this error from CommonFSUtils. > invokeSetStoragePolicy() > < > https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533 > ;. > I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem > extends from) I do see the method setStoragePolicy > < > https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637 > ; > . > > Can someone explain how is this NoSuchMethodException is being thrown or I > am looking at the wrong code path for LocalFileSystem? > > On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey > that is the detail message of why it determined that the FileSystem > doesn't support setStoragePolicy. As opposed to e.g. a security > manager denying access to introspect the methods available. > > On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna < > subharaj.ma...@gmail.com > wrote: > > I understood the "util.CommonFSUtils: FileSystem doesn't support > setStoragePolicy;" part. > > Can you let me know why it is saying > "java.lang.NoSuchMethodException: > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20 > 06:02:24,859 WARN [StoreOpener-1588230740-1]" ? > > > On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031...@qq.com > wrote: > >This log info just as a warning that cant make it disappear > for now, > but >will not impact anything, so you can just ignore it in > local mode. > > > --nbsp;原始邮件nbsp;-- >发件人: > > > "user" > > > < >subharaj.ma...@gmail.comgt;; >发送时间:nbsp;2020年7月21日(星期二) 晚上9:19 >收件人:nbsp;"Hbase-User" >主题:nbsp;Re: HBase 2.1.0 - NoSuchMethodException >org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > >Thanks for replying. > >Yes it is a single node hbase cluster. I am not specifying > any storage >policy. Looking at the HStore >< > > > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274gt > > <https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274gt>; > ; >code it appears even if no storage policy is specified it > will take > HOT. > >Can you explain this a bit more how can I get around this > error or in a >single node hbase cluster I should be ignoring this? > > >On Tue, Jul 21, 2020 at 3:03 PM zheng wang > <18031...@qq.comgt; > wrote: > >gt; LocalFileSystem? Theamp;nbsp;setStoragePolicy > could only be used > in >gt; distributed hdfs. >gt; amp;nbsp; >gt; >gt; >gt; > --amp;nbsp;原始邮件amp;nbsp;-- >gt; 发件人: > > > gt;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; >"user" > > > gt;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; >< >gt; subharaj.ma...@gmail.comamp;gt;; >gt; 发送时间:amp;nbsp;2020年7月21日(星期二) 下午5:58 >gt; 收件人:amp;nbsp;"Hbase-User"< > user@hbase.apache.orgamp;gt;; >gt; >gt; 主题:amp;nbsp;HBase 2.1.0 - > NoSuchMethodException >gt; > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy >gt; >gt; >gt; >gt; Hi >gt; >gt; I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase > master logs I > am >gt; seeing a warning l
?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Are you sure you are using hadoop3.0.0? ---- ??: "user" https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533;. I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem extends from) I do see the method setStoragePolicy
Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Thanks for the pointer. One more query in I am getting this error from CommonFSUtils. invokeSetStoragePolicy() <https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>. I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem extends from) I do see the method setStoragePolicy <https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637> . Can someone explain how is this NoSuchMethodException is being thrown or I am looking at the wrong code path for LocalFileSystem? On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey wrote: > that is the detail message of why it determined that the FileSystem > doesn't support setStoragePolicy. As opposed to e.g. a security > manager denying access to introspect the methods available. > > On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna > wrote: > > > > I understood the "util.CommonFSUtils: FileSystem doesn't support > > setStoragePolicy;" part. > > > > Can you let me know why it is saying "java.lang.NoSuchMethodException: > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20 > > 06:02:24,859 WARN [StoreOpener-1588230740-1]" ? > > > > > > On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031...@qq.com> wrote: > > > > > This log info just as a warning that cant make it disappear for now, > but > > > will not impact anything, so you can just ignore it in local mode. > > > > > > > > > --原始邮件-- > > > 发件人: > > > "user" > > > < > > > subharaj.ma...@gmail.com; > > > 发送时间:2020年7月21日(星期二) 晚上9:19 > > > 收件人:"Hbase-User" > > > > > 主题:Re: HBase 2.1.0 - NoSuchMethodException > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > > > > > > > > > Thanks for replying. > > > > > > Yes it is a single node hbase cluster. I am not specifying any storage > > > policy. Looking at the HStore > > > < > > > > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274 > > > ; > > > code it appears even if no storage policy is specified it will take > HOT. > > > > > > Can you explain this a bit more how can I get around this error or in a > > > single node hbase cluster I should be ignoring this? > > > > > > > > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang <18031...@qq.com wrote: > > > > > > LocalFileSystem? Thenbsp;setStoragePolicy could only be used > in > > > distributed hdfs. > > > nbsp; > > > > > > > > > --nbsp;原始邮件nbsp;-- > > > 发件人: > > > > > > > "user" > > > > > > > < > > > subharaj.ma...@gmail.comgt;; > > > 发送时间:nbsp;2020年7月21日(星期二) 下午5:58 > > > 收件人:nbsp;"Hbase-User" > > > > > 主题:nbsp;HBase 2.1.0 - NoSuchMethodException > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > > > > > > > > > Hi > > > > > > I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase master logs I > am > > > seeing a warning like below > > > > > > 2020-07-20 06:02:24,859 WARNnbsp; [StoreOpener-1588230740-1] > > > util.CommonFSUtils: FileSystem doesn't support setStoragePolicy; > > > HDFS-6584, HDFS-9345 not available. This is normal and expected on > > > earlier Hadoop versions. > > > java.lang.NoSuchMethodException: > > > > > > > > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, > > > java.lang.String) > > > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; > at > > > java.lang.Class.getDeclaredMethod(Class.java:2130) > > > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; > at > > > > > > > org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577) > > > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; > at > > > > > > > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558) > > > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; > at > > > > > &g
Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
that is the detail message of why it determined that the FileSystem doesn't support setStoragePolicy. As opposed to e.g. a security manager denying access to introspect the methods available. On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna wrote: > > I understood the "util.CommonFSUtils: FileSystem doesn't support > setStoragePolicy;" part. > > Can you let me know why it is saying "java.lang.NoSuchMethodException: > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20 > 06:02:24,859 WARN [StoreOpener-1588230740-1]" ? > > > On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031...@qq.com> wrote: > > > This log info just as a warning that cant make it disappear for now, but > > will not impact anything, so you can just ignore it in local mode. > > > > > > --原始邮件-- > > 发件人: > > "user" > > < > > subharaj.ma...@gmail.com; > > 发送时间:2020年7月21日(星期二) 晚上9:19 > > 收件人:"Hbase-User" > > > 主题:Re: HBase 2.1.0 - NoSuchMethodException > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > > > > > Thanks for replying. > > > > Yes it is a single node hbase cluster. I am not specifying any storage > > policy. Looking at the HStore > > < > > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274 > > ; > > code it appears even if no storage policy is specified it will take HOT. > > > > Can you explain this a bit more how can I get around this error or in a > > single node hbase cluster I should be ignoring this? > > > > > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang <18031...@qq.com wrote: > > > > LocalFileSystem? Thenbsp;setStoragePolicy could only be used in > > distributed hdfs. > > nbsp; > > > > > > --nbsp;原始邮件nbsp;-- > > 发件人: > > > > "user" > > > > < > > subharaj.ma...@gmail.comgt;; > > 发送时间:nbsp;2020年7月21日(星期二) 下午5:58 > > 收件人:nbsp;"Hbase-User" > > > 主题:nbsp;HBase 2.1.0 - NoSuchMethodException > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > > > > > Hi > > > > I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase master logs I am > > seeing a warning like below > > > > 2020-07-20 06:02:24,859 WARNnbsp; [StoreOpener-1588230740-1] > > util.CommonFSUtils: FileSystem doesn't support setStoragePolicy; > > HDFS-6584, HDFS-9345 not available. This is normal and expected on > > earlier Hadoop versions. > > java.lang.NoSuchMethodException: > > > > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, > > java.lang.String) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > java.lang.Class.getDeclaredMethod(Class.java:2130) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:526) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:194) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > org.apache.hadoop.hbase.regionserver.HStore. > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5731) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1059) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1056) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > java.util.concurrent.FutureTask.run(FutureTask.java:266) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > java.util.concurrent.FutureTask.run(FutureTask.java:266) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > > > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > java.lang.Thread.run(Thread.java:748) > > > > As per my understanding, this error should not be coming with Hadoop > > 3.0.0. Can someone let me know if my understanding is correct or what > > could be going wrong here? -- Sean
Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
I understood the "util.CommonFSUtils: FileSystem doesn't support setStoragePolicy;" part. Can you let me know why it is saying "java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20 06:02:24,859 WARN [StoreOpener-1588230740-1]" ? On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031...@qq.com> wrote: > This log info just as a warning that cant make it disappear for now, but > will not impact anything, so you can just ignore it in local mode. > > > --原始邮件-- > 发件人: > "user" > < > subharaj.ma...@gmail.com; > 发送时间:2020年7月21日(星期二) 晚上9:19 > 收件人:"Hbase-User" > 主题:Re: HBase 2.1.0 - NoSuchMethodException > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > Thanks for replying. > > Yes it is a single node hbase cluster. I am not specifying any storage > policy. Looking at the HStore > < > https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274 > ; > code it appears even if no storage policy is specified it will take HOT. > > Can you explain this a bit more how can I get around this error or in a > single node hbase cluster I should be ignoring this? > > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang <18031...@qq.com wrote: > > LocalFileSystem? Thenbsp;setStoragePolicy could only be used in > distributed hdfs. > nbsp; > > > --nbsp;原始邮件nbsp;-- > 发件人: > > "user" > > < > subharaj.ma...@gmail.comgt;; > 发送时间:nbsp;2020年7月21日(星期二) 下午5:58 > 收件人:nbsp;"Hbase-User" > 主题:nbsp;HBase 2.1.0 - NoSuchMethodException > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > Hi > > I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase master logs I am > seeing a warning like below > > 2020-07-20 06:02:24,859 WARNnbsp; [StoreOpener-1588230740-1] > util.CommonFSUtils: FileSystem doesn't support setStoragePolicy; > HDFS-6584, HDFS-9345 not available. This is normal and expected on > earlier Hadoop versions. > java.lang.NoSuchMethodException: > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, > java.lang.String) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > java.lang.Class.getDeclaredMethod(Class.java:2130) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:526) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:194) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.regionserver.HStore. > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5731) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1059) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1056) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > java.util.concurrent.FutureTask.run(FutureTask.java:266) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > java.util.concurrent.FutureTask.run(FutureTask.java:266) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > > nbsp;nbsp;nbsp;nbsp;nbsp;nbsp;nbsp; at > java.lang.Thread.run(Thread.java:748) > > As per my understanding, this error should not be coming with Hadoop > 3.0.0. Can someone let me know if my understanding is correct or what > could be going wrong here?
?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
This log info just as a warning that cant make it disappear for now, but will not impact anything, so you can just ignore it in local mode. ---- ??: "user" https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274; code it appears even if no storage policy is specified it will take HOT. Can you explain this a bit more how can I get around this error or in a single node hbase cluster I should be ignoring this? On Tue, Jul 21, 2020 at 3:03 PM zheng wang <18031...@qq.com wrote: LocalFileSystem? Thenbsp;setStoragePolicy could only be used in distributed hdfs. nbsp; --nbsp;nbsp;-- ??: "user" < subharaj.ma...@gmail.comgt;; :nbsp;2020??7??21??(??) 5:58 ??:nbsp;"Hbase-User"
Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Thanks for replying. Yes it is a single node hbase cluster. I am not specifying any storage policy. Looking at the HStore <https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274> code it appears even if no storage policy is specified it will take HOT. Can you explain this a bit more how can I get around this error or in a single node hbase cluster I should be ignoring this? On Tue, Jul 21, 2020 at 3:03 PM zheng wang <18031...@qq.com> wrote: > LocalFileSystem? ThesetStoragePolicy could only be used in > distributed hdfs. > > > > --原始邮件-- > 发件人: > "user" > < > subharaj.ma...@gmail.com; > 发送时间:2020年7月21日(星期二) 下午5:58 > 收件人:"Hbase-User" > 主题:HBase 2.1.0 - NoSuchMethodException > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy > > > > Hi > > I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase master logs I am > seeing a warning like below > > 2020-07-20 06:02:24,859 WARN [StoreOpener-1588230740-1] > util.CommonFSUtils: FileSystem doesn't support setStoragePolicy; > HDFS-6584, HDFS-9345 not available. This is normal and expected on > earlier Hadoop versions. > java.lang.NoSuchMethodException: > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, > java.lang.String) > at > java.lang.Class.getDeclaredMethod(Class.java:2130) > at > org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577) > at > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558) > at > org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:526) > at > org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:194) > at > org.apache.hadoop.hbase.regionserver.HStore. at > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5731) > at > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1059) > at > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1056) > at > java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at > java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at > java.lang.Thread.run(Thread.java:748) > > As per my understanding, this error should not be coming with Hadoop > 3.0.0. Can someone let me know if my understanding is correct or what > could be going wrong here?
??????HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
LocalFileSystem? ThesetStoragePolicy could only be used in distributed hdfs. ---- ??: "user"
HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
Hi I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase master logs I am seeing a warning like below 2020-07-20 06:02:24,859 WARN [StoreOpener-1588230740-1] util.CommonFSUtils: FileSystem doesn't support setStoragePolicy; HDFS-6584, HDFS-9345 not available. This is normal and expected on earlier Hadoop versions. java.lang.NoSuchMethodException: org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path, java.lang.String) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.util.CommonFSUtils.invokeSetStoragePolicy(CommonFSUtils.java:577) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:558) at org.apache.hadoop.hbase.util.CommonFSUtils.setStoragePolicy(CommonFSUtils.java:526) at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.setStoragePolicy(HRegionFileSystem.java:194) at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:264) at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:5731) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1059) at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:1056) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) As per my understanding, this error should not be coming with Hadoop 3.0.0. Can someone let me know if my understanding is correct or what could be going wrong here?
