date:20200722

Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

2020-07-22 Thread Debraj Manna

Thanks all my doubts are resolved now.

On Wed, Jul 22, 2020 at 4:46 PM zheng wang <18031...@qq.com> wrote:

> And getMethod does.
>
>
>
>
> -- 原始邮件 --
> 发件人:
>   "user"
> <
> subharaj.ma...@gmail.com>;
> 发送时间: 2020年7月22日(星期三) 晚上6:44
> 收件人: "Hbase-User"
> 主题: Re: HBase 2.1.0 - NoSuchMethodException
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
>
>
>
> Yes I am using hadoop 3.0.0.
>
> On Wed, Jul 22, 2020 at 12:31 PM zheng wang <18031...@qq.com> wrote:
>
> > Are you sure you are using hadoop3.0.0?
> >
> >
> >
> >
> > -- 原始邮件 --
> > 发件人:
> >  
> "user"
> >
> <
> > subharaj.ma...@gmail.com>;
> > 发送时间: 2020年7月22日(星期三) 凌晨3:17
> > 收件人: "Hbase-User" >
> > 主题: Re: HBase 2.1.0 - NoSuchMethodException
> > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> >
> >
> >
> > Thanks for the pointer.
> >
> > One more query in I am getting this error from CommonFSUtils.
> > invokeSetStoragePolicy()
> > <
> >
> https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>
> >
> >;
> ;.
> > I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem
> > extends from) I do see the method  setStoragePolicy
> > <
> >
> https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637>
> >
> >;
> ;
> > .
> >
> > Can someone explain how is this NoSuchMethodException is being thrown
> or I
> > am looking at the wrong code path for LocalFileSystem?
> >
> > On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey  wrote:
> >
> > > that is the detail message of why it determined that the
> FileSystem
> > > doesn't support setStoragePolicy. As opposed to e.g. a
> security
> > > manager denying access to introspect the methods available.
> > >
> > > On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna <
> > subharaj.ma...@gmail.com>
> > > wrote:
> > > >
> > > > I understood the "util.CommonFSUtils: FileSystem
> doesn't support
> > > > setStoragePolicy;" part.
> > > >
> > > > Can you let me know why it is saying
> > "java.lang.NoSuchMethodException:
> > > >
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20
> > > > 06:02:24,859 WARN 
> [StoreOpener-1588230740-1]" ?
> > > >
> > > >
> > > > On Tue, Jul 21, 2020 at 6:43 PM zheng wang <
> 18031...@qq.com>
> > wrote:
> > > >
> > > > > This log info just as a warning that cant
> make it disappear
> > for now,
> > > but
> > > > > will not impact anything, so you can just
> ignore it in
> > local mode.
> > > > >
> > > > >
> > > > >
> --&nbsp;原始邮件&nbsp;--
> > > > > 发件人:
> > > >
> >
> >                                                  
> > "user"
> > > >
> >
> >                                                                
> > <
> > > > > subharaj.ma...@gmail.com&gt;;
> > > > > 发送时间:&nbsp;2020年7月21日(星期二) 晚上9:19
> > > > > 收件人:&nbsp;"Hbase-User"<
> user@hbase.apache.org&gt;;
> > > > >
> > > > > 主题:&nbsp;Re: HBase 2.1.0 -
> NoSuchMethodException
> > > > >
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > > > >
> > > > >
> > > > >
> > > > > Thanks for replying.
> > > > >
> > > > > Yes it is a single node hbase cluster. I
> am not specifying
> > any storage
> > > > > policy. Looking at the HStore
> > > > > <
> > > > >
> > >
> >
> https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274&gt
> >
>

?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

2020-07-22 Thread zheng wang

And getMethod does.




--  --
??: 
   "user"   
 
https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>
> ;.
> I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem
> extends from) I do see the method  setStoragePolicy
> <
> 
https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637>
> ;
> .
>
> Can someone explain how is this NoSuchMethodException is being thrown or I
> am looking at the wrong code path for LocalFileSystem?
>
> On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274&gt
> >
> 
;;
> > > ;
> > > > code it appears even if no storage policy is 
specified it
> will take
> > HOT.
> > > >
> > > > Can you explain this a bit more how can I get 
around this
> error or in a
> > > > single node hbase cluster I should be ignoring 
this?
> > > >
> > > >
> > > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang 
<18031...@qq.com&gt;
> wrote:
> > > >
> > > > &gt; LocalFileSystem? 
The&amp;nbsp;setStoragePolicy
> could only be used
> > in
> > > > &gt; distributed hdfs.
> > > > &gt; &amp;nbsp;
> > > > &gt;
> > > > &gt;
> > > > &gt;
> 
--&amp;nbsp;&amp;nbsp;--
> > > > &gt; ??:
> > > >
> >
> 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > > > "user"
> > > >
> >
> 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > > > <
> > > > &gt; 
subharaj.ma...@gmail.com&amp;gt;;
> > > > &gt; 
:&amp;nbsp;2020??7??21??(??) 5:58
> > > > &gt; 
??:&amp;nbsp;"Hbase-User"<
> user@hbase.apache.org&amp;gt;;
> > > > &gt;
> > > > &gt; :&amp;nbsp;HBase 2.1.0 
-
> NoSuchMethodException
> > > > &gt;
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > > > &gt;
> > > > &gt;
> > > > &gt;
> > > > &gt; Hi
> > > > &gt;
> > > > &gt; I am using HBase 2.1.0 with Hadoop 
3.0.0. In hbase
> master logs I
> > am
> > > > &gt; seeing a warning like below
> > > > &gt;
> > > > &gt; 2020-07-20 06:02:24,859 
WARN&amp;nbsp;
> [StoreOpener-1588230740-1]
> > > > &gt; util.CommonFSUtils: FileSystem 
doesn't support
> setStoragePolicy;
> > > > &gt; HDFS-6584, HDFS-9345 not 
available. This is normal
> and expected on
> > > > &gt; earlier Hadoop versions.
> > > > &gt; java.lang.NoSuchMethodException:
> > > > &gt;
> > > > &gt;
> > > >
> >
> 
org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path,
> > > > &gt; java.lang.String)
> > > > &gt;
> > > >
> 
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> > at
> > > > &gt; 
java.lang.Class.getDeclaredMethod(Class.java:2130)
> > > > &gt;
> > > >
> 
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&am

?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

2020-07-22 Thread zheng wang

Seems getDeclaredMethod does not include the methods that extends from 
parent.




--  --
??: 
   "user"   
 
https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>
> ;.
> I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem
> extends from) I do see the method  setStoragePolicy
> <
> 
https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637>
> ;
> .
>
> Can someone explain how is this NoSuchMethodException is being thrown or I
> am looking at the wrong code path for LocalFileSystem?
>
> On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274&gt
> >
> 
;;
> > > ;
> > > > code it appears even if no storage policy is 
specified it
> will take
> > HOT.
> > > >
> > > > Can you explain this a bit more how can I get 
around this
> error or in a
> > > > single node hbase cluster I should be ignoring 
this?
> > > >
> > > >
> > > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang 
<18031...@qq.com&gt;
> wrote:
> > > >
> > > > &gt; LocalFileSystem? 
The&amp;nbsp;setStoragePolicy
> could only be used
> > in
> > > > &gt; distributed hdfs.
> > > > &gt; &amp;nbsp;
> > > > &gt;
> > > > &gt;
> > > > &gt;
> 
--&amp;nbsp;&amp;nbsp;--
> > > > &gt; ??:
> > > >
> >
> 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > > > "user"
> > > >
> >
> 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> > > > <
> > > > &gt; 
subharaj.ma...@gmail.com&amp;gt;;
> > > > &gt; 
:&amp;nbsp;2020??7??21??(??) 5:58
> > > > &gt; 
??:&amp;nbsp;"Hbase-User"<
> user@hbase.apache.org&amp;gt;;
> > > > &gt;
> > > > &gt; :&amp;nbsp;HBase 2.1.0 
-
> NoSuchMethodException
> > > > &gt;
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > > > &gt;
> > > > &gt;
> > > > &gt;
> > > > &gt; Hi
> > > > &gt;
> > > > &gt; I am using HBase 2.1.0 with Hadoop 
3.0.0. In hbase
> master logs I
> > am
> > > > &gt; seeing a warning like below
> > > > &gt;
> > > > &gt; 2020-07-20 06:02:24,859 
WARN&amp;nbsp;
> [StoreOpener-1588230740-1]
> > > > &gt; util.CommonFSUtils: FileSystem 
doesn't support
> setStoragePolicy;
> > > > &gt; HDFS-6584, HDFS-9345 not 
available. This is normal
> and expected on
> > > > &gt; earlier Hadoop versions.
> > > > &gt; java.lang.NoSuchMethodException:
> > > > &gt;
> > > > &gt;
> > > >
> >
> 
org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy(org.apache.hadoop.fs.Path,
> > > > &gt; java.lang.String)
> > > > &gt;
> > > >
> 
&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;
> > at
> > > > &gt; 
java.lang.Class.getDeclaredMethod(Class.java:2130)
> > > > &gt;
> > > >
> 
&amp;nbsp;&amp;nbsp;&am

Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

2020-07-22 Thread Debraj Manna

Yes I am using hadoop 3.0.0.

On Wed, Jul 22, 2020 at 12:31 PM zheng wang <18031...@qq.com> wrote:

> Are you sure you are using hadoop3.0.0?
>
>
>
>
> -- 原始邮件 --
> 发件人:
>   "user"
> <
> subharaj.ma...@gmail.com>;
> 发送时间: 2020年7月22日(星期三) 凌晨3:17
> 收件人: "Hbase-User"
> 主题: Re: HBase 2.1.0 - NoSuchMethodException
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
>
>
>
> Thanks for the pointer.
>
> One more query in I am getting this error from CommonFSUtils.
> invokeSetStoragePolicy()
> <
> https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>
> ;.
> I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem
> extends from) I do see the method  setStoragePolicy
> <
> https://github.com/apache/hadoop/blob/release-3.0.0-RC1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FilterFileSystem.java#L637>
> ;
> .
>
> Can someone explain how is this NoSuchMethodException is being thrown or I
> am looking at the wrong code path for LocalFileSystem?
>
> On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey 
> > that is the detail message of why it determined that the FileSystem
> > doesn't support setStoragePolicy. As opposed to e.g. a security
> > manager denying access to introspect the methods available.
> >
> > On Tue, Jul 21, 2020 at 8:24 AM Debraj Manna <
> subharaj.ma...@gmail.com>
> > wrote:
> > >
> > > I understood the "util.CommonFSUtils: FileSystem doesn't support
> > > setStoragePolicy;" part.
> > >
> > > Can you let me know why it is saying
> "java.lang.NoSuchMethodException:
> > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy2020-07-20
> > > 06:02:24,859 WARN  [StoreOpener-1588230740-1]" ?
> > >
> > >
> > > On Tue, Jul 21, 2020 at 6:43 PM zheng wang <18031...@qq.com>
> wrote:
> > >
> > > > This log info just as a warning that cant make it disappear
> for now,
> > but
> > > > will not impact anything, so you can just ignore it in
> local mode.
> > > >
> > > >
> > > > -- 原始邮件 --
> > > > 发件人:
> > >
> >  
> "user"
> > >
> >
> <
> > > > subharaj.ma...@gmail.com>;
> > > > 发送时间: 2020年7月21日(星期二) 晚上9:19
> > > > 收件人: "Hbase-User" > > >
> > > > 主题: Re: HBase 2.1.0 - NoSuchMethodException
> > > > org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > > >
> > > >
> > > >
> > > > Thanks for replying.
> > > >
> > > > Yes it is a single node hbase cluster. I am not specifying
> any storage
> > > > policy. Looking at the HStore
> > > > <
> > > >
> >
> https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274>
> >
> >;
> > > ;
> > > > code it appears even if no storage policy is specified it
> will take
> > HOT.
> > > >
> > > > Can you explain this a bit more how can I get around this
> error or in a
> > > > single node hbase cluster I should be ignoring this?
> > > >
> > > >
> > > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang 
> <18031...@qq.com>
> wrote:
> > > >
> > > > > LocalFileSystem? The&nbsp;setStoragePolicy
> could only be used
> > in
> > > > > distributed hdfs.
> > > > > &nbsp;
> > > > >
> > > > >
> > > > >
> --&nbsp;原始邮件&nbsp;--
> > > > > 发件人:
> > > >
> >
> >                                                  
> > > > "user"
> > > >
> >
> >                                                                
> > > > <
> > > > > subharaj.ma...@gmail.com&gt;;
> > > > > 发送时间:&nbsp;2020年7月21日(星期二) 下午5:58
> > > > > 收件人:&nbsp;"Hbase-User"<
> user@hbase.apache.org&gt;;
> > > > >
> > > > > 主题:&nbsp;HBase 2.1.0 -
> NoSuchMethodException
> > > > >
> org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy
> > > > >
> > > > >
> > > > >
> > > > > Hi
> > > > >
> > > > > I am using HBase 2.1.0 with Hadoop 3.0.0. In hbase
> master logs I
> > am
> > > > > seeing a warning like below
> > > > >
> > > > > 2020-07-20 06:02:24,8

?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

2020-07-22 Thread zheng wang

Are you sure you are using hadoop3.0.0?




--  --
??: 
   "user"   
 
https://github.com/apache/hbase/blob/branch-2.1/hbase-common/src/main/java/org/apache/hadoop/hbase/util/CommonFSUtils.java#L533>;.
I am using hadoop 3.0.0 and in FilterFileSystem (which LocalFileSystem
extends from) I do see the method  setStoragePolicy
;
.

Can someone explain how is this NoSuchMethodException is being thrown or I
am looking at the wrong code path for LocalFileSystem?

On Tue, Jul 21, 2020 at 7:04 PM Sean Busbey https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java#L274>
> > > ;
> > > code it appears even if no storage policy is specified it will 
take
> HOT.
> > >
> > > Can you explain this a bit more how can I get around this error 
or in a
> > > single node hbase cluster I should be ignoring this?
> > >
> > >
> > > On Tue, Jul 21, 2020 at 3:03 PM zheng wang 
<18031...@qq.com> wrote:
> > >
> > > > LocalFileSystem? The&nbsp;setStoragePolicy 
could only be used
> in
> > > > distributed hdfs.
> > > > &nbsp;
> > > >
> > > >
> > > > 
--&nbsp;&nbsp;--
> > > > ??:
> > >
> 
>                                                  
> > > "user"
> > >
> 
>                                                                
> > > <
> > > > subharaj.ma...@gmail.com&gt;;
> > > > :&nbsp;2020??7??21??(??) 5:58
> > > > 
??:&nbsp;"Hbase-User"

Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

Re: HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

?????? HBase 2.1.0 - NoSuchMethodException org.apache.hadoop.fs.LocalFileSystem.setStoragePolicy

5 matches

Site Navigation

Mail list logo

Footer information