Re: readAtOffset error when reading from HFiles
s3:// and s3n:// are different things. Given the structure of your S3 key, I think you should be using s3n. For reference, http://wiki.apache.org/hadoop/AmazonS3
Re: readAtOffset error when reading from HFiles
I tried to access http://pastebin.com/SJci7uQM (from your first email) but looks like the file has been removed. Can you post the error on pastebin again ? Cheers On Wed, May 20, 2015 at 9:38 PM, donmai wrote: > Hi Ted - would you happen to have any insight as to what issues might cause > a positional read failure for an HFile? Running the HFile tool seems to > have normal output. > > On Wed, May 13, 2015 at 12:40 PM, donmai wrote: > > > Ahhh, thanks for that. Yep, all flushes will (or should be) going to S3. > > I'm working through it and it seems that it's defaulting to the > positional > > read instead of seek+read - is this accurate? > > > > On Tue, May 12, 2015 at 12:00 PM, Ted Yu wrote: > > > >> -w is shorthand for --seekToRow (so it is not offset): > >> > >> -w,--seekToRow Seek to this row and print all the kvs for > this > >> row only > >> > >> Do you store all your data on s3 ? > >> > >> Cheers > >> > >> On Tue, May 12, 2015 at 8:50 AM, donmai wrote: > >> > >> > Actually, looking deeper into it, things don't seem to be making > sense. > >> > > >> > The error message is this: Caused by: java.io.IOException: Positional > >> read > >> > of 65723 bytes failed at offset 394218 (returned 16384) > >> > > >> > As such, I try to do a read for 65723 bytes using the tool to see if > it > >> > fails at that offset: > >> > > >> > hbase org.apache.hadoop.hbase.io.hfile.HFile -w 65723 -f > >> > > >> > > >> > s3://hbase/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0 > >> > > >> > This results in no output other than: > >> > > >> > INFO [main] s3n.S3NativeFileSystem: Stream for key > >> > > >> > > >> > 'bleh2/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0' > >> > seeking to position '1693329' > >> > > >> > Am I using the HFIle command correctly? > >> > > >> > On Tue, May 12, 2015 at 11:09 AM, donmai wrote: > >> > > >> > > Thanks Ted, this actually helped me out alot! I'm running 0.98.6 and > >> was > >> > > able to determine that the HFiles are perfectly okay and can be > >> scanned > >> > > through without issue - it looks like there's something else going > on, > >> > > since after a compaction everything works... > >> > > > >> > > On Tue, May 12, 2015 at 9:55 AM, Ted Yu > wrote: > >> > > > >> > >> What release of hbase are you using ? > >> > >> > >> > >> Please read http://hbase.apache.org/book.html#hfile where you can > >> find > >> > >> description about HFile tool. This tool would allow you to > >> investigate > >> > >> given HFile. > >> > >> > >> > >> Cheers > >> > >> > >> > >> On Tue, May 12, 2015 at 6:02 AM, donmai wrote: > >> > >> > >> > >> > Hi, > >> > >> > > >> > >> > I'm getting this error when trying to read from HFiles: > >> > >> > > >> > >> > http://pastebin.com/SJci7uQM > >> > >> > > >> > >> > Any idea what's going on here? > >> > >> > > >> > >> > Thanks! > >> > >> > > >> > >> > >> > > > >> > > > >> > > >> > > > > >
Re: readAtOffset error when reading from HFiles
Hi Ted - would you happen to have any insight as to what issues might cause a positional read failure for an HFile? Running the HFile tool seems to have normal output. On Wed, May 13, 2015 at 12:40 PM, donmai wrote: > Ahhh, thanks for that. Yep, all flushes will (or should be) going to S3. > I'm working through it and it seems that it's defaulting to the positional > read instead of seek+read - is this accurate? > > On Tue, May 12, 2015 at 12:00 PM, Ted Yu wrote: > >> -w is shorthand for --seekToRow (so it is not offset): >> >> -w,--seekToRow Seek to this row and print all the kvs for this >> row only >> >> Do you store all your data on s3 ? >> >> Cheers >> >> On Tue, May 12, 2015 at 8:50 AM, donmai wrote: >> >> > Actually, looking deeper into it, things don't seem to be making sense. >> > >> > The error message is this: Caused by: java.io.IOException: Positional >> read >> > of 65723 bytes failed at offset 394218 (returned 16384) >> > >> > As such, I try to do a read for 65723 bytes using the tool to see if it >> > fails at that offset: >> > >> > hbase org.apache.hadoop.hbase.io.hfile.HFile -w 65723 -f >> > >> > >> s3://hbase/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0 >> > >> > This results in no output other than: >> > >> > INFO [main] s3n.S3NativeFileSystem: Stream for key >> > >> > >> 'bleh2/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0' >> > seeking to position '1693329' >> > >> > Am I using the HFIle command correctly? >> > >> > On Tue, May 12, 2015 at 11:09 AM, donmai wrote: >> > >> > > Thanks Ted, this actually helped me out alot! I'm running 0.98.6 and >> was >> > > able to determine that the HFiles are perfectly okay and can be >> scanned >> > > through without issue - it looks like there's something else going on, >> > > since after a compaction everything works... >> > > >> > > On Tue, May 12, 2015 at 9:55 AM, Ted Yu wrote: >> > > >> > >> What release of hbase are you using ? >> > >> >> > >> Please read http://hbase.apache.org/book.html#hfile where you can >> find >> > >> description about HFile tool. This tool would allow you to >> investigate >> > >> given HFile. >> > >> >> > >> Cheers >> > >> >> > >> On Tue, May 12, 2015 at 6:02 AM, donmai wrote: >> > >> >> > >> > Hi, >> > >> > >> > >> > I'm getting this error when trying to read from HFiles: >> > >> > >> > >> > http://pastebin.com/SJci7uQM >> > >> > >> > >> > Any idea what's going on here? >> > >> > >> > >> > Thanks! >> > >> > >> > >> >> > > >> > > >> > >> > >
Re: readAtOffset error when reading from HFiles
Ahhh, thanks for that. Yep, all flushes will (or should be) going to S3. I'm working through it and it seems that it's defaulting to the positional read instead of seek+read - is this accurate? On Tue, May 12, 2015 at 12:00 PM, Ted Yu wrote: > -w is shorthand for --seekToRow (so it is not offset): > > -w,--seekToRow Seek to this row and print all the kvs for this > row only > > Do you store all your data on s3 ? > > Cheers > > On Tue, May 12, 2015 at 8:50 AM, donmai wrote: > > > Actually, looking deeper into it, things don't seem to be making sense. > > > > The error message is this: Caused by: java.io.IOException: Positional > read > > of 65723 bytes failed at offset 394218 (returned 16384) > > > > As such, I try to do a read for 65723 bytes using the tool to see if it > > fails at that offset: > > > > hbase org.apache.hadoop.hbase.io.hfile.HFile -w 65723 -f > > > > > s3://hbase/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0 > > > > This results in no output other than: > > > > INFO [main] s3n.S3NativeFileSystem: Stream for key > > > > > 'bleh2/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0' > > seeking to position '1693329' > > > > Am I using the HFIle command correctly? > > > > On Tue, May 12, 2015 at 11:09 AM, donmai wrote: > > > > > Thanks Ted, this actually helped me out alot! I'm running 0.98.6 and > was > > > able to determine that the HFiles are perfectly okay and can be scanned > > > through without issue - it looks like there's something else going on, > > > since after a compaction everything works... > > > > > > On Tue, May 12, 2015 at 9:55 AM, Ted Yu wrote: > > > > > >> What release of hbase are you using ? > > >> > > >> Please read http://hbase.apache.org/book.html#hfile where you can > find > > >> description about HFile tool. This tool would allow you to investigate > > >> given HFile. > > >> > > >> Cheers > > >> > > >> On Tue, May 12, 2015 at 6:02 AM, donmai wrote: > > >> > > >> > Hi, > > >> > > > >> > I'm getting this error when trying to read from HFiles: > > >> > > > >> > http://pastebin.com/SJci7uQM > > >> > > > >> > Any idea what's going on here? > > >> > > > >> > Thanks! > > >> > > > >> > > > > > > > > >
Re: readAtOffset error when reading from HFiles
-w is shorthand for --seekToRow (so it is not offset): -w,--seekToRow Seek to this row and print all the kvs for this row only Do you store all your data on s3 ? Cheers On Tue, May 12, 2015 at 8:50 AM, donmai wrote: > Actually, looking deeper into it, things don't seem to be making sense. > > The error message is this: Caused by: java.io.IOException: Positional read > of 65723 bytes failed at offset 394218 (returned 16384) > > As such, I try to do a read for 65723 bytes using the tool to see if it > fails at that offset: > > hbase org.apache.hadoop.hbase.io.hfile.HFile -w 65723 -f > > s3://hbase/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0 > > This results in no output other than: > > INFO [main] s3n.S3NativeFileSystem: Stream for key > > 'bleh2/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0' > seeking to position '1693329' > > Am I using the HFIle command correctly? > > On Tue, May 12, 2015 at 11:09 AM, donmai wrote: > > > Thanks Ted, this actually helped me out alot! I'm running 0.98.6 and was > > able to determine that the HFiles are perfectly okay and can be scanned > > through without issue - it looks like there's something else going on, > > since after a compaction everything works... > > > > On Tue, May 12, 2015 at 9:55 AM, Ted Yu wrote: > > > >> What release of hbase are you using ? > >> > >> Please read http://hbase.apache.org/book.html#hfile where you can find > >> description about HFile tool. This tool would allow you to investigate > >> given HFile. > >> > >> Cheers > >> > >> On Tue, May 12, 2015 at 6:02 AM, donmai wrote: > >> > >> > Hi, > >> > > >> > I'm getting this error when trying to read from HFiles: > >> > > >> > http://pastebin.com/SJci7uQM > >> > > >> > Any idea what's going on here? > >> > > >> > Thanks! > >> > > >> > > > > >
Re: readAtOffset error when reading from HFiles
Actually, looking deeper into it, things don't seem to be making sense. The error message is this: Caused by: java.io.IOException: Positional read of 65723 bytes failed at offset 394218 (returned 16384) As such, I try to do a read for 65723 bytes using the tool to see if it fails at that offset: hbase org.apache.hadoop.hbase.io.hfile.HFile -w 65723 -f s3://hbase/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0 This results in no output other than: INFO [main] s3n.S3NativeFileSystem: Stream for key 'bleh2/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0' seeking to position '1693329' Am I using the HFIle command correctly? On Tue, May 12, 2015 at 11:09 AM, donmai wrote: > Thanks Ted, this actually helped me out alot! I'm running 0.98.6 and was > able to determine that the HFiles are perfectly okay and can be scanned > through without issue - it looks like there's something else going on, > since after a compaction everything works... > > On Tue, May 12, 2015 at 9:55 AM, Ted Yu wrote: > >> What release of hbase are you using ? >> >> Please read http://hbase.apache.org/book.html#hfile where you can find >> description about HFile tool. This tool would allow you to investigate >> given HFile. >> >> Cheers >> >> On Tue, May 12, 2015 at 6:02 AM, donmai wrote: >> >> > Hi, >> > >> > I'm getting this error when trying to read from HFiles: >> > >> > http://pastebin.com/SJci7uQM >> > >> > Any idea what's going on here? >> > >> > Thanks! >> > >> > >
Re: readAtOffset error when reading from HFiles
Thanks Ted, this actually helped me out alot! I'm running 0.98.6 and was able to determine that the HFiles are perfectly okay and can be scanned through without issue - it looks like there's something else going on, since after a compaction everything works... On Tue, May 12, 2015 at 9:55 AM, Ted Yu wrote: > What release of hbase are you using ? > > Please read http://hbase.apache.org/book.html#hfile where you can find > description about HFile tool. This tool would allow you to investigate > given HFile. > > Cheers > > On Tue, May 12, 2015 at 6:02 AM, donmai wrote: > > > Hi, > > > > I'm getting this error when trying to read from HFiles: > > > > http://pastebin.com/SJci7uQM > > > > Any idea what's going on here? > > > > Thanks! > > >
Re: readAtOffset error when reading from HFiles
Thanks for the help! I am getting 'okay' for everything. I am using S3 for the store, do you think it could be an issue with how S3 is reading the files? On Tue, May 12, 2015 at 9:45 AM, Talat Uyarer wrote: > Hi Donmai, > > Seems to be something wrong with this file. Can you try to reach the > HFile ? Try to check cluster with hbck tool > (http://hbase.apache.org/book.html#hbck), use -details flag to see the > errors. > > > 2015-05-12 16:02 GMT+03:00 donmai : > > Hi, > > > > I'm getting this error when trying to read from HFiles: > > > > http://pastebin.com/SJci7uQM > > > > Any idea what's going on here? > > > > Thanks! > > > > -- > Talat UYARER > Websitesi: http://talat.uyarer.com > Twitter: http://twitter.com/talatuyarer > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304 >
Re: readAtOffset error when reading from HFiles
What release of hbase are you using ? Please read http://hbase.apache.org/book.html#hfile where you can find description about HFile tool. This tool would allow you to investigate given HFile. Cheers On Tue, May 12, 2015 at 6:02 AM, donmai wrote: > Hi, > > I'm getting this error when trying to read from HFiles: > > http://pastebin.com/SJci7uQM > > Any idea what's going on here? > > Thanks! >
Re: readAtOffset error when reading from HFiles
Hi Donmai, Seems to be something wrong with this file. Can you try to reach the HFile ? Try to check cluster with hbck tool (http://hbase.apache.org/book.html#hbck), use -details flag to see the errors. 2015-05-12 16:02 GMT+03:00 donmai : > Hi, > > I'm getting this error when trying to read from HFiles: > > http://pastebin.com/SJci7uQM > > Any idea what's going on here? > > Thanks! -- Talat UYARER Websitesi: http://talat.uyarer.com Twitter: http://twitter.com/talatuyarer Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
readAtOffset error when reading from HFiles
Hi, I'm getting this error when trying to read from HFiles: http://pastebin.com/SJci7uQM Any idea what's going on here? Thanks!
