I tried to access http://pastebin.com/SJci7uQM (from your first email) but looks like the file has been removed.
Can you post the error on pastebin again ? Cheers On Wed, May 20, 2015 at 9:38 PM, donmai <dood...@gmail.com> wrote: > Hi Ted - would you happen to have any insight as to what issues might cause > a positional read failure for an HFile? Running the HFile tool seems to > have normal output. > > On Wed, May 13, 2015 at 12:40 PM, donmai <dood...@gmail.com> wrote: > > > Ahhh, thanks for that. Yep, all flushes will (or should be) going to S3. > > I'm working through it and it seems that it's defaulting to the > positional > > read instead of seek+read - is this accurate? > > > > On Tue, May 12, 2015 at 12:00 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > >> -w is shorthand for --seekToRow (so it is not offset): > >> > >> -w,--seekToRow <arg> Seek to this row and print all the kvs for > this > >> row only > >> > >> Do you store all your data on s3 ? > >> > >> Cheers > >> > >> On Tue, May 12, 2015 at 8:50 AM, donmai <dood...@gmail.com> wrote: > >> > >> > Actually, looking deeper into it, things don't seem to be making > sense. > >> > > >> > The error message is this: Caused by: java.io.IOException: Positional > >> read > >> > of 65723 bytes failed at offset 394218 (returned 16384) > >> > > >> > As such, I try to do a read for 65723 bytes using the tool to see if > it > >> > fails at that offset: > >> > > >> > hbase org.apache.hadoop.hbase.io.hfile.HFile -w 65723 -f > >> > > >> > > >> > s3://hbase/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0 > >> > > >> > This results in no output other than: > >> > > >> > INFO [main] s3n.S3NativeFileSystem: Stream for key > >> > > >> > > >> > 'bleh2/data/default/usertable/5cce51bd0bcc8f7507c7e594b73d2d15/family/ec3d1516dba0447e875d489f3ad8bdc0' > >> > seeking to position '1693329' > >> > > >> > Am I using the HFIle command correctly? > >> > > >> > On Tue, May 12, 2015 at 11:09 AM, donmai <dood...@gmail.com> wrote: > >> > > >> > > Thanks Ted, this actually helped me out alot! I'm running 0.98.6 and > >> was > >> > > able to determine that the HFiles are perfectly okay and can be > >> scanned > >> > > through without issue - it looks like there's something else going > on, > >> > > since after a compaction everything works... > >> > > > >> > > On Tue, May 12, 2015 at 9:55 AM, Ted Yu <yuzhih...@gmail.com> > wrote: > >> > > > >> > >> What release of hbase are you using ? > >> > >> > >> > >> Please read http://hbase.apache.org/book.html#hfile where you can > >> find > >> > >> description about HFile tool. This tool would allow you to > >> investigate > >> > >> given HFile. > >> > >> > >> > >> Cheers > >> > >> > >> > >> On Tue, May 12, 2015 at 6:02 AM, donmai <dood...@gmail.com> wrote: > >> > >> > >> > >> > Hi, > >> > >> > > >> > >> > I'm getting this error when trying to read from HFiles: > >> > >> > > >> > >> > http://pastebin.com/SJci7uQM > >> > >> > > >> > >> > Any idea what's going on here? > >> > >> > > >> > >> > Thanks! > >> > >> > > >> > >> > >> > > > >> > > > >> > > >> > > > > >
