Re: persistence in Hbase

2013-01-14 Thread lars hofhansl
You are right. The software should not get a free pass only because the hardware might lose data, though. :) From: Otis Gospodnetic To: user@hbase.apache.org; lars hofhansl Sent: Monday, January 14, 2013 7:19 PM Subject: Re: persistence in Hbase Hi, Just

Re: persistence in Hbase

2013-01-14 Thread Mohit Anchlia
lose data. > > > > > > -- Lars > > > > > > > > - Original Message ----- > > From: anil gupta > > To: user@hbase.apache.org > > Cc: > > Sent: Thursday, January 10, 2013 2:38 PM > > Subject: Re: persistence in Hbase > >

Re: persistence in Hbase

2013-01-14 Thread Otis Gospodnetic
Lars > > > > - Original Message - > From: anil gupta > To: user@hbase.apache.org > Cc: > Sent: Thursday, January 10, 2013 2:38 PM > Subject: Re: persistence in Hbase > > Hi Mohammad, > > If the Write Ahead Log(WAL) is "turned on" then in **NO** case

Re: persistence in Hbase

2013-01-10 Thread shashwat shriparv
t; Data is not sync'ed to disk, but only distributed to all HDFS replicas. > >> During a power outage event across all HDFS failure zones (such as a > data > >> center) you can lose data. > >> > >> > >> -- Lars > >> > >> > >>

Re: persistence in Hbase

2013-01-10 Thread anil gupta
Lars >> >> >> >> - Original Message - >> From: anil gupta >> To: user@hbase.apache.org >> Cc: >> Sent: Thursday, January 10, 2013 2:38 PM >> Subject: Re: persistence in Hbase >> >> Hi Mohammad, >> >> If the Write

Re: persistence in Hbase

2013-01-10 Thread anil gupta
> center) you can lose data. > > > -- Lars > > > > - Original Message - > From: anil gupta > To: user@hbase.apache.org > Cc: > Sent: Thursday, January 10, 2013 2:38 PM > Subject: Re: persistence in Hbase > > Hi Mohammad, > > If the Write A

Re: persistence in Hbase

2013-01-10 Thread lars hofhansl
Sent: Thursday, January 10, 2013 2:38 PM Subject: Re: persistence in Hbase Hi Mohammad, If the Write Ahead Log(WAL) is "turned on" then in **NO** case data should be lost. HBase is strongly-consistent. If you know of any case when WAL is turned on and data is lost then IMO that's a C

Re: persistence in Hbase

2013-01-10 Thread lars hofhansl
Lars From: Panshul Gupta To: user@hbase.apache.org Sent: Thursday, January 10, 2013 7:18 AM Subject: persistence in Hbase Hello, I was wondering if it is possible that I have data stored in Hbase tables on my 10 node cluster. I switch off (power down) my cluster. W

Re: persistence in Hbase

2013-01-10 Thread Mohammad Tariq
Hello Anil, You are absolutely correct and I haven't faced any such situation till date. I think I have made a controversial statement via my reply :) Apologies for the mess. Thank you Warm Regards, Tariq https://mtariq.jux.com/ On Fri, Jan 11, 2013 at 4:08 AM, anil gupta wrote: > Hi M

Re: persistence in Hbase

2013-01-10 Thread anil gupta
Hi Mohammad, If the Write Ahead Log(WAL) is "turned on" then in **NO** case data should be lost. HBase is strongly-consistent. If you know of any case when WAL is turned on and data is lost then IMO that's a Critical bug in HBase. Thanks, Anil Gupta On Thu, Jan 10, 2013 at 7:37 AM, Mohit Anchlia

Re: persistence in Hbase

2013-01-10 Thread Mohit Anchlia
Data also gets written in WAL. See: http://hbase.apache.org/book/perf.writing.html On Thu, Jan 10, 2013 at 7:36 AM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > Yes definitely you will get back the data. > > Please read the HBase Book that explains things in detail. > http:/

Re: persistence in Hbase

2013-01-10 Thread ramkrishna vasudevan
Yes definitely you will get back the data. Please read the HBase Book that explains things in detail. http://hbase.apache.org/book.html. Regards Ram On Thu, Jan 10, 2013 at 8:48 PM, Panshul Gupta wrote: > Hello, > > I was wondering if it is possible that I have data stored in Hbase tables > o

Re: persistence in Hbase

2013-01-10 Thread Leonid Fedotov
Panshul, Of course you will have all your data in place. It stored in HDFS and remains in there after restarting. Thank you! Sincerely, Leonid Fedotov On Jan 10, 2013, at 7:18 AM, Panshul Gupta wrote: > Hello, > > I was wondering if it is possible that I have data stored in Hbase tables > on

Re: persistence in Hbase

2013-01-10 Thread Mohammad Tariq
Hello Pranshul, The data which you are pushing to the HBase doesn't go its final destination directly. When you start pushing the data, it first goes to an in-memory log file. Once the log files are considerably big, they are merged together and put in an in-memory store called as memstore.