Re: small hbase doubt
I ment to ask if this type of compression is supported over RPC calls in 0.95? On Saturday, July 13, 2013, Ted Yu wrote: bq. Do you think prefix compression can also be utilized here? In your use case, prefix compression would help in reducing bandwidth consumption. On Thu, Jul 11, 2013 at 9:11 PM, Asaf Mesika asaf.mes...@gmail.comjavascript:; wrote: Do you think prefix compression can also be utilized here? In our use case we sent a list of Put of counters in which the key is quite long and the keys are quite similar to one another. This can save bandwidth. On Friday, July 12, 2013, Ted Yu wrote: Right. Take a look at http://hbase.apache.org/book.html#d2617e13654 and section J.4.3.2 On Thu, Jul 11, 2013 at 9:01 PM, Asaf Mesika asaf.mes...@gmail.comjavascript:; javascript:; wrote: I thought that in 0.95 ProtoBuf provides RPC compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org javascript:; javascript:; javascript:; wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com javascript:; javascript:;javascript:; Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks -- Sent from Gmail Mobile
Re: small hbase doubt
Not yet, to my knowledge. On Sat, Jul 13, 2013 at 10:57 AM, Asaf Mesika asaf.mes...@gmail.com wrote: I ment to ask if this type of compression is supported over RPC calls in 0.95? On Saturday, July 13, 2013, Ted Yu wrote: bq. Do you think prefix compression can also be utilized here? In your use case, prefix compression would help in reducing bandwidth consumption. On Thu, Jul 11, 2013 at 9:11 PM, Asaf Mesika asaf.mes...@gmail.com javascript:; wrote: Do you think prefix compression can also be utilized here? In our use case we sent a list of Put of counters in which the key is quite long and the keys are quite similar to one another. This can save bandwidth. On Friday, July 12, 2013, Ted Yu wrote: Right. Take a look at http://hbase.apache.org/book.html#d2617e13654 and section J.4.3.2 On Thu, Jul 11, 2013 at 9:01 PM, Asaf Mesika asaf.mes...@gmail.com javascript:; javascript:; wrote: I thought that in 0.95 ProtoBuf provides RPC compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org javascript:; javascript:; javascript:; wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com javascript:; javascript:;javascript:; Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks -- Sent from Gmail Mobile
Re: small hbase doubt
bq. Do you think prefix compression can also be utilized here? In your use case, prefix compression would help in reducing bandwidth consumption. On Thu, Jul 11, 2013 at 9:11 PM, Asaf Mesika asaf.mes...@gmail.com wrote: Do you think prefix compression can also be utilized here? In our use case we sent a list of Put of counters in which the key is quite long and the keys are quite similar to one another. This can save bandwidth. On Friday, July 12, 2013, Ted Yu wrote: Right. Take a look at http://hbase.apache.org/book.html#d2617e13654 and section J.4.3.2 On Thu, Jul 11, 2013 at 9:01 PM, Asaf Mesika asaf.mes...@gmail.com javascript:; wrote: I thought that in 0.95 ProtoBuf provides RPC compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org javascript:; javascript:; wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.comjavascript:;javascript:; Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks
Re: small hbase doubt
Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks
Re: small hbase doubt
Compression only applies to data on disk. Over the wire (I.E., RS to client) is uncompressed. On 7/11/13 9:24 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks
Re: small hbase doubt
To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks
Re: small hbase doubt
I thought that in 0.95 ProtoBuf provides RPC compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org javascript:; wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com javascript:; Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks
Re: small hbase doubt
Right. Take a look at http://hbase.apache.org/book.html#d2617e13654 and section J.4.3.2 On Thu, Jul 11, 2013 at 9:01 PM, Asaf Mesika asaf.mes...@gmail.com wrote: I thought that in 0.95 ProtoBuf provides RPC compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org javascript:; wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com javascript:; Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks
Re: small hbase doubt
Do you think prefix compression can also be utilized here? In our use case we sent a list of Put of counters in which the key is quite long and the keys are quite similar to one another. This can save bandwidth. On Friday, July 12, 2013, Ted Yu wrote: Right. Take a look at http://hbase.apache.org/book.html#d2617e13654 and section J.4.3.2 On Thu, Jul 11, 2013 at 9:01 PM, Asaf Mesika asaf.mes...@gmail.comjavascript:; wrote: I thought that in 0.95 ProtoBuf provides RPC compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org javascript:; javascript:; wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor alokma...@gmail.com javascript:;javascript:; Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks
