bq. Do we have kind of native compression in PB? I don't think so.
On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Do we have kind of native compression in PB? Or not at all? Because if so, > it might be an issue. > > I run a 0.94 cluster with a mix of 32 and 64 with Snappy enabled. But never > tried 0.96 or more on it... > > 2014-09-15 18:36 GMT-04:00 Andrew Purtell <apurt...@apache.org>: > > > Only where we touch the native Hadoop libraries I think. If you have > > specified compression implemented with a Hadoop native library, like > > snappy or lzo, and have forgotten to deploy 64 bit native libraries, > > and move to this 64 bit environment, you won't be able to open the > > affected table(s) until native link issues are resolved. > > > > > > On Mon, Sep 15, 2014 at 2:27 PM, Otis Gospodnetic > > <otis.gospodne...@gmail.com> wrote: > > > Hi Esteban, > > > > > > Sorry, I meant to point that out in my original email - yeah, heap > sizes, > > > Xmx, and such will be different for 32-bit and 64-bit servers, but I > was > > > wondering if there is anything in HBase that could complain if, say, a > > > region written on a 32-bit server moves to a 64-bit server.... or > > anything > > > else of that sort that is HBase (or Hadoop) specific. > > > > > > Thanks, > > > Otis > > > -- > > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > > > Solr & Elasticsearch Support * http://sematext.com/ > > > > > > > > > > > > On Mon, Sep 15, 2014 at 5:19 PM, Esteban Gutierrez < > este...@cloudera.com > > > > > > wrote: > > > > > >> Well, many HBase internal limits are based on the architecture so that > > >> should impact you right away in resource utilization in the RSs, so a > > heap > > >> or a setting that worked fine for your 32-bit RSs might need to be > tuned > > >> for a 64-bit environment. Probably might be easier to run a 32-bit JVM > > in > > >> the 64-bit boxes and phase out the old 32-bit nodes after you test > for a > > >> while in a couple of the 64-bit nodes new settings. > > >> > > >> cheers, > > >> esteban, > > >> > > >> > > >> -- > > >> Cloudera, Inc. > > >> > > >> > > >> On Mon, Sep 15, 2014 at 1:37 PM, Otis Gospodnetic < > > >> otis.gospodne...@gmail.com> wrote: > > >> > > >> > Hi, > > >> > > > >> > We are thinking of adding some new 64-bit servers to run > > RegionServers to > > >> > our 32-bit HBase cluster. Anything we should worry about or pay > extra > > >> > attention to? > > >> > > > >> > Thanks, > > >> > Otis > > >> > -- > > >> > Monitoring * Alerting * Anomaly Detection * Centralized Log > Management > > >> > Solr & Elasticsearch Support * http://sematext.com/ > > >> > > > >> > > > > > > > > -- > > Best regards, > > > > - Andy > > > > Problems worthy of attack prove their worth by hitting back. - Piet > > Hein (via Tom White) > > >
