[
https://issues.apache.org/jira/browse/HBASE-18882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384182#comment-16384182
]
Josh Elser commented on HBASE-18882:
------------------------------------
Good news here, things are actually looking pretty good.
* 2.7.3-ish Hadoop installation and 3.4.5-ish ZooKeeper installation
* Latest from 1.2.7 and 2.0.0-beta-2 as of 2018/02/27 or so
* 5 RegionServers of each. The platform barfed, though, and I ended up with 3
RS for the 2.0.0 cluster by the end (yay filesystems flipping to R/O)
* I used {{hbase pe}} to load 500M rows into each. Didn't quite get there on
the 2.0 cluster for the aforementioned nodes locking up, but got ~470M rows
luckily
* Then, enabled Kerberos on each with separate KDCs (no cross-trust setup
shenanigans)
* By copying krb5.conf and the HDFS, YARN, and HBase configuration from teh
2.0 cluster to the 1.2.7 cluster, I was successfully able to run RowCounter,
ExportSnapshot, and Export over the large table I had created.
* Setting {{-Djava.security.krb5.conf}} was the biggest thing. The rest was
just making sure I picked up the correct configuration directory
{code:java}
$ HBASE_OPTS="-Djava.security.krb5.conf=/etc/krb5-2.conf" ./bin/hbase --config
/home/hbase/hbase2-conf/ org.apache.hadoop.hbase.mapreduce.Export TestTable
/user/hbase/tt1-export
$ HBASE_OPTS="-Djava.security.krb5.conf=/etc/krb5-2.conf" ./bin/hbase --config
/home/hbase/hbase2-conf/ org.apache.hadoop.hbase.snapshot.ExportSnapshot
-snapshot tt1 -copy-to /user/hbase/tt1-data -mappers 9
$ HBASE_OPTS="-Djava.security.krb5.conf=/etc/krb5-2.conf" ./bin/hbase --config
/home/hbase/hbase2-conf/ org.apache.hadoop.hbase.mapreduce.RowCounter
TestTable{code}
Also briefly used the shell with the same trick.
Please holler if there are more tests people can think about. The clusters are
finite, but I can extend their lifetime for a little bit more if there are more
requests!
> [TEST] Run MR branch-1 jobs against hbase2 cluster
> --------------------------------------------------
>
> Key: HBASE-18882
> URL: https://issues.apache.org/jira/browse/HBASE-18882
> Project: HBase
> Issue Type: Task
> Components: mapreduce, test
> Reporter: stack
> Assignee: Josh Elser
> Priority: Major
> Fix For: 2.0.0
>
>
> Ensure this works still. Run all our bundled MR tools at least. Find some
> custom if time.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
