Please take a look at the following methods:
>From HBaseAdmin:
public List<HRegionInfo> getTableRegions(final TableName tableName)
>From HRegion:
public static HDFSBlocksDistribution computeHDFSBlocksDistribution(final
Configuration conf,
final HTableDescriptor tableDescriptor, final HRegionInfo regionInfo)
throws IOException {
FYI
On Wed, Jul 20, 2016 at 11:28 PM, Sachin Jain <sachinjain...@gmail.com>
wrote:
> *Context*
> I am using Spark (1.5.1) with HBase (1.1.2) to dump the output of Spark
> Jobs into HBase which will be further available as lookups from HBase
> Table. BaseRelation extends HadoopFSRelation and is used to read and write
> to HBase. Spark Default Source API is used.
>
> *Use Case*
> Now, whenever I perform join operation, Spark creates a logical plan and
> decides which type of join it should execute and as per Spark Strategies
> [0] it checks the size of HBase Table. If it is less than some threshold
> (10 MB) it selects Broadcast Hash join otherwise Sort Merge join.
>
> *Problem Statement*
> I want to know if there is an API or some approach to calculate the size of
> an HBase table.
>
> [0]:
>
> https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala#L118
>
> Thanks
> -Sachin
>
