Re: Incrementally load HFiles outside of MR/Spark

[Ted Yu]

You can refer to HFilePerformanceEvaluation where creation of Writer is
demonstrated:

      writer = HFile.getWriterFactoryNoCache(conf)

          .withPath(fs, mf)

          .withFileContext(hFileContext)

          .withComparator(CellComparator.getInstance())

          .create();

Cheers

On Sun, Feb 25, 2018 at 12:42 PM, Mike Thomsen <mikerthom...@gmail.com>
wrote:

> I'm looking into creating HFiles directly from NiFi using the HBase API. It
> seems pretty straight forward:
>
> 1. Open a HFile.Writer pointing to a file path in HDFS.
> 2. Write the cells with the HFile API.
> 3. Call the incremental loader API to have it tell HBase to load the
> generated segments.
>
> Is that right? If so, are there any gotchas that I should be aware of?
>
> Thanks,
>
> Mike
>