thanx for your response... i thought that would be the best one to use; spent my time yesterday trying to use the other one... using the client i see there is a builder pattern and i was able to create a simple test methods to verify it works:
*// this is just a simple example for anyone to get started* *def scanRFile(filepath: String, user: String): Unit = {* * val rfileInputArgs: RFile.InputArguments = Rfile.newScanner* * val scanner: Scanner = rfileInputArgs.from(filepath).withAuthorization(securityOps.getUserAuthorizations(user)).build* * scanner.iterator.asScala.foreach({ field => * * println(s"key => ${field.getKey}, value => ${field.getValue}")* * })}* this is a great start and now i can work on integrating it into a mapreduce/spark job thanx again On Wed, Aug 5, 2020 at 12:51 PM Christopher <ctubb...@apache.org> wrote: > The one in core.client is newer, and intended as a stable public API. > The other is internal API, more awkward to use, and not guaranteed to > be stable. If the public API is missing something that would be > useful, we can consider making a non-public method more visible, or > adding new public methods to the API in core.client. > > On Wed, Aug 5, 2020 at 12:48 PM Bulldog20630405 > <bulldog20630...@gmail.com> wrote: > > > > i looked at the RFile class (there are two of them in core ... one is > core.client.rfile.RFile and the other is core.file.rfile.RFile) > > > > in both cases most of the capability is private or package protected and > you cannot access the functionality. > > > > am i missing something? > > > > > > > > On Tue, Aug 4, 2020 at 1:07 PM Bulldog20630405 < > bulldog20630...@gmail.com> wrote: > >> > >> yes; that is more what i want to do; i wish there was an > AccumuloFileInputFormat; but there isnt... maybe i need to create > one...thanx... i will look into the rfile class (i am using 1.9 so we > should be good) > >> > >> On Tue, Aug 4, 2020 at 12:20 PM Keith Turner <ke...@deenlo.com> wrote: > >>> > >>> Could the Accumulo Map Reduce input format and enable scanning an > >>> offline table. This will read the tables rfiles directly excluding any > >>> data falling outside of tablet boundaries. Since this is a Hadoop > >>> input format, it should work easily with Spark. I can point to > >>> examples of this if interested. > >>> > >>> Another option is using the RFile class (added in 1.8) in the public > >>> API to directly read individual RFiles, this is useful when tables and > >>> tablets are not a concern. I have not used this with Spark, but I > >>> think it would work easily by partitioning a list of files into task > >>> and having each task read a set of rfiles directly. > >>> > >>> On Mon, Aug 3, 2020 at 4:46 PM Bulldog20630405 > >>> <bulldog20630...@gmail.com> wrote: > >>> > > >>> > > >>> > we would like to read rfiles directly outside an active accumulo > instance using spark. is there a example to do this? > >>> > > >>> > note: i know there is an utility to print rfiles and i could start > there and build my own; but was hoping to leverage something already there. >