Spark RDD

2016-03-23 Thread Brian McBride
I'm looking for options for processing RDF data in a hadoop style cluster. My understanding from my reading so far is that using Rya, I could have a quad store with the data partitioned across my cluster. I could send SPARQL queries Rya's SPARQL endpoint. I would like to do bulk, hadoop styl

Re: Spark RDD

2016-03-23 Thread Aaron D. Mihalik
You should take a look at the Pig script processing in Rya [1][2] and the Fluo work that was just checked in [3]. The accumulo.pig transforms a SPARQL query in to a Pig script which later becomes a series of map-reduce jobs. The rya.pcj.fluo is very similar, but uses a mini-batch approach to inc

Integrate jenkins to Apache-rya incuabator.

2016-03-23 Thread Amila Wijayarathna
Hi all, We are planning to integrate jenkins to Apache-rya incuabator. Can some one please guide me on what is the procedure to follow when doing this? Thank you! -- *Amila Wijayarathna* Undergraduate, Faculty of Information Technology, University of Moratuwa, Sri Lanka.

RE: Integrate jenkins to Apache-rya incuabator.

2016-03-23 Thread Mark Wallace
Generally, there are no Jenkins-specific things you need to do the software itself. Since the software has a maven build, an automated build in Jenkins should be easy to set up. Jenkins will need the ability to pull the software (probably the development branch). Since the code is public on g

Re: Rya Working Group tomorrow

2016-03-23 Thread Aaron D. Mihalik
All, We are going to have another "Rya Working Group" discussion today at Noon (Eastern). Email me if you would like to participate and I will send you the telecon info directly. Hopefully, this will be the last time that we use a telecon line. Next time, (Wed April 6), we'll try to get this do

Re: Rya Working Group tomorrow

2016-03-23 Thread Aaron D. Mihalik
We had a relatively short discussion that focused on two items: 1. New Feature: We briefly discussed the new Fluo work that was just checked in [1] and the forth coming improvements that are documented in Jira. 2. Next time -- Hands-on Developer Demo: Next Rya Working Group we will do a hands on