How to keep s3 data in memory with apache drill?

2016-01-26 Thread Stephan Kölle
Querying JSON data stored on aws s3 with apache drill works awesome, but drill fetches the data fresh from s3 for every query. How to tell drill to keep the data in memory for the next query? I got tachyon to work with drill (with the informations available on this list) about 90%, but "SHOW FILE

Re: How to keep s3 data in memory with apache drill?

2016-01-26 Thread Stefán Baxter
Hi, I think the latest version of Tachyon uses a transparent storage structure. Regards, -Stefán On Tue, Jan 26, 2016 at 10:05 AM, Stephan Kölle wrote: > Querying JSON data stored on aws s3 with apache drill works awesome, but > drill fetches the data fresh from s3 for every query. > > How t

Re: Re: How to keep s3 data in memory with apache drill?

2016-01-26 Thread Stephan Kölle
I'm working with tachyon 0.8.2 (November 11, 2015) - current - stephan > Hi, > >I think the latest version of Tachyon uses a transparent storage structure. > >Regards, >-Stefán > > >On Tue, Jan 26, 2016 at 10:05 AM, Stephan Kölle wrote: >> Querying JSON data stored on aws s3 with apache drill

Re: Re: How to keep s3 data in memory with apache drill?

2016-01-26 Thread Stefán Baxter
Hi, I got an email from the Tachyon team a while back were they informed my of this change. I think you should visit their google group and check the status of this change. Regards, -Stefán On Tue, Jan 26, 2016 at 9:28 PM, Stephan Kölle wrote: > I'm working with tachyon 0.8.2 (November 11,