[R] Advantages of using SQLite for data import in comparison to csv files

2010-01-13 Thread Juliet Jacobson
Hello everybody out there using R, I'm using R for the analysis of biological data and write the results down using LaTeX, both on a notebook with linux installed. I've already tried two options for the import of my data: 1. Import from a SQLite database 2. Import from individual csv files edited

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-13 Thread Gabor Grothendieck
You could look at read.csv.sql in sqldf (http://sqldf.googlecode.com) as well. On Wed, Jan 13, 2010 at 2:00 PM, Juliet Jacobson wrote: > Hello everybody out there using R, > > I'm using R for the analysis of biological data and write the results > down using LaTeX, both on a notebook with linux i

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-13 Thread Juliet Jacobson
Thanks for your answer. I hadn't found this possibility by web search. Since sqldf also allows the import of tables from csv files, complex SELECT queries and even joins on tables, I have the impression that there aren't any reasons for using a SQLite database to organise the data for R. But then w

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-14 Thread Gabor Grothendieck
sqldf is layered on top of RSQLite. Its not a separate facility. On Thu, Jan 14, 2010 at 2:12 AM, Juliet Jacobson wrote: > Thanks for your answer. I hadn't found this possibility by web search. > Since sqldf also allows the import of tables from csv files, complex > SELECT queries and even joins

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-14 Thread Magnus Torfason
RSQLite is actually much more than a "driver for data import". It basically allows any manipulation of SQLite databases, including reading, writing, or updating and munging data within the database. Regarding the original question of data import: I use csv and sqlite files interchangeably to

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-15 Thread Juliet Jacobson
Thanks for your answer. I've thought of the possibility of an index when using a SQLite database, but as you mentioned, I don't really benefit from it in regard of rather small data sets. What I am considering as a problem when using csv files is the occurrence of data redundancy: When I wan't

Re: [R] Advantages of using SQLite for data import in comparison to csv files

2010-01-15 Thread Matthew Dowle
Just to comment on this bit : > For one thing, you cannot index a csv file or a data.frame. If you have to > repeatedly select subsets of your large data set, creating an index on the > relevant column in the sqlite table is an absolute life saver. This is one reason the data.table package was