[R] how to append new data to saved data on disk efficiently

Hi, I currently combine multiple processed data (data frame) into a list and save the list as .rda using the save command. When new data come, I load the rda file, process the new data into a data frame, append the data frame to the end of the list, and save the whole list to the disk. The

Re: [R] how to append new data to saved data on disk efficiently

You can keep each dataframe as a separate file and process them that way. You can look into storing in a relational database or using filehash. It all depends on how you want to process the data later. On Tue, Dec 29, 2009 at 8:40 AM, Hao Cen h...@andrew.cmu.edu wrote: Hi, I currently