Re: [R] Do you use R for data manipulation?

2009-05-13 Thread Wacek Kusnierczyk
Warren Young wrote: Farrel Buchinsky wrote: Is R an appropriate tool for data manipulation and data reshaping and data organizing? I think so but someone who recently joined our group thinks not. The new recruit believes that python or another language is a far better tool for developing

Re: [R] Do you use R for data manipulation?

2009-05-12 Thread Warren Young
Farrel Buchinsky wrote: Is R an appropriate tool for data manipulation and data reshaping and data organizing? I think so but someone who recently joined our group thinks not. The new recruit believes that python or another language is a far better tool for developing data manipulation scripts

Re: [R] Do you use R for data manipulation?

2009-05-11 Thread ronggui
2009/5/6 Emmanuel Charpentier charp...@bacbuc.dyndns.org: Le mercredi 06 mai 2009 à 00:22 -0400, Farrel Buchinsky a écrit : Is R an appropriate tool for data manipulation and data reshaping and data organizing? [ Large Snip ! ... ] Depends on what you have to do. I've done what can be more

Re: [R] Do you use R for data manipulation?

2009-05-11 Thread Dimitri Liakhovitski
I am not a statistician and not a computer scientist by education. I consider myself an R novice and came to R - thanks to my boss - from an SPSS background. I work for a market research company and the most typical data files we deal with are not huge - up to several thousand rows and up to a

Re: [R] Do you use R for data manipulation?

2009-05-11 Thread Emmanuel Charpentier
Le lundi 11 mai 2009 à 23:20 +0800, ronggui a écrit : [ Snip... ] But, at least in my trade, the ability to handle Excel files is a must (this is considered as a standard for data entry. Sigh ...). [ Re-snip... ] I don't think Excel is a standard tool for data entry. Epidata entry is

Re: [R] Do you use R for data manipulation?

2009-05-07 Thread Martin Waller
+1. I worked with Matthew for a while and saw in practice just how powerful that package is. I'm surprised it isn't more widely used. Martin Tom Short wrote: Another tool I find useful is Matthew Dowle's data.table package. It has very fast indexing, can have much lower memory requirements

Re: [R] Do you use R for data manipulation?

2009-05-07 Thread kostas savvidis
Farrel Buchinsky wrote: Is R an appropriate tool for data manipulation and data reshaping and data organizing? I think so but someone who recently joined our group thinks not. The new recruit believes that python or another language is a far better tool for developing data manipulation

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread viktoras d.
well, I am less proficient in R comparing with other tools/languages. Therefore my biased opinion is - it is possible in R, but it may be easier if you use other tools, especially if you have to build a user-friendly GUI. The most accessible (although limited to MS Windows only) method would

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Zeljko Vrba
Sorry for reply to the wrong person, I lost the original email. Farrel Buchinsky wrote: Is R an appropriate tool for data manipulation and data reshaping and data organizing? I think so but someone who recently joined our group thinks not. The new recruit believes that python or another

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Emmanuel Charpentier
Le mercredi 06 mai 2009 à 00:22 -0400, Farrel Buchinsky a écrit : Is R an appropriate tool for data manipulation and data reshaping and data organizing? [ Large Snip ! ... ] Depends on what you have to do. I've done what can be more or less termed data management with almost uncountable tools

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Philipp Pagel
On Wed, May 06, 2009 at 12:22:45AM -0400, Farrel Buchinsky wrote: Is R an appropriate tool for data manipulation and data reshaping and data organizing? I think so but someone who recently joined our group thinks not. The new recruit believes that python or another language is a far better

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Frank E Harrell Jr
I second what Zeljko wrote. In addition, see the data manipulation section in Chapter 4 of http://biostat.mc.vanderbilt.edu/wiki/pub/Main/RS/sintro.pdf Frank Zeljko Vrba wrote: Sorry for reply to the wrong person, I lost the original email. Farrel Buchinsky wrote: Is R an appropriate

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread hadley wickham
Take a look at plyr and reshape packages (http://had.co.nz/), I have a hunch that they would have saved me a lot of headache had I found out about them earlier :) As the author of these two packages, I'm admittedly biased, but I think R is unparalleled for data preparation, manipulation, and

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread John Kane
--- On Wed, 5/6/09, Farrel Buchinsky fjb...@gmail.com wrote: Is R an appropriate tool for data manipulation and data reshaping and data organizing? I think so but someone who recently joined our group thinks not. I only do small scale projects and am by no means a programmer. Isn't Perl

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Laura Arsanto
transparence, compared to other software. Laura *** Date: Wed, 6 May 2009 06:42:45 -0700 From: jrkrid...@yahoo.ca To: r-h...@stat.math.ethz.ch; fjb...@gmail.com CC: ross.laza...@gmail.com; gregory_war...@urmc.rochester.edu; g...@warnes.net Subject: Re: [R] Do you use R for data

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Simon Pickett
ghin...@hotmail.it To: jrkrid...@yahoo.ca; r-h...@stat.math.ethz.ch; fjb...@gmail.com Cc: ross.laza...@gmail.com; gregory_war...@urmc.rochester.edu; g...@warnes.net Sent: Wednesday, May 06, 2009 2:53 PM Subject: Re: [R] Do you use R for data manipulation? I used R for my master thesis (with big

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread C.H.
- From: Laura Arsanto ghin...@hotmail.it To: jrkrid...@yahoo.ca; r-h...@stat.math.ethz.ch; fjb...@gmail.com Cc: ross.laza...@gmail.com; gregory_war...@urmc.rochester.edu; g...@warnes.net Sent: Wednesday, May 06, 2009 2:53 PM Subject: Re: [R] Do you use R for data manipulation? I used R for my

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Paul Emberson
I also use the approach Philipp describes below. I use Python and shell scripts for processing thousands of input files and getting all the data into one tidy csv table. From that point onwards it's R all the way (often with the reshape package). Paul Philipp Pagel wrote: On Wed, May 06,

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Simon Pickett
. - Original Message - From: Laura Arsanto To: simon.pick...@bto.org Sent: Wednesday, May 06, 2009 3:09 PM Subject: RE: [R] Do you use R for data manipulation? dear simon, my job now is doing a benchmark between SAS and open source tools (like R, weka, etc) for data and text

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Mike Lawrence
I work in cognitive science where we collect one or more data files per participant in an experiment then merge those files to perform subsequent analyses. Sometimes some files are in wide format and others are in long format, necessitating reshaping. I've found R entirely satisfactory for this.*

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Greg Snow
] Do you use R for data manipulation? Is R an appropriate tool for data manipulation and data reshaping and data organizing? I think so but someone who recently joined our group thinks not. The new recruit believes that python or another language is a far better tool for developing data

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Tom Short
Another tool I find useful is Matthew Dowle's data.table package. It has very fast indexing, can have much lower memory requirements than a data frame, and has some built-in data manipulation capability. Especially with a 64-bit OS, you can use this to keep things in memory where you otherwise

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Peter Flom
Simon Pickett simon.pick...@bto.org wrote My institute uses SAS religiously, I am the only R heathen. I have resisted learning to use SAS because I dont see the point after years of using R and I like being able to do everything using one program. However, my colleagues maintain that SAS is

Re: [R] Do you use R for data manipulation?

2009-05-06 Thread Frank E Harrell Jr
: Re: [R] Do you use R for data manipulation? I used R for my master thesis (with big effort, anyway) and now I find difficult to use R in my daily work, becasue it has really serious problems with datasets of big dimension, both in the data manipulation step and in the analysis step. But I

Re: [R] Do you use R for data manipulation?

2009-05-05 Thread milton ruser
I also put my 2cents on sqldf :-) milton On Wed, May 6, 2009 at 12:30 AM, Wensui Liu liuwen...@gmail.com wrote: take a look at sqldf package(http://code.google.com/p/sqldf/), you will be amazed. On Wed, May 6, 2009 at 12:22 AM, Farrel Buchinsky fjb...@gmail.com wrote: Is R an appropriate