RE: [Rd] R's IO speed
Use memory.size(max=TRUE) in Windows, or some other profiling memory manager. On Mon, 3 Jan 2005, Vadim Ogranovich wrote: A technical question here: how does one measure the memory overhead mentioned below? I have a set of functions of my own and would like to profile them. Thanks, Vadim -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Prof Brian Ripley Sent: Sunday, December 26, 2004 2:04 AM To: [EMAIL PROTECTED] Subject: [Rd] R's IO speed R-devel now has some improved versions of read.table and write.table. For a million-row data frame containing one number, one factor with few levels and one logical column, a 56Mb object. generating it takes 4.5 secs. calling summary() on it takes 2.2 secs. writing it takes 8 secs and an additional 10Mb. saving it in .rda format takes 4 secs. reading it naively takes 28 secs and an additional 240Mb reading it carefully (using nrows, colClasses and comment.char) takes 16 secs and an additional 150Mb (56Mb of which is for the object read in). (The overhead of read.table over scan was about 2 secs, mainly in the conversion back to a factor.) loading from .rda format takes 3.4 secs. [R 2.0.1 read in 23 secs using an additional 210Mb, and wrote in 50 secs using an additional 450Mb.] Will Frank Harrell or someone else please explain to me a real application in which this is not fast enough? -- Brian D. Ripley, [EMAIL PROTECTED] Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272866 (PA) Oxford OX1 3TG, UKFax: +44 1865 272595 __ R-devel@stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-devel -- Brian D. Ripley, [EMAIL PROTECTED] Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272866 (PA) Oxford OX1 3TG, UKFax: +44 1865 272595 __ R-devel@stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-devel
RE: [Rd] R's IO speed
A technical question here: how does one measure the memory overhead mentioned below? I have a set of functions of my own and would like to profile them. Thanks, Vadim > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of Prof > Brian Ripley > Sent: Sunday, December 26, 2004 2:04 AM > To: [EMAIL PROTECTED] > Subject: [Rd] R's IO speed > > R-devel now has some improved versions of read.table and write.table. > > For a million-row data frame containing one number, one > factor with few levels and one logical column, a 56Mb object. > > generating it takes 4.5 secs. > > calling summary() on it takes 2.2 secs. > > writing it takes 8 secs and an additional 10Mb. > > saving it in .rda format takes 4 secs. > > reading it naively takes 28 secs and an additional 240Mb > > reading it carefully (using nrows, colClasses and > comment.char) takes 16 secs and an additional 150Mb (56Mb of > which is for the object read in). > (The overhead of read.table over scan was about 2 secs, > mainly in the conversion back to a factor.) > > loading from .rda format takes 3.4 secs. > > [R 2.0.1 read in 23 secs using an additional 210Mb, and wrote > in 50 secs using an additional 450Mb.] > > > Will Frank Harrell or someone else please explain to me a > real application > in which this is not fast enough? > > -- > Brian D. Ripley, [EMAIL PROTECTED] > Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ > University of Oxford, Tel: +44 1865 272861 (self) > 1 South Parks Road, +44 1865 272866 (PA) > Oxford OX1 3TG, UKFax: +44 1865 272595 > > __ > R-devel@stat.math.ethz.ch mailing list > https://stat.ethz.ch/mailman/listinfo/r-devel > __ R-devel@stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-devel
Re: [Rd] row ("FORTRAN") order?
Göran Broström <[EMAIL PROTECTED]> writes:
> Reading about 'R_max_col' in "Writing R extensions", Version
> 2.1.0,(2005-01-03), I find:
>
> "Given the nr by nc matrix matrix in row ("FORTRAN") order, ..."
>
> Looks like a contradiction to me, since FORTRAN stores matrices
> columnwise. So is this a documentation bug?
H. Maybe. FORTRAN order is known as column-*major* order. The row
index varies most quickly, so the question is whether "row order" may
have have some merit. Anyone have the terminology straight?
--
O__ Peter Dalgaard Blegdamsvej 3
c/ /'_ --- Dept. of Biostatistics 2200 Cph. N
(*) \(*) -- University of Copenhagen Denmark Ph: (+45) 35327918
~~ - ([EMAIL PROTECTED]) FAX: (+45) 35327907
__
R-devel@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
Re: [Rd] Windows vignettes, shQuote, texi2dvi
Gabor Grothendieck myway.com> writes: : : Further searching also found it at: : : http://www.ctan.org/tex-archive/graphics/texdraw/manual/texi2dvi : : but its the UNIX shell script. I looked at it quickly and it : probably would not be that hard to translate it into R (about half : of it is just argument processing) replacing : the existing texi2dvi R command with the equivalent of that : script. It could be added to the wishlist. : : A kludge might be to run that shell script on windows under cygwin : although that might still not fix the problem of building vignettes : from the R CMD build tool. : : Personally, I am just going to stick with MiKTeX's texify.exe and build : vignettes from the .tex file manually for now. Just an update. I just installed the January 2, 2005 r-devel build and I am now able to automatically generate vignettes on Windows. __ R-devel@stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-devel
[Rd] row ("FORTRAN") order?
Reading about 'R_max_col' in "Writing R extensions", Version
2.1.0,(2005-01-03), I find:
"Given the nr by nc matrix matrix in row ("FORTRAN") order, ..."
Looks like a contradiction to me, since FORTRAN stores matrices
columnwise. So is this a documentation bug?
--
Göran Broströmtel: +46 90 786 5223
Department of Statistics fax: +46 90 786 6614
Umeå University http://www.stat.umu.se/egna/gb/
SE-90187 Umeå, Sweden e-mail: [EMAIL PROTECTED]
__
R-devel@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
Re: [Rd] Plot elements echo NULL (PR#7466)
[EMAIL PROTECTED] writes: > This has been reported by Peter Dalgaard in PR#7397. > Please check whether a bug has already been reported before submitting a > new report. Even the submitter had forgotten that he submitted it as a formal report then... Better have it in once too many than once too few, I suppose. -p -- O__ Peter Dalgaard Blegdamsvej 3 c/ /'_ --- Dept. of Biostatistics 2200 Cph. N (*) \(*) -- University of Copenhagen Denmark Ph: (+45) 35327918 ~~ - ([EMAIL PROTECTED]) FAX: (+45) 35327907 __ R-devel@stat.math.ethz.ch mailing list https://stat.ethz.ch/mailman/listinfo/r-devel
Re: [Rd] Plot elements echo NULL (PR#7466)
My apologies.
Andrew.
On Mon, Jan 03, 2005 at 09:26:36AM +0100, [EMAIL PROTECTED] wrote:
> [EMAIL PROTECTED] wrote:
> > Full_Name: Andrew Robinson
> > Version: 2.0.1
> > OS: FreeBSD
> > Submission from: (NULL) (211.28.168.242)
> >
> >
> > Certain plot elements echo NULL when they are set. For example,
> >
> >
> >>plot(1:10,1:10)
> >>axis(1)
> >
> > NULL
> >
> >>mtext("test")
> >
> > NULL
> >
> >
> > In previous versions the functions were silent.
> >
> > __
> > R-devel@stat.math.ethz.ch mailing list
> > https://stat.ethz.ch/mailman/listinfo/r-devel
>
>
> This has been reported by Peter Dalgaard in PR#7397.
> Please check whether a bug has already been reported before submitting a
> new report.
>
> Uwe Ligges
>
> __
> R-devel@stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel
--
Andrew Robinson Ph: 208 885 7115
Department of Forest Resources Fa: 208 885 6226
University of Idaho E : [EMAIL PROTECTED]
PO Box 441133W : http://www.uidaho.edu/~andrewr
Moscow ID 83843 Or: http://www.biometrics.uidaho.edu
No statement above necessarily represents my employer's opinion.
__
R-devel@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
Re: [Rd] Plot elements echo NULL (PR#7466)
[EMAIL PROTECTED] wrote:
> Full_Name: Andrew Robinson
> Version: 2.0.1
> OS: FreeBSD
> Submission from: (NULL) (211.28.168.242)
>
>
> Certain plot elements echo NULL when they are set. For example,
>
>
>>plot(1:10,1:10)
>>axis(1)
>
> NULL
>
>>mtext("test")
>
> NULL
>
>
> In previous versions the functions were silent.
>
> __
> R-devel@stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel
This has been reported by Peter Dalgaard in PR#7397.
Please check whether a bug has already been reported before submitting a
new report.
Uwe Ligges
__
R-devel@stat.math.ethz.ch mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
