Re: [R] Splitting massive output into multiple text files

2009-11-20 Thread bartjoosen


try:
capture.output(fit5, file=paste(testperm, i, .txt, sep=), append=T)


Bart


A Singh wrote:
 
 Dear List,
 
 I thought it would be much easier to put a second query into a second
 mail.
 
 I need to print 426*1 blocks of variance components data, where 426 is 
 the number of columns of data that have 1 permutations of variance 
 generated for each of them.
 
 I have tried printing out a smaller number of permutations for a smaller 
 number of markers and that has worked.
 
 However, since a text file will not handle 4 million blocks in a single 
 file (which is what I ultimately need to do), is there a way to tell R to 
 create a new file for every 10 or so columns?
 
 I tried to use some suggested code that looked like:
 
 for (j in 1:426)
 {
  write(cbind(modeldf[,j:(j+9)]),file=as.character(j))
  j - j+10
 }
 
 ..but can't figure out how to put it into my own code and make it work.
 
 I did find one example of code for split files, each successive file being 
 labeled as a series of numbers, but I couldn't figure out how to even
 adapt 
 that to my model.
 
 I cannot figure out what other way there is to conveniently view 4 m.
 items 
 of data without losing some of it somewhere..
 
 Any help will be much much appreciated..
 
 Aditi
 
 --
 
 Code for shorter sample file:
 
 
 model-read.table(...)
 
 modeldf-data.frame(model)
 
 modeldf[2:13-lapply(modeldf[2:13],factor)
 
 colms-(modeldf)[4:13]   ## 10 markers only in this file
 se-c(1:1000)
 
 for(f in colms)
 {
 print(Marker)
 {
 for( i in 1:1000)
 {
 print(perm no.)
 print(se[i])
 {
 peg.no.prm-sample(peg.no, length(peg.no))
 try(fit5-lmer(data=modeldf, peg.no.prm~1 + (1|family/f)))
 print(summary(fit5))
 capture.output(fit5, file=testperm5.txt, append=T)
 }}}
 }
 
 
 The data files are at:


 http://www.4shared.com/file/131980362/460bdafe/Testvcomp10.ht
 ml (excel)
 http://www.4shared.com/file/131980512/dc7308b/Testvcomp10.html
 (txt)
 --
 
 
 --
 A Singh
 aditi.si...@bristol.ac.uk
 School of Biological Sciences
 University of Bristol
 
 __
 R-help@r-project.org mailing list
 https://stat.ethz.ch/mailman/listinfo/r-help
 PLEASE do read the posting guide
 http://www.R-project.org/posting-guide.html
 and provide commented, minimal, self-contained, reproducible code.
 
 

-- 
View this message in context: 
http://old.nabble.com/Splitting-massive-output-into-multiple-text-files-tp26429300p26432040.html
Sent from the R help mailing list archive at Nabble.com.

__
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.


[R] Splitting massive output into multiple text files

2009-11-19 Thread A Singh

Dear List,

I thought it would be much easier to put a second query into a second mail.

I need to print 426*1 blocks of variance components data, where 426 is 
the number of columns of data that have 1 permutations of variance 
generated for each of them.


I have tried printing out a smaller number of permutations for a smaller 
number of markers and that has worked.


However, since a text file will not handle 4 million blocks in a single 
file (which is what I ultimately need to do), is there a way to tell R to 
create a new file for every 10 or so columns?


I tried to use some suggested code that looked like:

for (j in 1:426)
{
write(cbind(modeldf[,j:(j+9)]),file=as.character(j))
j - j+10
}

..but can't figure out how to put it into my own code and make it work.

I did find one example of code for split files, each successive file being 
labeled as a series of numbers, but I couldn't figure out how to even adapt 
that to my model.


I cannot figure out what other way there is to conveniently view 4 m. items 
of data without losing some of it somewhere..


Any help will be much much appreciated..

Aditi

--

Code for shorter sample file:


model-read.table(...)

modeldf-data.frame(model)

modeldf[2:13-lapply(modeldf[2:13],factor)

colms-(modeldf)[4:13]   ## 10 markers only in this file
se-c(1:1000)

for(f in colms)
{
print(Marker)
{
for( i in 1:1000)
{
print(perm no.)
print(se[i])
{
peg.no.prm-sample(peg.no, length(peg.no))
try(fit5-lmer(data=modeldf, peg.no.prm~1 + (1|family/f)))
print(summary(fit5))
capture.output(fit5, file=testperm5.txt, append=T)
}}}
}


The data files are at:



http://www.4shared.com/file/131980362/460bdafe/Testvcomp10.ht
ml (excel)
http://www.4shared.com/file/131980512/dc7308b/Testvcomp10.html
(txt)

--


--
A Singh
aditi.si...@bristol.ac.uk
School of Biological Sciences
University of Bristol

__
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.