Rogerio Porto wrote:
Hello all.
I have a large .txt file whose variables are fixed-columns,
ie, variable V1 goes from columns 1 to 7, V2 from 8 to 23 etc.
This is a 60GB file with 90 variables and 60 million observations.
I'm working with a Pentium 4, 1GB RAM, Windows XP Pro.
I tried
You can read fixed-width-files with read.fwf(). But my rough calculation says
that your dataset will require 40GB of RAM. I don't think you'll be able to
read the entire thing into R. Maybe look at a subset?
-roger
Rogerio Porto wrote:
Hello all.
I have a large .txt file whose variables
Hello all.
I have a large .txt file whose variables are fixed-columns,
ie, variable V1 goes from columns 1 to 7, V2 from 8 to 23 etc.
This is a 60GB file with 90 variables and 60 million observations.
I'm working with a Pentium 4, 1GB RAM, Windows XP Pro.
I tried the following code just to see