[R] problem with bulk insert into a *.csv file

[venkata kirankumar]

Hi all,

I am trying to create a  "index.csv"  with caliculating different
types of caliculations .
In that i have to caliculate on 10,000 studies and have to insert many no of
rows more than 500,000
for that right now I am inserting every row after caliculating and doing
data.frame
but its taking much time to create that index.csv

is there any thing like bulk insert in to file with keeping those rows in
memory and inserting into table
if any thing is there means please give me some idea to do bulk insert
then I can save time to  create index.csv file

thanks in advance


kiran

[[alternative HTML version deleted]]

__
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.

Re: [R] problem with bulk insert into a *.csv file

[jim holtman]

You can always open a connection and write the rows out as you have
calculated them.  It would be nice if you had included at least a subset of
the calculations that you are doing so that we can understand the problem
you are trying to solve.

On Mon, Jun 8, 2009 at 11:43 AM, venkata kirankumar
wrote:

> Hi all,
>
> I am trying to create a  "index.csv"  with caliculating different
> types of caliculations .
> In that i have to caliculate on 10,000 studies and have to insert many no
> of
> rows more than 500,000
> for that right now I am inserting every row after caliculating and doing
> data.frame
> but its taking much time to create that index.csv
>
> is there any thing like bulk insert in to file with keeping those rows in
> memory and inserting into table
> if any thing is there means please give me some idea to do bulk insert
> then I can save time to  create index.csv file
>
> thanks in advance
>
>
> kiran
>
>[[alternative HTML version deleted]]
>
> __
> R-help@r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>



-- 
Jim Holtman
Cincinnati, OH
+1 513 646 9390

What is the problem that you are trying to solve?

[[alternative HTML version deleted]]

__
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.

Re: [R] problem with bulk insert into a *.csv file

[venkata kirankumar]

Hi jim,

I am caliculating these caliculation on quaring on 4 tables and preparing
subsets of those and from there I am getting the final results
that is

"034P91"|"d947468f-95ff-4844-8d04-36619ed2cced"|1|"Control"|9686|"brain"|9301|7912|10746|10742|9710|12591|7933|12612|"Gram"|2.014|1.721|1.8902|0.0772662927802285|0|1


this contains study "*Identyfier " *which contains *4 trialgroups  and each
group contains 2genders and each gender contains nearly 50 speciman types
for eachspeciman type I have to caliculate mean,max,min,standered
deviation,difference between treatmentgroup mean to controlgroup mean,and
ratio between  treatmentgroup mean to controlgroup mean*
*this will repeate for 10,000 studies*
*right now I am appending these values to the file row wise with making it
data.frame andding to the index.csv*

**
if any thing like keeping these rows in memory and inserting into *index.csv
*file at once means it will reduce time taken for creating the file

is there any thing to do such type of bulk insert  in R-project means saves
lots of time and improves performance to my project

can you please suggest me if any thing is there like that  and I am sending
my script file to you for the referance

thanks in advance


kiran


On Mon, Jun 8, 2009 at 9:43 PM, jim holtman  wrote:

> You can always open a connection and write the rows out as you have
> calculated them.  It would be nice if you had included at least a subset of
> the calculations that you are doing so that we can understand the problem
> you are trying to solve.
>
>   On Mon, Jun 8, 2009 at 11:43 AM, venkata kirankumar <
> kiran4u2...@gmail.com> wrote:
>
>>  Hi all,
>>
>> I am trying to create a  "index.csv"  with caliculating different
>> types of caliculations .
>> In that i have to caliculate on 10,000 studies and have to insert many no
>> of
>> rows more than 500,000
>> for that right now I am inserting every row after caliculating and doing
>> data.frame
>> but its taking much time to create that index.csv
>>
>> is there any thing like bulk insert in to file with keeping those rows in
>> memory and inserting into table
>> if any thing is there means please give me some idea to do bulk insert
>> then I can save time to  create index.csv file
>>
>> thanks in advance
>>
>>
>> kiran
>>
>>[[alternative HTML version deleted]]
>>
>> __
>> R-help@r-project.org mailing list
>> https://stat.ethz.ch/mailman/listinfo/r-help
>> PLEASE do read the posting guide
>> http://www.R-project.org/posting-guide.html
>> and provide commented, minimal, self-contained, reproducible code.
>>
>
>
>
> --
> Jim Holtman
> Cincinnati, OH
> +1 513 646 9390
>
> What is the problem that you are trying to solve?
>
__
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.