Thanks alot Simon , let me do as you advised me, will update you if that help me. have a nice day again many thanks :-),
Regards, Alok On 3 January 2011 04:18, Simon Slavin <[email protected]> wrote: > > On 2 Jan 2011, at 10:33pm, Alok Singh wrote: > > > i am doing the same inserting line by line using Transaction but its like > > dead code as its very slow where as my system config is quite heavy then > > also. > > Sorry, I don't use your language so I can't help with your code. However, > I do notice that a lot of the time taken by your application is in setting > up parameters and binding them, and you do this separately for each cell. > Also you are using a huge number of operations: one to INSERT each row, > then one UPDATE for every value in every row. You only really need one > INSERT for each row: assemble all the values in the row and put them all in > in the same command. > > Also you are still using a 2D array to store your values. This is slow and > requires a lot of memory. Instead, use one array to read in the first row > (with the names of the columns) and then use a second 1D array for each row > of values: read one line in then write the row out, then read the next line > in. You should not need any 2D arrays in your code at all, and you will > never hold the full file content in memory all at the same time. > > Just for testing purposes, try using the command-line tool to read the same > .csv file. That should give you an idea how fast it's possible to read that > file. If your own code isn't much slower then you are already doing a good > job. > > Simon. > _______________________________________________ > sqlite-users mailing list > [email protected] > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > -- Thanks Alok Kumar Singh _______________________________________________ sqlite-users mailing list [email protected] http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
