Re: Sorting an extremely LARGE file

2011-08-07 Thread Kenneth Wolcott
On Sun, Aug 7, 2011 at 22:10, Ramprasad Prasad wrote: > [snip] > I guess there is a serious need for re-architecting , rather than > create such monstrous files, but when people work with legacy systems > which worked fine when there was lower usage and now you tell then you > need a overhaul be

Re: Sorting an extremely LARGE file

2011-08-07 Thread Ramprasad Prasad
Using the system linux sort ... Does not help. On my dual quad core machine , (8 gb ram) sort -n file takes 10 minutes and in the end produces no output. when I put this data in mysql , there is an index on the order by field ... But I guess keys don't help when you are selecting the entire table.

how to use jks encrypt in perl webservice

2011-08-07 Thread 王�Z
My service is published by J2EE , it's use SOAP and RSA jks encrypt (serverStore.jks and clientStore.jks). I need to use PERL to invoke the webservice . Could you do me a favor, offer an example which use SOAP and RSA jks certificate and encrypt . 2011-08-08 王�Z

Re: Sorting an extremely LARGE file

2011-08-07 Thread Uri Guttman
> "RP" == Rajeev Prasad writes: RP> hi, you can try this: first get only that field (sed/awk/perl) RP> whihc you want to sort on in a file. sort that file which i assume RP> would be lot less in size then your current file/table. then run a RP> loop on the main file using sorted file

Re: Sorting an extremely LARGE file

2011-08-07 Thread shawn wilson
On Sun, Aug 7, 2011 at 15:58, Rob Dixon wrote: > On 07/08/2011 20:30, Shawn H Corey wrote: >> >> On 11-08-07 03:20 PM, shawn wilson wrote: >>> >>> It can be sped up (slightly) with an index. >> >> Indexes in SQL don't normally speed up sorting. What they're best at is >> selecting a limited number

Re: Sorting an extremely LARGE file

2011-08-07 Thread Rob Dixon
On 07/08/2011 20:30, Shawn H Corey wrote: On 11-08-07 03:20 PM, shawn wilson wrote: It can be sped up (slightly) with an index. Indexes in SQL don't normally speed up sorting. What they're best at is selecting a limited number of records, usually less than 10% of the total. Otherwise, they ju

Re: Sorting an extremely LARGE file

2011-08-07 Thread Shawn H Corey
On 11-08-07 03:20 PM, shawn wilson wrote: It can be sped up (slightly) with an index. Indexes in SQL don't normally speed up sorting. What they're best at is selecting a limited number of records, usually less than 10% of the total. Otherwise, they just get in the way. The best you can do

Re: Sorting an extremely LARGE file

2011-08-07 Thread shawn wilson
On Aug 7, 2011 1:15 PM, "Paul Johnson" wrote: > > On Sun, Aug 07, 2011 at 08:58:14PM +0530, Ramprasad Prasad wrote: > > > I have a file that contains records of customer interaction > > The first column of the file is the batch number(INT) , and other columns > > are date time , close time etc etc

Re: Sorting an extremely LARGE file

2011-08-07 Thread Paul Johnson
On Sun, Aug 07, 2011 at 08:58:14PM +0530, Ramprasad Prasad wrote: > I have a file that contains records of customer interaction > The first column of the file is the batch number(INT) , and other columns > are date time , close time etc etc > > I have to sort the entire file in order of the first

Re: Sorting an extremely LARGE file

2011-08-07 Thread Rajeev Prasad
hi, you can try this: first get only that field (sed/awk/perl) whihc you want to sort on in a file. sort that file which i assume would be lot less in size then your current file/table. then run a loop on the main file using sorted file as variable.   here is the logic in shell:   awk '{print $}

Re: Sorting an extremely LARGE file

2011-08-07 Thread Dr.Ruud
On 2011-08-07 17:28, Ramprasad Prasad wrote: I have a file that contains records of customer interaction The first column of the file is the batch number(INT) , and other columns are date time , close time etc etc I have to sort the entire file in order of the first column .. but the problem is

Re: Sorting an extremely LARGE file

2011-08-07 Thread Ramprasad Prasad
On 7 August 2011 21:24, Shawn H Corey wrote: > On 11-08-07 11:46 AM, Ramprasad Prasad wrote: > >> I used a mysql database , but the order by clause used to hang the >> process indefinitely >> If I sort files in smaller chunks how can I merge them back ?? >> >> > Please use "Reply All" when respon

Re: Sorting an extremely LARGE file

2011-08-07 Thread Shawn H Corey
On 11-08-07 11:46 AM, Ramprasad Prasad wrote: I used a mysql database , but the order by clause used to hang the process indefinitely If I sort files in smaller chunks how can I merge them back ?? Please use "Reply All" when responding to a message on this list. You need two temporary files a

Re: Sorting an extremely LARGE file

2011-08-07 Thread Shawn H Corey
On 11-08-07 11:28 AM, Ramprasad Prasad wrote: I have a file that contains records of customer interaction The first column of the file is the batch number(INT) , and other columns are date time , close time etc etc I have to sort the entire file in order of the first column .. but the problem is

Sorting an extremely LARGE file

2011-08-07 Thread Ramprasad Prasad
I have a file that contains records of customer interaction The first column of the file is the batch number(INT) , and other columns are date time , close time etc etc I have to sort the entire file in order of the first column .. but the problem is that the file is extremely huge. For the large

Re: Using an undefined value as a hash reference

2011-08-07 Thread Octavian Rasnita
Hi Shlomi, Thanks for the explanation. > vincent: well, it seems like a leaky abstraction and it's another > reason why one should use «my ($self, $args) = @_;» instead of «my ($self, > %args) = @_;». Yes, in LWP::UserAgent::get I've seen: my($self, @parameters) = @_; so just like in case it

Re: Using an undefined value as a hash reference

2011-08-07 Thread Shlomi Fish
Hi Octavian, On Sun, 7 Aug 2011 12:28:27 +0300 "Octavian Rasnita" wrote: > Hi, > > I made the following test script: > > use strict; > use warnings FATAL => 'all'; > use LWP::UserAgent; > > my $fields; > > my $ua = LWP::UserAgent->new; > my $res = $ua->get( 'http://www.google.com/', %$fields

Using an undefined value as a hash reference

2011-08-07 Thread Octavian Rasnita
Hi, I made the following test script: use strict; use warnings FATAL => 'all'; use LWP::UserAgent; my $fields; my $ua = LWP::UserAgent->new; my $res = $ua->get( 'http://www.google.com/', %$fields ); This script runs with no errors, although the variable $fields is undefined and it is used as