Re: Comparing strings
On Apr 11, 2005 11:22 AM, Craig Cardimon <[EMAIL PROTECTED]> wrote: > I am working with huge ASCII text files and large text fields. > > As needs and wants have changed, I will be reprocessing data we have > already gone through to see if more records can be extracted. > > I will need to compare strings to ensure that records I am inserting > into our SQL Sever 2000 database are not duplicates of records already > there. > > I have come up with two ways: > > (1) use string length (number of characters a string holds): [---] > (2) compare strings (or 200-characer substrings thereof) directly: > [---] > Does this sound sane to you folks? If anyone has a better way, don't be shy. I'm not one to judge sanity one way or another :-) ... but maybe you might want to consider loading your data into a temporary table and having tsql determine the duplicates. If the files are a big as you say, I would think SQL Server BCP, in combo with a native-SQL Server t-SQL stored procedure would be MUCH faster than any line-by-line perl ETL utility you can write; I mean hey, I have SQLSrver 7 running on a laptop importing over 4 Million rows a minute... Perl is great and all, but physics says it isn't going to give you super-threading DB I/O unless you really, REALLY work at it. Just my thoughts- kevdot ___ Perl-Win32-Users mailing list Perl-Win32-Users@listserv.ActiveState.com To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
RE: Comparing strings
[EMAIL PROTECTED] wrote:
> I am working with huge ASCII text files and large text fields.
>
> As needs and wants have changed, I will be reprocessing data we have
> already gone through to see if more records can be extracted.
>
> I will need to compare strings to ensure that records I am inserting
> into our SQL Sever 2000 database are not duplicates of records already
> there.
>
> I have come up with two ways:
>
> (1) use string length (number of characters a string holds):
>
> $length = length($name);
>
> If both strings are identical in length, I have a duplicate and would
> cease processing.
>
> (2) compare strings (or 200-characer substrings thereof) directly:
>
> if ( $str1 eq $str2 )
> {
>
> }
>
The string compare should not be that big a thing. I would believe
that you would have duplicate lengths since the size of your field you are
talking about is only 200 characters.
Use Benchmark if you have questions on what you are doing and you can
see the time ( wallclock and amount of cpu time ) required to do a certain
action.
Wags ;)
>
> Does this sound sane to you folks? If anyone has a better way, don't
> be shy.
>
> -- Craig
>
>
> ---
> avast! Antivirus: Outbound message clean.
> Virus Database (VPS): 0515-0, 04/11/2005
> Tested on: 4/11/2005 2:22:59 PM
> avast! - copyright (c) 1988-2004 ALWIL Software.
> http://www.avast.com
>
>
>
> ___
> ActivePerl mailing list
> ActivePerl@listserv.ActiveState.com
> To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
***
This message contains information that is confidential
and proprietary to FedEx Freight or its affiliates.
It is intended only for the recipient named and for
the express purpose(s) described therein.
Any other use is prohibited.
***
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
Comparing strings
I am working with huge ASCII text files and large text fields.
As needs and wants have changed, I will be reprocessing data we have
already gone through to see if more records can be extracted.
I will need to compare strings to ensure that records I am inserting
into our SQL Sever 2000 database are not duplicates of records already
there.
I have come up with two ways:
(1) use string length (number of characters a string holds):
$length = length($name);
If both strings are identical in length, I have a duplicate and would
cease processing.
(2) compare strings (or 200-characer substrings thereof) directly:
if ( $str1 eq $str2 )
{
}
Does this sound sane to you folks? If anyone has a better way, don't be shy.
-- Craig
---
avast! Antivirus: Outbound message clean.
Virus Database (VPS): 0515-0, 04/11/2005
Tested on: 4/11/2005 2:22:59 PM
avast! - copyright (c) 1988-2004 ALWIL Software.
http://www.avast.com
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
Re: Inline::CPP
"Sisyphus" <[EMAIL PROTECTED]> wrote on 04/08/2005 05:23:42 PM:
>
> > $Bill wrote on 04/08/2005 09:23:03 AM:
> >
> > > Sisyphus wrote:
> > >
> > > > Try cpan :-)
> > > >
> > > > As was mentioned a few days back, there might be problems with
some
> > > > compilers on Win32 - but I thought we covered those issues. What's
the
> > > > problem you've come up against ?
> > >
> > > If there were no problems, it would be available via PPM somewhere.
:)
> > >
>
> That's correct - but those (2) problems were discussed a few days back
in
> the thread 'More on Re: Windows DLL - Perl Interface' which op was
> following.
>
> > I need to link functions from a vendor's CPP source to a Perl program.
> > (Inline::C doesn't find the functions because of the name mangling.)
The
> > ActiveState web site does not indicate that Inline::CPP is available
for
> > Win32. Am I SOL?
> >
>
> Go to http://search.cpan.org/~neilw/Inline-CPP-0.25/ and click on the
> 'Download' link. Extract the downloaded file to some folder and cd to
that
> folder. As was mentioned in a link provided in that other thread,
starting
> at about line 44 of CPP.pm you have:
>
> #ifndef bool
> #include <%iostream%>
> #endif
> extern "C" {
> #include "EXTERN.h"
> #include "perl.h"
>
> Add "#include " to the top of that list - so it reads:
>
> #include
> #ifndef bool
> #include <%iostream%>
> #endif
> extern "C" {
> #include "EXTERN.h"
> #include "perl.h"
>
> Then run, in succession,
> perl makefile.pl
> nmake test
> nmake install
>
> The last test in the test suite will fail (with VC++ 6.0) - not sure
why,
> but it probably won't lead to any problems for you. If it does, let us
know.
>
> I assume you are using VC++ 6.0.
I am using Microsoft Visual C++ Toolkit 2003 installed per
http://aspn.activestate.com/ASPN/docs/ActivePerl/lib/Pod/perlwin32.html.
However,
I never rebuilt Perl. Is that necessary?
$ cl /?
Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 13.10.3077 for
80x86
Copyright (C) Microsoft Corporation 1984-2002. All rights reserved.
I get an unusual error: Can't open perl script "and" when testing.
$ perl makefile.pl
This will configure and build Inline::C++.
What default C++ compiler would you like to use? [cl -TP]
What default libraries would you like to include? [MSVCIRT.LIB]
Writing Makefile for Inline::CPP::grammar
Writing Makefile for Inline::CPP
$ nmake test
Microsoft (R) Program Maintenance Utility Version 7.10.3077
Copyright (C) Microsoft Corporation. All rights reserved.
Skip blib\lib\Inline\CPP.pm (unchanged)
Skip blib\lib\Inline\CPP.pod (unchanged)
C:\Perl\bin\perl.exe "-MExtUtils::Command::MM" "-e"
"test_harness(0, 'bl
ib\lib', 'blib\arch')" t\01basic.t t\02prefix.t
t\01basic.Can't open perl script "and": No such file or directory
Failed to autogenerate C:\Documents and Settings\a1027277\My
Documents\Perl\Inli
ne-CPP\Inline-CPP-0.25\_Inline\config.
at t\01basic.t line 30
BEGIN failed--compilation aborted at t\01basic.t line 64.
t\01basic.dubious
Test returned status 2 (wstat 512, 0x200)
DIED. FAILED tests 1-10
Failed 10/10 tests, 0.00% okay
t\02prefixCan't open perl script "and": No such file or directory
Failed to autogenerate C:\Documents and Settings\a1027277\My
Documents\Perl\Inli
ne-CPP\Inline-CPP-0.25\_Inline\config.
at t\02prefix.t line 0
INIT failed--call queue aborted, line 1.
t\02prefixdubious
Test returned status 2 (wstat 512, 0x200)
DIED. FAILED tests 1-4
Failed 4/4 tests, 0.00% okay
Failed Test Stat Wstat Total Fail Failed List of Failed
---
t\01basic.t 2 51210 20 200.00% 1-10
t\02prefix.t2 512 48 200.00% 1-4
Failed 2/2 test scripts, 0.00% okay. 14/14 subtests failed, 0.00% okay.
NMAKE : fatal error U1077: 'C:\Perl\bin\perl.exe' : return code '0x2'
Stop.
>>
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
RE: Inline::CPP
I am having good luck so far with Win32::OLE. As long as the DLL
supports IDispatch (or Automation interfaces) it should work fine.
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of
Sisyphus
Sent: Friday, April 08, 2005 6:24 PM
To: Lloyd Sartor
Cc: perl-win32-users
Subject: Re: Inline::CPP
- Original Message -
From: "Lloyd Sartor" <[EMAIL PROTECTED]>
Cc:
Sent: Saturday, April 09, 2005 1:00 AM
Subject: Re: Inline::CPP
> $Bill wrote on 04/08/2005 09:23:03 AM:
>
> > Sisyphus wrote:
> >
> > > Try cpan :-)
> > >
> > > As was mentioned a few days back, there might be problems with
some
> > > compilers on Win32 - but I thought we covered those issues. What's
the
> > > problem you've come up against ?
> >
> > If there were no problems, it would be available via PPM somewhere.
:)
> >
That's correct - but those (2) problems were discussed a few days back
in
the thread 'More on Re: Windows DLL - Perl Interface' which op was
following.
> I need to link functions from a vendor's CPP source to a Perl program.
> (Inline::C doesn't find the functions because of the name mangling.)
The
> ActiveState web site does not indicate that Inline::CPP is available
for
> Win32. Am I SOL?
>
Go to http://search.cpan.org/~neilw/Inline-CPP-0.25/ and click on the
'Download' link. Extract the downloaded file to some folder and cd to
that
folder. As was mentioned in a link provided in that other thread,
starting
at about line 44 of CPP.pm you have:
#ifndef bool
#include <%iostream%>
#endif
extern "C" {
#include "EXTERN.h"
#include "perl.h"
Add "#include " to the top of that list - so it reads:
#include
#ifndef bool
#include <%iostream%>
#endif
extern "C" {
#include "EXTERN.h"
#include "perl.h"
Then run, in succession,
perl makefile.pl
nmake test
nmake install
The last test in the test suite will fail (with VC++ 6.0) - not sure
why,
but it probably won't lead to any problems for you. If it does, let us
know.
I assume you are using VC++ 6.0.
Cheers,
Rob
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
RE: change IE proxy settings
There will be an API call, but why not put it in a logon script and avoid the necessity for this? If you're doing one-off work use Win32::Internet and work that way... P. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Ing. Branislav Gerzo (mail-lists) Sent: 11 April 2005 13:01 To: perl-win32-users@listserv.ActiveState.com Subject: Re: change IE proxy settings Paul Sobey [PS], on Monday, April 11, 2005 at 12:39 (+0100) thoughtfully wrote the following: PS> within Active Directory it's easy to apply the policy via the group PS> policy console, but it all ends up as registry keys eventually anyway. I think too. PS> Try modifying these in a logon script or similar: PS> HKCU\Software\Microsoft\windows\CurrentVersion\Internet PS> Settings\ProxyEnable 0x1 PS> HKCU\Software\Microsoft\windows\CurrentVersion\Internet PS> Settings\ProxyServer "server:port" I have set proxu:port in IE, but it is disabled (not checked). Everything I wants is to enable it (check proxy), and I have that in my initial script, just look. But the problem is I don't know how to refresh settings -- ...m8s, cu l8r, Brano. [Orville Bullitt - All the lights don't shine in his marquee.] ___ Perl-Win32-Users mailing list Perl-Win32-Users@listserv.ActiveState.com To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs * Gloucester Research Limited believes the information provided herein is reliable. While every care has been taken to ensure accuracy, the information is furnished to the recipients with no warranty as to the completeness and accuracy of its contents and on condition that any errors or omissions shall not be made the basis for any claim, demand or cause for action. * ___ Perl-Win32-Users mailing list Perl-Win32-Users@listserv.ActiveState.com To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
RE: Globbing
andrew,
this should work.
#glob.pl
my @Files = glob "*.c";
print @Files;
the idea is that you need to scheme it using the glob function.
cheers,
-Original Message-
From: andrew Black [mailto:[EMAIL PROTECTED]
Sent: Monday, April 11, 2005 3:02 PM
To: perl-win32-users
Subject: Globbing
In Unix, if you provide a list of wildcards on the command line, by the
time you program sees the list of files.
I have program that I call on Unix
$ myprog.pl *.html
and the program is basically
while ( <> )
{ do something }
Is there a way of achieving the same on Win32, hopefully in a way that
would still allow my script to run under Unix?
Related question, what is the difference between Dosglob and perls built
in one
Andrew
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
**
The information contained in this email and any attachments
is likely to be confidential and legally privileged, and is for the
intended recipient named above only. Any copying,
dissemination, disclosure of or use of this email or its
attachments unless authorised by us is prohibited, except
that you may forward this email and/or attachments to a third
party on a strict "need to know" basis.
If you have received this email in error, please notify us
immediately by replying to the email or by calling
+91-80-22297030. Please then delete this email and any full
or partial copies of it.
You as the intended recipient must be aware and accept
that emailis not a totally secure communications medium.
Although we have taken all reasonable steps to make
sure this email and any attachments are free from viruses,
we do not (to the extent permitted by law) accept any liability
whatsoever for any virus infection and/or compromise of
security caused by this email and any attachment.
No contract may be formed or documents served by you
on or with us by this email or any attachments unless
expressly agreed otherwise by us.
Any views expressed in this email or attachments by
an individual are not necessarily those of UbiNetics
India (Private) Limited.
**
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
Re: change IE proxy settings
Paul Sobey [PS], on Monday, April 11, 2005 at 12:39 (+0100) thoughtfully wrote the following: PS> within Active Directory it's easy to apply the policy via the group PS> policy console, but it all ends up as registry keys eventually anyway. I think too. PS> Try modifying these in a logon script or similar: PS> HKCU\Software\Microsoft\windows\CurrentVersion\Internet PS> Settings\ProxyEnable 0x1 PS> HKCU\Software\Microsoft\windows\CurrentVersion\Internet PS> Settings\ProxyServer "server:port" I have set proxu:port in IE, but it is disabled (not checked). Everything I wants is to enable it (check proxy), and I have that in my initial script, just look. But the problem is I don't know how to refresh settings -- ...m8s, cu l8r, Brano. [Orville Bullitt - All the lights don't shine in his marquee.] ___ Perl-Win32-Users mailing list Perl-Win32-Users@listserv.ActiveState.com To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
RE: Globbing
from perldoc -f glob you can either:
@ARGV=glob("*.html");
while( <> ) {...}
or
while( <*.html>) { ...}
Kind regards,
Mark Anderson
Service Improvement Programme
Level 2, 113 Dundas Street
Edinburgh, EH3 5DE
Tel: 0131 523 8786
Mob: 07808 826 063
> -Original Message-
> From: [EMAIL PROTECTED]
> [SMTP:[EMAIL PROTECTED] On Behalf Of
> andrew Black
> Sent: Monday, April 11, 2005 10:32 AM
> To: perl-win32-users
> Subject: Globbing
>
> *** WARNING : This message originates from the Internet ***
>
> In Unix, if you provide a list of wildcards on the command line, by the
> time you program sees the list of files.
> I have program that I call on Unix
>
> $ myprog.pl *.html
>
> and the program is basically
> while ( <> )
> { do something }
>
> Is there a way of achieving the same on Win32, hopefully in a way that
> would still allow my script to run under Unix?
>
> Related question, what is the difference between Dosglob and perls built
> in one
>
> Andrew
>
>
> ___
> Perl-Win32-Users mailing list
> Perl-Win32-Users@listserv.ActiveState.com
> To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
The Royal Bank of Scotland plc, Registered in Scotland No. 90312. Registered
Office: 36 St Andrew Square, Edinburgh EH2 2YB
The Royal Bank of Scotland plc is authorised and regulated by the Financial
Services Authority and represents The Royal Bank of Scotland Marketing Group.
The Bank sells life policies, collective investment schemes and pension
products and advises only on the Marketing Group's range of these products and
on a With-Profit Bond produced by Norwich Union Life (RBS) Limited.
This e-mail message is confidential and for use by the addressee only. If the
message is received by anyone other than the addressee, please return the
message to the sender by replying to it and then delete the message from your
computer. Internet e-mails are not necessarily secure. The Royal Bank of
Scotland plc does not accept responsibility for changes made to this message
after it was sent.
Whilst all reasonable care has been taken to avoid the transmission of viruses,
it is the responsibility of the recipient to ensure that the onward
transmission, opening or use of this message and any attachments will not
adversely affect its systems or data. No responsibility is accepted by The
Royal Bank of Scotland plc in this regard and the recipient should carry out
such virus and other checks as it considers appropriate.
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
RE: change IE proxy settings
The adm files contain representations of registry settings to be
applied. Your best bet here would be to use Win32::TieRegistry to set
the appropriate reg key to control IE's proxy settings. If you are
within Active Directory it's easy to apply the policy via the group
policy console, but it all ends up as registry keys eventually anyway.
Try modifying these in a logon script or similar:
HKCU\Software\Microsoft\windows\CurrentVersion\Internet
Settings\ProxyEnable 0x1
HKCU\Software\Microsoft\windows\CurrentVersion\Internet
Settings\ProxyServer "server:port"
Paul
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of
Ing. Branislav Gerzo (mail-lists)
Sent: 11 April 2005 12:02
To: perl-win32-users@listserv.ActiveState.com
Subject: Re: change IE proxy settings
$Bill Luebkert [BL], on Friday, April 08, 2005 at 04:52 (-0700)
thoughtfully wrote the following:
BL> Check out Win32::Internet instead of using the API:
I checked it first, but I think this works only in one perl script
(make constructor of $INET connection and using it). I'd like to
change proxy settings in _real_ IE, so when I run it, I will have
changed settings. I'm using another module, which uses real IE.
BL> # try something like this instead of API (check docs in
Win32::Internet)
BL> # you'll have to play with it to get the desired results I assume -
I have
BL> # no experience with it.
BL> my $I = new Win32::Internet('', INTERNET_OPEN_TYPE_PROXY,
'') or
BL> die "new Win32::Internet: $! ($^E)";
thanks, I tried, no luck.
--
...m8s, cu l8r, Brano.
[* <- Tribble = <- Tribble after laying on RR tracks]
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
*
Gloucester Research Limited believes the information
provided herein is reliable. While every care has been
taken to ensure accuracy, the information is furnished
to the recipients with no warranty as to the completeness
and accuracy of its contents and on condition that any
errors or omissions shall not be made the basis for any
claim, demand or cause for action.
*
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
Re: Globbing
Andrew,
andrew Black wrote:
In Unix, if you provide a list of wildcards on the command line, by the
time you program sees the list of files.
I have program that I call on Unix
$myprog.pl *.html
and the program is basically
while ( <> )
{ do something}
Is there a way of achieving the same on Win32, hopefully in a way that
would still allow my script to run under Unix?
should be the same depending on what modules/code you are using.
[EMAIL PROTECTED] scripts $ perl glob.pl *.pl
addall.pl
add_rem_ws.pl
admin-first.pl
antivir.pl
appetc.pl
args.pl
checkdrive.pl
CRM_20030625.pl
CRM_Daba_copy.pl
CRM_Datenbank.pl
delcon.pl
del.pl
dir_list.pl
[EMAIL PROTECTED] scripts $ echo $HOSTTYPE
i386-linux
H:\scripts>perl glob.pl *.pl
add_rem_ws.pl
addall.pl
admin-first.pl
antivir.pl
appetc.pl
args.pl
checkdrive.pl
CRM_20030625.pl
CRM_Daba_copy.pl
CRM_Datenbank.pl
del.pl
delcon.pl
dir_list.pl
H:\scripts>cmd
Microsoft Windows 2000 [Version 5.00.2195]
(C) Copyright 1985-2000 Microsoft Corp.
The code I used for this...
use strict;
use warnings;
while (<@ARGV>) {
print "$_\n";
}
Related question, what is the difference between Dosglob and perls built
in one
Andrew
Hth
Alex
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
Globbing
In Unix, if you provide a list of wildcards on the command line, by the
time you program sees the list of files.
I have program that I call on Unix
$ myprog.pl *.html
and the program is basically
while ( <> )
{ do something }
Is there a way of achieving the same on Win32, hopefully in a way that
would still allow my script to run under Unix?
Related question, what is the difference between Dosglob and perls built
in one
Andrew
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
Re: change IE proxy settings
MJG [M], on Friday, April 8, 2005 at 23:07 (-0500) wrote these comments: M> If you have the system.adm file from an active directory server, you can M> see how that sets the value. IF you are using a 200/2003 server not in M> AD, you can apply that adm locally, or just use AD GPOs to keep it M> simple. IF this is your environment to begin with. yes, I have windows 2003 server, no active directory, found D:\WINDOWS\inf\system.adm D:\WINDOWS\system32\GroupPolicy\Adm\system.adm what I should change there ? I didn't found any proxy ip I set in IE. -- ...m8s, cu l8r, Brano. [Now I have friends I never knew were there. - Londo] ___ Perl-Win32-Users mailing list Perl-Win32-Users@listserv.ActiveState.com To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
Re: change IE proxy settings
$Bill Luebkert [BL], on Friday, April 08, 2005 at 04:52 (-0700)
thoughtfully wrote the following:
BL> Check out Win32::Internet instead of using the API:
I checked it first, but I think this works only in one perl script
(make constructor of $INET connection and using it). I'd like to
change proxy settings in _real_ IE, so when I run it, I will have
changed settings. I'm using another module, which uses real IE.
BL> # try something like this instead of API (check docs in Win32::Internet)
BL> # you'll have to play with it to get the desired results I assume - I have
BL> # no experience with it.
BL> my $I = new Win32::Internet('', INTERNET_OPEN_TYPE_PROXY,
'') or
BL> die "new Win32::Internet: $! ($^E)";
thanks, I tried, no luck.
--
...m8s, cu l8r, Brano.
[* <- Tribble = <- Tribble after laying on RR tracks]
___
Perl-Win32-Users mailing list
Perl-Win32-Users@listserv.ActiveState.com
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs
