Re: text editor to remove duplicate lines?

2000-08-09 Thread Steve Lamb

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Wednesday, August 09, 2000, 12:35:08 AM, Jamie wrote:
 Grep.com was supplied free with all versions of Borland C and C++ as well
 as Pascal from version 3 onwards .

I'm not sure it has the same options, however.

- --
 Steve C. Lamb | I'm your priest, I'm your shrink, I'm your
 ICQ: 5107343  | main connection to the switchboard of souls.
- ---+-

-BEGIN PGP SIGNATURE-
Version: PGP 6.5i

iQA/AwUBOZFRJ3pf7K2LbpnFEQK/BwCg0o0mOma6jUzGhX0vROXAnlgxNCUAnjkz
XVNfAeU+3DXdmLM0/k3Gfs5k
=BYYy
-END PGP SIGNATURE-

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re: text editor to remove duplicate lines?

2000-08-09 Thread Steve Lamb

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Wednesday, August 09, 2000, 5:45:48 AM, Oliver wrote:
grep aol file  die.scum

Ah, very correct.

- --
 Steve C. Lamb | I'm your priest, I'm your shrink, I'm your
 ICQ: 5107343  | main connection to the switchboard of souls.
- ---+-

-BEGIN PGP SIGNATURE-
Version: PGP 6.5i

iQA/AwUBOZFXCHpf7K2LbpnFEQJqBwCg4o7XTUS39DlBcPuZ0B+HVaYBx9YAoMAC
RA3VNxTqznzqJHSqh5T0IslK
=yCHW
-END PGP SIGNATURE-

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re[2]: text editor to remove duplicate lines?

2000-08-08 Thread Jamie Dainton

Hello Steve,

Wednesday, August 02, 2000, 5:20:25 PM, you wrote:

SL On Thu, Aug 03, 2000 at 12:14:55AM +0800, icqman wrote:
 do you by any chance know of any txt editor which can remove identical lines?
 i have got  a list of addresses which i joined from 5 other txts and it
 came to some 5000 k and about 4 identical lines of each

SL The GNU text utils would work wonders here.

SL type file | sort | uniq  file.new

SL Sort will put them all in order and then uniq will return only a single
SL occurance of any repeating line.


It's  time  to get your copy of C++ or Pascal out. Ultraedit won't cut
it  and  I've never used GNU text editing tools. I'll have a look into
it, if I think it'll take less than an hour or three I'll have a go. Just
please don't expect miracles. I'm usually reasonably busy.

-- 
From Jamie Dainton
[EMAIL PROTECTED]



Wednesday, August 02, 2000 8:31:25 PM
Using The Bat! 1.45 Beta/11
Windows 98 4.10 

The Bat

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re: text editor to remove duplicate lines?

2000-08-08 Thread Steve Lamb

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Wednesday, August 02, 2000, 12:32:56 PM, Jamie wrote:
SL The GNU text utils would work wonders here.

SL type file | sort | uniq  file.new

SL Sort will put them all in order and then uniq will return only a single
SL occurance of any repeating line.

 It's  time  to get your copy of C++ or Pascal out. Ultraedit won't cut
 it  and  I've never used GNU text editing tools. I'll have a look into
 it, if I think it'll take less than an hour or three I'll have a go. Just
 please don't expect miracles. I'm usually reasonably busy.

Oy.  Am I the only one who can do it three different ways?  The above is
simplest, get the GNU tools, install run it at the command line replacing
"file" and "file.new".  Done in just a few minutes.  Or I could do it in Perl
or Python.  I fail to see why anyone would have to pull out a compiled
language to do something so trivial.

- --
 Steve C. Lamb | I'm your priest, I'm your shrink, I'm your
 ICQ: 5107343  | main connection to the switchboard of souls.
- ---+-

-BEGIN PGP SIGNATURE-
Version: PGP 6.5i

iQA/AwUBOZBzEnpf7K2LbpnFEQKPwgCfYAwRqOeOF8zMJVhENiJD9LtjdrIAn120
CwqMJ2D3xFh3z4uP5EnlUlhR
=10of
-END PGP SIGNATURE-

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re[3]: text editor to remove duplicate lines?

2000-08-08 Thread Oliver Sturm

Hi Jamie Dainton,

On Wednesday, August 02, 2000 at 9:32:56 PM you wrote:

 do you by any chance know of any txt editor which can remove identical lines?
 i have got  a list of addresses which i joined from 5 other txts and it
 came to some 5000 k and about 4 identical lines of each

SL The GNU text utils would work wonders here.
SL type file | sort | uniq  file.new

SL Sort will put them all in order and then uniq will return only a single
SL occurance of any repeating line.

 It's  time  to get your copy of C++ or Pascal out. Ultraedit won't cut
 it  and  I've never used GNU text editing tools. I'll have a look into
 it, if I think it'll take less than an hour or three I'll have a go. Just
 please don't expect miracles. I'm usually reasonably busy.

Well,  here's a piece of Perl code that does the same thing. Tell me if you
get the C++ version any shorter ;)

@lines = ;
foreach $line (sort @lines) {
  push (@uniquelines, $line) unless $seen{$line}++;
}
print @uniquelines;


Oliver Sturm

-- 
% ar m God
ar: God does not exist
-- 
Oliver Sturm / [EMAIL PROTECTED]

Key ID: 71D86996
Fingerprint: 8085 5C52 60B8 EFBD DAD0  78B8 CE7F 38D7 71D8 6996

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re: text editor to remove duplicate lines?

2000-08-08 Thread Ming-Li

Hi Jamie,

 It's  time  to get your copy of C++ or Pascal out. Ultraedit won't
 cut it  and  I've never used GNU text editing tools.

Ultraedit does this, easily.

-- 
Best regards,
Ming-Li

The Bat! 1.46 Beta/3 | Win2k SP1



-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re: text editor to remove duplicate lines?

2000-08-08 Thread Arthur Warren

In fact, UltraEdit will do this just fine, for what it's worth.
File-Sort-Advanced... set "ignore case"  "remove duplicates" and
Bob's yer uncle. I'm with Mr. Steve Lamb - I have at least 3 ways of
doing this w/o resorting to compiler (and yes, I consider Java
"compiled").

File sorting/uniqueness DSW, anyone?

-- 
Herb Warren

  Using The Bat! 1.45
  on: Windows NT 4.0 
  Build 1381 Service Pack 5

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re[3]: text editor to remove duplicate lines?

2000-08-08 Thread Deryk Lister

Hi Jamie,
On Wednesday 02/08/2000 at 20:32, you wrote:

SL The GNU text utils would work wonders here.

SL type file | sort | uniq  file.new
snip

 I've never used GNU text editing tools.

You don't know what you're missing :)  I'm not Linux's no.1 fan anymore
(in some ways it's *very* difficult to use, but I refuse to discuss that
on this list).

However: the GNU tools are extremely useful and a lot easier to use
than you think... I think they were ported to Win32 as well, which
makes Steve's point more valid to those who aren't Linux zealots.

I think my fave GNU tool has to be grep... for example: Suppose you
had a list of email addresses that you pulled from the TBUDL list. You
want to find anyone who uses AOL, to place in a killfile (hey, I'm
still allowed to be evil!)
You type "cat tbudladdresses.txt | grep aol" and it would list anyone
with AOL in their address.  You then export the output to a real "kill
file".  Super!

-- 
Deryk Lister  ||  ICQ 25869912  ||  www.deryk.co.uk
"..." -- Cid, after feeding him a fish

PGP: mailto:[EMAIL PROTECTED]?subject=Retr%20PGP%20Key
Any of my keys _under_ 3072 bit (usually on keyservers) don't work.

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re: text editor to remove duplicate lines?

2000-08-08 Thread Steve Lamb

On Wed, Aug 09, 2000 at 12:49:03AM +0100, Deryk Lister wrote:
 However: the GNU tools are extremely useful and a lot easier to use
 than you think... I think they were ported to Win32 as well, which
 makes Steve's point more valid to those who aren't Linux zealots.

Yes, they have been.

 You type "cat tbudladdresses.txt | grep aol" and it would list anyone
 with AOL in their address.  You then export the output to a real "kill
 file".  Super!

In dos that is type

type file | grep aol  die.scum

-- 
 Steve C. Lamb | I'm your priest, I'm your shrink, I'm your
 ICQ: 5107343  | main connection to the switchboard of souls.
---+-
-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





text editor to remove duplicate lines?

2000-08-02 Thread icqman

thanks to those who email me how and where to download the 1.46 beta

just got it and testing it out.. a marvelous piece of engineering 
also sub to the_bat/beta.html


do you by any chance know of any txt editor which can remove identical lines?
i have got  a list of addresses which i joined from 5 other txts and it
came to some 5000 k and about 4 identical lines of each

it is taking me quite some time to delete the lines

thebat can delete identical mesasge a miracle LOL

but cant delete duplicate lines 

any ideas?

thanks in advance


Cheers
icqman
--
HP1 http ://icqman.free.web1000.com/default.zip
HP2 http ://www.freeyellow.com/members8/icqman147369/ 
Address mailto:[EMAIL PROTECTED] ICQ NO 5435606


-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re: text editor to remove duplicate lines?

2000-08-02 Thread Steve Lamb

On Thu, Aug 03, 2000 at 12:14:55AM +0800, icqman wrote:
 do you by any chance know of any txt editor which can remove identical lines?
 i have got  a list of addresses which i joined from 5 other txts and it
 came to some 5000 k and about 4 identical lines of each

The GNU text utils would work wonders here.

type file | sort | uniq  file.new

Sort will put them all in order and then uniq will return only a single
occurance of any repeating line.

-- 
 Steve C. Lamb | I'm your priest, I'm your shrink, I'm your
 ICQ: 5107343  | main connection to the switchboard of souls.
---+-
-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org





Re: text editor to remove duplicate lines?

2000-08-02 Thread Curtis

On Wed, 2 Aug 2000 09:20:25 -0700, Steve Lamb wrote:
SL On Thu, Aug 03, 2000 at 12:14:55AM +0800, icqman wrote:
 do you by any chance know of any txt editor which can remove identical lines?
 i have got  a list of addresses which i joined from 5 other txts and it
 came to some 5000 k and about 4 identical lines of each

SL The GNU text utils would work wonders here.

SL type file | sort | uniq  file.new

SL Sort will put them all in order and then uniq will return only a single
SL occurance of any repeating line.

I'll add 'Finder' to that. http://www.scp.on.ca/finder.html

-- 
-=A.C. Martin=-[TB! v1.46 Beta/2 «» Win2k Pro SP1]
PGP Key: mailto:[EMAIL PROTECTED]?Subject=SendAlliePGPKey

"Oxymoron: Respectable Lawyer. " 

-- 
--
View the TBUDL archive at http://tbudl.thebat.dutaint.com
To send a message to the list moderation team double click here:
   mailto:[EMAIL PROTECTED]
To Unsubscribe from TBUDL, double click here and send the message:
   mailto:[EMAIL PROTECTED]
--

You are subscribed as : archive@jab.org