I may have confused you when I said the UNION does the deduping - Sorry. -----Original Message----- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen Sent: Thursday, May 17, 2012 5:15 PM To: U2 Users List Subject: Re: [U2] SAVING UNIQUE ( multivalued)
The union combines the lists, then merge.list does the deduping when it's finished the merge as it does the sorting. George -----Original Message----- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Chris Austin Sent: Thursday, May 17, 2012 5:11 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] SAVING UNIQUE ( multivalued) The description of UNION is a bit confusing with regards to the way this works: UNION - list3 contains all elements from list1 and all elements from list2 that are not in list1. >From the HELP description I would think it wouldn't work, for example: list 1 = 1,1,2,2,3,4,5 list 2 = 1,4,6,8 wouldn't list 3 look like the following? list 3 = 1,1,2,2,3,4,5,6,8 How does it DEDUPE list 1? The description says it 'contains all elements from list1' but there could be duplicates in list 1 so how do those get shaken out? Chris > From: ggal...@wyanokegroup.com > To: u2-users@listserver.u2ug.org > Date: Thu, 17 May 2012 16:06:10 -0500 > Subject: Re: [U2] SAVING UNIQUE ( multivalued) > > Now thinking about it, I think MERGE.LIST always does sort and deduping > regardless of which ACTION you use. > > -----Original Message----- > From: u2-users-boun...@listserver.u2ug.org > [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of George Gallen > Sent: Thursday, May 17, 2012 5:05 PM > To: U2 Users List > Subject: Re: [U2] SAVING UNIQUE ( multivalued) > > MERGE.LIST Sorts automatically, > > The UNION does the DEDUPING > > The 1 union 1 - says to union of list#1 with list#1 (itself) > > Otherwise: > > MERGE.LIST # ACTION # TO # > > Where ACTION = (UNION, INTERSECT or DIFF) > And the TO # will save the results to that list# (if it's not specified, the > default list #0 is used) > > George > > -----Original Message----- > From: u2-users-boun...@listserver.u2ug.org > [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Chris Austin > Sent: Thursday, May 17, 2012 5:00 PM > To: u2-users@listserver.u2ug.org > Subject: Re: [U2] SAVING UNIQUE ( multivalued) > > > That works beautifully George, thanks for the tip! I've never used the > MERGE.LIST command before, I assume the line you have > > > 0005: MERGE.LIST 1 UNION 1 > > basically take the list #1 and shakes out the unique values? > > Chris > > > > From: ggal...@wyanokegroup.com > > To: u2-users@listserver.u2ug.org > > Date: Thu, 17 May 2012 15:47:11 -0500 > > Subject: Re: [U2] SAVING UNIQUE ( multivalued) > > > > What about ... > > > > ----: P > > > > 0001: PA > > > > 0002: QSELECT <<C2,file>> * SAVING <<C3,field number>> > > > > 0003: SAVE.LIST UNIQUE > > 0004: GET.LIST UNIQUE TO 1 > > 0005: MERGE.LIST 1 UNION 1 > > 0006: SAVE.LIST UNIQUE > > 0007: GET.LIST UNIQUE > > > > (The MERGE.LIST will sort and dedupe) > > > > > > 0004: sh -c "/usr/bin/sort -uo '&SAVEDLISTS&/UNIQUE' '&SAVEDLISTS&/UNIQUE'" > > > > 0005: GET.LIST UNIQUE > > > > -----Original Message----- > > From: u2-users-boun...@listserver.u2ug.org > > [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Rick Nuckolls > > Sent: Thursday, May 17, 2012 4:38 PM > > To: 'U2 Users List' > > Subject: Re: [U2] SAVING UNIQUE ( multivalued) > > > > This does present a challenge, > > > > The following (non-portable solution works) > > :ED VOC MUNIQUE > > > > 5 lines long. > > > > > > > > ----: P > > > > 0001: PA > > > > 0002: QSELECT <<C2,file>> * SAVING <<C3,field number>> > > > > 0003: SAVE.LIST UNIQUE > > > > 0004: sh -c "/usr/bin/sort -uo '&SAVEDLISTS&/UNIQUE' '&SAVEDLISTS&/UNIQUE'" > > > > 0005: GET.LIST UNIQUE > > > > Or, I suppose that one could also > > > > EDIT.LIST GARBAGE > > > > New record. > > > > > > > > ----: I > > > > 0001= KAJDF;LJASDLF;KJADSL;FKJASDL;FJKASLD;JFALS;DJFLASKDF > > > > 0002= > > > > Bottom at line 1. > > > > ----: > > > > Top. > > > > ----: FI > > > > "GARBAGE" filed in file "&SAVEDLISTS&". > > > > :GET.LIST GARBAGE TO 1 > > > > > > > > 1 record(s) selected to SELECT list #1. > > > > :QSELECT IU * SAVING 19 > > > > > > > > 32987 record(s) selected to SELECT list #0. > > > > ::MERGE.LIST 0 DIFF 1 > > > > > > > > 90 record(s) selected to SELECT list #0. > > > > :: > > > > ---------------- > > Be nice if there was MV support of 'SAVING UNIQUE', or a cleaner syntactic > > way to use MERGE.LIST to dedupe. > > > > -Rick > > > > > > > > -----Original Message----- > > From: u2-users-boun...@listserver.u2ug.org > > [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Chris Austin > > Sent: Thursday, May 17, 2012 1:20 PM > > To: u2-users@listserver.u2ug.org > > Subject: Re: [U2] SAVING UNIQUE ( multivalued) > > > > > > I usually get my exploded list and then DEDUPE using the following: > > > > LOCATE VALUE.TO.FIND IN UNIQUE.LIST BY "AL" SETTING POS ELSE > > UNIQUE.LIST = INSERT(UNIQUE.LIST,1,POS,0,VALUE.TO.FIND) > > END > > > > This puts everything in a nice ARRAY called UNIQUE.LIST, I then can use a > > FOR loop to loop through as needed. > > > > Chris > > > > > > > To: u2-users@listserver.u2ug.org > > > From: wjhon...@aol.com > > > Date: Thu, 17 May 2012 16:13:31 -0400 > > > Subject: Re: [U2] SAVING UNIQUE ( multivalued) > > > > > > > > > You have two issues. > > > One is to create a list from an exploded multi-value > > > The other issue, is to dedupe that list. > > > > > > Without using something like REFORMAT I don't think you can get the two > > > issues resolved at once. > > > Qselect does not allow Unique > > > So > > > QSELECT MYFILE SAVING 2 > > > will explode the multi-values, but it won't dedupe them. > > > > > > > > > > > > -----Original Message----- > > > From: Rick Nuckolls <r...@lynden.com> > > > To: 'U2 Users List' <u2-users@listserver.u2ug.org> > > > Sent: Thu, May 17, 2012 1:06 pm > > > Subject: [U2] SAVING UNIQUE ( multivalued) > > > > > > > > > Does anyone know a trick to achieve the equivalent of > > > SELECT filename SAVING UNIQUE fieldname > > > When "fieldname" is the name of a multivalued field, and I want a list > > > of all > > > he unique values for that field? > > > The syntax above does not explode the values, but just looks at the whole > > > field. > > > I suppose that I can do a LIST with a BY.EXP & a BREAK.ON, but perhaps I > > > am > > > issing something... > > > Thanks, > > > Rick Nuckolls > > > ynden Inc. > > > > > > ______________________________________________ > > > 2-Users mailing list > > > 2-us...@listserver.u2ug.org > > > ttp://listserver.u2ug.org/mailman/listinfo/u2-users > > > > > > _______________________________________________ > > > U2-Users mailing list > > > U2-Users@listserver.u2ug.org > > > http://listserver.u2ug.org/mailman/listinfo/u2-users > > > > _______________________________________________ > > U2-Users mailing list > > U2-Users@listserver.u2ug.org > > http://listserver.u2ug.org/mailman/listinfo/u2-users > > _______________________________________________ > > U2-Users mailing list > > U2-Users@listserver.u2ug.org > > http://listserver.u2ug.org/mailman/listinfo/u2-users > > _______________________________________________ > > U2-Users mailing list > > U2-Users@listserver.u2ug.org > > http://listserver.u2ug.org/mailman/listinfo/u2-users > > _______________________________________________ > U2-Users mailing list > U2-Users@listserver.u2ug.org > http://listserver.u2ug.org/mailman/listinfo/u2-users > _______________________________________________ > U2-Users mailing list > U2-Users@listserver.u2ug.org > http://listserver.u2ug.org/mailman/listinfo/u2-users > _______________________________________________ > U2-Users mailing list > U2-Users@listserver.u2ug.org > http://listserver.u2ug.org/mailman/listinfo/u2-users _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users