Off the wall - our AIE implementation for CTM:People gets updates from LDAP into a separate SQL Server db all day (and night) as changes post in PeopleSoft. When things are popping (student registration and new employee hires at the beginning of each semester), there may be many updates to the same person's record over several hours, sometimes within the AIE processing cycle of 1 hour. They are transparent to AIE because the duplicate updates post to a single record in the SQL Server table and AIE only sees one record with an update flag. AIE then pushes to a custom form like you described, updating or creating records as appropriate. You may need to use an external db table that you can push your .csv file through in order to combine the duplicate entries into a single row.
Just an idea; for scale, we currently maintain over 297,000 records this way (external SQL table -> custom form -> CTM:People/User/CTM:People Permission Groups). Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing & IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Nathan Aker Sent: Thursday, February 02, 2012 8:46 AM To: arslist@ARSLIST.ORG Subject: Import .csv with duplicates to AR Form via AIE ** Greetings Listers, I'm stuck on an AIE limitation that I can't seem to get around. I want to do a nightly file import from a .csv file to a target custom AR form. Problem is the .csv file contains duplicate entries and there is no way to get a completely unique key (even using a composite key from multiple columns in the .csv file). After much testing, frustration, and retesting I have found that AIE cannot (successfully) import from a .csv file without a unique key. Period. It's not that it simply will overwrite records where duplicates are encountered, it gets completely confused on the number of records to import and only processes approx. 1/3 of the total data. I've tried every combination of configurations/queries/keys in the AIE mapping and exchange entries. For reasons I won't detail, I don't have the option of altering the source of the .csv file to insert a unique ID or to filter duplicates out. I'm racking my brain to figure out some script or batch file I can create to run prior to the exchange which inserts a unique column (a counter basically) into the .csv file so that AIE can import it. I've validated that I can manually add a unique column to the .csv and everything imports as expected. Anyone have a clever way to insert a unique column to a .csv file programmatically, or a way to get Remedy to import a .csv nightly which contains non-unique data? I'm trying to avoid a less desireable solution involving running the import tool from workflow as I believe it would require me to pass Admin credentials in the command line to run the import tool. The security implications there concern me. Thanks. Nate. Nathan Aker ITSM Solution Architect McAfee, Inc. 5000 Headquarters Drive Plano, TX 75024 _attend WWRUG12 www.wwrug.com<http://www.wwrug.com> ARSlist: "Where the Answers Are"_ _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: "Where the Answers Are"