Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace Migration Workflow

2019-12-10 Thread Custer, Mark
Corey,

First of all, welcome to the ArchivesSpace community!  Your project will 
definitely make you an ArchivesSpace expert in no time.

Glancing at your workflow document, it looks like you’ve got all of your bases 
covered.  I would strongly suggest running the AT to ASpace migration a couple 
of times (just to get familiar with it), and also to get a few other folks to 
help spot-check the results (the more eyes / institutional experience the 
better), before you go ahead and do the final migration.  It’s a been a long 
while since I used that tool.  I do remember, though, that when we started 
testing it out, the tool couldn’t be used to migrate multiple AT databases into 
a single ASpace database.  That feature was added a long time back, though, so 
you *should* be good to go with migrating your two AT databases into a single 
version of ASpace, which I would highly recommend.

Regarding the AT to ASpace migration tool, just off the top of my head, I’d 
also add:


  1.  if you have linked cross references in your current EAD files, you’ll 
either want to make sure to run the migration with the “-refid_original” 
parameter, or set aside some time after the migration to go back and update 
those linked cross references (during the migration, all of the IDs in the AT 
for the notes and components will be replaced with ASpace IDs, so if you have 
cross references embedded in your finding aids, those will be broken).  We had 
a lot of cross references in our source files in the AT, so we opted with that 
first option, as you can see here:  
https://cpb-us-w2.wpmucdn.com/campuspress.yale.edu/dist/3/30/files/2015/06/Unknown-272cqj2.png
  (that screenshot was taken by Maureen Callahan, and described in a lot of 
more detail and other invaluable advice in this blog post: 
https://campuspress.yale.edu/yalearchivesspace/2015/06/14/migration-step-by-step/)
  2.  unless things have changed, be prepared for that migration tool to 
occasionally add data where no data existed before (even when it’s not required 
to do so).  E.g. for our lists in the AT that did not have a title, after the 
migration we wound up with lists in ASpace that had a title of “Missing Title”. 
 That was something we missed early on, but later on we were able to delete all 
of those values from ASpace.  Ditto for other unexpected things, like if in the 
AT someone selected a container type of “Box” but level the container value 
blank, the AT to ASpace migration would create an auto-generated container 
number so that it could keep that container type of “Box” around without 
dropping it during the migration.  We had quite a few instances in the AT where 
someone would add “Box X, Folder”. That behaved fine in the AT, but once we 
migrated, that would turn into something like “Box X, Folder someweirdnumber” 
(ideally it would’ve just come over as “Box X”).

And unless you have EAD files that aren’t in the AT already, I don’t think that 
you should need to go the route of importing EAD into ASpace.  If you do, there 
are more issues and tricks involved there, not to mention the fact that the 
more import options you allow during the migration, the more variety you’ll 
have in the results.  That’s not to say that EAD imports are bad ASpace, since 
they’ve actually improved on the AT’s EAD import process.  Also, long after our 
migration, we still import EAD files into ASpace, especially when adding 
newly-created finding aids that are so large or complex that they’d be hard to 
create directly in ASpace. However, you’ll have to be mindful of all of the 
ways that those EAD imports can muddy up your database (the primary offender 
being the fact that the importer will add values to controlled value lists 
during the import process when it tries to parse them from free text data….  
See the comment here 
https://github.com/archivesspace/archivesspace/blob/bc675bc12b72f6fb7818aae646958c80d54ff4de/backend/app/model/backend_enum_source.rb#L16…
 In other words, free text like “2.5 Linear feet (4 boxes)” would result in a 
new extent type with a value of “Linear Feet (4 boxes)”, which is not a 
controlled extent type that anyone wants to have around.

Okay, that’s probably more info than you wanted, but hopefully some of it’s 
helpful 😊

There are lots of others who have been through the same journey, so lots of 
folks to get advice from, including this recent article in the code4lib 
journal, https://journal.code4lib.org/articles/14871, which describes the 
migration to ASpace at Columbia University.

Keep us posted with how everything goes,

Mark




From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
[mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org] On Behalf Of 
Corey Schmidt
Sent: Tuesday, 10 December, 2019 2:09 PM
To: archivesspace_users_group@lyralists.lyrasis.org
Subject: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

Dear ArchivesSpace Community,

Hello, my name is 

Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace Migration Workflow

2019-12-11 Thread Corey Schmidt
Mark,

Thank you so much for the wonderful info!

I am just beginning to dive into the data, but I will look out for linked cross 
references and the creation of new data in ArchivesSpace. We don’t have any 
EADs that exist outside of AT so far as I’m aware, so the process of exporting 
from AT, cleaning up, then reimporting might be unnecessary as you pointed out. 
If it’s possible to update the AT database directly, that would save so much 
time and effort. The articles you linked were very helpful and should give me a 
basis for how to approach this and other potential problems.

Thanks again!

Corey

From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 On Behalf Of Custer, 
Mark
Sent: Tuesday, December 10, 2019 6:33 PM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Corey,

First of all, welcome to the ArchivesSpace community!  Your project will 
definitely make you an ArchivesSpace expert in no time.

Glancing at your workflow document, it looks like you’ve got all of your bases 
covered.  I would strongly suggest running the AT to ASpace migration a couple 
of times (just to get familiar with it), and also to get a few other folks to 
help spot-check the results (the more eyes / institutional experience the 
better), before you go ahead and do the final migration.  It’s a been a long 
while since I used that tool.  I do remember, though, that when we started 
testing it out, the tool couldn’t be used to migrate multiple AT databases into 
a single ASpace database.  That feature was added a long time back, though, so 
you *should* be good to go with migrating your two AT databases into a single 
version of ASpace, which I would highly recommend.

Regarding the AT to ASpace migration tool, just off the top of my head, I’d 
also add:


  1.  if you have linked cross references in your current EAD files, you’ll 
either want to make sure to run the migration with the “-refid_original” 
parameter, or set aside some time after the migration to go back and update 
those linked cross references (during the migration, all of the IDs in the AT 
for the notes and components will be replaced with ASpace IDs, so if you have 
cross references embedded in your finding aids, those will be broken).  We had 
a lot of cross references in our source files in the AT, so we opted with that 
first option, as you can see here:  
https://cpb-us-w2.wpmucdn.com/campuspress.yale.edu/dist/3/30/files/2015/06/Unknown-272cqj2.png
  (that screenshot was taken by Maureen Callahan, and described in a lot of 
more detail and other invaluable advice in this blog post: 
https://campuspress.yale.edu/yalearchivesspace/2015/06/14/migration-step-by-step/)
  2.  unless things have changed, be prepared for that migration tool to 
occasionally add data where no data existed before (even when it’s not required 
to do so).  E.g. for our lists in the AT that did not have a title, after the 
migration we wound up with lists in ASpace that had a title of “Missing Title”. 
 That was something we missed early on, but later on we were able to delete all 
of those values from ASpace.  Ditto for other unexpected things, like if in the 
AT someone selected a container type of “Box” but level the container value 
blank, the AT to ASpace migration would create an auto-generated container 
number so that it could keep that container type of “Box” around without 
dropping it during the migration.  We had quite a few instances in the AT where 
someone would add “Box X, Folder”. That behaved fine in the AT, but once we 
migrated, that would turn into something like “Box X, Folder someweirdnumber” 
(ideally it would’ve just come over as “Box X”).

And unless you have EAD files that aren’t in the AT already, I don’t think that 
you should need to go the route of importing EAD into ASpace.  If you do, there 
are more issues and tricks involved there, not to mention the fact that the 
more import options you allow during the migration, the more variety you’ll 
have in the results.  That’s not to say that EAD imports are bad ASpace, since 
they’ve actually improved on the AT’s EAD import process.  Also, long after our 
migration, we still import EAD files into ASpace, especially when adding 
newly-created finding aids that are so large or complex that they’d be hard to 
create directly in ASpace. However, you’ll have to be mindful of all of the 
ways that those EAD imports can muddy up your database (the primary offender 
being the fact that the importer will add values to controlled value lists 
during the import process when it tries to parse them from free text data….  
See the comment here 
https://github.com/archivesspace/archivesspace/blob/bc675bc12b72f6fb7818aae646958c80d54ff4de/backend/app/model/backend_enum_source.rb#L16…
 In other words, free text like “2.5 Linear feet (4 boxes)” would result in a 
new extent type with a value of “Linear Fe

Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace Migration Workflow

2019-12-11 Thread Noah Huffman
Hi Corey,

I’d highly recommend doing as much data cleanup as possible directly in your AT 
database, particularly extent type values, container type values, etc. Of 
course, be sure to back up your database☺

If you’re comfortable writing/running SQL queries, you can connect a free 
database management tool like MySQL Workbench to your AT backend database to 
review/clean your data in bulk.

Alternatively, there are other database management tools like Navicat that let 
you review and edit the backend database tables in a graphical spreadsheet-like 
editor (without having to write SQL). I used Navicat to clean up a lot of AT 
data prior to migrating to ASpace. If you can do all your cleanup in the 14-day 
trial period, then you don’t have to buy the software!

Best of luck,
-Noah


Noah Huffman
Archivist for Metadata, Systems, and Digital Records
David M. Rubenstein Rare Book & Manuscript Library
Duke University | 919-660-5982
http://library.duke.edu/rubenstein/


From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 On Behalf Of Corey 
Schmidt
Sent: Wednesday, December 11, 2019 10:20 AM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

Mark,

Thank you so much for the wonderful info!

I am just beginning to dive into the data, but I will look out for linked cross 
references and the creation of new data in ArchivesSpace. We don’t have any 
EADs that exist outside of AT so far as I’m aware, so the process of exporting 
from AT, cleaning up, then reimporting might be unnecessary as you pointed out. 
If it’s possible to update the AT database directly, that would save so much 
time and effort. The articles you linked were very helpful and should give me a 
basis for how to approach this and other potential problems.

Thanks again!

Corey
From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Custer, Mark
Sent: Tuesday, December 10, 2019 6:33 PM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Corey,

First of all, welcome to the ArchivesSpace community!  Your project will 
definitely make you an ArchivesSpace expert in no time.

Glancing at your workflow document, it looks like you’ve got all of your bases 
covered.  I would strongly suggest running the AT to ASpace migration a couple 
of times (just to get familiar with it), and also to get a few other folks to 
help spot-check the results (the more eyes / institutional experience the 
better), before you go ahead and do the final migration.  It’s a been a long 
while since I used that tool.  I do remember, though, that when we started 
testing it out, the tool couldn’t be used to migrate multiple AT databases into 
a single ASpace database.  That feature was added a long time back, though, so 
you *should* be good to go with migrating your two AT databases into a single 
version of ASpace, which I would highly recommend.

Regarding the AT to ASpace migration tool, just off the top of my head, I’d 
also add:


  1.  if you have linked cross references in your current EAD files, you’ll 
either want to make sure to run the migration with the “-refid_original” 
parameter, or set aside some time after the migration to go back and update 
those linked cross references (during the migration, all of the IDs in the AT 
for the notes and components will be replaced with ASpace IDs, so if you have 
cross references embedded in your finding aids, those will be broken).  We had 
a lot of cross references in our source files in the AT, so we opted with that 
first option, as you can see here:  
https://cpb-us-w2.wpmucdn.com/campuspress.yale.edu/dist/3/30/files/2015/06/Unknown-272cqj2.png<https://urldefense.proofpoint.com/v2/url?u=https-3A__cpb-2Dus-2Dw2.wpmucdn.com_campuspress.yale.edu_dist_3_30_files_2015_06_Unknown-2D272cqj2.png&d=DwMGaQ&c=imBPVzF25OnBgGmVOlcsiEgHoG1i6YHLR0Sj_gZ4adc&r=F0JE8U9-xhxe_nE7d7aEUi-uqfKqvYJ222bS0oz9mko&m=vo2cEUnvLpW5VnkjGgT51bFLOVXx20ZT_riutVaGWdk&s=wAFpobhQCHykVKaA3PvxMD1LV9nuhYN6NlBik8fLndQ&e=>
  (that screenshot was taken by Maureen Callahan, and described in a lot of 
more detail and other invaluable advice in this blog post: 
https://campuspress.yale.edu/yalearchivesspace/2015/06/14/migration-step-by-step/<https://urldefense.proofpoint.com/v2/url?u=https-3A__campuspress.yale.edu_yalearchivesspace_2015_06_14_migration-2Dstep-2Dby-2Dstep_&d=DwMGaQ&c=imBPVzF25OnBgGmVOlcsiEgHoG1i6YHLR0Sj_gZ4adc&r=F0JE8U9-xhxe_nE7d7aEUi-uqfKqvYJ222bS0oz9mko&m=vo2cEUnvLpW5VnkjGgT51bFLOVXx20ZT_riutVaGWdk&s=j8ov-2Tv_zGRR7Hv0uGKmvXsigJAHo14quVlYe2hYTQ&e=>)
  2

Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace Migration Workflow

2019-12-11 Thread Corey Schmidt
Noah,

Thank you for the advice!

I have copies of databases made, but I do not have access to the MySQL 
databases directly, as that is being hosted by a third-party. If I can get 
access to them, I should be able to experiment with cleaning them up directly 
with SQL. I have some experience working with SQLite, so it shouldn’t be too 
hard to learn. I’ll look into using Navicat too, as it seems like a pretty 
handy tool.

Thanks,

Corey

From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 On Behalf Of Noah 
Huffman
Sent: Wednesday, December 11, 2019 12:13 PM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Hi Corey,

I’d highly recommend doing as much data cleanup as possible directly in your AT 
database, particularly extent type values, container type values, etc. Of 
course, be sure to back up your database☺

If you’re comfortable writing/running SQL queries, you can connect a free 
database management tool like MySQL Workbench to your AT backend database to 
review/clean your data in bulk.

Alternatively, there are other database management tools like Navicat that let 
you review and edit the backend database tables in a graphical spreadsheet-like 
editor (without having to write SQL). I used Navicat to clean up a lot of AT 
data prior to migrating to ASpace. If you can do all your cleanup in the 14-day 
trial period, then you don’t have to buy the software!

Best of luck,
-Noah


Noah Huffman
Archivist for Metadata, Systems, and Digital Records
David M. Rubenstein Rare Book & Manuscript Library
Duke University | 919-660-5982
http://library.duke.edu/rubenstein/


From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Corey Schmidt
Sent: Wednesday, December 11, 2019 10:20 AM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

Mark,

Thank you so much for the wonderful info!

I am just beginning to dive into the data, but I will look out for linked cross 
references and the creation of new data in ArchivesSpace. We don’t have any 
EADs that exist outside of AT so far as I’m aware, so the process of exporting 
from AT, cleaning up, then reimporting might be unnecessary as you pointed out. 
If it’s possible to update the AT database directly, that would save so much 
time and effort. The articles you linked were very helpful and should give me a 
basis for how to approach this and other potential problems.

Thanks again!

Corey
From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Custer, Mark
Sent: Tuesday, December 10, 2019 6:33 PM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Corey,

First of all, welcome to the ArchivesSpace community!  Your project will 
definitely make you an ArchivesSpace expert in no time.

Glancing at your workflow document, it looks like you’ve got all of your bases 
covered.  I would strongly suggest running the AT to ASpace migration a couple 
of times (just to get familiar with it), and also to get a few other folks to 
help spot-check the results (the more eyes / institutional experience the 
better), before you go ahead and do the final migration.  It’s a been a long 
while since I used that tool.  I do remember, though, that when we started 
testing it out, the tool couldn’t be used to migrate multiple AT databases into 
a single ASpace database.  That feature was added a long time back, though, so 
you *should* be good to go with migrating your two AT databases into a single 
version of ASpace, which I would highly recommend.

Regarding the AT to ASpace migration tool, just off the top of my head, I’d 
also add:


  1.  if you have linked cross references in your current EAD files, you’ll 
either want to make sure to run the migration with the “-refid_original” 
parameter, or set aside some time after the migration to go back and update 
those linked cross references (during the migration, all of the IDs in the AT 
for the notes and components will be replaced with ASpace IDs, so if you have 
cross references embedded in your finding aids, those will be broken).  We had 
a lot of cross references in our source files in the AT, so we opted with that 
first option, as you can see here:  
https://cpb-us-w2.wpmucdn.com/campuspress.yale.edu/dist/3/30/files/2015/06/Unknown-272cqj2.png<https://

Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace Migration Workflow

2019-12-12 Thread Laney McGlohon
Hi Corey,

I wanted to make sure that you knew that the current version of the AT 
Migration Tool will only work up to ArchivesSpace version 2.6.0 so, when 
testing and for production, make sure you migrate into ArchivesSpace version 
2.6.0 and then upgrade into 2.7.0 or higher from there.

Best,
Laney

From:  on behalf of 
Corey Schmidt 
Reply-To: Archivesspace Users Group 

Date: Wednesday, December 11, 2019 at 12:51 PM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

Noah,

Thank you for the advice!

I have copies of databases made, but I do not have access to the MySQL 
databases directly, as that is being hosted by a third-party. If I can get 
access to them, I should be able to experiment with cleaning them up directly 
with SQL. I have some experience working with SQLite, so it shouldn’t be too 
hard to learn. I’ll look into using Navicat too, as it seems like a pretty 
handy tool.

Thanks,

Corey

From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 On Behalf Of Noah 
Huffman
Sent: Wednesday, December 11, 2019 12:13 PM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Hi Corey,

I’d highly recommend doing as much data cleanup as possible directly in your AT 
database, particularly extent type values, container type values, etc. Of 
course, be sure to back up your database☺

If you’re comfortable writing/running SQL queries, you can connect a free 
database management tool like MySQL Workbench to your AT backend database to 
review/clean your data in bulk.

Alternatively, there are other database management tools like Navicat that let 
you review and edit the backend database tables in a graphical spreadsheet-like 
editor (without having to write SQL). I used Navicat to clean up a lot of AT 
data prior to migrating to ASpace. If you can do all your cleanup in the 14-day 
trial period, then you don’t have to buy the software!

Best of luck,
-Noah


Noah Huffman
Archivist for Metadata, Systems, and Digital Records
David M. Rubenstein Rare Book & Manuscript Library
Duke University | 919-660-5982
http://library.duke.edu/rubenstein/


From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Corey Schmidt
Sent: Wednesday, December 11, 2019 10:20 AM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

Mark,

Thank you so much for the wonderful info!

I am just beginning to dive into the data, but I will look out for linked cross 
references and the creation of new data in ArchivesSpace. We don’t have any 
EADs that exist outside of AT so far as I’m aware, so the process of exporting 
from AT, cleaning up, then reimporting might be unnecessary as you pointed out. 
If it’s possible to update the AT database directly, that would save so much 
time and effort. The articles you linked were very helpful and should give me a 
basis for how to approach this and other potential problems.

Thanks again!

Corey
From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Custer, Mark
Sent: Tuesday, December 10, 2019 6:33 PM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Corey,

First of all, welcome to the ArchivesSpace community!  Your project will 
definitely make you an ArchivesSpace expert in no time.

Glancing at your workflow document, it looks like you’ve got all of your bases 
covered.  I would strongly suggest running the AT to ASpace migration a couple 
of times (just to get familiar with it), and also to get a few other folks to 
help spot-check the results (the more eyes / institutional experience the 
better), before you go ahead and do the final migration.  It’s a been a long 
while since I used that tool.  I do remember, though, that when we started 
testing it out, the tool couldn’t be used to migrate multiple AT databases into 
a single ASpace database.  That feature was added a long time back, though, so 
you *should* be good to go with migrating your two AT databases into a single 
version of ASpace, which I would highly recommend.

Regarding the AT to ASpace migration tool, just off the top of my head, I’d 
also add:


  1.  if you have linked cross references in your current EAD files, you’ll 
either want to make sure to run the migration with the “-

Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace Migration Workflow

2019-12-12 Thread Corey Schmidt
Laney,

Thank you for the heads up! Fortunately, we are running ArchivesSpace version 
2.6.0 and my first test migration has been running smoothly (55 hours later). 
I’ll follow up if I have any issues.

Thanks,

Corey

From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 On Behalf Of Laney 
McGlohon
Sent: Thursday, December 12, 2019 1:08 PM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Hi Corey,

I wanted to make sure that you knew that the current version of the AT 
Migration Tool will only work up to ArchivesSpace version 2.6.0 so, when 
testing and for production, make sure you migrate into ArchivesSpace version 
2.6.0 and then upgrade into 2.7.0 or higher from there.

Best,
Laney

From: 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 on behalf of Corey Schmidt 
mailto:corey.schm...@uga.edu>>
Reply-To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Date: Wednesday, December 11, 2019 at 12:51 PM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

Noah,

Thank you for the advice!

I have copies of databases made, but I do not have access to the MySQL 
databases directly, as that is being hosted by a third-party. If I can get 
access to them, I should be able to experiment with cleaning them up directly 
with SQL. I have some experience working with SQLite, so it shouldn’t be too 
hard to learn. I’ll look into using Navicat too, as it seems like a pretty 
handy tool.

Thanks,

Corey

From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Noah Huffman
Sent: Wednesday, December 11, 2019 12:13 PM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Hi Corey,

I’d highly recommend doing as much data cleanup as possible directly in your AT 
database, particularly extent type values, container type values, etc. Of 
course, be sure to back up your database☺

If you’re comfortable writing/running SQL queries, you can connect a free 
database management tool like MySQL Workbench to your AT backend database to 
review/clean your data in bulk.

Alternatively, there are other database management tools like Navicat that let 
you review and edit the backend database tables in a graphical spreadsheet-like 
editor (without having to write SQL). I used Navicat to clean up a lot of AT 
data prior to migrating to ASpace. If you can do all your cleanup in the 14-day 
trial period, then you don’t have to buy the software!

Best of luck,
-Noah


Noah Huffman
Archivist for Metadata, Systems, and Digital Records
David M. Rubenstein Rare Book & Manuscript Library
Duke University | 919-660-5982
http://library.duke.edu/rubenstein/


From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Corey Schmidt
Sent: Wednesday, December 11, 2019 10:20 AM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

Mark,

Thank you so much for the wonderful info!

I am just beginning to dive into the data, but I will look out for linked cross 
references and the creation of new data in ArchivesSpace. We don’t have any 
EADs that exist outside of AT so far as I’m aware, so the process of exporting 
from AT, cleaning up, then reimporting might be unnecessary as you pointed out. 
If it’s possible to update the AT database directly, that would save so much 
time and effort. The articles you linked were very helpful and should give me a 
basis for how to approach this and other potential problems.

Thanks again!

Corey
From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org<mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of Custer, Mark
Sent: Tuesday, December 10, 2019 6:33 PM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] Archivists' Toolkit to ArchivesSpace 
Migration Workflow

[External Sender]
Corey,

First of all, welcome to the ArchivesSpace community!  Your project will 
definitely make you an ArchivesSpace expert in no time.

Glancing at your workflow document, it loo