Re: [Archivesspace_Users_Group] PUI inheritance configuration

[Custer, Mark]

Cory,

I just tested this out with a new build of ASpace, since I knew this worked 
before!  At first I didn't get it to work either, but that was because I just 
copied over one of your examples as is.  When I looked at the ASpace JSON 
records, though, I realized that your genreform example just needed to be 
changed slightly so that the type match was looking for "genre_form" instead, 
i.e.:

{
  :property => "subjects",
  :inherit_if => proc {|json| json.select {|j| ! 
j['_resolved']['terms'].select { |t| t['term_type'] == 'genre_form'}.empty? } },
  :inherit_directly => true
}

I didn't test any of the other mappings (or the "skip_if" parameters), so I 
can't say if all of those term types are accurate or not, but I definitely got 
this one to inherit once I added the underscore to the term type.

I hope that helps,

Mark





From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 on behalf of James 
Bullen 
Sent: Wednesday, February 19, 2020 10:14 PM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] PUI inheritance configuration


Hi Cory,

It’s been some years since this was in my head, but it looks good.

The :inherit_if on the first rule should be selecting all subjects that have at 
least one term with a ‘genreform’ type.


Cheers,
James


On Feb 20, 2020, at 1:37 AM, Cory Nimer 
mailto:cory_ni...@byu.edu>> wrote:

James,

To my knowledge, a complete reindex was done following the changes (other 
changes in note inheritance did appear as anticipated). However, the subject 
inheritance did not seem to work. Are the inheritance statements below 
structured correctly, or are there other reasons that these elements would not 
be visible in the interface?

Best,

Cory

From: 
archivesspace_users_group-boun...@lyralists.lyrasis.org
 
mailto:archivesspace_users_group-boun...@lyralists.lyrasis.org>>
 On Behalf Of James Bullen
Sent: Tuesday, February 18, 2020 6:49 PM
To: Archivesspace Users Group 
mailto:archivesspace_users_group@lyralists.lyrasis.org>>
Subject: Re: [Archivesspace_Users_Group] PUI inheritance configuration


Hi Cory,

Have you reindexed?

The PUI runs exclusively from the PUI index so these changes won’t take effect 
until the relevant records have been reindexed.


Cheers,
James



On Feb 19, 2020, at 2:26 AM, Cory Nimer 
mailto:cory_ni...@byu.edu>> wrote:

We are continuing to tweak our PUI configuration, and are interested in testing 
inclusion of subject terms. Based on the configuration template, our IT staff 
have attempted to add the code below but it does not appear to be working after 
a restart and reindex:

{
  :property => 'subjects',
  :inherit_if => proc {|json| json.select {|j| ! j['_resolved']['terms'].select 
{ |t| t['term_type'] == 'genreform'}.empty? } },
  :inherit_directly => true
},
{
  :property => 'subjects',
  :skip_if => proc {|json| ['file', 'item'].include?(json['level']) },
  :inherit_if => proc {|json| json.select {|j| ! j['_resolved']['terms'].select 
{ |t| t['term_type'] == 'topical'}.empty? } },
  :inherit_directly => true
},
{
  :property => 'subjects',
  :skip_if => proc {|json| ['file', 'item'].include?(json['level']) },
  :inherit_if => proc {|json| json.select {|j| ! j['_resolved']['terms'].select 
{ |t| t['term_type'] == 'title'}.empty? } },
  :inherit_directly => true
},
{
  :property => 'subjects',
  :skip_if => proc {|json| ['file', 'item'].include?(json['level']) },
  :inherit_if => proc {|json| json.select {|j| ! j['_resolved']['terms'].select 
{ |t| t['term_type'] == 'geogname'}.empty? } },
  :inherit_directly => true
},

Has anyone else successfully included subject terms in their PUI inheritance 
configuration, or have suggestions for what might be wrong? We are currently 
running version 2.5.1.

Thanks,

Cory Nimer
University Archivist
Brigham Young University
801-422-6091

___
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group@lyralists.lyrasis.org
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group


!DSPAM:5e4c053f111932459259872!

!DSPAM:5e4d482a179227770718730! ___
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group@lyralists.lyrasis.org

Re: [Archivesspace_Users_Group] Image hosting for Aspace

[Jason Loeffler]

Amazon S3 has the least friction by far, most resiliency and security, and
gives you options down the road should you need to extend your service copy
functionality, make your assets portable, or migrate to a repository
implementation. Steps include creating an S3 bucket on AWS, set up a secure
FTP connection to move files to the bucket, and configure/harden
permissions properly. Just make sure you 1) have some sense of the volume
of files (measured in multipes of bytes) beforehand as it is a metered
service and 2) exert some control over which parties in your organization
have access to the bucket. This has come up enough on the forum to warrant
unofficial high-level documentation for non-techinical administrators. If
there's demand, I can pull something together.

--
Jason Loeffler
Anthology of Recorded Music, Inc.
20 Jay Street
Suite 1001
Brooklyn, New York 11201


On Fri, Feb 21, 2020 at 2:32 PM Nic Stanton-Roark 
wrote:

> Thomas,
>
> Having looked into flickr a bit, I don't think it's a usable option, at
> least not for the kind of direct hosting we wanted to use it for. They
> actively discourage direct linking to the image unless a link to the
> photopage on their domain is provided as well, and if they discover that
> users are backdooring the process they consider it a violation of the TOS
> and may deactivate your account.
>
> I think we'll continue using Omeka, but I wish we had a quicker, messier
> option for bulk uploads that don't need metadata associated with the
> photos.
>
>
> *Nicholas Stanton-Roark*  |  Archivist  | Robert A. Nicholson University
> Library
> Anderson University  |  1100 E. Fifth St, Anderson, IN 46012
> (765) 641-4285 <%28765%29%20641%204285>  |  ndro...@anderson.edu
>
>
> On Fri, Feb 21, 2020 at 10:16 AM Thomas San Filippo <
> sanfilippo_tho...@wheatoncollege.edu> wrote:
>
>> We have the same question. We've considered Flickr, Amazon S3, ArtSTOR,
>> our digital repository.
>>
>> What are other folks using?
>>
>>
>> *Thomas San Filippo*
>> *Systems and Educational Technology Liaison*
>>
>> Pronouns: he/him/his; they/them/their(s)
>>
>> Madeleine Clark Wallace Library
>> , G34
>> Wheaton College 
>> 26 E. Main Street, Norton, MA 02766 
>> (508) 286-5601 <+15082865601>
>> Twitter: @WallaceLibrary  |
>> Instagram: /wallacelibrary  |
>> Facebook: wheatoncollege 
>> On 2/21/20 9:50 AM, Nic Stanton-Roark wrote:
>>
>> Hey all,
>>
>> We have a gallery collection that is going to use Aspace to catalog their
>> display collections.
>>
>> One thing they need is an embedded thumbnail image of each object. I know
>> how to use extptr tags in notes to embed images hosted elsewhere, but am
>> looking for advice on where to easily host images that need to be
>> referenced but do not need any kind of metadata or description for the
>> images themselves. They would be used only for illustrative purposes in
>> Aspace itself. This is work that will be done in repetitive fashion by
>> iterations of short-term interns, student workers, etc, so it just needs to
>> be straight forward.
>>
>> Thanks for any suggestions or examples.
>>
>>
>> *Nicholas Stanton-Roark*  |  Archivist  | Robert A. Nicholson University
>> Library
>> Anderson University  |  1100 E. Fifth St, Anderson, IN 46012
>> (765) 641-4285 <%28765%29%20641%204285>  |  ndro...@anderson.edu
>>
>> ___
>> Archivesspace_Users_Group mailing 
>> listArchivesspace_Users_Group@lyralists.lyrasis.orghttp://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>>
>> ___
>> Archivesspace_Users_Group mailing list
>> Archivesspace_Users_Group@lyralists.lyrasis.org
>> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>>
> ___
> Archivesspace_Users_Group mailing list
> Archivesspace_Users_Group@lyralists.lyrasis.org
> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>
___
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group@lyralists.lyrasis.org
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group

Re: [Archivesspace_Users_Group] Image hosting for Aspace

[Nic Stanton-Roark]

Thomas,

Having looked into flickr a bit, I don't think it's a usable option, at
least not for the kind of direct hosting we wanted to use it for. They
actively discourage direct linking to the image unless a link to the
photopage on their domain is provided as well, and if they discover that
users are backdooring the process they consider it a violation of the TOS
and may deactivate your account.

I think we'll continue using Omeka, but I wish we had a quicker, messier
option for bulk uploads that don't need metadata associated with the
photos.


*Nicholas Stanton-Roark*  |  Archivist  | Robert A. Nicholson University
Library
Anderson University  |  1100 E. Fifth St, Anderson, IN 46012
(765) 641-4285 <%28765%29%20641%204285>  |  ndro...@anderson.edu


On Fri, Feb 21, 2020 at 10:16 AM Thomas San Filippo <
sanfilippo_tho...@wheatoncollege.edu> wrote:

> We have the same question. We've considered Flickr, Amazon S3, ArtSTOR,
> our digital repository.
>
> What are other folks using?
>
>
> *Thomas San Filippo*
> *Systems and Educational Technology Liaison*
>
> Pronouns: he/him/his; they/them/their(s)
>
> Madeleine Clark Wallace Library
> , G34
> Wheaton College 
> 26 E. Main Street, Norton, MA 02766 
> (508) 286-5601 <+15082865601>
> Twitter: @WallaceLibrary  |
> Instagram: /wallacelibrary  |
> Facebook: wheatoncollege 
> On 2/21/20 9:50 AM, Nic Stanton-Roark wrote:
>
> Hey all,
>
> We have a gallery collection that is going to use Aspace to catalog their
> display collections.
>
> One thing they need is an embedded thumbnail image of each object. I know
> how to use extptr tags in notes to embed images hosted elsewhere, but am
> looking for advice on where to easily host images that need to be
> referenced but do not need any kind of metadata or description for the
> images themselves. They would be used only for illustrative purposes in
> Aspace itself. This is work that will be done in repetitive fashion by
> iterations of short-term interns, student workers, etc, so it just needs to
> be straight forward.
>
> Thanks for any suggestions or examples.
>
>
> *Nicholas Stanton-Roark*  |  Archivist  | Robert A. Nicholson University
> Library
> Anderson University  |  1100 E. Fifth St, Anderson, IN 46012
> (765) 641-4285 <%28765%29%20641%204285>  |  ndro...@anderson.edu
>
> ___
> Archivesspace_Users_Group mailing 
> listArchivesspace_Users_Group@lyralists.lyrasis.orghttp://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>
> ___
> Archivesspace_Users_Group mailing list
> Archivesspace_Users_Group@lyralists.lyrasis.org
> http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
>
___
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group@lyralists.lyrasis.org
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group

Re: [Archivesspace_Users_Group] Method to Pause Indexer during Job Run?

[Andrew Morrison]

Thank you for the information and thoughts.

Andrew.


On Thu, 2020-02-20 at 22:17 +, Joshua D. Shaw wrote:
To close this out, I decided to go with a migration because of the time 
involved to update. A migration takes about 10-15 minutes, but the job looked 
like it was gonna take about 10-20 *hours* to complete.

I also got an error about the position constraint failing in the db during a 
job run, which may be down to a locking issue? I didn't chase it down enough 
because I was testing the migration and realized the time benefit.

On the ANW-902 issue, if there were a way to get the state of the current 
indexer run - not just whether the indexer is on or off, then I think it would 
be doable to

1) wait until the current indexer run completes
2) send a pause indexer update
3) run the job
4) send a resume indexer update

Its that first step that needs some research/thought.

Joshua


From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 on behalf of Joshua 
D. Shaw 
Sent: Wednesday, February 19, 2020 9:56 AM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Method to Pause Indexer during Job Run?

One additional little bit of info that may complicate things. It seems like the 
pause will not shut down an indexer run midway. It will only take effect after 
the current run is complete. At least that seems to be the case. For the import 
jobs, that may make things a bit dicey if a large index run is in progress when 
the import job kicks off, since you could still get that sync happening. I 
guess you could wait for the indexer to complete (not sure how to get that 
status) and then kick off the import job? Or, perhaps the import jobs should 
add a final step that iterates through all of the created objects and sets the 
mtime to the import job completion time?

Joshua


From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 on behalf of Joshua 
D. Shaw 
Sent: Wednesday, February 19, 2020 9:40 AM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Method to Pause Indexer during Job Run?

I think I've got it going by adding a little loop that checks the indexer state 
via the response body of the indexer (ie does it contain the string "paused") 
and then sending a "put" with the duration parameter set to either pause (you 
can specify an exact duration or just let it default to 900 seconds) or resume 
(duration = 0). Things to note:

1) For some reason, the indexer actually listens at 
AppConfig[:indexer_url]/aspace-indexer/ not just AppConfig[:indexer_url]
2) There's no nice ASHTTP wrapper for put, so you have to construct the 
Net::HTTP for the put yourself

I don't see why similar logic couldn't be incorporated into any import job so 
that the import has a chance to finish up before the indexer runs again, 
preventing the sync issues in ANW-902.

I've got about 280k objects to check and update, so I'll see if I run into any 
indexer issues once the job is completed. The only thing I've seen that may be 
related to that is a snapshot failure when doing a large index run (full or 
otherwise), but I don't think I've ever seen it completely fail due to a commit 
timeout. That almost sounds more like disk access or network (if you're running 
a separate SOLR instance).

Joshua


From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 on behalf of Andrew 
Morrison 
Sent: Wednesday, February 19, 2020 8:32 AM
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Method to Pause Indexer during Job Run?

I'd be interested in hearing if you get this to work, because it could be 
useful in fixing this issue:

https://archivesspace.atlassian.net/browse/ANW-902

Also, if you're making a truly mammoth update, which will be followed by a 
re-index of nearly everything, you might want to consider increasing the 
AppConfig[:indexer_solr_timeout_seconds] config setting. It may be our 
infrastructure, but I've found that Solr commit's phase can take so long that 
ArchivesSpace times out before it finishes, causing it to start the whole 
re-index again from scratch. We've set it to 1800 to avoid this, but YMMV.

Andrew.


From: archivesspace_users_group-boun...@lyralists.lyrasis.org 
 on behalf of Joshua 
D. Shaw 
Sent: 19 February 2020 13:05
To: Archivesspace Users Group 
Subject: Re: [Archivesspace_Users_Group] Method to Pause Indexer during Job Run?

Thanks, James. I glanced at that, but somehow didn't realize those were 
endpoints I could hit. I'll give it a go!

Joshua

Re: [Archivesspace_Users_Group] Image hosting for Aspace

[Thomas San Filippo]

We have the same question. We've considered Flickr, Amazon S3, ArtSTOR, 
our digital repository.


What are other folks using?


*Thomas San Filippo*
/Systems and Educational Technology Liaison/

Pronouns: he/him/his; they/them/their(s)

Madeleine Clark Wallace Library 
, G34

Wheaton College 
26 E. Main Street, Norton, MA 02766 
(508) 286-5601 
Twitter: @WallaceLibrary  | 
Instagram: /wallacelibrary  | 
Facebook: wheatoncollege 

On 2/21/20 9:50 AM, Nic Stanton-Roark wrote:

Hey all,

We have a gallery collection that is going to use Aspace to catalog 
their display collections.


One thing they need is an embedded thumbnail image of each object. I 
know how to use extptr tags in notes to embed images hosted elsewhere, 
but am looking for advice on where to easily host images that need to 
be referenced but do not need any kind of metadata or description for 
the images themselves. They would be used only for illustrative 
purposes in Aspace itself. This is work that will be done in 
repetitive fashion by iterations of short-term interns, student 
workers, etc, so it just needs to be straight forward.


Thanks for any suggestions or examples.


*Nicholas Stanton-Roark*|  Archivist  | Robert A. Nicholson University 
Library

Anderson University  |  1100 E. Fifth St, Anderson, IN 46012
(765) 641-4285   | ndro...@anderson.edu 



___
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group@lyralists.lyrasis.org
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group
___
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group@lyralists.lyrasis.org
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group

[Archivesspace_Users_Group] Image hosting for Aspace

[Nic Stanton-Roark]

Hey all,

We have a gallery collection that is going to use Aspace to catalog their
display collections.

One thing they need is an embedded thumbnail image of each object. I know
how to use extptr tags in notes to embed images hosted elsewhere, but am
looking for advice on where to easily host images that need to be
referenced but do not need any kind of metadata or description for the
images themselves. They would be used only for illustrative purposes in
Aspace itself. This is work that will be done in repetitive fashion by
iterations of short-term interns, student workers, etc, so it just needs to
be straight forward.

Thanks for any suggestions or examples.


*Nicholas Stanton-Roark*  |  Archivist  | Robert A. Nicholson University
Library
Anderson University  |  1100 E. Fifth St, Anderson, IN 46012
(765) 641-4285 <%28765%29%20641%204285>  |  ndro...@anderson.edu
___
Archivesspace_Users_Group mailing list
Archivesspace_Users_Group@lyralists.lyrasis.org
http://lyralists.lyrasis.org/mailman/listinfo/archivesspace_users_group