Re: [dspace-tech] Re: DSpace 7.6.1 timeouts in production

[Max Nuding]

Hi Abel, hi Carolyn,

a couple notes from us, we've had similar experiences.

> Since those tenths of requests were coming from the Angular frontend, 
I suspected it had to be related to the server-side caching features, 
but I was unable to find the root cause.


The Angular frontend is doing SSR (Server-Side Rendering), which means 
it is constructing the whole page before sending it to the client. This 
is meant to help bots/search engine crawlers by sending a complete page, 
but absolutely kills performance when enough crawlers are active. You're 
seeing so many requests from the Angular frontend, because "this is just 
how it works"!. If you open  your DSpace instance in  browser and watch 
the network tab in the browser console you can see, that you also 
generate tens of requests per page.


We haven't found any good solutions yet, but manage to mitigate the 
issues a bit. We extended our robots.txt.ejs to block a slew of unwanted 
bots (Mostly AI and SEO bots) and we use *a lot* more hardware than the 
recommended amount. Our frontend (together with the proxy) are running 
on 8 cores with 7 frontend instances and 16GB of RAM (although we could 
probably get by with 12GB of RAM). Additionally, we have a second server 
with the backend, solr and database on 6 cores and another 16 GB of RAM.


We have found the requirements listed in the wiki to be very inaccurate, 
especially the frontend needs a *lot* of CPU power (but not as much 
memory).



Best regards

Max

On 26.02.24 21:13, Abel Gómez wrote:

Hi Gabriel,

can it be related to this?

https://groups.google.com/g/dspace-tech/c/ByXn_9oABOo

As explained in the docs 
(https://wiki.lyrasis.org/display/DSDOC7x/Technology+Overview), Server 
Side Rendering (SSR) is disabled when running in dev mode; and as I 
explained in the link above, I have experienced severe performance 
issues in my production site when bots were crawling it.


Maybe that's why you are having issues when running in production mode 
(and not in dev mode).


I think the performance issues I suffered from are caused by SSR and 
caching, but I have not received any "educated opinion" on this issue.


Any similar experience would be really appreciated.

Abel


El domingo, 25 de febrero de 2024 a las 3:20:57 UTC+1, Gabriel Martins 
escribió:


Dear All,

I am experiencing timeout issues when trying to make the DSpace 7
platform available in production with HTTPS when the front end is
served by dspace-ui-deploy. However, I am able to access it
normally when served by 'yarn start:dev'."

I tried following the documentation strictly and also looked into
similar questions on this forum, but unfortunately, I haven't had
any success yet. The issue seems to persist despite following the
recommended steps. It's possible that there might be a specific
configuration or setting that is causing the timeouts when using
HTTPS with dspace prod build.

If anyone has encountered a similar issue, I would greatly
appreciate any guidance or suggestions. Thank you in advance for
your help!

--
All messages to this mailing list should adhere to the Code of 
Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx

---
You received this message because you are subscribed to the Google 
Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send 
an email to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/a002c287-2c7d-4552-a502-60750935ec15n%40googlegroups.com 
.


--
Herr Max Nuding
Softwareentwickler / Abt. IT-Dienste für Forschung und Lehre
Kommunikations-, Informations-, Medienzentrum (KIM)
Universität Konstanz
78467 Konstanz
Tel: +49.7531.88-4658
Raum: B707

--
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.

To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/9702b998-45db-42f6-9c03-2d270854cb50%40uni-konstanz.de.


smime.p7s
Description: S/MIME Cryptographic Signature

RE: [dspace-tech] Where does this item translate? ("dc.contributor.author" and other...)

[Fitchett, Deborah]

Kia ora,

These fields aren’t ever translated as they are essentially the 
names/identifiers of the metadata fields and are stored in the database 
verbatim. “dc.date” (for example) has a specific meaning in the Dublin Core 
taxonomy and is expected by DSpace software and any other systems that 
interoperate with DSpace. People visiting the advanced view page will need to 
be comfortable with reading this format.

If there are people who can’t read that format but need the metadata, you could 
add additional metadata fields onto the simplificado page and manage 
translations on that page.

Deborah

From: dspace-tech@googlegroups.com  On Behalf Of 
Michel Montenegro
Sent: Thursday, February 29, 2024 5:41 AM
To: DSpace Technical Support 
Subject: [dspace-tech] Where does this item translate? ("dc.contributor.author" 
and other...)

You don't often get email from 
michel.montene...@gmail.com. Learn why this 
is important

Caution: This email originated from outside our organisation. Do not click 
links or open attachments unless you recognize the sender and know the content 
is safe.

I don't think this field is translated into Portuguese (pt-BR.json5) or English 
(en.json5).
[cid:image001.png@01DA6B0B.45DAF240]

--
Atenciosamente,
Michel Pinheiro Montenegro
- Bacharel em Sistema de Informação
- [Lato Sensu] Especialista em Engenharia de Sistemas
- [Stricto Sensu] Mestre em Ciência da Computação
- [Stricto Sensu] Doutorando em Ciência da Computação

E-mail/Gtalk: michel.montene...@gmail.com
--
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
---
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to 
dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/CADOAx_ifu6FidjjEMFKoR%3DhtqQ%2BXe6Xv_VFuMg%2BLaT8eQVSpCA%40mail.gmail.com.



"The contents of this e-mail (including any attachments) may be confidential 
and/or subject to copyright. Any unauthorised use, distribution, or copying of 
the contents is expressly prohibited. If you have received this e-mail in 
error, please advise the sender by return e-mail or telephone and then delete 
this e-mail together with all attachments from your system."

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/ME3PR01MB7524385F3418C2885CC70BF5C55F2%40ME3PR01MB7524.ausprd01.prod.outlook.com.

Re: [dspace-tech] Re: Item Counters for Communities and Collections not working well

[Andrew K]

It shows eactly 2 items now...


середу, 28 лютого 2024 р. о 15:05:45 UTC+2 Caty пише:


This collection has 2 items (one existent and one added by me), but it 
shows collection item counter 1:  "Coleção de teste (1)"

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/c56a0cb5-3f67-436f-bc70-60db49b2918fn%40googlegroups.com.

[dspace-tech] DSpace 7.6 Bitstream-level Embargos

[Carolyn Sullivan]

In DSpace 6.3, users were able to embargo all uploaded files at once, which 
was super helpful for when a user uploaded 20+ files to support their 
thesis.  In DSpace 7.6 though, it seems the user has to edit each upload 
individually to designate an embargo for it.  Is there any way to allow a 
user to embargo all uploaded files at once that isn't an item-level embargo 
(ie: we want the item page/metadata visible, we just don't want people to 
view the files)?  

Thanks,
Carolyn. 

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/eeb4bb67-982b-40e1-95e7-9e77d4b1d62cn%40googlegroups.com.

Re: [dspace-tech] Getting rid of jats-Tags in CrossRef-Import

[Sascha Szott]

Hi,

we are facing the same problem in the abstract field of the JSON 
response returned by CrossRef.


I've created a Github issue in the DS CRIS project: 
https://github.com/4Science/DSpace/issues/435


But now I realize that this function is not CRIS specific. Currently, we 
are trying to provide a bug fix by removing the JATS markup.


I'll move the issue (and PR) to the DSpace Github project.

Best regards,
Sascha

Am 28.02.24 um 17:56 schrieb Jarmo Schrader:

Hi Group,

abstracts imported from CrossRef often contain jats-tags (Journal 
Publishing Tag Set). DSpace does not seem to interpret these tags but 
instead shows them as normal text which is ugly an requires manual fixing.
Does anyone have an established solution to remove these tags during 
import?
Or is there a way to make DSpace interpret the tags for display so we 
could keep them?


Cheers
Jarmo

--
Dr. Jarmo Schrader
stellv. Bibliotheksleiter
Fachreferat und EDV
Universität Hildesheim
Universitätsbibliothek
Universitätsplatz 1
31141 Hildesheim

Tel: +49 (0) 5121 - 883 - 93004
jarmo.schra...@uni-hildesheim.de

--
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx 


---
You received this message because you are subscribed to the Google 
Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send 
an email to dspace-tech+unsubscr...@googlegroups.com 
.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/94025452-9be4-4550-9225-52a81d537dda%40uni-hildesheim.de .



--
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.

To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/85038186-d03f-4118-b962-aeae04d9912c%40hsu-hh.de.


smime.p7s
Description: Kryptografische S/MIME-Signatur

[dspace-tech] Direct URLs to documents in bitstream store in DSpace 7?

[McLaughlin, Sean (BAC/LAC)]

Hello,

Can anyone confirm if direct links to assets are still available, for example 
to be exposed in a metadata harvest, in DSpace 7?

In previous versions of DSpace we were able to extract direct links to say, 
PDFs, from metadata, that would appear such as 
"http://institution.ca/bitstream//xx/document.pdfhttp://institution.ca/bitstream//xx/document.pdf%3c/identifier>>"

and now I am seeing only things like
https://institution.ca/bitstreams/4d83d6df-7914-4cd2-b4f3-197a776ccec3/download

I read the support documentation but did not see a clear answer--are the latter 
type of links the only ones provided for in DSpace 7?

Thank you,

Sean

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/YTBPR01MB35527A6C7097D76407B79C76FA582%40YTBPR01MB3552.CANPRD01.PROD.OUTLOOK.COM.

[dspace-tech] Re: Set all DSpace items that do not have an associated file (bitstream) as private

[Javi Rojo Díaz]

Sorry, the query is incorrect. To set the item as private, I have executed: 


*update item set discoverable = false where uuid = 
'c017ed8c-cbe7-4323-80cb-48a831453a39';*

and to set it as public:


*update item set discoverable = true where uuid = 
'c017ed8c-cbe7-4323-80cb-48a831453a39';*


Thanks.

El miércoles, 28 de febrero de 2024 a las 17:45:00 UTC+1, Javi Rojo Díaz 
escribió:

> Hello, 
>
> Thank you very much for the help. I've tried running a SELECT on your 
> query for an item, first while it's public and then while it's private, but 
> I see no change in values when switching between states. I believe the 
> query may not be what I'm looking for.
>
> After some investigation, I managed to set a test item as private from SQL 
> using the following query:
>
>
> *update item set discoverable = true where uuid = 
> 'c017ed8c-cbe7-4323-80cb-48a831453a39';*
>
>
> *[image: Screenshot_6.png]*
>
>  However, the item still appears as public (although labeled as "private") 
> when searched for without being logged in. If I change the item's status to 
> private from the user interface, it works correctly; meaning, when I search 
> for it without being logged in, 
> I cannot find it since it's private. There must be another SQL table I 
> need to modify for the behavior I'm seeking. 
>
> Thank you very much.
>
> El lunes, 26 de febrero de 2024 a las 14:11:03 UTC+1, Matthias Letsch 
> escribió:
>
>> Hello Javi,
>>
>> Do you mean to make them only accessible to administrator? And do you 
>> already have a list of the uuids of your items you want to make private? 
>> (the long hash value which also appears in the url of an item).
>>
>> If so, and if you are somewhat familiar with SQL and the DSpace database, 
>> I'd suggest you could make the changes directly via sql update in the 
>> resourcepolicy table in your database.
>>
>> *Disclaimer: Please take this approach with a grain of salt and test it 
>> on a single item first, preferably in your test environment / test 
>> database. I don't know if there is a solution via the user interface, so 
>> this is what I would do, but if someone knows a more simple and secure 
>> solution via the user interface, I would also prefer the latter!*
>>
>> update resourcepolicy
>> set rpname = 'administrator', rptype = 'TYPE_CUSTOM', epersongroup_id = 
>> '*uuid 
>> of your administrator group*' 
>> where resource_type_id = 2 and action_id = 0 and dspace_object in (*comma 
>> separated list of your uuids*)
>>
>> this changes the existing access policies of your items to your 
>> administrator group only (you have to know the uuid of your administrator 
>> group, too).
>>
>> If you are not yet able to identify your items exactly by uuid, it will 
>> be a little more difficult, as you will then have to work across several 
>> tables (item2bundle, bundle2bitstream) to find out which items do not have 
>> bistreams. I can't go into this in detail at this point.
>>
>> Kind regards,
>> Matthias
>>
>>
>>
>> Javi Rojo Díaz schrieb am Montag, 26. Februar 2024 um 10:27:50 UTC+1:
>>
>>> Good morning, 
>>>
>>> I wanted to ask if there is any way to set all DSpace items that do not 
>>> have an associated file as private.
>>>  
>>> I know it's a bit of a stretch and I can't find information about it, 
>>> but I would appreciate any help. Otherwise, I understand that I will have 
>>> to do it manually, and there are about 700 items... 
>>>
>>> Thank you for your assistance. Best regards."
>>>
>>

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/515886df-a9fb-4f4e-afcd-cc2ca9d9cf14n%40googlegroups.com.

[dspace-tech] Re: Set all DSpace items that do not have an associated file (bitstream) as private

[Javi Rojo Díaz]

Hello, 

Thank you very much for the help. I've tried running a SELECT on your query 
for an item, first while it's public and then while it's private, but I see 
no change in values when switching between states. I believe the query may 
not be what I'm looking for.

After some investigation, I managed to set a test item as private from SQL 
using the following query:


*update item set discoverable = true where uuid = 
'c017ed8c-cbe7-4323-80cb-48a831453a39';*


*[image: Screenshot_6.png]*

 However, the item still appears as public (although labeled as "private") 
when searched for without being logged in. If I change the item's status to 
private from the user interface, it works correctly; meaning, when I search 
for it without being logged in, 
I cannot find it since it's private. There must be another SQL table I need 
to modify for the behavior I'm seeking. 

Thank you very much.

El lunes, 26 de febrero de 2024 a las 14:11:03 UTC+1, Matthias Letsch 
escribió:

> Hello Javi,
>
> Do you mean to make them only accessible to administrator? And do you 
> already have a list of the uuids of your items you want to make private? 
> (the long hash value which also appears in the url of an item).
>
> If so, and if you are somewhat familiar with SQL and the DSpace database, 
> I'd suggest you could make the changes directly via sql update in the 
> resourcepolicy table in your database.
>
> *Disclaimer: Please take this approach with a grain of salt and test it on 
> a single item first, preferably in your test environment / test database. I 
> don't know if there is a solution via the user interface, so this is what I 
> would do, but if someone knows a more simple and secure solution via the 
> user interface, I would also prefer the latter!*
>
> update resourcepolicy
> set rpname = 'administrator', rptype = 'TYPE_CUSTOM', epersongroup_id = 
> '*uuid 
> of your administrator group*' 
> where resource_type_id = 2 and action_id = 0 and dspace_object in (*comma 
> separated list of your uuids*)
>
> this changes the existing access policies of your items to your 
> administrator group only (you have to know the uuid of your administrator 
> group, too).
>
> If you are not yet able to identify your items exactly by uuid, it will be 
> a little more difficult, as you will then have to work across several 
> tables (item2bundle, bundle2bitstream) to find out which items do not have 
> bistreams. I can't go into this in detail at this point.
>
> Kind regards,
> Matthias
>
>
>
> Javi Rojo Díaz schrieb am Montag, 26. Februar 2024 um 10:27:50 UTC+1:
>
>> Good morning, 
>>
>> I wanted to ask if there is any way to set all DSpace items that do not 
>> have an associated file as private.
>>  
>> I know it's a bit of a stretch and I can't find information about it, but 
>> I would appreciate any help. Otherwise, I understand that I will have to do 
>> it manually, and there are about 700 items... 
>>
>> Thank you for your assistance. Best regards."
>>
>

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/ca843616-b584-46ae-a44e-924013b3a1e4n%40googlegroups.com.

[dspace-tech] Where does this item translate? ("dc.contributor.author" and other...)

[Michel Montenegro]

I don't think this field is translated into Portuguese (*pt-BR.json5*) or
English (*en.json5*).
[image: image.png]

-- 
Atenciosamente,
*Michel Pinheiro Montenegro*
- *Bacharel* em Sistema de Informação
- [Lato Sensu] *Especialista* em Engenharia de Sistemas
- [Stricto Sensu] *Mestre* em Ciência da Computação
- [Stricto Sensu] *Doutorando* em Ciência da Computação

E-mail/Gtalk: michel.montene...@gmail.com

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/CADOAx_ifu6FidjjEMFKoR%3DhtqQ%2BXe6Xv_VFuMg%2BLaT8eQVSpCA%40mail.gmail.com.

Re: [dspace-tech] Re: Item Counters for Communities and Collections not working well

[Caty]

Hi Emilio,

I added yesterday an item in the collection 
https://demo.dspace.org/collections/2dc46bf8-772f-4c44-8abd-a4514c23da96 
(Home/Comunidade de teste/Coleção de teste)

This collections has: READ Anonymous ,DEFAULT_ITEM_READ Anonymous, 
DEFAULT_BITSTREAM_READ Anonymous 
and the parent community (Comunidade de teste): READ Anonymous 

This collection has 2 items (one existent and one added by me), but it 
shows collection item counter 1:  "Coleção de teste (1)"

Best regards,
Caty

-- 
All messages to this mailing list should adhere to the Code of Conduct: 
https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/dspace-tech/a3cc8cac-9844-4910-8147-b669a32d3f8an%40googlegroups.com.