[dspace-tech] Re: solr

i think the solr server is not running because when I do the following wget -O - http://localhost:8080/solr/search/select?q=test i'm getting the following results: --2018-11-10 18:54:46-- http://localhost:8080/solr/search/select?q=test Resolving localhost (localhost)... ::1, 127.0.0.1 Connecti

Re: [dspace-tech] Re: solr

Hi Gilbert, The "Solr" webapp is created alongside your DSpace webapp. So, it should be available at [dspace]/webapps/solr/ after you complete the installation process (mvn package; ant update). If you copied that "solr" folder over to Tomcat, then it should be available to Tomcat. So, you may w

[dspace-tech] Re: Solr indexing problem

Hi Are you able to ping your solr server? Try using lynx browser on the server to browse to the solr server: # lynx http://localhost:8080/solr/search or try wget # wget http://localhost:8080/solr/search and see what error gets thrown to the screen. I'm guessing localhost resolves because jsp

[dspace-tech] Re: Solr indexing problem

Yes, it is 8082 On Fri, Jun 24, 2016 at 10:48 AM, Hayden Young wrote: > Is your port address correct? 8082? Not 8080? > > > On Friday, June 24, 2016 at 11:31:24 AM UTC+8, Pawan Agrawal wrote: > >> >> Thanks for the reply. >> >> Yes, I have records in dspace. In dsapce home I am able to see the >

[dspace-tech] Re: Solr ERROR 404

Hi Juan, If Solr is returning a 404 then it's likely either a configuration issue or Solr is somehow crashing on you in some way (but the latter is less likely if you don't see issues in Solr logs). I'd recommend following the steps in our Troubleshooting Guide to see if there are additional e

[dspace-tech] Re: Solr ERROR 404

You're Right Tim! It was a misconfiguration in *Apache, it had a ReverseProxy for the route /search. *I removed that line and everything works fine now. thank you for your time! Juan. El martes, 21 de mayo de 2024 a las 9:32:17 UTC-5, DSpace Technical Support escribió: > Hi Juan, > > If Solr

[dspace-tech] Re: Solr filterCache too small?

An interesting question. How would one measure the actual cache effectiveness? It seems to me that changes to this sort of thing would be difficult to judge by simply oberving overall performance. -- All messages to this mailing list should adhere to the DuraSpace Code of Conduct: https://du

[dspace-tech] Re: Solr lock obtained timeout

On Tuesday, March 19, 2019 at 11:35:47 AM UTC-4, Alan Orth wrote: > > Dear list, > > In the last few months we've been having issues with Solr throwing "Error > creating core" errors one out of every two times we start Tomcat. This > results in our statistics from previous years being inaccessibl

Re: [dspace-tech] Re: Solr indexing problem

What do you get when you try and access: http://localhost:8080/solr/search/select?q=*:* On 23/06/16 18:27, Dr. Pawan Agrawal wrote: I am facing the same problem. HTTP://localhost:8080/solr is accessible On Jun 23, 2016 1:45 PM, "Hayden Young" > wrote:

Re: [dspace-tech] Re: Solr indexing problem

on accessing http://localhost:8082/solr/#/ Solr is accessible On accessing http://localhost:8082/solr/search/ Error 404 is coming on accessing http://localhost:8082/solr/search/select?q=*.* Following error is coming This XML file does not appear to have any style information associated with

Re: [dspace-tech] Re: Solr indexing problem

Your solr server looks to be running. what you've pasted below shows it is correctly querying but you have not indexed any records. If you have records in dspace run from the command line: # /path/to/your/dspace/bin/dspace index-discovery xmlui is not accessible (It is returning a white scree

Fwd: [dspace-tech] Re: Solr indexing problem

Thanks for the reply. Yes, I have records in dspace. In dsapce home I am able to see the communities, and name of author, articles written by them. However, I am not able to access pdf of the same. assetstore contains all pdf. on running command dsapce/bin/dspace index-discovery I received followi

Re: [dspace-tech] Re: Solr indexing problem

Is your port address correct? 8082? Not 8080? On Friday, June 24, 2016 at 11:31:24 AM UTC+8, Pawan Agrawal wrote: > > > Thanks for the reply. > > Yes, I have records in dspace. In dsapce home I am able to see the > communities, and name of author, articles written by them. However, I am > not ab

Re: [dspace-tech] Re: Solr indexing problem

okay that's a very strange problem. Only other thing I can think of is to explicitly set the port on the solr.xml config. Back up /path/to/dspace/solr/solr.xml Open /path/to/dspace/solr/solr.xml Change: to Restart tomcat and see if that fixes the connection refused issue (but the fac

Re: [dspace-tech] Re: Solr indexing problem

Yes, in fact till now i am failing to get solution of the same on web. also tried to optimize the collection using command dspace index-discovery -o which sucessfully worked but dspace index-discovery is not working. Today i tried to run the same command on the another installation but surprisingl

[dspace-tech] Re: Solr multicore join queries

Hi Claudia, Did you find the solution to this? I also need to list items and their number of downloads. http://localhost:8080/solr/statistics/select?indent=on&rows=0&q=type:0&facet=true&facet.limit=10&facet.field=owningItem&fq=-isBot:true&fq=-(bundleName:[*+TO+*]-bundleName:ORIGINAL)&fq=-(statis

[dspace-tech] Re: solr search can't find

A little late but, I've had luck with using the containers name like: "http://dspacesolr:8983/solr"; On Friday, March 31, 2023 at 8:43:00 AM UTC-5 Tianyi Gu wrote: > Hi, > > I am trying to run dspace backend from docker the lastest version. It > failed to run. Log file is as below: > > 2023-03-

[dspace-tech] Re: solr error importing stats

(I sent it early be mistake) https://mail.google.com/mail/u/0/?tab=rm&ogbl#search/Exception+writing+document+id/FMfcgzGtvsbMhlrcPsHZXVSJjRcZSsvW https://stackoverflow.com/questions/37070593/how-to-deal-with-document-contains-at-least-one-immense-term-in-solr 1) What would cause this (on the pro

[dspace-tech] Re: solr error importing stats

Hi James, I have to admit, I've never seen that error before. My guess is there's something odd/different (or incorrect) with the data that you are trying to import. But, I don't know what it could be. That error mentions the "query" field is the problematic one. Have you looked at the data

[dspace-tech] Re: Solr Core Name Prefix

For those who might need it: Setting solr.multicorePrefix = folder_name_ should reflect core prefixes (which reside, e.g., in [solr]/server/solr/configsets), like: folder_name_authority folder_name_oai folder_name_qaevent etc. piątek, 17 maja 2024 o 16:30:25 UTC+1 Peter napisał(a): > Hello, > >

[dspace-tech] Re: Solr export an import inconsistencies

Hi Shaun, Hm, these scripts were definitely written with just 'statistics' in mind (hence the names of the commands)... I like the idea of trying them out to do exports/imports of other solr indexes but I'm not surprised that a few things aren't working properly there will be some assumptio

Re: [dspace-tech] Re: Solr filterCache too small?

Dear Mark, I see that you can monitor cache status and evictions in the Solr UI. As far as I understand the filterCache, it will store the results of 512 queries where filter query (fq) was used. For example, if I want to see how many views a particular item has: http://localhost:3000/solr/statis

Re: [dspace-tech] Re: Solr filterCache too small?

Dear Mark, I found an excellent resource on calculating the filterCache size on the solr-user mailing list archives[0]. In 2014 one user wrote an article detailing their testing extensively[1]. Basically, the filterCache can end up using many gigabytes of the JVM's heap depending on how many docum

Re: [dspace-tech] Re: Solr lock obtained timeout

Thanks for the response, Mark. I have started testing Solr 4.10.4 in a few development environments will share my notes after some time. Regarding the lock files, I might be barking up the wrong tree because it seems like Solr never deletes these: I did a quick check by adding a `find /dspace -typ

Re: [dspace-tech] Re: Solr lock obtained timeout

Dear list, I'm still experiencing sporadic occurrences of the "Error opening new searcher" issue with the Solr statistics core. In our case Tomcat always shuts down cleanly, and even so, manually deleting the write locks before Tomcat startup doesn't seem to help. Thinking about this a bit more, i

Re: [dspace-tech] Re: Solr lock obtained timeout

On Mon, May 06, 2019 at 11:50:15AM +0300, Alan Orth wrote: > I'm still experiencing sporadic occurrences of the "Error opening new > searcher" issue with the Solr statistics core. In our case Tomcat always > shuts down cleanly, and even so, manually deleting the write locks before > Tomcat startup

Re: [dspace-tech] Re: Solr lock obtained timeout

On Mon, May 06, 2019 at 11:50:15AM +0300, Alan Orth wrote: > Some Solr parameter that seems like it should help is writeLockTimeout. The > default in solrconfig.xml is 1000ms (1 sec). I tried setting it to 5000 and > 1, neither of which helped. Should I try to bump this setting up to > some obs

[dspace-tech] Re: Solr fails to index documents.

Here's how I solved this problem: In solrconfig.xml, for the ExtractingRequestHandler, I specified a stream.type of text/plain so that Tika wouldn't have to guess at the mime type. Since the fulltext element of the solr doc comes strictly from the TEXT bundle (I think), this should not cause a

[dspace-tech] Re: solr search browse - strange results

there may have been something wrong in my dspace.cfg configs regarding search indices I wiped my solr/index/data and brought the old configs back - which solved the problem now I have to hunt for the config issue if anybody has a top regarding pitfalls to avoid - let me know Monika ___

[dspace-tech] Re: Solr Sharding by year ERROR

Nevermind, As this link says: https://wiki.lyrasis.org/display/DSDOC6x/SOLR+Statistics+Maintenance#SOLRStatisticsMaintenance-SolrShardingByYear You have to restart tomcat after sharding... everything is working just fine! El miércoles, 12 de enero de 2022 a las 11:17:23 UTC-5, Juan López escr

Re: [dspace-tech] Re: solr error importing stats

I have found the "query" string in question in the particular csv file that was dumped (solr-export-statistics) from our DSpace 7.6 production machine. I have attached the relevant files to help as to any clue what may be happening. Thank you, James On Tue, Sep 12, 2023 at 11:12 AM DSpace Techni

Re: [dspace-tech] Re: solr error importing stats

During our move from DSpace 6.x to DSpace 7.x we had to combine solr shards and then use the UUIDfix tool to convert the old DSpace Object ID to UUID. Anyways, I saved all the csv files for solr ingest and went looking through them for clues about the "query" in question. The solr-export-statistics

Re: [dspace-tech] Re: solr error importing stats

Hi James, That long query looks suspiciously like a "directory traversal" attack that someone tried to (unsuccessfully) run against your system in the past using the search page. For example: https://www.acunetix.com/websitesecurity/directory-traversal/ (Notice how the query you shared had "

Re: [dspace-tech] Re: solr error importing stats

After evaluation I suspected the same thing. The big issue of the whole matter is that DSpace 7.6, while it was exporting the statistics, was adding escape characters (\) to the path character (again \) probably which increased the "query" size. I am just going to delete that record all together i

Re: [dspace-tech] Re: Solr Core Name Prefix

On Sat, Jul 13, 2024 at 11:17:27AM +, Peter wrote: > For those who might need it: > > Setting > solr.multicorePrefix = folder_name_ > should reflect core prefixes (which reside, e.g., in > [solr]/server/solr/configsets), like: > folder_name_authority > folder_name_oai > folder_name_qaevent >

Re: [dspace-tech] Re: Solr Core Name Prefix

hello user , I want to create all dspace 7.6 docker image and how to create docker file for solr ,postgres and please suggest and reply On Mon, Jul 15, 2024 at 6:14 PM wrote: > On Sat, Jul 13, 2024 at 11:17:27AM +, Peter wrote: > > For those who might need it: > > > > Setting > > solr.mul

Re: [dspace-tech] Re: Solr Core Name Prefix

Hi, DSpace already has sample Docker images in our codebase which you can use to build your own. A summary of the available DSpace Docker images can be found at https://wiki.lyrasis.org/display/DSPACE/DSpace+Docker+Images Tim On Monday, July 15, 2024 at 10:18:15 AM UTC-5 mdsar...@gmail.com wr

[dspace-tech] Re: Solr url access returning 403 error

*Resolved* Given the fact that the the following config parames were passed in local.cfg dspace.baseUrl = http://my.pc.ip.add:8080 solr.server = http://my.pc.ip.add:8080/solr where my.pc.ip.add are of course digits corresponding to my workstation's (static) IP addr, I had to also allow it exp

[dspace-tech] Re: Solr url access returning 403 error

You can solve this problem by ssh tunneling to your server without any change to the server's configuration. If you have ssh access to the server you can set up a tunnel. Coming from a Linux box I use: ssh -L localhost:9180:127.0.0.1:8080 myusername@my.dspace.server -N If you don't have ssh ke

[dspace-tech] Re: Solr Query of download and view.

Any luck on this Please help.. On Tuesday, September 6, 2016 at 2:14:00 PM UTC+5, Faiyaz Ahmed wrote: > > Hello EveryOne. > > Hope every one is doing well :) > > I need some help regarding Solr Query of download and view of a file. As > you can see at : http://demo.dspace.org/xmlui/handle/

[dspace-tech] Re: Solr Query of download and view.

Waiting for hope On Tuesday, September 6, 2016 at 2:14:00 PM UTC+5, Faiyaz Ahmed wrote: > > Hello EveryOne. > > Hope every one is doing well :) > > I need some help regarding Solr Query of download and view of a file. As > you can see at : http://demo.dspace.org/xmlui/handle/10673/419/st

Re: [dspace-tech] Re: solr search browse - strange results

Hi Monika With regard to test instances, one thing I've stumbled upon is that it seems to be necessary to stop tomcat before backing up the solr database. Otherwise I often have problems starting solr on the test instance, using the backed up files. Not sure if there's a way around that? Sean On

[dspace-tech] Re: Solr and DSpace 7 back end

It occurs to me that I should mention we are running DSpace 7 (experimentally only so far) on Ubuntu 22 LTS. We recently ran into a failure of the server webapp to run when solr was down. On Wednesday, March 8, 2023 at 8:31:42 AM UTC-5 cpgr...@gmail.com wrote: > Is there a standard or recommend

[dspace-tech] Re: Solr statistics shards in DSpace 7.6?

While awaiting an answer to your question, may I propose a tangential question of my own: what do you think sharding is doing for you, and have you seen evidence to support this? Because DSpace uses Solr's sharding support in a very eccentric manner, and I have my doubts that it actually buys

[dspace-tech] Re: SOLR vulnerabilities in v6 (and v5!)?

As long as you are not exposing the DSpace SOLR to the public web interface, the scope of this issue is limited. You should however at least take the upgrade to DSpace 6.4. Edmund On Thursday, April 11, 2024 at 9:52:16 PM UTC+10 Michael White wrote: > Hi, > > > > We have 2 DSpace reposit

[dspace-tech] Re: SOLR Problems - index locked for core - Write.lock

Problem is solved, this error was caused by a typo in /var/lib/tomcat7/conf/Catalina/localhost/oai.xml. The path to the webapp was wrong. -- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop rec

Re: [dspace-tech] Re: Solr Query of download and view.

Thank you so much Bruno for response and now I understand to run Solr Query. Below query I got from solr.log file : 2016-09-19 15:57:44,851 INFO org.apache.solr.core.SolrCore @ [statistics] webapp=/solr path=/select params={facet=true&shards=localhost:8080/solr/statistics-2015,localhost:8080/sol

Re: [dspace-tech] Re: Solr Query of download and view.

Hey! Glad it helped!! As a said, you will have to parse the response to get this info. The field of interest for you is "numFound". For example, when i execute the query that i cited in the first message i get the following response: { "responseHeader":{ "status":0, "QTime":2, "par

[dspace-tech] Re: solr result text highlight in different languages

It has nothing to do with the language but what should be highlighted and where. Check this link https://solr.apache.org/guide/8_2/highlighting.html You welcome On Thursday, January 27, 2022 at 8:29:22 AM UTC+3 ayatr...@gmail.com wrote: > currently I am working on dspace 7.1 and I am having an

Re: [dspace-tech] Re: Solr Query of download and view.

Hi, Can you please tell me how I can find the internal-id for Community? Thanks, Karol poniedziałek, 19 września 2016 o 17:13:34 UTC+2 Bruno Nocera Zanette napisał(a): > Hey! Glad it helped!! > > As a said, you will have to parse the response to get this info. The field > of interest for you

Re: [dspace-tech] Re: Solr Query of download and view.

Hi Karol If you're comfortable trawling through the solr.log, you'll find the community uuid referenced when you access that community, e.g.: 2022-06-08 13:50:26,967 INFO org.apache.solr.core.SolrCore @ [search] webapp=/solr path=/select params={f.has_content_in_original_bundle.facet.limit=3&fac

[dspace-tech] Re: SOLR error update dspace 5.2 -> 6.3 -> 7.0 ,

Hi, Before we can provide any help, you would need to check the Solr logs to get more details on the underlying error. It's possible it's something as simple as a permissions error, or something like that. Notice how that "SolrCore Initialization Failures" red box says at the bottom to "Pleas

[dspace-tech] Re: SOLR error update dspace 5.2 -> 6.3 -> 7.0 ,

Hi, Unfortunately that logging screenshot isn't much help either. There's a lot of errors there which seems like it could imply some major issue right at the beginning of startup. You may want to check to see if earlier logs exist (as earlier errors may snowball into those later errors). You

[dspace-tech] Re: SOLR error update dspace 5.2 -> 6.3 -> 7.0 ,

I understand, in the same way I thank you very much for your help, could you tell me where that solr log would be? It is true what it says, I have searched for the resolution of these generic errors on the internet and in this group but I always found different solutions, probably because of

Re: [dspace-tech] Re: Solr statistics shards in DSpace 7.6?

On Mon, Nov 6, 2023 at 2:38 PM DSpace Technical Support < dspace-tech@googlegroups.com> wrote: > While awaiting an answer to your question, may I propose a tangential > question of my own: what do you think sharding is doing for you, and have > you seen evidence to support this? > > > > Mark, I d

Re: [dspace-tech] Re: Solr statistics shards in DSpace 7.6?

Hello We experience some problems with date ranges into big cores (60Gb), that are solved sharding. Software as dspace-stats-collector of "lareferencia" fail working with this cores (https://github.com/lareferencia/dspace-stats-collector) Maybe sharding is not the best sollution, but works.

Re: [dspace-tech] Re: Solr statistics shards in DSpace 7.6?

Hi Keith, To answer the initial question, as far as I'm aware, Solr Sharding of Statistics should work in DSpace 7.6.x. However, prior versions may have issues. These two fixes in particular didn't come into DSpace until 7.6.x: * 7.6 - Fix issue with statistics loading after sharding: https:

[dspace-tech] Re: Solr incremental files store in different Drive

Hi, I'm not an expert in configuring Solr's folder/storage directories. But, my best guess is you'd likely want to tell Solr to store it's data in a different location (by configurating the data directory in Solr): https://solr.apache.org/guide/8_0/datadir-and-directoryfactory-in-solrconfig.h

Re: [dspace-tech] Re: SOLR error update dspace 5.2 -> 6.3 -> 7.0 ,

On Mon, Jun 13, 2022 at 03:18:43PM -0700, Jorge Alberto Bonilla Castaneda wrote: > I understand, in the same way I thank you very much for your help, could > you tell me where that solr log would be? The precise answer depends on how you have installed and configured Solr, and how it is started.

Re: [dspace-tech] Re: SOLR error update dspace 5.2 -> 6.3 -> 7.0 ,

Hi everyone I checked what the solr log said, and I found a few errors, I'll send you the file, solr hasn't been implemented for long on the server so the log doesn't have as many rows Any recommendation is more than welcome. El martes, 14 de junio de 2022 a las 8:21:22 UTC-6, Mark H. Wood

Re: [dspace-tech] Re: SOLR error update dspace 5.2 -> 6.3 -> 7.0 ,

Hi, The important error in that log is this one: Caused by: org.apache.lucene.index.IndexFormatTooOldException: Format version is not supported (resource BufferedChecksumIndexInput(MMapIndexInput(path="/opt/solr-8.11.1/server/solr/configsets/oai/data/index/segments_1"))): 3 (needs to be betwe

Re: [dspace-tech] Re: SOLR error update dspace 5.2 -> 6.3 -> 7.0 ,

hello After reviewing the documentation and the problems that were reported to me, I was able to solve the problem by deleting the solr folder that contained the old 6.3 cores before running the command ant update so that the new files are downloaded, when doing that it shows me the cores co

Re: [dspace-tech] Re: Solr incremental files store in different Drive

Thanks for reply. Your method worked perfectly for me. On Mon, 5 Aug 2024 at 9:32 PM, DSpace Technical Support < dspace-tech@googlegroups.com> wrote: > Hi, > > I'm not an expert in configuring Solr's folder/storage directories. But, > my best guess is you'd likely want to tell Solr to store it's

[dspace-tech] Re: SOLR Query doesn't coincide with DSpace Item Usage Statistics

Change isBot:true to isBot:false . The statistics on the page show where they aren't bots, your query asks for where they are bots. On Saturday, 2 March 2019 00:37:16 UTC+11, Jose Antonio Galeano Cardenas wrote: > > Hi! In the usage statistics on DSpace I get a total views of 136 but when > I

Re: [dspace-tech] Re: SOLR Query doesn't coincide with DSpace Item Usage Statistics

Dear Genevieve, The bot part of Jose's query is correct because it is negated. Having said that, I also agree that using "isBot:false" is easier to understand than "-isBot:true". The issue is that "type:0" is for item downloads—essentially "views" of bitstreams. He should be using "type:2" for it