Hi Guys!
I've removed the two largest documents which were very large. One of which
consisted of 1 field and was around 4MB (text)..
This fixed my issue..
Kind regards,
Bram Rongen
On Fri, Apr 20, 2012 at 2:09 PM, Bram Rongen m...@bramrongen.nl wrote:
Hmm, reading your reply again I see
Good point! Do you store the large file in your documents, or just index them?
Do you have a largest file limit in your environment? Try this:
ulimit -a
What is the file size?
On Thu, Apr 19, 2012 at 8:04 AM, Shawn Heisey s...@elyograg.org wrote:
On 4/19/2012 7:49 AM, Bram Rongen wrote:
Yeah, I'm indexing some PDF documents.. I've extracted the text through
tika (pre-indexing).. and the largest field in my DB is 20MB. That's quite
extensive ;) My Solution for the moment is to cut this text to the first
500KB, that should be enough for a decent index and search capabilities..
Hmm, reading your reply again I see that Solr only uses the first 10k
tokens from each field so field length should not be a problem per se.. It
could be my document contain very large tokens and unorganized tokens,
could this startle Solr?
On Fri, Apr 20, 2012 at 2:03 PM, Bram Rongen
Hello Shawn,
Thanks very much for your answer.
Yesterday I've started indexing again but this time on Solr 3.6.. Again
Solr is failing around the same time, but not exactly (now the largest fdt
file is 4.8G).. It's right after the moment I receive memory-errors at the
Drupal side which make me
I've discovered some documents are 100+MB in size.. Could this be the
problem?
On Thu, Apr 19, 2012 at 3:49 PM, Bram Rongen m...@bramrongen.nl wrote:
Hello Shawn,
Thanks very much for your answer.
Yesterday I've started indexing again but this time on Solr 3.6.. Again
Solr is failing
On 4/19/2012 7:49 AM, Bram Rongen wrote:
Yesterday I've started indexing again but this time on Solr 3.6.. Again
Solr is failing around the same time, but not exactly (now the largest fdt
file is 4.8G).. It's right after the moment I receive memory-errors at the
Drupal side which make me
Dear fellow Solr users,
I've been using Solr for a very short time now and I'm stuck. I'm trying to
index a drupal website consisting of 1.2 million smaller nodes and 300k
larger nodes (~400kb avg)..
I'm using Solr 3.5 on a dedicated Ubuntu 10.04 box with 3TB of diskspace
and 16GB of memory.
On 4/18/2012 6:17 AM, Bram Rongen wrote:
I'm using Solr 3.5 on a dedicated Ubuntu 10.04 box with 3TB of diskspace
and 16GB of memory. I've tried using the sun JRE and OpenJDK, both
resulting in the same problem. Indexing works great until my .fdt file
reaches the size of 4.9GB/ 5217987319b. At
On 4/18/2012 6:17 AM, Bram Rongen wrote:
I've been using Solr for a very short time now and I'm stuck. I'm trying to
index a drupal website consisting of 1.2 million smaller nodes and 300k
larger nodes (~400kb avg)..
A followup to my previous reply: Your ramBufferSizeMB is only 32, the
10 matches
Mail list logo
