On Tue, 2016-06-28 at 16:42 +, Rajendran, Prabaharan wrote:
> Please suggest me which is best way to index(multithreaded) if your
> input format is text/csv (file).
Last I tried, it was pretty straight forward: Split your CSV in chunks
and start about as many separate uploads as you have (real
-
From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com]
Sent: 28 June 2016 16:06
To: solr-user@lucene.apache.org; Toke Eskildsen
Subject: Re: SimplePostTool: FATAL: IOException while posting data:
java.io.IOException: too many bytes written
This was fixed in 5.5 and 6.0. You can upload
024m-Xss256k
>
> java -Dtype=text/csv -Dparams="separator=%09"
> -Durl=http://localhost:8983/solr/mycollection/update -jar
> ..\example\exampledocs\post.jar ..\example\exampledocs\largefile.txt
>
> While doing index got error like below,
> SimplePostTool: FATA
> > I am trying to index a text file about 4.2 GB in size. [...]
> >
> > SimplePostTool: FATAL: IOException while posting data:
> java.io.IOException: too many bytes written
>
> SimplePostTool uses
> HttpUrlConnection.setFixedLengthStreamingMode(file_size)
> where f
On Mon, 2016-06-27 at 13:24 +, Rajendran, Prabaharan wrote:
> I am trying to index a text file about 4.2 GB in size. [...]
>
> SimplePostTool: FATAL: IOException while posting data: java.io.IOException:
> too many bytes written
SimpleP
k
>
> java -Dtype=text/csv -Dparams="separator=%09"
> -Durl=http://localhost:8983/solr/mycollection/update -jar
> ..\example\exampledocs\post.jar ..\example\exampledocs\largefile.txt
>
> While doing index got error like below,
> SimplePostTool: FATAL: IOException while p
r/mycollection/update -jar
..\example\exampledocs\post.jar ..\example\exampledocs\largefile.txt
While doing index got error like below,
SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too
many bytes written
Kindly let me know, if I need to change (increase me