Re: SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written

2016-06-29 Thread Toke Eskildsen
On Tue, 2016-06-28 at 16:42 +, Rajendran, Prabaharan wrote: > Please suggest me which is best way to index(multithreaded) if your > input format is text/csv (file). Last I tried, it was pretty straight forward: Split your CSV in chunks and start about as many separate uploads as you have (real

RE: SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written

2016-06-28 Thread Rajendran, Prabaharan
- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: 28 June 2016 16:06 To: solr-user@lucene.apache.org; Toke Eskildsen Subject: Re: SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written This was fixed in 5.5 and 6.0. You can upload

RE: SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written

2016-06-28 Thread Rajendran, Prabaharan
024m-Xss256k > > java -Dtype=text/csv -Dparams="separator=%09" > -Durl=http://localhost:8983/solr/mycollection/update -jar > ..\example\exampledocs\post.jar ..\example\exampledocs\largefile.txt > > While doing index got error like below, > SimplePostTool: FATA

Re: SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written

2016-06-28 Thread Shalin Shekhar Mangar
> > I am trying to index a text file about 4.2 GB in size. [...] > > > > SimplePostTool: FATAL: IOException while posting data: > java.io.IOException: too many bytes written > > SimplePostTool uses > HttpUrlConnection.setFixedLengthStreamingMode(file_size) > where f

Re: SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written

2016-06-28 Thread Toke Eskildsen
On Mon, 2016-06-27 at 13:24 +, Rajendran, Prabaharan wrote: > I am trying to index a text file about 4.2 GB in size. [...] > > SimplePostTool: FATAL: IOException while posting data: java.io.IOException: > too many bytes written SimpleP

Re: SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written

2016-06-27 Thread Erick Erickson
k > > java -Dtype=text/csv -Dparams="separator=%09" > -Durl=http://localhost:8983/solr/mycollection/update -jar > ..\example\exampledocs\post.jar ..\example\exampledocs\largefile.txt > > While doing index got error like below, > SimplePostTool: FATAL: IOException while p

SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written

2016-06-27 Thread Rajendran, Prabaharan
r/mycollection/update -jar ..\example\exampledocs\post.jar ..\example\exampledocs\largefile.txt While doing index got error like below, SimplePostTool: FATAL: IOException while posting data: java.io.IOException: too many bytes written Kindly let me know, if I need to change (increase me