Re: XML File Size for Post.jar

2015-07-14 Thread Erik Hatcher
Ravi - don’t get hung up on post.jar - it’s just a means to an end. Use good ol’ curl if you’re having issues with post.jar. But really, 2GB? Is that a single document? Or a bunch of documents? If it’s a bunch of documents, definitely split it up into multiple files. — Erik Hatcher, Senior

Re: XML File Size for Post.jar

2015-07-13 Thread Upayavira
ge- > > From: Alexandre Rafalovitch [mailto:arafa...@gmail.com] > > Sent: Monday, July 13, 2015 3:01 PM > > To: solr-user > > Subject: Re: XML File Size for Post.jar > > > > I don't think you can do files that big. The memory would blow out. > > You su

Re: XML File Size for Post.jar

2015-07-13 Thread Alexandre Rafalovitch
M > To: solr-user > Subject: Re: XML File Size for Post.jar > > I don't think you can do files that big. The memory would blow out. > You sure you cannot chunk it into smaller document sets? Or make it a > streaming parsing with DIH in a pull fashion? > > Regards, >

RE: XML File Size for Post.jar

2015-07-13 Thread EXTERNAL Taminidi Ravi (ETI, AA-AS/PAS-PTS)
: solr-user Subject: Re: XML File Size for Post.jar I don't think you can do files that big. The memory would blow out. You sure you cannot chunk it into smaller document sets? Or make it a streaming parsing with DIH in a pull fashion? Regards, Alex. Solr Analyzers, Tokenizers, Filters,

Re: XML File Size for Post.jar

2015-07-13 Thread Alexandre Rafalovitch
I don't think you can do files that big. The memory would blow out. You sure you cannot chunk it into smaller document sets? Or make it a streaming parsing with DIH in a pull fashion? Regards, Alex. Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: http://www.solr-start.com/