[
https://issues.apache.org/jira/browse/SOLR-579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12598737#action_12598737
]
Hoss Man commented on SOLR-579:
-------------------------------
bq. If everyone has to write their own "ComplexPost" tool in order to populate
their instances of Solr, it would be a waste of time and effort. Isn't there a
requirement for a general purpose reusable tool, and wouldn't it's natural home
be the Solr project?
unless people just happen to have their data lying arround in XML docs that
match the Solr XmlUpdateHandler syntax, then yes, people are going to have to
write their own code to import their data -- no matter how robust
SimplePostTool may be, they need something to convert that source data into
messages to Solr.
If people want to use java, SolrJ provides a much better way to do this for 99%
of the users in the world then SimplePostTool, if people want to use another
language, then the client libraries for those languages (some of which already
exist, and some of which need to be improved before they are as useful as
SolrJ) are still a better option then saying "convert your data to this XML
format, dump it in a directory, and then use SimplePostTool.
> Extend SimplePost with RecurseDirectories, threads, document encoding ,
> number of docs per commit
> -------------------------------------------------------------------------------------------------
>
> Key: SOLR-579
> URL: https://issues.apache.org/jira/browse/SOLR-579
> Project: Solr
> Issue Type: New Feature
> Affects Versions: 1.3
> Environment: Applies to all platforms
> Reporter: Patrick Debois
> Priority: Minor
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> -When specifying a directory, simplepost should read also the contents of a
> directory
> New options for the commandline (some only usefull in DATAMODE= files)
> -RECURSEDIRS
> Recursive read of directories as an option, this is usefull for
> directories with a lot of files where the commandline expansion fails and
> xargs is too slow
> -DOCENCODING (default = system encoding or UTF-8)
> For non utf-8 clients , simplepost should include a way to set the
> encoding of the documents posted
> -THREADSIZE (default =1 )
> For large volume posts, a threading pool makes sense , using JDK 1.5
> Threadpool model
> -DOCSPERCOMMIT (default = 1)
> Number of documents after which a commit is done, instead of only at
> the end
> Note: not to break the existing behaviour of the existing SimplePost tool
> (post.sh) might be used in scripts
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
