[
https://issues.apache.org/jira/browse/SOLR-994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668348#action_12668348
]
Noble Paul commented on SOLR-994:
---------------------------------
I guess this is already possible w/ any change.
{code}
<entity name="myEntity" processor="XPathEntityProcessor" transformer="MyTrans"
url="http://host:port/path/to/resource?maximum_number_returned=50&return_start_index=${myEntity.somename}";
chunkSize=50></entity>
{code}
The MyTransformer can put in a variable called 'somename' into the row and one
extra variable called '$hasMore' with a value "true" . XPathEntityprocessor
automatically takes up this value 'somename' and make a request after all your
current set of rows are done with.
one extra addition which I can think of is put an implicit variable
'rowsFetchedCount ' into the variableresolver so that it can be directly used .
> EnumeratedEntityTransformer
> ---------------------------
>
> Key: SOLR-994
> URL: https://issues.apache.org/jira/browse/SOLR-994
> Project: Solr
> Issue Type: New Feature
> Components: contrib - DataImportHandler
> Affects Versions: 1.4
> Reporter: Jared Flatow
> Priority: Minor
> Fix For: 1.4
>
> Attachments: SOLR-994.patch
>
>
> An EnumeratedEntityTransformer gives the Nth entity an accessible
> ${<entity>.n} == N. In addition, the entity may specify a chunkSize
> attribute, which will cause the chunkSize'th entity to gain the attribute
> $hasMore=true. A template for a nextUrl may also be specified on the entity,
> that is different from the url template.
> Consider an API:
> http://host:port/path/to/resource?maximum_number_returned=50&return_start_index=0
> an entity could specify:
> <entity name="myEntity" processor="XPathEntityProcessor"
> transformer="EnumeratedEntityTransformer"
> url="http://host:port/path/to/resource?maximum_number_returned=50&return_start_index=${myEntity.n}";
> chunkSize=50>...</entity>
> This allows for fetching entities in chunks until there are < chunkSize
> returned.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
