[
https://issues.apache.org/jira/browse/CONNECTORS-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638921#comment-13638921
]
Karl Wright commented on CONNECTORS-676:
----------------------------------------
bq. regarding the seeds: i see your point, it could be quite large. i don't see
how to fit a paging paradigm into the connector though. it seems that
processDocuments expects to have a list of the identifiers to begin with.
Actually, activities.addSeedDocument() adds documents one at a time. The only
tricky part is that you cannot call this method from within a secondary thread.
See the wiki connector, though, for a demonstration on how to do this. But
with the cursor architecture this may not be needed.
bq. 1. is there really an issue of too large a memory footprint if each of the
seeds added is just a string of the filename? even with 100 filenames of 255
characters, the memory consumption is only 204k. i didn't know if manifold
keeps all of it in memory anyway or writes it to the db for usage later.
It writes to the DB. But you can put large amounts into memory. The only
requirement I have is that the amount is "bounded" - that is, it never exceeds
some reasonable bound. If the cursor construct allows that to be the case
(e.g. you set a per-call limit of, say, 10000 files, and just loop until you
get back nothing additional) then it meets the criteria just fine.
> Connector for dropbox
> ---------------------
>
> Key: CONNECTORS-676
> URL: https://issues.apache.org/jira/browse/CONNECTORS-676
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Dropbox connector
> Affects Versions: ManifoldCF 1.1.1
> Reporter: Andrew Janowczyk
> Assignee: Karl Wright
> Fix For: ManifoldCF 1.2
>
> Attachments: dropbox-patch.patch
>
>
> Pretty straight forward. It'd be nice to have a connector which can read from
> dropbox.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
