[
https://issues.apache.org/jira/browse/OLIO-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shanti Subramanyam updated OLIO-40:
-----------------------------------
Due Date: 28/Aug/09
Description:
As we scale up the number of users, the fileloader takes longer and longer to
load the filestore. Further, the loader clutters the faban log with lots of
messages marking it's progress. The frequency of these msgs need to be reduced.
In addition, the current filestore design of a single directory to hold all the
files is proving to be difficult to manage. It is impossible to even do an 'ls'
in the directory as the number of files is large at scales beyond a few
thousand users. A well-defined directory hierarchy should be used to make
access more reasonable.
was:As we scale up the number of users, the fileloader takes longer and
longer to load the filestore. Further, the loader clutters the faban log with
lots of messages marking it's progress. The frequency of these msgs need to be
reduced.
Priority: Major (was: Minor)
Affects Version/s: 0.1
Fix Version/s: 0.2
Summary: File loader is slow. Filestore architecture is
problematic (was: File loader is slow)
Expanded JIRA to include re-design of filestore to use multiple level
directories.
> File loader is slow. Filestore architecture is problematic
> ----------------------------------------------------------
>
> Key: OLIO-40
> URL: https://issues.apache.org/jira/browse/OLIO-40
> Project: Olio
> Issue Type: Improvement
> Components: generic
> Affects Versions: 0.1
> Reporter: Shanti Subramanyam
> Assignee: Akara Sucharitakul
> Fix For: 0.2
>
>
> As we scale up the number of users, the fileloader takes longer and longer to
> load the filestore. Further, the loader clutters the faban log with lots of
> messages marking it's progress. The frequency of these msgs need to be
> reduced.
> In addition, the current filestore design of a single directory to hold all
> the files is proving to be difficult to manage. It is impossible to even do
> an 'ls' in the directory as the number of files is large at scales beyond a
> few thousand users. A well-defined directory hierarchy should be used to make
> access more reasonable.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
