[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-09-11 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: results.zip This Zip contains latest test runs. The Difference is for

[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-09-10 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: CUD_Latency_Report-11-09-13.zip Hi Here are the latest CUD results which

[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-09-09 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: CassandraUpdateLatencyReport.txt

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-29 Thread Ian Boston
Hi Dishara, That was definitely worth doing. Looks like it is flat scalable on read in this form up to 100M items per collection. Before I get too excited about the results, are you absolutely certain that the ResourceProvider is retrieving the items requested and not just short circuiting

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-29 Thread Dishara Wijewardana
Hi Ian, On Thu, Aug 29, 2013 at 12:13 PM, Ian Boston i...@tfd.co.uk wrote: Hi Dishara, That was definitely worth doing. Looks like it is flat scalable on read in this form up to 100M items per collection. Before I get too excited about the results, are you absolutely certain that the

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-29 Thread Ian Boston
I'll think you are clear to go onto the next phase if you are willing. I think you have an option. Do write or do access control. Write will be more exciting, access control will be more thought intensive. You may already have most of the write code, as you just wrote 100M items! Which one

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-29 Thread Dishara Wijewardana
Hi Ian, On Thu, Aug 29, 2013 at 5:32 PM, Ian Boston i...@tfd.co.uk wrote: I'll think you are clear to go onto the next phase if you are willing. I think you have an option. Do write or do access control. Write will be more exciting, access control will be more thought intensive. You

[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-28 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: CassandraLatencyReport_V1.txt Here I am attaching the latest test

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-28 Thread Dishara Wijewardana
Hi Ian, I have updated the latest results in the JIRA, and please find the report named CassandraLatencyReport_V1.txt to get the latest results. I improve the report also to get average latency under each node. So the node E and F will have 10M and 100M collection. P.S It took 7 hrs for me to

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-27 Thread Ian Boston
Hi Dishara, Thats excellent. More evidence that read scalability is flat as the number of child entries rises. All the results are distributed around 14ms regardless of the number of child nodes upto 1M. How much effort would it be to populate a collection with 10M and 100M items ? Ian On 27

[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-26 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: CassandraLatencyReport.txt Please find the attached Latency report with

[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-26 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: CassandraIntegrationTest.patch Here I am attaching the patch which has

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-26 Thread Dishara Wijewardana
Hi Ian, I have updated the JIRA https://issues.apache.org/jira/browse/SLING-3026 with the new test results. I have created a integration test which runs inside /launchpad/integration-tests which does the exact same thing you mentioned. And I am writing the results to a file and that is also

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-26 Thread Dishara Wijewardana
Hi Ian, FYI The exercise data is the first 100 even numbers and test data is first 100 odd numbers. On Tue, Aug 27, 2013 at 11:12 AM, Dishara Wijewardana ddwijeward...@gmail.com wrote: Hi Ian, I have updated the JIRA https://issues.apache.org/jira/browse/SLING-3026 with the new test

Re: [jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-24 Thread Ian Boston
Hi Dishara, Interesting, Read times show no correlation the number of items in a collection. (thats good!). From 1 - 1M child nodes the access time is almost identical showing flat scalability for read as collection size grows. Since the results are so good, I think it would be worth expanding

[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-22 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: SLING_CASSANDRA_LATENCY_STATS_22-08-2013.txt Here I have attached the

[jira] [Updated] (SLING-3026) Cassandra Resource Provider READ Latency Stats

2013-08-22 Thread Dishara Wijewardana (JIRA)
[ https://issues.apache.org/jira/browse/SLING-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dishara Wijewardana updated SLING-3026: --- Attachment: SLING_CASSANDRA_LATENCY_STATS_TWO_CHART_22-08-2013.png