Re: How to display LARGE amounts of Data in a Timely Fashion
They can't see that much on one screen anyway. So break it up and only give them 500 at a time. You can use startrow and maxrows for that. Or you can spit it out in a .csv file that will pop up in excel or openoffice. I did this all the time with CF8 and it is even easier now with cf9 because you can use cfspreadsheet. On Wed, Oct 21, 2009 at 9:22 PM, Rick Colman rcol...@cox.net wrote: I need to query, retrieve and display a large amount of data; i.e. 4100 rows by 50 columns of numerics, to the browser screen. It is really slow, and after some testing, the bottleneck seems to be on the page that displays the data. The query is OK and connection is ok. But, the user has to wait an unacceptably long time for the results to show. Ideally, I would like to break the returned data into about 10 spreadsheet-style grids, with one grid per tab. TABLES is way too slow. Any ideas on how to render the displayed data quickly would be appreciated. Rick. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:327489 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: How to display LARGE amounts of Data in a Timely Fashion
well, you can try using CFFLUSH in the end of your cfoutput query=myQuery block. -- From: David Mineer min...@gmail.com Sent: Thursday, October 22, 2009 12:37 PM To: cf-talk cf-talk@houseoffusion.com Subject: Re: How to display LARGE amounts of Data in a Timely Fashion They can't see that much on one screen anyway. So break it up and only give them 500 at a time. You can use startrow and maxrows for that. Or you can spit it out in a .csv file that will pop up in excel or openoffice. I did this all the time with CF8 and it is even easier now with cf9 because you can use cfspreadsheet. On Wed, Oct 21, 2009 at 9:22 PM, Rick Colman rcol...@cox.net wrote: I need to query, retrieve and display a large amount of data; i.e. 4100 rows by 50 columns of numerics, to the browser screen. It is really slow, and after some testing, the bottleneck seems to be on the page that displays the data. The query is OK and connection is ok. But, the user has to wait an unacceptably long time for the results to show. Ideally, I would like to break the returned data into about 10 spreadsheet-style grids, with one grid per tab. TABLES is way too slow. Any ideas on how to render the displayed data quickly would be appreciated. Rick. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:327490 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: How to display LARGE amounts of Data in a Timely Fashion
If you're putting the data on 10 different tabs, then only call or render the data for the first one and use DHTML / Ajax to load the each other tab only when a user clicks on it. Basically, it's slow right now simply because the size of the HTML document being returned to the user is probably over a MB of data ... simply takes time to stream it from the web server and assemble it on the desktop. If you only render 1/10 of the table (i.e., one tab), the overall file size will be much smaller and you should notice a significant improvement in speed. Then each tab click can just call an Ajax function to populate the new tab with the right data and the user will only have to wait for that 2nd 10th of data to be rendered. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:327494 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: How to display LARGE amounts of Data in a Timely Fashion
cache your query so u dont have to access the database each time Sincerely, Chuka I.W. Anene Chief Software Eng./CEO Quorium Solutions www.quorium.org 07029609185,07032696113 From: Rick Colman rcol...@cox.net To: cf-talk cf-talk@houseoffusion.com Sent: Thu, October 22, 2009 4:22:07 AM Subject: How to display LARGE amounts of Data in a Timely Fashion I need to query, retrieve and display a large amount of data; i.e. 4100 rows by 50 columns of numerics, to the browser screen. It is really slow, and after some testing, the bottleneck seems to be on the page that displays the data. The query is OK and connection is ok. But, the user has to wait an unacceptably long time for the results to show. Ideally, I would like to break the returned data into about 10 spreadsheet-style grids, with one grid per tab. TABLES is way too slow. Any ideas on how to render the displayed data quickly would be appreciated. Rick. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:327495 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: How to display LARGE amounts of Data in a Timely Fashion
Your problem is probably render time, which makes sense if you have a ton of data coming out in a table layout. What you can do is remove as many of the tables as possible, especially for any layout stuff, headers, footers and the like. If you wrap the entire contents of the page in a table, your page has to finish downloading and then figure out how to render, which takes time. You can streamline this process by using CSS to lay your page out. Another thing, and probably the best increase, is if you use a fixed table layout (table-layout:fixed; in CSS). That will render your table with the same dimensions as your first table row, thus forcing the rest of the rows to fall in line. With that set, the browser doesn't have to download the whole table to start rendering it, it renders as it downloads. Another trick that I see around lately is the automatic scroll loading (don't know the official term). The idea is that once someone reaches the bottom of a page of data, more data loads, so you never really reach the bottom until the data has all been loaded. Google Reader was one of the first big sites to do this, but now it's more common. With this trick, you only need to load a couple pagefuls of data at a time. Consider that last one, sure, but DO those first two, for real. nathan strutz [Blog and Family @ http://www.dopefly.com/] [AZCFUG Manager @ http://www.azcfug.org/] [Twitter @nathanstrutz] On Wed, Oct 21, 2009 at 8:22 PM, Rick Colman rcol...@cox.net wrote: I need to query, retrieve and display a large amount of data; i.e. 4100 rows by 50 columns of numerics, to the browser screen. It is really slow, and after some testing, the bottleneck seems to be on the page that displays the data. The query is OK and connection is ok. But, the user has to wait an unacceptably long time for the results to show. Ideally, I would like to break the returned data into about 10 spreadsheet-style grids, with one grid per tab. TABLES is way too slow. Any ideas on how to render the displayed data quickly would be appreciated. Rick. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:327529 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
How to display LARGE amounts of Data in a Timely Fashion
I need to query, retrieve and display a large amount of data; i.e. 4100 rows by 50 columns of numerics, to the browser screen. It is really slow, and after some testing, the bottleneck seems to be on the page that displays the data. The query is OK and connection is ok. But, the user has to wait an unacceptably long time for the results to show. Ideally, I would like to break the returned data into about 10 spreadsheet-style grids, with one grid per tab. TABLES is way too slow. Any ideas on how to render the displayed data quickly would be appreciated. Rick. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:327487 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
