Re: cffile read 47 MB
Do you need to read the whole file in or could you process it line by line Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 19 Dec 2013 06:54, John M Bliss bliss.j...@gmail.com wrote: The FileRead function seems to have the same problem as cffile. Java heap space errors. Am I doing something wrong? On Mon, Dec 9, 2013 at 5:34 PM, richpaul7 . richpa...@gmail.com wrote: use the FileRead function. it can handle large files and doesn't suck up all the resources. forget trying to use CFFILE for large files. http://livedocs.adobe.com/coldfusion/8/htmldocs/help.html?content=functions_e-g_13.html On Mon, Dec 9, 2013 at 2:30 PM, Russ Michaels r...@michaels.me.uk wrote: On 32bit you can only use around 1gb, it will fail to start if you assign too much. Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 9 Dec 2013 22:25, John M Bliss bliss.j...@gmail.com wrote: And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357367 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
I found a way to reduce the size of the XML, so this is no longer an issue (for me). Thanks for the advice! On Thu, Dec 19, 2013 at 3:56 AM, Russ Michaels r...@michaels.me.uk wrote: Do you need to read the whole file in or could you process it line by line Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 19 Dec 2013 06:54, John M Bliss bliss.j...@gmail.com wrote: The FileRead function seems to have the same problem as cffile. Java heap space errors. Am I doing something wrong? On Mon, Dec 9, 2013 at 5:34 PM, richpaul7 . richpa...@gmail.com wrote: use the FileRead function. it can handle large files and doesn't suck up all the resources. forget trying to use CFFILE for large files. http://livedocs.adobe.com/coldfusion/8/htmldocs/help.html?content=functions_e-g_13.html On Mon, Dec 9, 2013 at 2:30 PM, Russ Michaels r...@michaels.me.uk wrote: On 32bit you can only use around 1gb, it will fail to start if you assign too much. Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 9 Dec 2013 22:25, John M Bliss bliss.j...@gmail.com wrote: And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357368 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
maybe try using FileOpen, then FileRead myfile = FileOpen(c:\temp\test1.txt, read); x = FileRead(myfile, 100); On Thu, Dec 19, 2013 at 12:56 AM, Russ Michaels r...@michaels.me.uk wrote: Do you need to read the whole file in or could you process it line by line Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 19 Dec 2013 06:54, John M Bliss bliss.j...@gmail.com wrote: The FileRead function seems to have the same problem as cffile. Java heap space errors. Am I doing something wrong? On Mon, Dec 9, 2013 at 5:34 PM, richpaul7 . richpa...@gmail.com wrote: use the FileRead function. it can handle large files and doesn't suck up all the resources. forget trying to use CFFILE for large files. http://livedocs.adobe.com/coldfusion/8/htmldocs/help.html?content=functions_e-g_13.html On Mon, Dec 9, 2013 at 2:30 PM, Russ Michaels r...@michaels.me.uk wrote: On 32bit you can only use around 1gb, it will fail to start if you assign too much. Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 9 Dec 2013 22:25, John M Bliss bliss.j...@gmail.com wrote: And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357372 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
The FileRead function seems to have the same problem as cffile. Java heap space errors. Am I doing something wrong? On Mon, Dec 9, 2013 at 5:34 PM, richpaul7 . richpa...@gmail.com wrote: use the FileRead function. it can handle large files and doesn't suck up all the resources. forget trying to use CFFILE for large files. http://livedocs.adobe.com/coldfusion/8/htmldocs/help.html?content=functions_e-g_13.html On Mon, Dec 9, 2013 at 2:30 PM, Russ Michaels r...@michaels.me.uk wrote: On 32bit you can only use around 1gb, it will fail to start if you assign too much. Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 9 Dec 2013 22:25, John M Bliss bliss.j...@gmail.com wrote: And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357359 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
cffile read 47 MB
Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? -- John Bliss - http://about.me/jbliss ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357318 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? Are you just doing a CFFILE read? Or are you also converting it into an XML object? Because that will increase the internal memory size needed by quite a bit. But yes, you can probably fix this by allocating more memory to the JVM. Nowadays, if you're running a 64-bit version of CF, you can throw a lot of memory at it and avoid these types of problems most of the time. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ http://training.figleaf.com/ Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on GSA Schedule, and provides the highest caliber vendor-authorized instruction at our training centers, online, or onsite. ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357319 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357320 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357321 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
On 32bit you can only use around 1gb, it will fail to start if you assign too much. Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 9 Dec 2013 22:25, John M Bliss bliss.j...@gmail.com wrote: And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357323 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
Switch to 64-bit. :-) (Seriously. There's not much hope for memory-intensive operations on a 32-bit machine. You're limited to only being able to utilize something like 3.4GB of RAM, and that just ain't gonna cut it.) On Mon, Dec 9, 2013 at 5:25 PM, John M Bliss bliss.j...@gmail.com wrote: And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357322 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
use the FileRead function. it can handle large files and doesn't suck up all the resources. forget trying to use CFFILE for large files. http://livedocs.adobe.com/coldfusion/8/htmldocs/help.html?content=functions_e-g_13.html On Mon, Dec 9, 2013 at 2:30 PM, Russ Michaels r...@michaels.me.uk wrote: On 32bit you can only use around 1gb, it will fail to start if you assign too much. Russ Michaels www.michaels.me.uk cfmldeveloper.com cflive.net cfsearch.com On 9 Dec 2013 22:25, John M Bliss bliss.j...@gmail.com wrote: And for 32 bit? On Dec 9, 2013 5:14 PM, Steve 'Cutter' Blades cold.fus...@cutterscrossing.com wrote: Looks like you're still using the default install values. On a 64-bit system, I generally look at my overall RAM available, subtract 2GB for the OS, then adjust my CF RAM availability according to what's left, starting at 1 GB max, 256 min, then gradually move up half a gig as required. Finding the right balance in your JVM config (min, max, gc, etc) can really help tweak the performance of your application. Steve 'Cutter' Blades Adobe Community Professional Adobe Certified Expert Advanced Macromedia ColdFusion MX 7 Developer http://cutterscrossing.com Co-Author Learning Ext JS 3.2 Packt Publishing 2010 https://www.packtpub.com/learning-ext-js-3-2-for-building-dynamic-desktop-style-user-interfaces/book The best way to predict the future is to help create it On 12/9/2013 4:01 PM, John M Bliss wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357324 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
Re: cffile read 47 MB
Provided with a disclaimer, as I asked a Java friend about this and he suggested something called Stax api for xml parsing. I did some quick research and found this article. It would be more Java than CF, but hey CF plays nice with that. http://www.javacodegeeks.com/2013/05/parsing-xml-using-dom-sax-and-stax-parser-in-java.html Based on that, I would imagine, CF uses a Dom parser based on its parsing performance. All a bit dependent on the required outcome however as this may be overkill if you just need to read the file. Are you parsing and searching xml, or just doing some file manipulation stuff? Byron Mann Lead Engineer Architect HostMySite.com On Dec 9, 2013 5:04 PM, John M Bliss bliss.j...@gmail.com wrote: Hi, I'm attempting to perform a cffile read on a 47 MB XML file. It's failing but ACF10 is not throwing an error to the browser. Finally dug into the logs and am seeing Java heap space errors. My JVM is configured as such: Min JVM Heap Size - 256 Max JVM Heap Size - 512 JVM Arguments - -XX:MaxPermSize=192m Solution is just to increase those numbers? Does this behavior seem odd? -- John Bliss - http://about.me/jbliss ~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:357325 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm