Thanks for the info Gert! I decided to investigate this going down a little different route of performance tuning. Something I know very little about w/r/t Java applications, but I found this[1] random documentation page helpful (I promise it isn't an incorrect image link to poor Huell this time).
I hadn't known about all of this wonderful parrall threading parameters, and after adding a bit of what I've learned hear to my start up parameters, things seem to be behaving a lot snappier. Which got me to thinking about the possiblity of folks sharing how they tune fcrepo with the type of objects that manage. Is that something of interest? cheers! -nruest [1] http://www.liferay.com/documentation/liferay-portal/6.1/user-guide/-/ai/performance-tuni-5 On 13-10-07 05:20 AM, Gert Schmeltz Pedersen wrote: > Hi Nick, > > You may see the time consumption for Fedora and for GSearch separately from > the fedora.log and fedoragsearch.log, and for GSearch you may see the time > for each datastream. > > Concerning GSearch, you may see from foxmlToSolr.xslt how tika is called for > the video stream. You may index datastreams on the metadata or on the > contents or both, and if your foxmlToSolr.xslt by default try to index the > video contents, then you should tailor your foxmlToSolr.xslt, see the GSearch > documentation page about how to call tika on datastreams. > > Gert > > > On 07/10/2013, at 04.03, Nick Ruest wrote: > >> Hi folks, >> >> Late last week I decided to test out ingesting some large files (5GB >> video file) with Plupload[1][2], and while I was able to ingest just >> fine through Islandora interface, I've noticed fcrepo has become >> basically worthless since. I wanted to try and wait it out and see if >> this is just its thing with large files I noticed a while back -- taking >> forever to decided how to handle it -- but, about 4 days later, we still >> have massive processes rocking[3]. >> >> Is this expected behaviour? Is this a faux pas (dude never let fcrepo >> manage a large file!)? Gsearch/Tika chugging away at the file forever? >> Or, something else? >> >> I'm running fcrepo 3.6.2 on an Islandora stack (gsearch + solr), and >> here[4] is my install.properities. Let me know if you need anymore >> config info, or anything else. >> >> cheers! >> >> -nruest >> >> [1] https://drupal.org/project/plupload >> [2] https://github.com/discoverygarden/islandora_plupload >> [3] http://i.imgur.com/3ewAeSD.jpga >> [4] https://gist.github.com/ruebot/01fbbec034b7331dcc94 >> >> ------------------------------------------------------------------------------ >> October Webinars: Code for Performance >> Free Intel webinars can help you accelerate application performance. >> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from >> the latest Intel processors and coprocessors. See abstracts and register > >> http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk >> _______________________________________________ >> Fedora-commons-users mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/fedora-commons-users > > > ------------------------------------------------------------------------------ > October Webinars: Code for Performance > Free Intel webinars can help you accelerate application performance. > Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from > the latest Intel processors and coprocessors. See abstracts and register > > http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk > _______________________________________________ > Fedora-commons-users mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/fedora-commons-users > ------------------------------------------------------------------------------ October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60134071&iu=/4140/ostg.clktrk _______________________________________________ Fedora-commons-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
