Balkrishnan.V wrote: > Marshall Schor <m...@...> writes: > > >> Did you try increasing your java heap size? What size are you running with? >> >> -Marshall >> >> > > Hi Marshall, > > ThankYou for your time. > > Yes, I tried resetting the jvm-heap-size to 1327MB and now I am able to run > the > CVD successfully with 101MB text-log-file. > > Can you please let me know : > (i) Is this maximum heap-size setting (1327MB) enough to handle a text-file of > size 2GB(say) ? It depends on what you're running in UIMA. But, since 1327MB = about 1.3 GB, and that's less than the size of the text file you're hoping to process (2GB), maybe it it isn't big enough. But, it really depends on the components you're running within UIMA. For instance, you might be running components which you've written, which read a small part of the 2GB text file, as a "chunk", and then process that through the pipeline of UIMA components, and then the next small chunk could be processed, etc. It really just depends on the particular processing you're doing. > If not, then any idea the approximate maximum text-file size > that can be handled with this heap-size setting ? > No, again it depends not on UIMA, but more on the components UIMA is running as annotators. > (ii) Why I am unable to increase the JVM Heap-Size more than 1327MB ? > I don't know. It may be a limitation of your particular machine. We have seen users who have 64-bit linux machines, running with heap sizes of 16 GB, for instance. > (iii) What should I do to handle the text-files that cannot be handled within > the bounds of the heap-size setting of 1327MB ? > A good approach is to break these things up into more managable work-units, and process each one separately.
-Marshall > Kind Regards, > Balkrishnan.V > > > >
