On 02.09.11 03:50, Bergquist, Brett wrote:
Finally with power restored here (hurricane Irene here on the east coast of the U.S. put 
me out of commission for a while)   I fixed the connection leak and with a "-Xmx4096 
-d64" I was able to get this to work whereas before I fixed the connection leak with 
up to 24Gb of memory it would always run out of memory.  So it looks like the connection 
leak was a triggering factor.  Not sure this is completely fixed but I think it can be 
closed and re-opened later if I find out more.

Thanks, Brett.

I have resolved the issue as invalid for now - please reopen it if you find out that Derby is the culprit after all.


Regards,
--
Kristian


Brett
________________________________________
From: Kristian Waagan (JIRA) [[email protected]]
Sent: Tuesday, August 30, 2011 4:56 AM
To: [email protected]
Subject: [jira] [Commented] (DERBY-5387) Memory leak or unbounded consumption 
problem when running a utility to copy one database to another using 
SYSCS_EXPORT_TABLE and SYSCS_IMPORT_TABLE

     [ 
https://issues.apache.org/jira/browse/DERBY-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13093561#comment-13093561
 ]

Kristian Waagan commented on DERBY-5387:
----------------------------------------

Any more information on this problem?
The deadline for fixes for 10.8.2 is getting close.

Memory leak or unbounded consumption problem when running a utility to copy one 
database to another using SYSCS_EXPORT_TABLE and SYSCS_IMPORT_TABLE
---------------------------------------------------------------------------------------------------------------------------------------------------

                 Key: DERBY-5387
                 URL: https://issues.apache.org/jira/browse/DERBY-5387
             Project: Derby
          Issue Type: Bug
          Components: SQL
    Affects Versions: 10.8.1.2
         Environment: Solaris 10/9, Oracle Java 1.6.0_22, 1Gb heap space (also 
ran with 8Gb heap space with no difference other than how long it takes to run 
out of memory).
            Reporter: Brett Bergquist
            Priority: Critical
         Attachments: dbcopy.zip, java_pid2364_Leak_Hunter.zip, 
java_pid2364_Leak_Suspects.zip


I have a utility that copies one database to another by using 'dblook" to 
export the schema from the first which is then uses to create the copy's schema.  
The tables are exported from the first database using the SYSCS_EXPORT_TABLE and 
imported into the second database using SYSCS_IMPORT_TABLE, processing each table 
before moving on to the next.  The the constraints and indexes present in the schema 
generated by 'dblook' are applied to the second database.  The utility runs out of 
memory regardless of the amount of memory given when run on a very large database 
(one table has 75 million rows in it and the total database size is 110Gb of disk 
storage).  The utility does complete on a smaller database.
I will attach the source code for the utility.  Also added the 
-XX:+HeapDumpOnOutOfMemory flag and ran with -Xmx1024m heap.  I will attach the 
suspected leaks report generated by the Eclipse MemoryAnalyzer tool.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira





Reply via email to