Re: [xwiki-users] unable to import big xar file
Hello, Is there any generic solution to this problem? I get lots of such issues when exporting documents. Each time exporter runs for 5 to 10 minutes before giving me one error i have to fix. It's very time consuming. Thank you David Delbecq - Mail original - De: David Delbecq david.delb...@meteo.be À: XWiki Users users@xwiki.org Envoyé: Jeudi 5 Juillet 2012 14:32:27 Objet: Re: [xwiki-users] unable to import big xar file Hello again, this procedure does not seem to work either. I am struggling with this exception when i try to export some pages: Wrapped Exception: 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) java.lang.NullPointerException 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.rcs.XWikiRCSArchive$XWikiJRCSNode.getTextString(XWikiRCSArchive.java:209) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.rcs.XWikiRCSArchive$XWikiJRCSNode.setDiff(XWikiRCSArchive.java:196) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.rcs.XWikiRCSArchive.init(XWikiRCSArchive.java:79) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.XWikiDocumentArchive.getArchive(XWikiDocumentArchive.java:201) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.XWikiDocument.toXML(XWikiDocument.java:3881) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.XWikiDocument.toXML(XWikiDocument.java:3909) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.plugin.packaging.Package.addToDir(Package.java:1040) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.plugin.packaging.Package.exportToDir(Package.java:355) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at sun.reflect.GeneratedMethodAccessor4625.invoke(Unknown Source) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at java.lang.reflect.Method.invoke(Method.java:597) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoCachedMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:229) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:52) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:129) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at Script1.getXAR(Script1.groovy:29) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at Script1$getXAR.callCurrent(Unknown Source) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at Script1.run(Script1.groovy:37) For another page, i achieved to get around this problem by destroying it's history, but even with no history, it doesn't work on this page. When i try to edit this page (addin a single hello in the page for example), i get this error Detailed information: Error number 3201 in 3: Exception while saving document xwiki:XWiki.XWikiAdminGroup Wrapped Exception: Error number 3211 in 3: Exception while updating archive XWiki.XWikiAdminGroup Wrapped Exception: Error number 13027 in 13: Failed to create diff for doc XWiki.XWikiAdminGroup Wrapped Exception: null com.xpn.xwiki.XWikiException: Error number 3201 in 3: Exception while saving document xwiki:XWiki.XWikiAdminGroup Wrapped Exception: Error number 3211 in 3: Exception while updating archive XWiki.XWikiAdminGroup Wrapped Exception: Error number 13027 in 13: Failed to create diff for doc XWiki.XWikiAdminGroup Wrapped Exception: null at com.xpn.xwiki.store.XWikiHibernateStore.saveXWikiDoc(XWikiHibernateStore.java:647) at com.xpn.xwiki.store.XWikiCacheStore.saveXWikiDoc(XWikiCacheStore.java:182) at com.xpn.xwiki.store.XWikiCacheStore.saveXWikiDoc(XWikiCacheStore.java:175) at com.xpn.xwiki.XWiki.saveDocument
Re: [xwiki-users] unable to import big xar file
On Mon, Jul 9, 2012 at 1:25 PM, David Delbecq david.delb...@meteo.be wrote: Hello, Is there any generic solution to this problem? I get lots of such issues when exporting documents. Each time exporter runs for 5 to 10 minutes before giving me one error i have to fix. It's very time consuming. Hard to tell you exactly with just the error. Could you export a page which have the issue using the standard EXPORT - Export as XAR menu and send it to me so that I try to reproduce it. Thank you David Delbecq - Mail original - De: David Delbecq david.delb...@meteo.be À: XWiki Users users@xwiki.org Envoyé: Jeudi 5 Juillet 2012 14:32:27 Objet: Re: [xwiki-users] unable to import big xar file Hello again, this procedure does not seem to work either. I am struggling with this exception when i try to export some pages: Wrapped Exception: 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) java.lang.NullPointerException 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.rcs.XWikiRCSArchive$XWikiJRCSNode.getTextString(XWikiRCSArchive.java:209) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.rcs.XWikiRCSArchive$XWikiJRCSNode.setDiff(XWikiRCSArchive.java:196) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.rcs.XWikiRCSArchive.init(XWikiRCSArchive.java:79) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.XWikiDocumentArchive.getArchive(XWikiDocumentArchive.java:201) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.XWikiDocument.toXML(XWikiDocument.java:3881) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.doc.XWikiDocument.toXML(XWikiDocument.java:3909) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.plugin.packaging.Package.addToDir(Package.java:1040) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at com.xpn.xwiki.plugin.packaging.Package.exportToDir(Package.java:355) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at sun.reflect.GeneratedMethodAccessor4625.invoke(Unknown Source) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at java.lang.reflect.Method.invoke(Method.java:597) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoCachedMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:229) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:52) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:129) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at Script1.getXAR(Script1.groovy:29) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at Script1$getXAR.callCurrent(Unknown Source) 2012-07-05 14:23:09,325 ERROR [STDERR] (http://intrarmi.oma.be/xwiki/bin/view/Main/largeExportBySpace) at Script1.run(Script1.groovy:37) For another page, i achieved to get around this problem by destroying it's history, but even with no history, it doesn't work on this page. When i try to edit this page (addin a single hello in the page for example), i get this error Detailed information: Error number 3201 in 3: Exception while saving document xwiki:XWiki.XWikiAdminGroup Wrapped Exception: Error number 3211 in 3: Exception while updating archive XWiki.XWikiAdminGroup Wrapped Exception: Error number 13027 in 13: Failed to create diff for doc XWiki.XWikiAdminGroup Wrapped Exception: null com.xpn.xwiki.XWikiException: Error number 3201 in 3: Exception while saving document xwiki:XWiki.XWikiAdminGroup Wrapped Exception: Error number 3211 in 3: Exception while updating archive XWiki.XWikiAdminGroup Wrapped Exception: Error number 13027 in 13: Failed to create diff for doc XWiki.XWikiAdminGroup
[xwiki-users] unable to import big xar file
Hello, i am migrating a small wiki that is expected to grow in the future (more pages, more documents). Currently, the wiki is small, the xar is about 50M. To my surprise, xwiki was unable to load it with 1G heap space. Actually, it consumed 2.5G memory just to upload this xar, which make a ration of 50x (a big problem by itself). And then, when i select this archive, i am greeted with There was an error reading the file MainWiki.xar. Truncated ZIP file and the error below in the console. What is the recommanded way to some pages from an existing old xwiki to another more recent xwiki since the xar is not working? Is there some plan to recode this xar importer so that it becomes far less greedy? 08:17:52,271 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) 2012-07-05 08:17:52,271 [http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar] WARN c.x.x.p.p.Package - Failed to parse document [XWiki/XWikiAdminGroup.xml] from XML during import, thus it will not be installed. The error was: Error number 2002 in 2: Error parsing xml 08:17:52,274 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) Wrapped Exception: Truncated ZIP file Nested exception: Truncated ZIP file 08:17:52,514 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) java.lang.NullPointerException: Cannot invoke method collate() on null object 08:17:52,516 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:77) 08:17:52,521 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:45) 08:17:52,524 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,528 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:32) 08:17:52,532 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,536 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) 08:17:52,539 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) 08:17:52,543 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at Script14.createHtmlStructure(Script14.groovy:80) 08:17:52,546 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 08:17:52,550 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 08:17:52,553 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 08:17:52,557 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at java.lang.reflect.Method.invoke(Method.java:601) 08:17:52,561 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90) 08:17:52,564 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233) 08:17:52,567 ERROR [stderr]
Re: [xwiki-users] unable to import big xar file
Yes the standard import is not very good and we need to work on that. In the meantime you can use http://extensions.xwiki.org/xwiki/bin/view/Extension/Large+XAR+Import script. On Thu, Jul 5, 2012 at 10:29 AM, David Delbecq david.delb...@meteo.be wrote: Hello, i am migrating a small wiki that is expected to grow in the future (more pages, more documents). Currently, the wiki is small, the xar is about 50M. To my surprise, xwiki was unable to load it with 1G heap space. Actually, it consumed 2.5G memory just to upload this xar, which make a ration of 50x (a big problem by itself). And then, when i select this archive, i am greeted with There was an error reading the file MainWiki.xar. Truncated ZIP file and the error below in the console. What is the recommanded way to some pages from an existing old xwiki to another more recent xwiki since the xar is not working? Is there some plan to recode this xar importer so that it becomes far less greedy? 08:17:52,271 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) 2012-07-05 08:17:52,271 [http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar] WARN c.x.x.p.p.Package - Failed to parse document [XWiki/XWikiAdminGroup.xml] from XML during import, thus it will not be installed. The error was: Error number 2002 in 2: Error parsing xml 08:17:52,274 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) Wrapped Exception: Truncated ZIP file Nested exception: Truncated ZIP file 08:17:52,514 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) java.lang.NullPointerException: Cannot invoke method collate() on null object 08:17:52,516 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:77) 08:17:52,521 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:45) 08:17:52,524 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,528 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:32) 08:17:52,532 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,536 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) 08:17:52,539 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) 08:17:52,543 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at Script14.createHtmlStructure(Script14.groovy:80) 08:17:52,546 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 08:17:52,550 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 08:17:52,553 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 08:17:52,557 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at java.lang.reflect.Method.invoke(Method.java:601) 08:17:52,561 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at
Re: [xwiki-users] unable to import big xar file
Hello Thomas, thank you for your quick response. Investigations here have shown that the later exception (truncated zip) was due to the old xwiki not exporting completly the xar (but without any error anywhere in the logs). I see there is a large xar export script at http://extensions.xwiki.org/xwiki/bin/view/Extension/Large+Wiki+Export;. but it exports to a folder. Do i simply have to zip this folder to feed it to large xar import? Thank you. - Mail original - De: Thomas Mortagne thomas.morta...@xwiki.com À: XWiki Users users@xwiki.org Envoyé: Jeudi 5 Juillet 2012 11:01:48 Objet: Re: [xwiki-users] unable to import big xar file Yes the standard import is not very good and we need to work on that. In the meantime you can use http://extensions.xwiki.org/xwiki/bin/view/Extension/Large+XAR+Import script. On Thu, Jul 5, 2012 at 10:29 AM, David Delbecq david.delb...@meteo.be wrote: Hello, i am migrating a small wiki that is expected to grow in the future (more pages, more documents). Currently, the wiki is small, the xar is about 50M. To my surprise, xwiki was unable to load it with 1G heap space. Actually, it consumed 2.5G memory just to upload this xar, which make a ration of 50x (a big problem by itself). And then, when i select this archive, i am greeted with There was an error reading the file MainWiki.xar. Truncated ZIP file and the error below in the console. What is the recommanded way to some pages from an existing old xwiki to another more recent xwiki since the xar is not working? Is there some plan to recode this xar importer so that it becomes far less greedy? 08:17:52,271 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) 2012-07-05 08:17:52,271 [http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar] WARN c.x.x.p.p.Package - Failed to parse document [XWiki/XWikiAdminGroup.xml] from XML during import, thus it will not be installed. The error was: Error number 2002 in 2: Error parsing xml 08:17:52,274 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) Wrapped Exception: Truncated ZIP file Nested exception: Truncated ZIP file 08:17:52,514 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) java.lang.NullPointerException: Cannot invoke method collate() on null object 08:17:52,516 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:77) 08:17:52,521 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:45) 08:17:52,524 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,528 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:32) 08:17:52,532 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,536 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) 08:17:52,539 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) 08:17:52,543 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at Script14.createHtmlStructure(Script14.groovy:80) 08:17:52,546 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 08:17:52,550 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar
Re: [xwiki-users] unable to import big xar file
On Thu, Jul 5, 2012 at 11:30 AM, David Delbecq david.delb...@meteo.be wrote: Hello Thomas, thank you for your quick response. Investigations here have shown that the later exception (truncated zip) was due to the old xwiki not exporting completly the xar (but without any error anywhere in the logs). Yes export has the same kind of memory issues even if a bit lower. I see there is a large xar export script at http://extensions.xwiki.org/xwiki/bin/view/Extension/Large+Wiki+Export;. but it exports to a folder. Do i simply have to zip this folder to feed it to large xar import? Yes, just zip it. Thank you. - Mail original - De: Thomas Mortagne thomas.morta...@xwiki.com À: XWiki Users users@xwiki.org Envoyé: Jeudi 5 Juillet 2012 11:01:48 Objet: Re: [xwiki-users] unable to import big xar file Yes the standard import is not very good and we need to work on that. In the meantime you can use http://extensions.xwiki.org/xwiki/bin/view/Extension/Large+XAR+Import script. On Thu, Jul 5, 2012 at 10:29 AM, David Delbecq david.delb...@meteo.be wrote: Hello, i am migrating a small wiki that is expected to grow in the future (more pages, more documents). Currently, the wiki is small, the xar is about 50M. To my surprise, xwiki was unable to load it with 1G heap space. Actually, it consumed 2.5G memory just to upload this xar, which make a ration of 50x (a big problem by itself). And then, when i select this archive, i am greeted with There was an error reading the file MainWiki.xar. Truncated ZIP file and the error below in the console. What is the recommanded way to some pages from an existing old xwiki to another more recent xwiki since the xar is not working? Is there some plan to recode this xar importer so that it becomes far less greedy? 08:17:52,271 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) 2012-07-05 08:17:52,271 [http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar] WARN c.x.x.p.p.Package - Failed to parse document [XWiki/XWikiAdminGroup.xml] from XML during import, thus it will not be installed. The error was: Error number 2002 in 2: Error parsing xml 08:17:52,274 INFO [stdout] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) Wrapped Exception: Truncated ZIP file Nested exception: Truncated ZIP file 08:17:52,514 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) java.lang.NullPointerException: Cannot invoke method collate() on null object 08:17:52,516 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:77) 08:17:52,521 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:45) 08:17:52,524 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,528 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:32) 08:17:52,532 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42) 08:17:52,536 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108) 08:17:52,539 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116) 08:17:52,543 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at Script14.createHtmlStructure(Script14.groovy:80) 08:17:52,546 ERROR [stderr] (http://intraweb-me.oma.be:10080/xwiki/bin/import/XWiki/XWikiPreferences?editor=globaladminsection=Importfile=MainWiki.xar) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 08:17:52,550 ERROR [stderr] (http://intraweb-me.oma.be:10080
