Hi All,
Importing page-article dump to mysql database is unsuccessful.
First i received Exception-
*"
Caused by: javax.xml.stream.XMLStreamException: ParseError at
[row,col]:[1,249]
Message: expected <mediawiki> with namespace [
http://www.mediawiki.org/xml/export-0.6/], found [
http://www.mediawiki.org/xml/export-0.8/]
"
*
To resolve above i have changed mediawiki version to 0.6 from 0.8 in
"20130325/enwiki-20130325-pages-articles.xm" file.
After doing this I have not received above exception but no data is being
imported to database.
"
INFO] No sources to compile
[INFO]
[INFO] --- maven-scala-plugin:2.15.2:testCompile (test-compile) @ dump ---
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[WARNING] No source files found.
[INFO]
[INFO] <<< maven-scala-plugin:2.15.2:run (default-cli) @ dump <<<
[INFO]
[INFO] --- maven-scala-plugin:2.15.2:run (default-cli) @ dump ---
[INFO] Checking for multiple versions of scala
[INFO] launcher 'import' selected => org.dbpedia.extraction.dump.sql.Import
*importing pages in namespaces [Template] from
/mnt/ebs/framework/test_dump/enwiki/20130325/enwiki-20130325-pages-articles.xml
to database enwiki on server
localhost:3306/?characterEncoding=UTF-8&user=testuser&password=testpass*
*imported 0 pages in 4941 millis (Infinity millis per page)*
imported pages in namespaces [Template] from
/mnt/ebs/framework/test_dump/enwiki/20130325/enwiki-20130325-pages-articles.xml
to database enwiki on server
localhost:3306/?characterEncoding=UTF-8&user=testuser&password=testpass
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 13.247s
[INFO] Finished at: Thu Mar 28 12:51:19 UTC 2013
[INFO] Final Memory: 8M/56M
[INFO]
------------------------------------------------------------------------
"
Please let me know what is the problem?Whether my previous approach of
resolving exception is wrong?
Thanks
On Tue, Mar 26, 2013 at 12:44 AM, Jona Christopher Sahnwaldt <
j...@sahnwaldt.de> wrote:
> On 25 March 2013 19:35, gaurav pant <golup...@gmail.com> wrote:
> >
> > Hi All/Jona,
> >
> > With updated dump I am able to import data into mysql. Now the issue is
> > with abstract extraction.Thanks Jona for all the help.
> >
> > I am getting below errors for many files during ../clean-install-run
> > extraction extraction.abstracts.properties.
> >
> > "
> > Mon Mar 25 16:13:31 2013] [error] [client 10.169.15.110] PHP Warning:
> >
> require_once(/mnt/ebs/framework/media_wiki/wikimedia/extensions/Babel/Babel.php):
> > failed to open stream: No such file or directory in
> > /mnt/ebs/framework/media_wiki/wikimedia/LocalSettings.php on line 144
> >
> > [Mon Mar 25 17:26:15 2013] [error] [client 127.0.0.1] PHP Warning:
> >
> require_once(/mnt/ebs/framework/media_wiki/wikimedia/extensions/CategoryTree/CategoryTree.php):
> > failed to open stream: No such file or directory in
> > /mnt/ebs/framework/media_wiki/wikimedia/LocalSettings.php on line 145
> > "
>
> Please send us line 145 of LocalSettings.php.
>
> >
> > I am getting all required file specified in CategoryTree.php in
> > "mw-modified.tar.gz" which is not being used in new abstractor( as
> previous
> > dicussion). So it seems me that i am using old "mediawiki".
> >
> >
> > Can you please let me know the exact path of new mediawiki? or any
> > possible suggestion.
>
> First, use the appropriate MediaWiki version. I would recommend to use
> the exact version for your Wikipedia dump file. You can find the
> version in one of the first few lines of the dump file, or at
> http://en.wikipedia.org/wiki/Special:Version, for example 1.21wmf12.
> MediaWiki 1.21 is has no stable release for download yet, and
> sometimes the "wmf" branches (adapted for WikiMediaFoundation) contain
> significant changes, so you should check out the exact version from
> WikiMedia's git repo:
>
>
> https://gerrit.wikimedia.org/r/gitweb?p=mediawiki/core.git;a=tree;hb=refs/heads/wmf/1.21wmf12
>
> That's how I installed MediaWiki when I last extracted the abstracts a
> few months ago.
>
> You also need to install the extensions listed on
> http://en.wikipedia.org/wiki/Special:Version . You don't need all of
> them, but most. When you check out the code from git, the appropriate
> extensions may already be included. Maybe you have to use a special
> git flag to get them, something like --sub-repositories or
> --follow-references, I don't remember. I hope the git experts on this
> list can help.
>
> Finally, to modify MediaWiki for DBpedia, just copy the three files from
>
>
> https://github.com/dbpedia/extraction-framework/tree/master/dump/src/main/mediawiki
>
> into your MediaWiki installation in the appropriate places. Note:
> these files may be OUTDATED. In other words, the MediaWiki versions of
> these files have probably changed since we last modified them. Maybe
> it's better if you apply our patches to the current files. For
> example, here's what we changed in ApiParse.php:
>
>
> https://github.com/dbpedia/extraction-framework/commit/e36913dabe0715672cbf0f2e6c5d86ec424b08b3
>
> Hope that helps.
>
> JC
>
> >
> > On Mon, Mar 25, 2013 at 3:01 PM, Jona Christopher Sahnwaldt
> > <j...@sahnwaldt.de> wrote:
> >>
> >> did you update the code to the latest version? git pull, update, etc.?
> >>
> >> On Mar 25, 2013 8:33 AM, "gaurav pant" <golup...@gmail.com> wrote:
> >>>
> >>> Hi Jona/All,
> >>>
> >>> I have changed pom.xml accordingly as below. But I am getting error.
> >>> "
> >>> <launcher>
> >>> <id>import</id>
> >>>
> >>> <mainClass>org.dbpedia.extraction.dump.sql.Import</mainClass>
> >>> <jvmArgs>
> >>> <jvmArg>-server</jvmArg>
> >>> </jvmArgs>
> >>> <args>
> >>> <arg>/mnt/ebs/framework/test_dump</arg>
> >>>
> >>>
> <arg>/mnt/ebs/framework/media_wiki/wikimedia/maintenance/tables.sql</arg>
> >>>
> >>>
> <arg>jdbc:mysql://localhost:3306/?characterEncoding=UTF-8&user=user-name&password=my_password</arg><!--
> >>> MySQL host:port -->
> >>> <arg>false</arg><!--
> >>> require-download-complete -->
> >>> <arg>en</arg><!-- languages and article
> >>> count ranges, comma-separated -->
> >>> </args>
> >>> </launcher>
> >>> "
> >>>
> >>> I am getting below error--
> >>>
> >>> java.lang.reflect.InvocationTargetException
> >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>> at
> >>>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >>> at
> >>>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>> at java.lang.reflect.Method.invoke(Method.java:601)
> >>> at
> >>>
> org_scala_tools_maven_executions.MainHelper.runMain(MainHelper.java:161)
> >>> at
> >>>
> org_scala_tools_maven_executions.MainWithArgsInFile.main(MainWithArgsInFile.java:26)
> >>> Caused by:
> >>> com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
> Cannot
> >>> load connection class because of underlying exception:
> >>> 'java.lang.NumberFormatException: For input string: "mysql:"'.
> >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> >>> Method)
> >>> at
> >>>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> >>> at
> >>>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> >>> at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
> >>> at com.mysql.jdbc.Util.getInstance(Util.java:386)
> >>> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
> >>> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
> >>> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
> >>> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
> >>> at
> >>>
> com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:314)
> >>> at org.dbpedia.extraction.dump.sql.Import$.main(Import.scala:39)
> >>> at org.dbpedia.extraction.dump.sql.Import.main(Import.scala)
> >>> ... 6 more
> >>> Caused by: java.lang.NumberFormatException: For input string: "mysql:"
> >>> at
> >>>
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> >>> at java.lang.Integer.parseInt(Integer.java:492)
> >>> at java.lang.Integer.parseInt(Integer.java:527)
> >>> at
> >>> com.mysql.jdbc.NonRegisteringDriver.port(NonRegisteringDriver.java:831)
> >>> at
> >>>
> com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:305)
> >>> ... 8 more
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD FAILURE
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 9.228s
> >>> [INFO] Finished at: Mon Mar 25 06:11:54 UTC 2013
> >>> [INFO] Final Memory: 8M/56M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [ERROR] Failed to execute goal
> >>> org.scala-tools:maven-scala-plugin:2.15.2:run (default-cli) on project
> dump:
> >>> wrap: org.apache.commons.exec.ExecuteException: Process exited with an
> >>> error: 240(Exit value: 240) -> [Help 1]
> >>>
> >>> On Mon, Mar 25, 2013 at 6:54 AM, Jona Christopher Sahnwaldt
> >>> <j...@sahnwaldt.de> wrote:
> >>>>
> >>>> On 20 March 2013 15:38, Mohamed Morsey
> >>>> <mor...@informatik.uni-leipzig.de> wrote:
> >>>> > Hi Jona and all,
> >>>> >
> >>>> >
> >>>> > On 03/20/2013 03:25 PM, Jona Christopher Sahnwaldt wrote:
> >>>> >
> >>>> > On Wed, Mar 20, 2013 at 3:01 PM, gaurav pant <golup...@gmail.com>
> >>>> > wrote:
> >>>> >
> >>>> >> Hi Morsy/All,
> >>>> >>
> >>>> >> While running Import.sh is am getting below error.
> >>>> >
> >>>> > Don't use import.sh.
> >>>> >
> >>>> >
> >>>> >>
> >>>> >> missing
> >>>> >>
> >>>> >>
> >>>> >>
> /home/gaurav/other_lang_extraction/extraction-framework-master/dump/wiki_dump/dewiki/tables-no-indexes.sql
> >>>> >> missing
> >>>> >>
> >>>> >>
> >>>> >>
> /home/gaurav/other_lang_extraction/extraction-framework-master/dump/wiki_dump/dewiki/tables-only-indexes.sql
> >>>> >>
> >>>> >>
> >>>> >>
> >>>> >>
> "/home/gaurav/other_lang_extraction/extraction-framework-master/dump/wiki_dump/dewiki/"
> >>>> >> is the directory where my dump exists.
> >>>> >>
> >>>> >> I think Some index need to be created before actual import start
> and
> >>>> >> required index files are missing. Where can I get these files.
> >>>> >>
> >>>> >> I am following
> >>>> >>
> >>>> >>
> >>>> >> "
> https://github.com/dbpedia/dbpedia/blob/master/abstractExtraction/README.txt
> "
> >>>> >
> >>>> > See the text at the top of this file:
> >>>> >
> >>>> > OUTDATED! EVERYTHING IN THIS DIRECTORY,
> >>>> > INCLUDING THE INSTRUCTIONS BELOW,
> >>>> > IS OUTDATED. THE CURRENT CODE IS IN
> >>>> > dbpedia/extraction-framework/dump
> >>>> >
> >>>> >
> >>>> >
> >>>> > Sorry for that, I overlooked that note.
> >>>>
> >>>> All right, I just made some changes that hopefully make it really
> >>>> painfully obvious that that stuff is outdated. :-)
> >>>>
> >>>> >
> >>>> >
> >>>> > --
> >>>> > Kind Regards
> >>>> > Mohamed Morsey
> >>>> > Department of Computer Science
> >>>> > University of Leipzig
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> Regards
> >>> Gaurav Pant
> >>> +91-7709196607,+91-9405757794
> >
> >
> >
> >
> > --
> > Regards
> > Gaurav Pant
> > +91-7709196607,+91-9405757794
>
--
Regards
Gaurav Pant
+91-7709196607,+91-9405757794
------------------------------------------------------------------------------
Own the Future-Intel® Level Up Game Demo Contest 2013
Rise to greatness in Intel's independent game demo contest.
Compete for recognition, cash, and the chance to get your game
on Steam. $5K grand prize plus 10 genre and skill prizes.
Submit your demo by 6/6/13. http://p.sf.net/sfu/intel_levelupd2d
_______________________________________________
Dbpedia-discussion mailing list
Dbpedia-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
