On 23 March 2013 07:05, gaurav pant <golup...@gmail.com> wrote: > Hi All, > > I am now using new code. But facing below problems with the new repository. > > @Jona- Yes I am using Amazon Elastic Block Storage. Is there any issue with > this? > > @All- I could not be able to understand that where I should give "mysql > user-name" and password.Also I want that it should use fresh blank database > specified by me.
You cannot specify a database. More precisely: you can specify a database in the URL, but the importer will ignore it. The reason is that the importer is made for importing many languages at once and we have to use a different database for each language. The importer creates new databases with names like "enwiki", "dewiki" etc. and drops any existing database with that name first. These names are also used in the modified MediaWiki code. > > I have changed my importer configuration at pom.xml file as below > > > <launcher> > <id>import</id> > > <mainClass>org.dbpedia.extraction.dump.sql.Import</mainClass> > <jvmArgs> > <jvmArg>-server</jvmArg> > </jvmArgs> > <args> > <arg>/mnt/ebs/framework/test_dump</arg> > > <arg>/mnt/ebs/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> > <arg>localhost</arg><!-- MySQL host:port > no user name & password--> > <arg>false</arg><!-- > require-download-complete --> > <arg>en</arg><!-- languages and article > count ranges, comma-separated --> > </args> > </launcher> > > Thanks for all the suggestions. > > > On Wed, Mar 20, 2013 at 8:08 PM, Dimitris Kontokostas <jimk...@gmail.com> > wrote: >> >> I also think that this is a maven / folder permissions like JC and Andrea >> suggested. >> The script breaks at $mvn clean >> so you should check your system >> >> Dimitris >> >> >> On Wed, Mar 20, 2013 at 4:32 PM, Jona Christopher Sahnwaldt >> <j...@sahnwaldt.de> wrote: >>> >>> Yes, this is almost certainly a problem with file/folder permissions. >>> >>> >From looking at your path /mnt/ebs/, I assume you're using Amazon >>> Elastic Block Storage. Is that correct? >>> >>> On Wed, Mar 20, 2013 at 11:48 AM, Andrea Di Menna <ninn...@gmail.com> >>> wrote: >>> > Hi Gaurav, >>> > >>> > which are the permissions this folder? >>> > >>> > /mnt/ebs/perl/framework/dbpedia/target/classes >>> > >>> > Maybe not related, but the error message seems to suggest maven cannot >>> > clean >>> > that directory. >>> > >>> > Also, it might be useful to rerun the maven command with -eX switches. >>> > >>> > Regards >>> > Andrea >>> > >>> > 2013/3/20 gaurav pant <golup...@gmail.com> >>> >> >>> >> Hi Morsey/All, >>> >> >>> >> Please find pom.xml file contents as below. >>> >> >>> >> " >>> >> <?xml version="1.0" encoding="UTF-8"?> >>> >> <project xmlns="http://maven.apache.org/POM/4.0.0";> >>> >> >>> >> <modelVersion>4.0.0</modelVersion> >>> >> >>> >> <parent> >>> >> <groupId>org.dbpedia</groupId> >>> >> <artifactId>extraction</artifactId> >>> >> <version>3.8</version> >>> >> </parent> >>> >> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>dump</artifactId><?xml version="1.0" >>> >> encoding="UTF-8"?> >>> >> <project xmlns="http://maven.apache.org/POM/4.0.0";> >>> >> >>> >> <modelVersion>4.0.0</modelVersion> >>> >> >>> >> <parent> >>> >> <groupId>org.dbpedia</groupId> >>> >> <artifactId>extraction</artifactId> >>> >> <version>3.8</version> >>> >> </parent> >>> >> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>dump</artifactId> >>> >> <name>DBpedia Dump Extraction</name> >>> >> >>> >> <build> >>> >> <plugins> >>> >> <plugin> >>> >> >>> >> <groupId>org.scala-tools</groupId> >>> >> <artifactId>maven-scala-plugin</artifactId> >>> >> >>> >> <configuration> >>> >> <launchers> >>> >> >>> >> <launcher> >>> >> <id>import</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.sql.Import</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> </jvmArgs> >>> >> <args> >>> >> >>> >> <arg>/mnt/ebs3/dbpedia_other_lang_dump/trimmed</arg> >>> >> >>> >> >>> >> >>> >> <arg>/mnt/ebs/perl/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> >>> >> <arg>localhost</arg><!-- MySQL >>> >> host:port >>> >> --> >>> >> <arg>true</arg><!-- >>> >> require-download-complete --> >>> >> >>> >> <arg>de</arg><!-- languages and >>> >> article >>> >> count ranges, comma-separated --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.extract.Extraction</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>compress</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.compress.Compress</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> <!-- mvn scala:run -Dlauncher=Compress >>> >> "-DaddArgs=/data|/data-compressed" --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.download.Download</mainClass> >>> >> <!-- ../run download >>> >> config=download.properties --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>download-complete</arg> >>> >> <arg>1</arg><!-- keep only one latest >>> >> download --> >>> >> >>> >> >>> >> <arg>*.sql.gz,*.xml.bz2,*.sql,*-pages-articles.xml,index.html</arg><!-- >>> >> delete these files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>extraction-complete</arg> >>> >> <arg>2</arg><!-- keep two extractions >>> >> --> >>> >> >>> >> <arg>*.nt,*.nq,*.tql,*.ttl,*.trix,*-redirects.obj</arg><!-- delete >>> >> these >>> >> files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> </launchers> >>> >> </configuration> >>> >> >>> >> </plugin> >>> >> </plugins> >>> >> </build> >>> >> >>> >> <dependencies> >>> >> >>> >> <dependency> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>core</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>org.apache.commons</groupId> >>> >> <artifactId>commons-compress</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>mysql</groupId> >>> >> <artifactId>mysql-connector-java</artifactId> >>> >> <version>5.1.20</version> >>> >> </dependency> >>> >> >>> >> </dependencies> >>> >> >>> >> </project> >>> >> >>> >> <name>DBpedia Dump Extraction</name> >>> >> >>> >> <build> >>> >> <plugins> >>> >> <plugin> >>> >> >>> >> <groupId>org.scala-tools</groupId> >>> >> <artifactId>maven-scala-plugin</artifactId> >>> >> >>> >> <configuration> >>> >> <launchers> >>> >> >>> >> <launcher> >>> >> <id>import</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.sql.Import</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> </jvmArgs> >>> >> <args> >>> >> >>> >> <arg>/mnt/ebs3/dbpedia_other_lang_dump/trimmed</arg> >>> >> >>> >> >>> >> >>> >> <arg>/mnt/ebs/perl/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> >>> >> <arg>localhost</arg><!-- MySQL >>> >> host:port >>> >> --> >>> >> <arg>true</arg><!-- >>> >> require-download-complete --> >>> >> >>> >> <arg>de</arg><!-- languages and >>> >> article >>> >> count ranges, comma-separated --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.extract.Extraction</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>compress</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.compress.Compress</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> <!-- mvn scala:run -Dlauncher=Compress >>> >> "-DaddArgs=/data|/data-compressed" --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.download.Download</mainClass> >>> >> <!-- ../run download >>> >> config=download.properties --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>download-complete</arg> >>> >> <arg>1</arg><!-- keep only one latest >>> >> download --> >>> >> >>> >> >>> >> <arg>*.sql.gz,*.xml.bz2,*.sql,*-pages-articles.xml,index.html</arg><!-- >>> >> delete these files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>extraction-complete</arg> >>> >> <arg>2</arg><!-- keep two extractions >>> >> --> >>> >> >>> >> <arg>*.nt,*.nq,*.tql,*.ttl,*.trix,*-redirects.obj</arg><!-- delete >>> >> these >>> >> files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> </launchers> >>> >> </configuration> >>> >> >>> >> </plugin> >>> >> </plugins> >>> >> </build> >>> >> >>> >> <dependencies> >>> >> >>> >> <dependency> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>core</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>org.apache.commons</groupId> >>> >> <artifactId>commons-compress</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>mysql</groupId> >>> >> <artifactId>mysql-connector-java</artifactId> >>> >> <version>5.1.20</version> >>> >> </dependency> >>> >> >>> >> </dependencies> >>> >> >>> >> </project> >>> >> >>> >> " >>> >> >>> >> On Wed, Mar 20, 2013 at 3:44 PM, Mohamed Morsey >>> >> <mor...@informatik.uni-leipzig.de> wrote: >>> >>> >>> >>> Hi Gaurav, >>> >>> >>> >>> would you please send us the full pom file? >>> >>> >>> >>> >>> >>> On 03/20/2013 11:01 AM, gaurav pant wrote: >>> >>> >>> >>> Hi, >>> >>> >>> >>> I am trying to extract cleaner abstracts using >>> >>> git://github.com/dbpedia/extraction-framework.git. >>> >>> >>> >>> I have configured pom.xml inside dump directory as below. >>> >>> >>> >>> <arg>/mnt/ebs3/dbpedia_other_lang_dump/trimmed</arg> <!-- file >>> >>> where my page-article.cump exists --> >>> >>> >>> >>> >>> >>> <arg>/mnt/ebs/perl/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> >>> >>> <arg>localhost</arg><!-- MySQL >>> >>> host:port >>> >>> --> >>> >>> <arg>false</arg><!-- not >>> >>> require-download-complete; as downloaded manually --> >>> >>> <arg>de</arg><!-- languages and >>> >>> article >>> >>> count ranges, comma-separated --> >>> >>> >>> >>> >>> >>> Then I ran command "../clean-install-run import". I got below error. >>> >>> " >>> >>> $sh ../clean-install-run import >>> >>> [INFO] Scanning for projects... >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Reactor Build Order: >>> >>> [INFO] >>> >>> [INFO] Parent POM of the DBpedia framework >>> >>> [INFO] DBpedia Core Libraries >>> >>> [INFO] DBpedia Server >>> >>> [INFO] DBpedia Dump Extraction >>> >>> [INFO] DBpedia Scripts >>> >>> [INFO] Live extraction >>> >>> [INFO] Wiktionary Dump >>> >>> [INFO] >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Building Parent POM of the DBpedia framework 3.8 >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] >>> >>> [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ >>> >>> extraction >>> >>> --- >>> >>> [INFO] Deleting /mnt/ebs/perl/framework/dbpedia/dump/../target >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Reactor Summary: >>> >>> [INFO] >>> >>> [INFO] Parent POM of the DBpedia framework ............... FAILURE >>> >>> [2.864s] >>> >>> [INFO] DBpedia Core Libraries ............................ SKIPPED >>> >>> [INFO] DBpedia Server .................................... SKIPPED >>> >>> [INFO] DBpedia Dump Extraction ........................... SKIPPED >>> >>> [INFO] DBpedia Scripts ................................... SKIPPED >>> >>> [INFO] Live extraction ................................... SKIPPED >>> >>> [INFO] Wiktionary Dump ................................... SKIPPED >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] BUILD FAILURE >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Total time: 6.262s >>> >>> [INFO] Finished at: Wed Mar 20 09:39:56 UTC 2013 >>> >>> [INFO] Final Memory: 7M/56M >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [ERROR] Failed to execute goal >>> >>> org.apache.maven.plugins:maven-clean-plugin:2.4.1:clean >>> >>> (default-clean) on >>> >>> project extraction: Failed to clean project: Failed to delete >>> >>> /mnt/ebs/perl/framework/dbpedia/target/classes -> [Help 1] >>> >>> [ERROR] >>> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with >>> >>> the >>> >>> -e switch. >>> >>> [ERROR] Re-run Maven using the -X switch to enable full debug >>> >>> logging. >>> >>> [ERROR] >>> >>> [ERROR] For more information about the errors and possible solutions, >>> >>> please read the following articles: >>> >>> [ERROR] [Help 1] >>> >>> >>> >>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >>> >>> >>> >>> " >>> >>> >>> >>> I have below concerns. >>> >>> >>> >>> 1- Which database it will use As I want to create dbf file into >>> >>> different >>> >>> directory everytime due to space constraint? >>> >>> 2- Where to give login credential for database also database name to >>> >>> be >>> >>> used? >>> >>> 3- Also please help me to sort out the error! >>> >>> >>> >>> >>> >>> -- >>> >>> Regards >>> >>> Gaurav Pant >>> >>> +91-7709196607,+91-9405757794 >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> Kind Regards >>> >>> Mohamed Morsey >>> >>> Department of Computer Science >>> >>> University of Leipzig >>> >> >>> >> >>> >> >>> >> >>> >> -- >>> >> Regards >>> >> Gaurav Pant >>> >> +91-7709196607,+91-9405757794 >>> >> >>> >> >>> >> >>> >> ------------------------------------------------------------------------------ >>> >> Everyone hates slow websites. So do we. >>> >> Make your web apps faster with AppDynamics >>> >> Download AppDynamics Lite for free today: >>> >> http://p.sf.net/sfu/appdyn_d2d_mar >>> >> _______________________________________________ >>> >> Dbpedia-discussion mailing list >>> >> Dbpedia-discussion@lists.sourceforge.net >>> >> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >>> >> >>> > >>> > >>> > >>> > ------------------------------------------------------------------------------ >>> > Everyone hates slow websites. So do we. >>> > Make your web apps faster with AppDynamics >>> > Download AppDynamics Lite for free today: >>> > http://p.sf.net/sfu/appdyn_d2d_mar >>> > _______________________________________________ >>> > Dbpedia-discussion mailing list >>> > Dbpedia-discussion@lists.sourceforge.net >>> > https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >>> > >>> >>> >>> ------------------------------------------------------------------------------ >>> Everyone hates slow websites. So do we. >>> Make your web apps faster with AppDynamics >>> Download AppDynamics Lite for free today: >>> http://p.sf.net/sfu/appdyn_d2d_mar >>> _______________________________________________ >>> Dbpedia-discussion mailing list >>> Dbpedia-discussion@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >> >> >> >> >> -- >> Kontokostas Dimitris > > > > > -- > Regards > Gaurav Pant > +91-7709196607,+91-9405757794 ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar _______________________________________________ Dbpedia-discussion mailing list Dbpedia-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
