Hi Adhish,

The files are supposed to be specified by:

 -files hdfs://host:fs_port/user/testfile.txt

Did you try that? And as I said you could also just put the files locally
in all machines (in the same location) which I think it was what you were
doing originally.
The warning is just because Gora doesn't find the files.


Best,

Renato M.


2017-09-29 16:48 GMT+02:00 Adhish Singla <adhish.sin...@research.iiit.ac.in>
:

> And it also mentions this :
>
> WARN  [main] store.DataStoreFactory (DataStoreFactory.java:createProps(91))
> - gora.properties not found, properties will be empty.
>
> ----- Original Message -----
> From: "Adhish Singla" <adhish.sin...@research.iiit.ac.in>
> To: "rmarroquin" <rmarroq...@apache.org>
> Sent: Friday, September 29, 2017 8:16:07 PM
> Subject: Re: Need Urgent Help with Giraph-Gora
>
> I am using HDFS and I tried by shifting the files to HDFS. You can check
> the updated file.
>
> org.apache.gora.util.GoraException: java.lang.RuntimeException:
> java.net.MalformedURLException
>         at org.apache.gora.store.DataStoreFactory.createDataStore(
> DataStoreFactory.java:169)
>         at org.apache.gora.store.DataStoreFactory.createDataStore(
> DataStoreFactory.java:120)
>         at org.apache.giraph.io.gora.utils.GoraUtils.
> createDataStore(GoraUtils.java:63)
>         at org.apache.giraph.io.gora.utils.GoraUtils.
> createSpecificDataStore(GoraUtils.java:87)
>         at org.apache.giraph.io.gora.GoraVertexInputFormat.
> createDataStore(GoraVertexInputFormat.java:189)
>         at org.apache.giraph.io.gora.GoraVertexInputFormat.
> checkInputSpecs(GoraVertexInputFormat.java:118)
>         at org.apache.giraph.io.internal.WrappedVertexInputFormat.
> checkInputSpecs(WrappedVertexInputFormat.java:66)
>         at org.apache.giraph.graph.GraphTaskManager.checkInput(
> GraphTaskManager.java:173)
>         at org.apache.giraph.graph.GraphTaskManager.setup(
> GraphTaskManager.java:210)
>         at org.apache.giraph.yarn.GiraphYarnTask.run(
> GiraphYarnTask.java:91)
>         at org.apache.giraph.yarn.GiraphYarnTask.main(
> GiraphYarnTask.java:183)
> Caused by: java.lang.RuntimeException: java.net.MalformedURLException
>         at org.apache.gora.hbase.store.HBaseStore.initialize(
> HBaseStore.java:133)
>         at org.apache.gora.store.DataStoreFactory.initializeDataStore(
> DataStoreFactory.java:104)
>         at org.apache.gora.store.DataStoreFactory.createDataStore(
> DataStoreFactory.java:163)
>         ... 10 more
> Caused by: java.net.MalformedURLException
>         at java.net.URL.<init>(URL.java:619)
>         at java.net.URL.<init>(URL.java:482)
>         at java.net.URL.<init>(URL.java:431)
>         at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.
> setupCurrentEntity(XMLEntityManager.java:616)
>         at com.sun.org.apache.xerces.internal.impl.XMLVersionDetector.
> determineDocVersion(XMLVersionDetector.java:189)
>         at com.sun.org.apache.xerces.internal.parsers.
> XML11Configuration.parse(XML11Configuration.java:812)
>         at com.sun.org.apache.xerces.internal.parsers.
> XML11Configuration.parse(XML11Configuration.java:777)
>         at com.sun.org.apache.xerces.internal.parsers.XMLParser.
> parse(XMLParser.java:141)
>         at com.sun.org.apache.xerces.internal.parsers.
> AbstractSAXParser.parse(AbstractSAXParser.java:1213)
>         at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$
> JAXPSAXParser.parse(SAXParserImpl.java:648)
>         at org.jdom.input.SAXBuilder.build(SAXBuilder.java:518)
>         at org.jdom.input.SAXBuilder.build(SAXBuilder.java:865)
>         at org.apache.gora.hbase.store.HBaseStore.readMapping(
> HBaseStore.java:730)
>         at org.apache.gora.hbase.store.HBaseStore.initialize(
> HBaseStore.java:116)
>         ... 12 more
> Caused by: java.lang.NullPointerException
>         at java.net.URL.<init>(URL.java:524)
>         ... 25 more
>
> This is the complete error trace that i get.
>
> Regards,
> Adhish
>
>
> ----- Original Message -----
> From: "rmarroquin" <rmarroq...@apache.org>
> To: "Adhish Singla" <adhish.sin...@research.iiit.ac.in>
> Sent: Friday, September 29, 2017 6:30:01 PM
> Subject: Re: Need Urgent Help with Giraph-Gora
>
> Hi Adhish,
>
> Could you please post the actual error you are seeing? Are you sure that
> the files are inside HDFS?
> Take a look at this:
> https://hadoop.apache.org/docs/r1.2.1/streaming.html#
> Making+Files+Available+to+Tasks
>
> The other thing you can try is just putting the files in all machines in
> the same location if you are not using HDFS.
> Hope it helps,
>
> Renato M.
>
> 2017-09-29 12:14 GMT+02:00 Adhish Singla <adhish.sin...@research.iiit.
> ac.in>
> :
>
> > Hi,
> >
> > I am a Giraph User and need some help with setting Giraph-Gora on AWS
> EMR.
> > I have attached the script using which i try to run the code. But the
> code
> > is not able to detect the files mentioned in "-files" option.
> >
> > Kindly help me with the same.
> >
> > Thanks and regards,
> > Adhish
>

Reply via email to