Hi Furkan, The error seems like Zookeeper is closing the HBase connections ahead of time. This is a very common problem when starting zookeeper and hbase together. Check [1] hopefully that will be it.
Renato M. [1] http://stackoverflow.com/questions/10188889/hbase-connection-refused 2015-08-27 6:21 GMT+02:00 Lewis John Mcgibbney <[email protected]>: > Hi Furkan, > > On Wed, Aug 26, 2015 at 8:54 PM, <[email protected]> wrote: > > > > > I've finished my GSoC project but I have a problem. I've implemented a > > Spark backend for Gora and I've written a word count test class for it. > > > > Yep. Nice work. > > > > > > Here is my particular test method: > > > > > > > https://github.com/kamaci/gora/blob/master/gora-hbase/src/test/java/org/apache/gora/hbase/mapreduce/TestHBaseStoreWordCount.java#L65 > > > > Actually the Test and Method is here > > https://github.com/kamaci/gora/blob/master/gora-core/src/examples/java/org/apache/gora/examples/spark/SparkWordCount.java > > > > > > > > > When I run my test there is no need to startup an Hbase cluster because > > Spark will connect to my dummy cluster. However when I run my test method > > it throws an error. Here is a part from stack trace: > > > > > OK, maybe I am interpreting things incorrectly here however unless you want > SparkWordCount.java to be run for every datastore then it should be tested > ONLY by GoraSparkEngine... no? > > I need to also comment that I think it is important for you to implement > our base test suite defined within > > > https://github.com/apache/gora/blob/master/gora-core/src/test/java/org/apache/gora/store/DataStoreTestUtil.java > > and implemented via > > > https://github.com/apache/gora/blob/master/gora-core/src/test/java/org/apache/gora/store/DataStoreTestBase.java > > Does this make sense? We need to have the GoraSparkEngine displaying that > it is able to store, operate upon and provide access to all of the test > cases provided under the base test suite. > This is also detailed within our documentation > http://gora.apache.org/current/index.html#gora-testing > > If I were you I would implement the Unit tests under > > https://github.com/kamaci/gora/tree/master/gora-core/src/test/java/org/apache/gora/spark > or something like that. > > [snip] > > > > > > Any ideas about solving that connection problem? > > > > I wouldn't worry about it right now. I would address the questions above > first and tell me/us what you think about that. We can then move on to the > HBase cluster at a later stage. > > > > > > PS 1: I've ignored the test at my Github repository. > > PS 2: I don't think that there is a problem Spark side. > > PS 3: I'll upload full stack trace to > > https://issues.apache.org/jira/browse/GORA-386 > > > > Great thank you. > Lewis >
