Dynamically generating HBase columns

2015-02-24 Thread Lewis John Mcgibbney
Hi Folks, I am currently supercharging persistence in Apache Chukwa [0] with Gora, progress can be tracked in Jira [1]. The issue I run in to, is that the required HBase schema looks as follows Row Key: [Invert Date]:[Data Type]:[Primary Key] Column Family: log Column Name: [Sequence ID]

Re: Dynamically generating HBase columns

2015-02-24 Thread Alfonso Nishikawa
Hi, Lewis. In my use cases I always need a mix between static and dynamic columns. In my first week I tried to mix a Map over a column family overlapped with static columns. Didn't work because Gora was not prepared for that (and indeed needs thinking about it further). What I do is separate the

Re: Workings of Hadoop Shims

2015-02-24 Thread Henry Saputra
The gora-shims-distribution have optional dependencies on Hadoop-2 which should be ok. Lewis, could you try update gora-core/pom.xml to add optional to be true for the hadoop-client dependency: dependency groupIdorg.apache.hadoop/groupId artifactIdhadoop-client/artifactId