[ 
https://issues.apache.org/jira/browse/CASSANDRA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698911#comment-13698911
 ] 

Nicolas Lalevée commented on CASSANDRA-4131:
--------------------------------------------

FYI, I have used the Hive/Cassandra storage patch for some time now, only for 
writes, and I had to modify some lines to make it work properly. I never took 
time to figure out if it was because of my environment or if this is a real 
bug. Maybe you should look into it.

It is about the precision of the timestamp. In the patches, the timestamp is 
set to {{System.currentTimeMillis()}}. And as far as I understand, the command 
line client of cassandra precision is in micro seconds. So if a write happen 
once in the command line client, every writes from Hive will be ignore.

For instance, here are lines which I patched:
https://github.com/milliondreams/hive/blob/cas-support/cassandra-handler/src/main/java/org/apache/hadoop/hive/cassandra/serde/RegularTableMapping.java#L84
https://github.com/milliondreams/hive/blob/cas-support/cassandra-handler/src/main/java/org/apache/hadoop/hive/cassandra/serde/RegularTableMapping.java#L94
https://github.com/milliondreams/hive/blob/cas-support/cassandra-handler/src/main/java/org/apache/hadoop/hive/cassandra/serde/TransposedMapping.java#L45
https://github.com/milliondreams/hive/blob/cas-support/cassandra-handler/src/main/java/org/apache/hadoop/hive/cassandra/serde/TransposedMapping.java#L63

Instead I used: {{cc.setTimeStamp(FBUtilities.timestampMicros());}}

                
> Integrate Hive support to be in core cassandra
> ----------------------------------------------
>
>                 Key: CASSANDRA-4131
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4131
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: Jeremy Hanna
>            Assignee: Edward Capriolo
>              Labels: hadoop, hive
>
> The standalone hive support (at https://github.com/riptano/hive) would be 
> great to have in-tree so that people don't have to go out to github to 
> download it and wonder if it's a left-for-dead external shim.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to