[ 
https://issues.apache.org/jira/browse/HIVE-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019232#comment-13019232
 ] 

jirapos...@reviews.apache.org commented on HIVE-1943:
-----------------------------------------------------



bq.  On 2011-04-13 06:21:06, Amareshwari Sriramadasu wrote:
bq.  > http://svn.apache.org/repos/asf/hive/trunk/metastore/build.xml, lines 
25-46
bq.  > <https://reviews.apache.org/r/586/diff/1/?file=15648#file15648line25>
bq.  >
bq.  >     Did not understand why this change is required?

Right. This is not needed (it was needed in an earlier version of the 
TestMetaStoreAuthorization).


bq.  On 2011-04-13 06:21:06, Amareshwari Sriramadasu wrote:
bq.  > 
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java,
 line 649
bq.  > <https://reviews.apache.org/r/586/diff/1/?file=15649#file15649line649>
bq.  >
bq.  >     change Table metadata to databse metadata?

Copy-paste problem :(


bq.  On 2011-04-13 06:21:06, Amareshwari Sriramadasu wrote:
bq.  > 
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java,
 line 1399
bq.  > <https://reviews.apache.org/r/586/diff/1/?file=15649#file15649line1399>
bq.  >
bq.  >     change Table metadata to partition metadata?

Copy-paste problem :(


bq.  On 2011-04-13 06:21:06, Amareshwari Sriramadasu wrote:
bq.  > 
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java,
 line 1411
bq.  > <https://reviews.apache.org/r/586/diff/1/?file=15649#file15649line1411>
bq.  >
bq.  >     change Table metadata to partition metadata?

Copy-paste problem :(


bq.  On 2011-04-13 06:21:06, Amareshwari Sriramadasu wrote:
bq.  > 
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreAuthorization.java,
 lines 63-65
bq.  > <https://reviews.apache.org/r/586/diff/1/?file=15652#file15652line63>
bq.  >
bq.  >     Can this be changed to assert statement instead of throwing 
exception?

Okay, will make it an assert.


bq.  On 2011-04-13 06:21:06, Amareshwari Sriramadasu wrote:
bq.  > 
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreAuthorization.java,
 lines 67-69
bq.  > <https://reviews.apache.org/r/586/diff/1/?file=15652#file15652line67>
bq.  >
bq.  >     Can this be changed to assert statement instead of throwing 
exception?

Okay, will make it an assert.


bq.  On 2011-04-13 06:21:06, Amareshwari Sriramadasu wrote:
bq.  > 
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreAuthorization.java,
 line 73
bq.  > <https://reviews.apache.org/r/586/diff/1/?file=15652#file15652line73>
bq.  >
bq.  >     Can we add the test for group writable also?

That's a bit tricky. The reason being that the test might give out false 
positives, since the isWritable call doesn't take any argument to signify for 
which entity (owner or group) we are doing the check. For example, 
isWritable(foo) will return true for both 570 and 750 permissions on foo. We 
really can't say whether the test passed because the check for the owner part 
returned true, or, the check for the group part returned true. If i break up 
the method isWritable to three methods that do checks on owner, group, and, 
others, respectively, i can do the tests for all three, but have a feeling that 
that will be an overkill.. Thoughts?


- Devaraj


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/586/#review437
-----------------------------------------------------------


On 2011-04-12 22:12:32, Devaraj Das wrote:
bq.  
bq.  -----------------------------------------------------------
bq.  This is an automatically generated e-mail. To reply, visit:
bq.  https://reviews.apache.org/r/586/
bq.  -----------------------------------------------------------
bq.  
bq.  (Updated 2011-04-12 22:12:32)
bq.  
bq.  
bq.  Review request for hive.
bq.  
bq.  
bq.  Summary
bq.  -------
bq.  
bq.  This is a patch to handle the issue described in HIVE-1943
bq.  
bq.  
bq.  This addresses bug HIVE-1943.
bq.      https://issues.apache.org/jira/browse/HIVE-1943
bq.  
bq.  
bq.  Diffs
bq.  -----
bq.  
bq.    
http://svn.apache.org/repos/asf/hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
 1090038 
bq.    http://svn.apache.org/repos/asf/hive/trunk/conf/hive-default.xml 1090038 
bq.    http://svn.apache.org/repos/asf/hive/trunk/metastore/build.xml 1090038 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
 1090038 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java
 1090038 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java
 1090038 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreAuthorization.java
 PRE-CREATION 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
 1090038 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
 1090038 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java
 1090038 
bq.    
http://svn.apache.org/repos/asf/hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java
 1090038 
bq.  
bq.  Diff: https://reviews.apache.org/r/586/diff
bq.  
bq.  
bq.  Testing
bq.  -------
bq.  
bq.  Unit tests added.
bq.  
bq.  
bq.  Thanks,
bq.  
bq.  Devaraj
bq.  
bq.



> Metastore operations (like drop_partition) could be improved in terms of 
> maintaining consistency of metadata and data
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1943
>                 URL: https://issues.apache.org/jira/browse/HIVE-1943
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>
> Currently, metastore operations with associated hdfs operations like 
> drop_partition doesn't do a rollback if the hdfs operation fails. The 
> metastore first updates the metadata, and then tries to do hdfs operation. If 
> the hdfs operation fails for any reason, the data on the hdfs will be 
> orphaned. We should improve the situation.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to