[jira] [Commented] (HADOOP-14543) Should use getAversion() while setting the zkacl

2017-06-23 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-14543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060533#comment-16060533
 ] 

Rakesh R commented on HADOOP-14543:
---

Thanks all for pointing out this, am adding [ZooKeeper user mailing list 
discussion 
thread|http://zookeeper-user.578899.n2.nabble.com/Version-parameter-passed-to-ZooKeeper-setACL-td7583140.html]
 link. The fix looks good to me.

Just curiosity I've tried unit testing this part. Perhaps, you could include 
this unit test as well.

{code}

  /**
   * Test to verify that proper ZooKeper ACLs can be updated on
   * ActiveStandbyElector's parent znode.
   */
  @Test(timeout = 15000)
  public void testSetZooKeeperACLsOnParentZnodeName() throws Exception {
ActiveStandbyElectorCallback cb = Mockito
.mock(ActiveStandbyElectorCallback.class);
ActiveStandbyElector elector = new ActiveStandbyElector(hostPort, 5000,
PARENT_DIR, Ids.READ_ACL_UNSAFE, Collections. emptyList(),
cb, CommonConfigurationKeys.HA_FC_ELECTOR_ZK_OP_RETRIES_DEFAULT);

// Simulate the case by pre-creating znode 'parentZnodeName'. Then updates
// znode's data so that data version will be increased to 1. Here znode's
// aversion is 0.
ZooKeeper otherClient = createClient();
otherClient.create(PARENT_DIR, "sample1".getBytes(), Ids.OPEN_ACL_UNSAFE,
CreateMode.PERSISTENT);
otherClient.setData(PARENT_DIR, "sample2".getBytes(), -1);
otherClient.close();

elector.ensureParentZNode();
  }
{code}

> Should use getAversion() while setting the zkacl
> 
>
> Key: HADOOP-14543
> URL: https://issues.apache.org/jira/browse/HADOOP-14543
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Attachments: HADOOP-14543.patch
>
>
> while setting the zkacl we used {{getVersion()}} which is dataVersion,Ideally 
> we should use {{getAversion()}}. If there is any acl changes( i.e relam 
> change/..) ,we set the ACL with dataversion which will cause BADVersion and 
> *process will not start*. See 
> [here|https://issues.apache.org/jira/browse/HDFS-11403?focusedCommentId=16051804=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16051804]
> {{zkClient.setACL(path, zkAcl, stat.getVersion());}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-10075) Update jetty dependency to version 9

2016-10-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614361#comment-15614361
 ] 

Rakesh R commented on HADOOP-10075:
---

I too faced same problem in my Windows env. I could see the issue has been 
resolved with this addendum patch and able to continue building. Thanks 
[~rkanter].

> Update jetty dependency to version 9
> 
>
> Key: HADOOP-10075
> URL: https://issues.apache.org/jira/browse/HADOOP-10075
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 2.2.0, 2.6.0
>Reporter: Robert Rati
>Assignee: Robert Kanter
>Priority: Critical
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-10075-002-wip.patch, HADOOP-10075.003.patch, 
> HADOOP-10075.004.patch, HADOOP-10075.005.patch, HADOOP-10075.006.patch, 
> HADOOP-10075.007.patch, HADOOP-10075.008.patch, HADOOP-10075.009.patch, 
> HADOOP-10075.010.patch, HADOOP-10075.011.patch, HADOOP-10075.patch, 
> HADOOP-10075_addendum.001.patch
>
>
> Jetty6 is no longer maintained.  Update the dependency to jetty9.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13201) Print the directory paths when ViewFs denies the rename operation on internal dirs

2016-10-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611805#comment-15611805
 ] 

Rakesh R commented on HADOOP-13201:
---

Thank you [~brahmareddy]

> Print the directory paths when ViewFs denies the rename operation on internal 
> dirs
> --
>
> Key: HADOOP-13201
> URL: https://issues.apache.org/jira/browse/HADOOP-13201
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: viewfs
>Affects Versions: 2.7.2
>Reporter: Tianyin Xu
>Assignee: Rakesh R
> Attachments: HADOOP-13201-001.patch, HADOOP-13201.000.patch
>
>
> With ViewFs, the delete and rename operations on internal dirs are denied by 
> throwing {{AccessControlException}}. 
> Unlike the {{delete()}} which notify the internal dir path, rename does not. 
> The attached patch appends the directory path on the logged exception.
> {code:title=ViewFs.java|borderStyle=solid}
>  InodeTree.ResolveResult resSrc = 
>fsState.resolve(getUriPath(src), false); 
>  if (resSrc.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + src);
>  }
>
>  InodeTree.ResolveResult resDst = 
>  fsState.resolve(getUriPath(dst), false);
>  if (resDst.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + dst);
>  }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-10829) Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe

2016-10-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611750#comment-15611750
 ] 

Rakesh R commented on HADOOP-10829:
---

Thanks [~lmccay],
bq. I am inclined to prefer the approach used in KeyProviderFactory
IIUC, you are suggesting to the use the following way.
{code}
+  // Iterate through the serviceLoader to avoid lazy loading.
+  // Lazy loading would require synchronization in concurrent use cases.
+  static {
+Iterator iterServices = 
serviceLoader.iterator();
+while (iterServices.hasNext()) {
+  iterServices.next();
+}
+  }
+
{code}
I had uploaded similar approach in the recent patch 
[HADOOP-10829.003.patch|https://issues.apache.org/jira/secure/attachment/12835546/HADOOP-10829.003.patch],
 is that ok?

> Iteration on CredentialProviderFactory.serviceLoader  is thread-unsafe
> --
>
> Key: HADOOP-10829
> URL: https://issues.apache.org/jira/browse/HADOOP-10829
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: security
>Affects Versions: 2.6.0
>Reporter: Benoy Antony
>Assignee: Benoy Antony
>  Labels: BB2015-05-TBR
> Attachments: HADOOP-10829.003.patch, HADOOP-10829.patch, 
> HADOOP-10829.patch
>
>
> CredentialProviderFactory uses _ServiceLoader_ framework to load 
> _CredentialProviderFactory_
> {code}
>   private static final ServiceLoader serviceLoader 
> =
>   ServiceLoader.load(CredentialProviderFactory.class);
> {code}
> The _ServiceLoader_ framework does lazy initialization of services which 
> makes it thread unsafe. If accessed from multiple threads, it is better to 
> synchronize the access.
> Similar synchronization has been done while loading compression codec 
> providers via HADOOP-8406. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13201) Print the directory paths when ViewFs denies the rename operation on internal dirs

2016-10-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611568#comment-15611568
 ] 

Rakesh R commented on HADOOP-13201:
---

cc/[~vinayrpet]

> Print the directory paths when ViewFs denies the rename operation on internal 
> dirs
> --
>
> Key: HADOOP-13201
> URL: https://issues.apache.org/jira/browse/HADOOP-13201
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: viewfs
>Affects Versions: 2.7.2
>Reporter: Tianyin Xu
>Assignee: Rakesh R
> Attachments: HADOOP-13201-001.patch, HADOOP-13201.000.patch
>
>
> With ViewFs, the delete and rename operations on internal dirs are denied by 
> throwing {{AccessControlException}}. 
> Unlike the {{delete()}} which notify the internal dir path, rename does not. 
> The attached patch appends the directory path on the logged exception.
> {code:title=ViewFs.java|borderStyle=solid}
>  InodeTree.ResolveResult resSrc = 
>fsState.resolve(getUriPath(src), false); 
>  if (resSrc.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + src);
>  }
>
>  InodeTree.ResolveResult resDst = 
>  fsState.resolve(getUriPath(dst), false);
>  if (resDst.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + dst);
>  }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13201) Print the directory paths when ViewFs denies the rename operation on internal dirs

2016-10-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611496#comment-15611496
 ] 

Rakesh R commented on HADOOP-13201:
---

Kindly review the patch. Thanks!

> Print the directory paths when ViewFs denies the rename operation on internal 
> dirs
> --
>
> Key: HADOOP-13201
> URL: https://issues.apache.org/jira/browse/HADOOP-13201
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: viewfs
>Affects Versions: 2.7.2
>Reporter: Tianyin Xu
>Assignee: Rakesh R
> Attachments: HADOOP-13201-001.patch, HADOOP-13201.000.patch
>
>
> With ViewFs, the delete and rename operations on internal dirs are denied by 
> throwing {{AccessControlException}}. 
> Unlike the {{delete()}} which notify the internal dir path, rename does not. 
> The attached patch appends the directory path on the logged exception.
> {code:title=ViewFs.java|borderStyle=solid}
>  InodeTree.ResolveResult resSrc = 
>fsState.resolve(getUriPath(src), false); 
>  if (resSrc.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + src);
>  }
>
>  InodeTree.ResolveResult resDst = 
>  fsState.resolve(getUriPath(dst), false);
>  if (resDst.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + dst);
>  }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Assigned] (HADOOP-13201) Print the directory paths when ViewFs denies the rename operation on internal dirs

2016-10-27 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R reassigned HADOOP-13201:
-

Assignee: Rakesh R

> Print the directory paths when ViewFs denies the rename operation on internal 
> dirs
> --
>
> Key: HADOOP-13201
> URL: https://issues.apache.org/jira/browse/HADOOP-13201
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: viewfs
>Affects Versions: 2.7.2
>Reporter: Tianyin Xu
>Assignee: Rakesh R
> Attachments: HADOOP-13201-001.patch, HADOOP-13201.000.patch
>
>
> With ViewFs, the delete and rename operations on internal dirs are denied by 
> throwing {{AccessControlException}}. 
> Unlike the {{delete()}} which notify the internal dir path, rename does not. 
> The attached patch appends the directory path on the logged exception.
> {code:title=ViewFs.java|borderStyle=solid}
>  InodeTree.ResolveResult resSrc = 
>fsState.resolve(getUriPath(src), false); 
>  if (resSrc.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + src);
>  }
>
>  InodeTree.ResolveResult resDst = 
>  fsState.resolve(getUriPath(dst), false);
>  if (resDst.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + dst);
>  }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-10829) Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe

2016-10-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611480#comment-15611480
 ] 

Rakesh R commented on HADOOP-10829:
---

Thanks [~benoyantony] for the fix. 

+1 (non-binding) for the fix. I've rebased the patch on latest trunk code, 
please someone help in reviewing the changes. Thanks!

> Iteration on CredentialProviderFactory.serviceLoader  is thread-unsafe
> --
>
> Key: HADOOP-10829
> URL: https://issues.apache.org/jira/browse/HADOOP-10829
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: security
>Affects Versions: 2.6.0
>Reporter: Benoy Antony
>Assignee: Benoy Antony
>  Labels: BB2015-05-TBR
> Attachments: HADOOP-10829.003.patch, HADOOP-10829.patch, 
> HADOOP-10829.patch
>
>
> CredentialProviderFactory uses _ServiceLoader_ framework to load 
> _CredentialProviderFactory_
> {code}
>   private static final ServiceLoader serviceLoader 
> =
>   ServiceLoader.load(CredentialProviderFactory.class);
> {code}
> The _ServiceLoader_ framework does lazy initialization of services which 
> makes it thread unsafe. If accessed from multiple threads, it is better to 
> synchronize the access.
> Similar synchronization has been done while loading compression codec 
> providers via HADOOP-8406. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-10829) Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe

2016-10-27 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-10829:
--
Attachment: HADOOP-10829.003.patch

> Iteration on CredentialProviderFactory.serviceLoader  is thread-unsafe
> --
>
> Key: HADOOP-10829
> URL: https://issues.apache.org/jira/browse/HADOOP-10829
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: security
>Affects Versions: 2.6.0
>Reporter: Benoy Antony
>Assignee: Benoy Antony
>  Labels: BB2015-05-TBR
> Attachments: HADOOP-10829.003.patch, HADOOP-10829.patch, 
> HADOOP-10829.patch
>
>
> CredentialProviderFactory uses _ServiceLoader_ framework to load 
> _CredentialProviderFactory_
> {code}
>   private static final ServiceLoader serviceLoader 
> =
>   ServiceLoader.load(CredentialProviderFactory.class);
> {code}
> The _ServiceLoader_ framework does lazy initialization of services which 
> makes it thread unsafe. If accessed from multiple threads, it is better to 
> synchronize the access.
> Similar synchronization has been done while loading compression codec 
> providers via HADOOP-8406. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13201) Print the directory paths when ViewFs denies the rename operation on internal dirs

2016-10-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611154#comment-15611154
 ] 

Rakesh R commented on HADOOP-13201:
---

Thanks [~tianyin] for reporting this. I've modified the exception message and 
placed {{src}} and {{dest}} properly, please review this.

> Print the directory paths when ViewFs denies the rename operation on internal 
> dirs
> --
>
> Key: HADOOP-13201
> URL: https://issues.apache.org/jira/browse/HADOOP-13201
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: viewfs
>Affects Versions: 2.7.2
>Reporter: Tianyin Xu
> Attachments: HADOOP-13201-001.patch, HADOOP-13201.000.patch
>
>
> With ViewFs, the delete and rename operations on internal dirs are denied by 
> throwing {{AccessControlException}}. 
> Unlike the {{delete()}} which notify the internal dir path, rename does not. 
> The attached patch appends the directory path on the logged exception.
> {code:title=ViewFs.java|borderStyle=solid}
>  InodeTree.ResolveResult resSrc = 
>fsState.resolve(getUriPath(src), false); 
>  if (resSrc.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + src);
>  }
>
>  InodeTree.ResolveResult resDst = 
>  fsState.resolve(getUriPath(dst), false);
>  if (resDst.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + dst);
>  }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13201) Print the directory paths when ViewFs denies the rename operation on internal dirs

2016-10-27 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13201:
--
Attachment: HADOOP-13201-001.patch

> Print the directory paths when ViewFs denies the rename operation on internal 
> dirs
> --
>
> Key: HADOOP-13201
> URL: https://issues.apache.org/jira/browse/HADOOP-13201
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: viewfs
>Affects Versions: 2.7.2
>Reporter: Tianyin Xu
> Attachments: HADOOP-13201-001.patch, HADOOP-13201.000.patch
>
>
> With ViewFs, the delete and rename operations on internal dirs are denied by 
> throwing {{AccessControlException}}. 
> Unlike the {{delete()}} which notify the internal dir path, rename does not. 
> The attached patch appends the directory path on the logged exception.
> {code:title=ViewFs.java|borderStyle=solid}
>  InodeTree.ResolveResult resSrc = 
>fsState.resolve(getUriPath(src), false); 
>  if (resSrc.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + src);
>  }
>
>  InodeTree.ResolveResult resDst = 
>  fsState.resolve(getUriPath(dst), false);
>  if (resDst.isInternalDir()) {
>throw new AccessControlException(
> -  "Cannot Rename within internal dirs of mount table: it is 
> readOnly");
> +  "Cannot Rename within internal dirs of mount table: it is readOnly"
> +  + dst);
>  }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13715) Add isErasureCoded() API to FileStatus class

2016-10-13 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574080#comment-15574080
 ] 

Rakesh R commented on HADOOP-13715:
---

Thanks [~drankye] for the useful thoughts. I could see encryption feature has 
exposed APIs like, HdfsFileStatus has {{#getFileEncryptionInfo()}} exposed and 
FileStatus contains {{#isEncrypted()}} flag, to tell whether the underlying 
file or directory is encrypted or not. imho, EC could expose APIs in similar 
lines.

> Add isErasureCoded() API to FileStatus class
> 
>
> Key: HADOOP-13715
> URL: https://issues.apache.org/jira/browse/HADOOP-13715
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: fs
>Affects Versions: 3.0.0-alpha1
>Reporter: Wei-Chiu Chuang
>Assignee: Wei-Chiu Chuang
>
> Per the discussion in 
> [HDFS-10971|https://issues.apache.org/jira/browse/HDFS-10971?focusedCommentId=15567108=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15567108]
>  I would like to add a new API {{isErasureCoded()}} to {{FileStatus}} so that 
> tools and downstream applications can tell if it needs to treat a file 
> differently.
> Hadoop tools that can benefit from this effort include: distcp and 
> teragen/terasort.
> Downstream applications such as flume or hbase may also benefit from it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13469) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-04 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13469:
--
Component/s: test

> Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test 
> failure
> 
>
> Key: HADOOP-13469
> URL: https://issues.apache.org/jira/browse/HADOOP-13469
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Reporter: Rakesh R
>Assignee: Rakesh R
>
> This jira is to analyse and fix the test case failure, which is failing in 
> Jenkins build, 
> [Build_16326|https://builds.apache.org/job/PreCommit-HDFS-Build/16326/testReport/org.apache.hadoop.security/TestRefreshUserMappings/testRefreshSuperUserGroupsConfiguration/]
>  very frequently.
> {code}
> Error Message
> first auth for user2 should've succeeded: User: super_userL is not allowed to 
> impersonate userL2
> Stacktrace
> java.lang.AssertionError: first auth for user2 should've succeeded: User: 
> super_userL is not allowed to impersonate userL2
>   at org.junit.Assert.fail(Assert.java:88)
>   at 
> org.apache.hadoop.security.TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration(TestRefreshUserMappings.java:200)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13469) Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure

2016-08-04 Thread Rakesh R (JIRA)
Rakesh R created HADOOP-13469:
-

 Summary: Fix 
TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure
 Key: HADOOP-13469
 URL: https://issues.apache.org/jira/browse/HADOOP-13469
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Rakesh R
Assignee: Rakesh R


This jira is to analyse and fix the test case failure, which is failing in 
Jenkins build, 
[Build_16326|https://builds.apache.org/job/PreCommit-HDFS-Build/16326/testReport/org.apache.hadoop.security/TestRefreshUserMappings/testRefreshSuperUserGroupsConfiguration/]
 very frequently.

{code}
Error Message

first auth for user2 should've succeeded: User: super_userL is not allowed to 
impersonate userL2
Stacktrace

java.lang.AssertionError: first auth for user2 should've succeeded: User: 
super_userL is not allowed to impersonate userL2
at org.junit.Assert.fail(Assert.java:88)
at 
org.apache.hadoop.security.TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration(TestRefreshUserMappings.java:200)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-13 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375137#comment-15375137
 ] 

Rakesh R commented on HADOOP-13366:
---

Thank you [~templedf] for the feedback.

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch, HADOOP-13366-03.patch, HADOOP-13366-04.patch, 
> HADOOP-13366-05.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-13 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374909#comment-15374909
 ] 

Rakesh R commented on HADOOP-13366:
---

[~ajisakaa], I got a better QA report now:)

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch, HADOOP-13366-03.patch, HADOOP-13366-04.patch, 
> HADOOP-13366-05.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-13 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: HADOOP-13366-05.patch

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch, HADOOP-13366-03.patch, HADOOP-13366-04.patch, 
> HADOOP-13366-05.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-13 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: HADOOP-13366-04.patch

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch, HADOOP-13366-03.patch, HADOOP-13366-04.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-13 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374514#comment-15374514
 ] 

Rakesh R commented on HADOOP-13366:
---

Attached another patch to resolve the javadoc warnings.

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch, HADOOP-13366-03.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-13 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: HADOOP-13366-03.patch

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch, HADOOP-13366-03.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374382#comment-15374382
 ] 

Rakesh R commented on HADOOP-13366:
---

[~ajisakaa], Uploaded new patch with the suggested changes. Please take a look 
at it again. Thanks!

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: HADOOP-13366-02.patch

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch, 
> HADOOP-13366-02.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: HADOOP-13366-02.patch

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: (was: HADOOP-13366-02.patch)

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374277#comment-15374277
 ] 

Rakesh R commented on HADOOP-13366:
---

Test case failure is unrelated, please ignore it. HADOOP-12588 is addressing 
the failure test.

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Comment Edited] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374204#comment-15374204
 ] 

Rakesh R edited comment on HADOOP-13366 at 7/13/16 2:42 AM:


Thank you [~ajisakaa] for the reviews. Attached new patch addressing the 
comments. Also, in the latest patch I've corrected {{core-default.xml}} path in 
{{CommonConfigurationKeys.java}} file. Kindly review it again.


was (Author: rakeshr):
Thank you [~ajisakaa] for the reviews. Attached new patch addressing the 
comments.

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374219#comment-15374219
 ] 

Rakesh R commented on HADOOP-13366:
---

Thanks [~templedf] for the interest in this. @docRoot tag is used in our 
existing hadoop code 
[Configuration.java|https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java#L121]
 and is working fine. Please see [Configuration Api 
Doc|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/conf/Configuration.html].

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374204#comment-15374204
 ] 

Rakesh R commented on HADOOP-13366:
---

Thank you [~ajisakaa] for the reviews. Attached new patch addressing the 
comments.

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-12 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: HADOOP-13366-01.patch

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch, HADOOP-13366-01.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-11 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Target Version/s: 2.8.0
  Status: Patch Available  (was: Open)

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-11 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-13366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-13366:
--
Attachment: HADOOP-13366-00.patch

> Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc
> ---
>
> Key: HADOOP-13366
> URL: https://issues.apache.org/jira/browse/HADOOP-13366
> Project: Hadoop Common
>  Issue Type: Sub-task
>  Components: documentation
>Reporter: Rakesh R
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-13366-00.patch
>
>
> This jira is to fix the dead link to {{core-default.xml}} in 
> [CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
>  javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13366) Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc

2016-07-11 Thread Rakesh R (JIRA)
Rakesh R created HADOOP-13366:
-

 Summary: Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic 
javadoc
 Key: HADOOP-13366
 URL: https://issues.apache.org/jira/browse/HADOOP-13366
 Project: Hadoop Common
  Issue Type: Sub-task
Reporter: Rakesh R
Assignee: Rakesh R
Priority: Minor


This jira is to fix the dead link to {{core-default.xml}} in 
[CommonConfigurationKeysPublic|https://hadoop.apache.org/docs/r2.7.2/api/org/apache/hadoop/fs/CommonConfigurationKeysPublic.html]
 javadoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Updated] (HADOOP-12230) hadoop-project declares duplicate, conflicting curator dependencies

2015-10-02 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-12230:
--
Attachment: HADOOP-12230.branch-2.01.patch

> hadoop-project declares duplicate, conflicting curator dependencies
> ---
>
> Key: HADOOP-12230
> URL: https://issues.apache.org/jira/browse/HADOOP-12230
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 2.7.1
>Reporter: Steve Loughran
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-12230-00.patch, HADOOP-12230.branch-2.00.patch, 
> HADOOP-12230.branch-2.01.patch
>
>   Original Estimate: 0.25h
>  Remaining Estimate: 0.25h
>
> HADOOP-11492 bumped up the curator version in trunk & branch-2, but it looks 
> like there were a couple of extra curator dependencies in branch-2 that 
> didn't get updated, and are still down as 2.6.0
> This isn't that serious, maven will have picked the latest one, but its still 
> messy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-12230) hadoop-project declares duplicate, conflicting curator dependencies

2015-10-02 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940924#comment-14940924
 ] 

Rakesh R commented on HADOOP-12230:
---

Thanks again [~ajisakaa] for the detailed review, I didn't notice the duplicate 
declaration. Attached another patch modifying the same.

> hadoop-project declares duplicate, conflicting curator dependencies
> ---
>
> Key: HADOOP-12230
> URL: https://issues.apache.org/jira/browse/HADOOP-12230
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 2.7.1
>Reporter: Steve Loughran
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-12230-00.patch, HADOOP-12230.branch-2.00.patch, 
> HADOOP-12230.branch-2.01.patch
>
>   Original Estimate: 0.25h
>  Remaining Estimate: 0.25h
>
> HADOOP-11492 bumped up the curator version in trunk & branch-2, but it looks 
> like there were a couple of extra curator dependencies in branch-2 that 
> didn't get updated, and are still down as 2.6.0
> This isn't that serious, maven will have picked the latest one, but its still 
> messy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-12230) hadoop-project declares duplicate, conflicting curator dependencies

2015-10-01 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940672#comment-14940672
 ] 

Rakesh R commented on HADOOP-12230:
---

Thank you [~ajisakaa] for the reviews and the help in getting Jenkins report.

> hadoop-project declares duplicate, conflicting curator dependencies
> ---
>
> Key: HADOOP-12230
> URL: https://issues.apache.org/jira/browse/HADOOP-12230
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 2.7.1
>Reporter: Steve Loughran
>Assignee: Rakesh R
>Priority: Minor
> Attachments: HADOOP-12230-00.patch, HADOOP-12230.branch-2.00.patch
>
>   Original Estimate: 0.25h
>  Remaining Estimate: 0.25h
>
> HADOOP-11492 bumped up the curator version in trunk & branch-2, but it looks 
> like there were a couple of extra curator dependencies in branch-2 that 
> didn't get updated, and are still down as 2.6.0
> This isn't that serious, maven will have picked the latest one, but its still 
> messy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-12230) hadoop-project declares duplicate, conflicting curator dependencies

2015-09-30 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936848#comment-14936848
 ] 

Rakesh R commented on HADOOP-12230:
---

Note: The attached patch is based on {{branch2-7}}. I think the patch is 
failing because it is trying to apply the patch against {{trunk}}.

> hadoop-project declares duplicate, conflicting curator dependencies
> ---
>
> Key: HADOOP-12230
> URL: https://issues.apache.org/jira/browse/HADOOP-12230
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 2.7.1
>Reporter: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-12230-00.patch
>
>   Original Estimate: 0.25h
>  Remaining Estimate: 0.25h
>
> HADOOP-11492 bumped up the curator version in trunk & branch-2, but it looks 
> like there were a couple of extra curator dependencies in branch-2 that 
> didn't get updated, and are still down as 2.6.0
> This isn't that serious, maven will have picked the latest one, but its still 
> messy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12230) hadoop-project declares duplicate, conflicting curator dependencies

2015-09-29 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-12230:
--
Attachment: HADOOP-12230-00.patch

> hadoop-project declares duplicate, conflicting curator dependencies
> ---
>
> Key: HADOOP-12230
> URL: https://issues.apache.org/jira/browse/HADOOP-12230
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 2.7.1
>Reporter: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-12230-00.patch
>
>   Original Estimate: 0.25h
>  Remaining Estimate: 0.25h
>
> HADOOP-11492 bumped up the curator version in trunk & branch-2, but it looks 
> like there were a couple of extra curator dependencies in branch-2 that 
> didn't get updated, and are still down as 2.6.0
> This isn't that serious, maven will have picked the latest one, but its still 
> messy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-12230) hadoop-project declares duplicate, conflicting curator dependencies

2015-09-29 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935617#comment-14935617
 ] 

Rakesh R commented on HADOOP-12230:
---

Hi [~ste...@apache.org], I could see two occurrences in {{hadoop-project}} and 
I'm attaching a patch based on branch-2.7. Kindly review, Thanks!

> hadoop-project declares duplicate, conflicting curator dependencies
> ---
>
> Key: HADOOP-12230
> URL: https://issues.apache.org/jira/browse/HADOOP-12230
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Affects Versions: 2.7.1
>Reporter: Steve Loughran
>Priority: Minor
> Attachments: HADOOP-12230-00.patch
>
>   Original Estimate: 0.25h
>  Remaining Estimate: 0.25h
>
> HADOOP-11492 bumped up the curator version in trunk & branch-2, but it looks 
> like there were a couple of extra curator dependencies in branch-2 that 
> didn't get updated, and are still down as 2.6.0
> This isn't that serious, maven will have picked the latest one, but its still 
> messy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-10584) ActiveStandbyElector goes down if ZK quorum become unavailable

2015-06-18 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591365#comment-14591365
 ] 

Rakesh R commented on HADOOP-10584:
---

Sorry for pitch in late. After looking at the logic, I also feel this case can 
occur in the production clusters. On ZooKeeper connection loss 
ActiveStandbyElector will do certain number of retries and finally notifies 
{{ActiveStandbyElectorCallback#notifyFatalError()}}. I could see the 
{{EmbeddedElectorService#notifyFatalError}} implementation is handling the case 
by immediately terminating the service. I think we have room to improve this 
logic instead of immediately terminating.

About the proposed patch, IIUC it is not required to do an additional handling 
of ZooKeeper exceptions and do re-election in ActiveStandbyElector class. 
Presently we have {{ActiveStandbyElector#processWatchEvent}} logic to handle 
the ZK connection state changes. On connection state changes, ZooKeeper client 
will notify this to the registered ZK watcher like, SyncConnected, 
Disconnected, Expired etc. Based on the STATE {{ActiveStandbyElector}} is 
notifying the registered {{ActiveStandbyElectorCallback}} and does the state 
transitions. Please see 
[ActiveStandbyElector.java#L550|https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ha/ActiveStandbyElector.java#L550]

What I meant is ZooKeeper client will be alive which internally does the 
connection re-establishment infinitely. IMHO, we could think of implemeting 
{{EmbeddedElectorService#enterNeutralMode}} to handle the NEUTRAL transition of 
RM. Also, {{ActiveStandbyElectorCallback#notifyFatalError()}} has to be 
refined. Any thoughts?

{code}
  public void enterNeutralMode() {
/**
 * Possibly due to transient connection issues. Do nothing.
 * TODO: Might want to keep track of how long in this state and transition
 * to standby.
 */
  }
{code}

 ActiveStandbyElector goes down if ZK quorum become unavailable
 --

 Key: HADOOP-10584
 URL: https://issues.apache.org/jira/browse/HADOOP-10584
 Project: Hadoop Common
  Issue Type: Bug
  Components: ha
Affects Versions: 2.4.0
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
Priority: Critical
 Attachments: hadoop-10584-prelim.patch, rm.log


 ActiveStandbyElector retries operations for a few times. If the ZK quorum 
 itself is down, it goes down and the daemons will have to be brought up 
 again. 
 Instead, it should log the fact that it is unable to talk to ZK, call 
 becomeStandby on its client, and continue to attempt connecting to ZK.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-05-15 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544980#comment-14544980
 ] 

Rakesh R commented on HADOOP-11713:
---

Thanks a lot [~cnauroth] for the helpful code review and commit the changes!

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.2.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Fix For: 2.8.0

 Attachments: HADOOP-11713-001.patch, HADOOP-11713-002.patch, 
 HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-05-11 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538422#comment-14538422
 ] 

Rakesh R commented on HADOOP-11713:
---

[~cnauroth] Latest patch addresses the review comments. Please have a look at 
it when you get a chance, thanks!

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.2.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Attachments: HADOOP-11713-001.patch, HADOOP-11713-002.patch, 
 HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-05-10 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11713:
--
Attachment: HADOOP-11713-002.patch

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.2.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Attachments: HADOOP-11713-001.patch, HADOOP-11713-002.patch, 
 HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-05-10 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537606#comment-14537606
 ] 

Rakesh R commented on HADOOP-11713:
---

Attached another patch fixing checkstyle warnings related to my patch. Also, 
I've fixed one minor {{whitespace}} and one minor {{checkstyle}} warnings which 
are not related to my patch. Since I touched the file I thought of fixing these 
considering that the change is very minor and not affecting any functionality.

# whitespace: ChRootedFs.java:381:  public void setVerifyChecksum(final boolean 
verifyChecksum) 
{code}
+  public void setVerifyChecksum(final boolean verifyChecksum)
{code}
# checkstyle: Line is longer than 80 characters (found 81).
{code}
-// Prefix validated at mount time and rest of path validated by mount 
target.
+// Prefix validated at mount time and rest of path validated by mount
+// target.
{code}

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.2.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Attachments: HADOOP-11713-001.patch, HADOOP-11713-002.patch, 
 HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-05-10 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11713:
--
Attachment: HADOOP-11713-001.patch

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.2.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Attachments: HADOOP-11713-001.patch, HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-05-10 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537328#comment-14537328
 ] 

Rakesh R commented on HADOOP-11713:
---

Thanks a lot [~cnauroth] for the review comments and the detailed explanation. 
Attached another patch addressing the comments.

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.2.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Attachments: HADOOP-11713-001.patch, HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11818) Minor improvements for erasurecode classes

2015-04-09 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11818:
--
Attachment: HADOOP-11818-002.patch

 Minor improvements for erasurecode classes
 --

 Key: HADOOP-11818
 URL: https://issues.apache.org/jira/browse/HADOOP-11818
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: io
Reporter: Rakesh R
Assignee: Rakesh R
 Attachments: HADOOP-11818-001.patch, HADOOP-11818-002.patch


 Following are few observations while going through the {{erasurecode}} 
 classes.
 \\
 - Use {{org.slf4j.Logger}} instead of {{org.apache.commons.logging.Log}}
 - {{RSErasureDecoder}}, {{RSErasureEncoder}}, {{RSUtil}} missing Apache 
 License header.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11818) Minor improvements for erasurecode classes

2015-04-09 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487161#comment-14487161
 ] 

Rakesh R commented on HADOOP-11818:
---

Attached new patch where it modifies link  {{ErasureDecoder}} to 
{{ErasureCoder}}. Please have a look at it when you get a chance. Thanks!

 Minor improvements for erasurecode classes
 --

 Key: HADOOP-11818
 URL: https://issues.apache.org/jira/browse/HADOOP-11818
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: io
Reporter: Rakesh R
Assignee: Rakesh R
 Attachments: HADOOP-11818-001.patch, HADOOP-11818-002.patch


 Following are few observations while going through the {{erasurecode}} 
 classes.
 \\
 - Use {{org.slf4j.Logger}} instead of {{org.apache.commons.logging.Log}}
 - {{RSErasureDecoder}}, {{RSErasureEncoder}}, {{RSUtil}} missing Apache 
 License header.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Work started] (HADOOP-11818) Minor improvements for erasurecode classes

2015-04-09 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on HADOOP-11818 started by Rakesh R.
-
 Minor improvements for erasurecode classes
 --

 Key: HADOOP-11818
 URL: https://issues.apache.org/jira/browse/HADOOP-11818
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: io
Reporter: Rakesh R
Assignee: Rakesh R
 Attachments: HADOOP-11818-001.patch


 Following are few observations while going through the {{erasurecode}} 
 classes.
 \\
 - Use {{org.slf4j.Logger}} instead of {{org.apache.commons.logging.Log}}
 - {{RSErasureDecoder}}, {{RSErasureEncoder}}, {{RSUtil}} missing Apache 
 License header.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11818) Minor improvements for erasurecode classes

2015-04-09 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11818:
--
Attachment: HADOOP-11818-001.patch

 Minor improvements for erasurecode classes
 --

 Key: HADOOP-11818
 URL: https://issues.apache.org/jira/browse/HADOOP-11818
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: io
Reporter: Rakesh R
Assignee: Rakesh R
 Attachments: HADOOP-11818-001.patch


 Following are few observations while going through the {{erasurecode}} 
 classes.
 \\
 - Use {{org.slf4j.Logger}} instead of {{org.apache.commons.logging.Log}}
 - {{RSErasureDecoder}}, {{RSErasureEncoder}}, {{RSUtil}} missing Apache 
 License header.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11818) Minor improvements for erasurecode classes

2015-04-09 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487140#comment-14487140
 ] 

Rakesh R commented on HADOOP-11818:
---

Thanks [~drankye] for the comment. I hope modify this to below one would be ok, 
right?
{code} It implements {@link ErasureCoder}.{code}

 Minor improvements for erasurecode classes
 --

 Key: HADOOP-11818
 URL: https://issues.apache.org/jira/browse/HADOOP-11818
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: io
Reporter: Rakesh R
Assignee: Rakesh R
 Attachments: HADOOP-11818-001.patch


 Following are few observations while going through the {{erasurecode}} 
 classes.
 \\
 - Use {{org.slf4j.Logger}} instead of {{org.apache.commons.logging.Log}}
 - {{RSErasureDecoder}}, {{RSErasureEncoder}}, {{RSUtil}} missing Apache 
 License header.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HADOOP-11818) Minor improvements for erasurecode classes

2015-04-09 Thread Rakesh R (JIRA)
Rakesh R created HADOOP-11818:
-

 Summary: Minor improvements for erasurecode classes
 Key: HADOOP-11818
 URL: https://issues.apache.org/jira/browse/HADOOP-11818
 Project: Hadoop Common
  Issue Type: Sub-task
Reporter: Rakesh R
Assignee: Rakesh R


Following are few observations while going through the {{erasurecode}} classes.
\\

- Use {{org.slf4j.Logger}} instead of {{org.apache.commons.logging.Log}}
- {{RSErasureDecoder}}, {{RSErasureEncoder}}, {{RSUtil}} missing Apache License 
header.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11818) Minor improvements for erasurecode classes

2015-04-09 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487069#comment-14487069
 ] 

Rakesh R commented on HADOOP-11818:
---

Attached patch which covers these cases. Please review. Thanks!

 Minor improvements for erasurecode classes
 --

 Key: HADOOP-11818
 URL: https://issues.apache.org/jira/browse/HADOOP-11818
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: io
Reporter: Rakesh R
Assignee: Rakesh R
 Attachments: HADOOP-11818-001.patch


 Following are few observations while going through the {{erasurecode}} 
 classes.
 \\
 - Use {{org.slf4j.Logger}} instead of {{org.apache.commons.logging.Log}}
 - {{RSErasureDecoder}}, {{RSErasureEncoder}}, {{RSUtil}} missing Apache 
 License header.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-03-15 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11713:
--
Status: Patch Available  (was: Open)

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.2.0, 3.0.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Attachments: HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11713) ViewFileSystem should support snapshot methods.

2015-03-15 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362476#comment-14362476
 ] 

Rakesh R commented on HADOOP-11713:
---

Failure reason is, since this is depending on the AbstractFileSystem.java 
{{snapshot}} apis in HDFS-5640 patch, we should re-visit this jira after 
pushing HDFS-5640 implementation first.

 ViewFileSystem should support snapshot methods.
 ---

 Key: HADOOP-11713
 URL: https://issues.apache.org/jira/browse/HADOOP-11713
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 3.0.0, 2.2.0
Reporter: Chris Nauroth
Assignee: Rakesh R
 Attachments: HDFS-5641-001.patch


 Currently, {{ViewFileSystem}} does not dispatch snapshot methods through the 
 mount table.  All snapshot methods throw {{UnsupportedOperationException}}, 
 even though the underlying mount points could be HDFS instances that support 
 snapshots.  We need to update {{ViewFileSystem}} to implement the snapshot 
 methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11589) NetUtils.createSocketAddr should trim the input URI

2015-02-14 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11589:
--
Attachment: HADOOP-11589-2.patch

 NetUtils.createSocketAddr should trim the input URI
 ---

 Key: HADOOP-11589
 URL: https://issues.apache.org/jira/browse/HADOOP-11589
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.6.0
Reporter: Akira AJISAKA
Assignee: Rakesh R
Priority: Minor
  Labels: newbie
 Attachments: HADOOP-11589-1.patch, HADOOP-11589-2.patch


 NetUtils.createSocketAddr does not trim the input URI, should be trimmed.
 HDFS-7684 and HADOOP-9869 are trying to trim some URIs to be passed to the 
 method, however, not all of the inputs have been trimmed already.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11589) NetUtils.createSocketAddr should trim the input URI

2015-02-14 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321284#comment-14321284
 ] 

Rakesh R commented on HADOOP-11589:
---

Thanks [~brahmareddy], [~umamaheswararao], [~ajisakaa] for the reviews.

Attached new patch addressing [~ajisakaa]'s comments.

 NetUtils.createSocketAddr should trim the input URI
 ---

 Key: HADOOP-11589
 URL: https://issues.apache.org/jira/browse/HADOOP-11589
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.6.0
Reporter: Akira AJISAKA
Assignee: Rakesh R
Priority: Minor
  Labels: newbie
 Attachments: HADOOP-11589-1.patch, HADOOP-11589-2.patch


 NetUtils.createSocketAddr does not trim the input URI, should be trimmed.
 HDFS-7684 and HADOOP-9869 are trying to trim some URIs to be passed to the 
 method, however, not all of the inputs have been trimmed already.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HADOOP-11589) NetUtils.createSocketAddr should trim the input URI

2015-02-12 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R reassigned HADOOP-11589:
-

Assignee: Rakesh R

 NetUtils.createSocketAddr should trim the input URI
 ---

 Key: HADOOP-11589
 URL: https://issues.apache.org/jira/browse/HADOOP-11589
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.6.0
Reporter: Akira AJISAKA
Assignee: Rakesh R
Priority: Minor
  Labels: newbie

 NetUtils.createSocketAddr does not trim the input URI, should be trimmed.
 HDFS-7684 and HADOOP-9869 are trying to trim some URIs to be passed to the 
 method, however, not all of the inputs have been trimmed already.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11589) NetUtils.createSocketAddr should trim the input URI

2015-02-12 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11589:
--
Status: Patch Available  (was: Open)

 NetUtils.createSocketAddr should trim the input URI
 ---

 Key: HADOOP-11589
 URL: https://issues.apache.org/jira/browse/HADOOP-11589
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.6.0
Reporter: Akira AJISAKA
Assignee: Rakesh R
Priority: Minor
  Labels: newbie
 Attachments: HADOOP-11589-1.patch


 NetUtils.createSocketAddr does not trim the input URI, should be trimmed.
 HDFS-7684 and HADOOP-9869 are trying to trim some URIs to be passed to the 
 method, however, not all of the inputs have been trimmed already.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11589) NetUtils.createSocketAddr should trim the input URI

2015-02-12 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-11589:
--
Attachment: HADOOP-11589-1.patch

 NetUtils.createSocketAddr should trim the input URI
 ---

 Key: HADOOP-11589
 URL: https://issues.apache.org/jira/browse/HADOOP-11589
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.6.0
Reporter: Akira AJISAKA
Assignee: Rakesh R
Priority: Minor
  Labels: newbie
 Attachments: HADOOP-11589-1.patch


 NetUtils.createSocketAddr does not trim the input URI, should be trimmed.
 HDFS-7684 and HADOOP-9869 are trying to trim some URIs to be passed to the 
 method, however, not all of the inputs have been trimmed already.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-11589) NetUtils.createSocketAddr should trim the input URI

2015-02-12 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-11589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319531#comment-14319531
 ] 

Rakesh R commented on HADOOP-11589:
---

Attached patch which does trimming. Please review the patch. Thanks!

 NetUtils.createSocketAddr should trim the input URI
 ---

 Key: HADOOP-11589
 URL: https://issues.apache.org/jira/browse/HADOOP-11589
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.6.0
Reporter: Akira AJISAKA
Assignee: Rakesh R
Priority: Minor
  Labels: newbie
 Attachments: HADOOP-11589-1.patch


 NetUtils.createSocketAddr does not trim the input URI, should be trimmed.
 HDFS-7684 and HADOOP-9869 are trying to trim some URIs to be passed to the 
 method, however, not all of the inputs have been trimmed already.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-6359) NetworkTopology.chooseRandom(..) throws an IllegalArgumentException

2015-02-11 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316509#comment-14316509
 ] 

Rakesh R commented on HADOOP-6359:
--

Hi [~szetszwo],

I could see {{numOfDatanodes == 0}} scenario has been taken care. Anything else 
needs to be taken care. Otw can we close this?

NetworkTopology.java
{code}
if (numOfDatanodes == 0) {
  throw new InvalidTopologyException(
  Failed to find datanode (scope=\ + String.valueOf(scope) +
  \ excludedScope=\ + String.valueOf(excludedScope) + \).);
}
{code}

 NetworkTopology.chooseRandom(..) throws an IllegalArgumentException
 ---

 Key: HADOOP-6359
 URL: https://issues.apache.org/jira/browse/HADOOP-6359
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Tsz Wo Nicholas Sze
  Labels: newbie

 When numOfDatanodes == 0, NetworkTopology.chooseRandom(..) throws an 
 IllegalArgumentException.
 {noformat}
 2009-09-30 00:12:50,768 ERROR org.mortbay.log: /nn_browsedfscontent.jsp
 java.lang.IllegalArgumentException: n must be positive
 at java.util.Random.nextInt(Random.java:250)
 at 
 org.apache.hadoop.net.NetworkTopology.chooseRandom(NetworkTopology.java:536)
 at 
 org.apache.hadoop.net.NetworkTopology.chooseRandom(NetworkTopology.java:504)
 ...
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HADOOP-11564) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-08 Thread Rakesh R (JIRA)
Rakesh R created HADOOP-11564:
-

 Summary: Fix Multithreaded correctness Warnings in BackupImage.java
 Key: HADOOP-11564
 URL: https://issues.apache.org/jira/browse/HADOOP-11564
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Rakesh R
Assignee: Rakesh R


Inconsistent synchronization of 
org.apache.hadoop.hdfs.server.namenode.BackupImage.namesystem; locked 60% of 
time
{code}
Bug type IS2_INCONSISTENT_SYNC (click for details) 
In class org.apache.hadoop.hdfs.server.namenode.BackupImage
Field org.apache.hadoop.hdfs.server.namenode.BackupImage.namesystem
Synchronized 60% of the time
Unsynchronized access at BackupImage.java:[line 97]
Unsynchronized access at BackupImage.java:[line 261]
Synchronized access at BackupImage.java:[line 197]
Synchronized access at BackupImage.java:[line 212]
Synchronized access at BackupImage.java:[line 295]
{code}

https://builds.apache.org/job/PreCommit-HDFS-Build/9493//artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html#Details



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-9645) KerberosAuthenticator NPEs on connect error

2015-02-05 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307217#comment-14307217
 ] 

Rakesh R commented on HADOOP-9645:
--

It looks like this is duplicate of HDFS-3980. Can we mark as duplicate ?

 KerberosAuthenticator NPEs on connect error
 ---

 Key: HADOOP-9645
 URL: https://issues.apache.org/jira/browse/HADOOP-9645
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 2.0.5-alpha
Reporter: Daryn Sharp
Priority: Critical

 A NPE occurs if there's a kerberos error during initial connect.  In this 
 case, the NN was using a HTTP service principal with a stale kvno.  It causes 
 webhdfs to fail in a non-user friendly manner by masking the real error from 
 the user.
 {noformat}
 java.lang.RuntimeException: java.lang.NullPointerException
 at
 sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241)
 at
 sun.net.www.protocol.http.HttpURLConnection.getHeaderField(HttpURLConnection.java:2713)
 at
 java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:477)
 at
 org.apache.hadoop.security.authentication.client.KerberosAuthenticator.isNegotiate(KerberosAuthenticator.java:164)
 at
 org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:140)
 at
 org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:217)
 at
 org.apache.hadoop.hdfs.web.WebHdfsFileSystem.openHttpUrlConnection(WebHdfsFileSystem.java:364)
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-10101) Update guava dependency to the latest version

2015-02-05 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306854#comment-14306854
 ] 

Rakesh R commented on HADOOP-10101:
---

bq. I also checked findbugs are not related.
I've attached patch to fix HDFS-7709, kindly review it. Thanks!

 Update guava dependency to the latest version
 -

 Key: HADOOP-10101
 URL: https://issues.apache.org/jira/browse/HADOOP-10101
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.2.0, 2.6.0
Reporter: Rakesh R
Assignee: Vinayakumar B
 Attachments: HADOOP-10101-002.patch, HADOOP-10101-004.patch, 
 HADOOP-10101-005.patch, HADOOP-10101-006.patch, HADOOP-10101-007.patch, 
 HADOOP-10101-008.patch, HADOOP-10101-009.patch, HADOOP-10101.patch, 
 HADOOP-10101.patch


 The existing guava version is 11.0.2 which is quite old. This 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-10101) Update guava dependency to the latest version

2015-01-31 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299734#comment-14299734
 ] 

Rakesh R commented on HADOOP-10101:
---

bq.findbugs warnings all seem unrelated

Raised HDFS-7709 to address the findbug warnings

 Update guava dependency to the latest version
 -

 Key: HADOOP-10101
 URL: https://issues.apache.org/jira/browse/HADOOP-10101
 Project: Hadoop Common
  Issue Type: Improvement
Affects Versions: 2.2.0, 2.6.0
Reporter: Rakesh R
Assignee: Vinayakumar B
 Attachments: HADOOP-10101-002.patch, HADOOP-10101-004.patch, 
 HADOOP-10101-005.patch, HADOOP-10101-006.patch, HADOOP-10101-007.patch, 
 HADOOP-10101-008.patch, HADOOP-10101.patch, HADOOP-10101.patch


 The existing guava version is 11.0.2 which is quite old. This 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HADOOP-10641) Introduce Coordination Engine

2014-07-04 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052297#comment-14052297
 ] 

Rakesh R commented on HADOOP-10641:
---

Hi [~posix4e],
bq. zab or zk?
ZAB is an fresh project idea and this is in the initial phase. I'm not having 
much details now. Please follow ZOOKEEPER-1931 to know more on this.
Motivation - there could be many use cases where you need a quorum based 
replication. So fresh thought came up to define consensus algorithm (ZAB) more 
cleanly so that the users can define their own data models and use ZAB to 
replicate their own data. 

Actually after seeing 'Coordination Engine' feature in HDFS, I thought of 
introducing this new idea.

 Introduce Coordination Engine
 -

 Key: HADOOP-10641
 URL: https://issues.apache.org/jira/browse/HADOOP-10641
 Project: Hadoop Common
  Issue Type: New Feature
Affects Versions: 3.0.0
Reporter: Konstantin Shvachko
Assignee: Plamen Jeliazkov
 Attachments: HADOOP-10641.patch, HADOOP-10641.patch, 
 HADOOP-10641.patch, hadoop-coordination.patch


 Coordination Engine (CE) is a system, which allows to agree on a sequence of 
 events in a distributed system. In order to be reliable CE should be 
 distributed by itself.
 Coordination Engine can be based on different algorithms (paxos, raft, 2PC, 
 zab) and have different implementations, depending on use cases, reliability, 
 availability, and performance requirements.
 CE should have a common API, so that it could serve as a pluggable component 
 in different projects. The immediate beneficiaries are HDFS (HDFS-6469) and 
 HBase (HBASE-10909).
 First implementation is proposed to be based on ZooKeeper.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HADOOP-10641) Introduce Coordination Engine

2014-06-27 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14045813#comment-14045813
 ] 

Rakesh R commented on HADOOP-10641:
---

Thanks [~shv] for the interest on ZAB internship and if everything goes well 
will try use ZAB as a base for CoordinationEngine. I'll keep an eye on this 
JIRA to watch the progress.

 Introduce Coordination Engine
 -

 Key: HADOOP-10641
 URL: https://issues.apache.org/jira/browse/HADOOP-10641
 Project: Hadoop Common
  Issue Type: New Feature
Affects Versions: 3.0.0
Reporter: Konstantin Shvachko
Assignee: Plamen Jeliazkov
 Attachments: HADOOP-10641.patch, HADOOP-10641.patch, 
 HADOOP-10641.patch


 Coordination Engine (CE) is a system, which allows to agree on a sequence of 
 events in a distributed system. In order to be reliable CE should be 
 distributed by itself.
 Coordination Engine can be based on different algorithms (paxos, raft, 2PC, 
 zab) and have different implementations, depending on use cases, reliability, 
 availability, and performance requirements.
 CE should have a common API, so that it could serve as a pluggable component 
 in different projects. The immediate beneficiaries are HDFS (HDFS-6469) and 
 HBase (HBASE-10909).
 First implementation is proposed to be based on ZooKeeper.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HADOOP-10641) Introduce Coordination Engine

2014-06-11 Thread Rakesh R (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14027601#comment-14027601
 ] 

Rakesh R commented on HADOOP-10641:
---

bq.The intent of this jira is not to solve the general problem of distributed 
consensus. That is, I do not propose to build an implementation of paxos or 
other coordination algorithms here. This is only to introduce a common 
interface, so that real implementations such as ZooKeeper could be plugged into 
hadoop projects.

This sounds interesting. Thanks for the effort!. If I understood the discussion 
correctly here, the idea is to build a quorum based replication. For example, 
the events(I think this represents data) are submitted as proposals to a quorum 
of nodes. In ZooKeeper terms, Leader proposes values to the Followers. Now 
Leader wait for acknowledgements from a quorum of Followers before considering 
a proposal committed. Also, Leader queues COMMIT(zxid) events to all Followers 
so that all other nodes learn the events. This ensures that the events will be 
reached to all nodes in the system. Adding one more point, in general ZK 
provides strong ordering guarantees.

Sometime back ZooKeeper folks initiated discussions to decouple ZAB from 
ZooKeeper, so that users can make use of this and can define their own models 
and reliably replicate the data. There is a related JIRA ZOOKEEPER-1931 talks 
similar feature, now this is in initial dev stage. Please have a look at this. 
I hope this would help to define a common interface, also an opportunity for us 
to know more about the use cases.

Regards,
Rakesh

 Introduce Coordination Engine
 -

 Key: HADOOP-10641
 URL: https://issues.apache.org/jira/browse/HADOOP-10641
 Project: Hadoop Common
  Issue Type: New Feature
Affects Versions: 3.0.0
Reporter: Konstantin Shvachko
Assignee: Plamen Jeliazkov
 Attachments: HADOOP-10641.patch, HADOOP-10641.patch, 
 HADOOP-10641.patch


 Coordination Engine (CE) is a system, which allows to agree on a sequence of 
 events in a distributed system. In order to be reliable CE should be 
 distributed by itself.
 Coordination Engine can be based on different algorithms (paxos, raft, 2PC, 
 zab) and have different implementations, depending on use cases, reliability, 
 availability, and performance requirements.
 CE should have a common API, so that it could serve as a pluggable component 
 in different projects. The immediate beneficiaries are HDFS (HDFS-6469) and 
 HBase (HBASE-10909).
 First implementation is proposed to be based on ZooKeeper.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Created] (HADOOP-10101) Update guava dependency to the latest version 15.0

2013-11-14 Thread Rakesh R (JIRA)
Rakesh R created HADOOP-10101:
-

 Summary: Update guava dependency to the latest version 15.0
 Key: HADOOP-10101
 URL: https://issues.apache.org/jira/browse/HADOOP-10101
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Rakesh R


The existing guava version is 11.0.2 which is quite old.



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Updated] (HADOOP-10101) Update guava dependency to the latest version 15.0

2013-11-14 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-10101:
--

Description: The existing guava version is 11.0.2 which is quite old. This  
 (was: The existing guava version is 11.0.2 which is quite old.)

 Update guava dependency to the latest version 15.0
 --

 Key: HADOOP-10101
 URL: https://issues.apache.org/jira/browse/HADOOP-10101
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Rakesh R
 Attachments: HADOOP-10101.patch


 The existing guava version is 11.0.2 which is quite old. This 



--
This message was sent by Atlassian JIRA
(v6.1#6144)


[jira] [Updated] (HADOOP-10101) Update guava dependency to the latest version 15.0

2013-11-14 Thread Rakesh R (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rakesh R updated HADOOP-10101:
--

Attachment: HADOOP-10101.patch

 Update guava dependency to the latest version 15.0
 --

 Key: HADOOP-10101
 URL: https://issues.apache.org/jira/browse/HADOOP-10101
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Rakesh R
 Attachments: HADOOP-10101.patch


 The existing guava version is 11.0.2 which is quite old.



--
This message was sent by Atlassian JIRA
(v6.1#6144)