[jira] [Updated] (HADOOP-16728) SFTPFileSystem connection pooling is not handling the pool properly

2019-11-27 Thread Benoit Perroud (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Perroud updated HADOOP-16728: Description: This issue is trying to address few issues in the SFTP filesystem, and espe

[jira] [Commented] (HADOOP-16728) SFTPFileSystem connection pooling is not handling the pool properly

2019-11-27 Thread Benoit Perroud (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983256#comment-16983256 ] Benoit Perroud commented on HADOOP-16728: - While digging into this issue, I fou

[jira] [Updated] (HADOOP-16728) SFTPFileSystem connection pool not reusing connections properly

2019-11-27 Thread Benoit Perroud (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Perroud updated HADOOP-16728: Summary: SFTPFileSystem connection pool not reusing connections properly (was: SFTPFileS

[jira] [Updated] (HADOOP-16728) SFTPFileSystem connection pool not reusing connections properly

2019-11-27 Thread Benoit Perroud (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Perroud updated HADOOP-16728: Labels: SFTP (was: ) > SFTPFileSystem connection pool not reusing connections properly >

[jira] [Updated] (HADOOP-16728) SFTPFileSystem connection pool not reusing connections properly

2019-11-27 Thread Benoit Perroud (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Perroud updated HADOOP-16728: Labels: SFTP fs perfomance (was: SFTP) > SFTPFileSystem connection pool not reusing conn

[GitHub] [hadoop] snvijaya opened a new pull request #1731: Initial draft for TAS support

2019-11-27 Thread GitBox
snvijaya opened a new pull request #1731: Initial draft for TAS support URL: https://github.com/apache/hadoop/pull/1731 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the correspondi

[GitHub] [hadoop] tamaashu commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
tamaashu commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1730#issuecomment-559042604 There is no need for additional or modified tests since, I didn't change any code. The only change is that I define third parti

[GitHub] [hadoop] hadoop-yetus commented on issue #1731: Initial draft for TAS support

2019-11-27 Thread GitBox
hadoop-yetus commented on issue #1731: Initial draft for TAS support URL: https://github.com/apache/hadoop/pull/1731#issuecomment-559046906 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :o

[GitHub] [hadoop] adamantal commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
adamantal commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1730#issuecomment-559065447 Thank you for the patch @tamaashu! +1 (non-binding) It might make sense to put the log4j version right after the slf4j on

[jira] [Commented] (HADOOP-16729) Extract version numbers to head of pom.xml

2019-11-27 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983473#comment-16983473 ] Adam Antal commented on HADOOP-16729: - Maybe this could be a subtask of HADOOP-9991

[GitHub] [hadoop] tamaashu commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
tamaashu commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1730#issuecomment-559081935 @adamantal done > It might make sense to put the log4j version right after the slf4j one a bit above, but it's perfectly oka

[GitHub] [hadoop] tamaashu opened a new pull request #1732: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
tamaashu opened a new pull request #1732: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1732 For branch-3.2 To be able to easily replace third-party dependency version numbers it would be useful to collect their version numbers

[GitHub] [hadoop] tamaashu commented on issue #1732: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
tamaashu commented on issue #1732: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1732#issuecomment-559087895 PR for trunk: https://github.com/apache/hadoop/pull/1730 This

[GitHub] [hadoop] tamaashu commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
tamaashu commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1730#issuecomment-559087752 PR for branch 3.2: https://github.com/apache/hadoop/pull/1732

[jira] [Created] (HADOOP-16731) 编译hadoop3.2.1源码出错

2019-11-27 Thread zhaobaoquan (Jira)
zhaobaoquan created HADOOP-16731: Summary: 编译hadoop3.2.1源码出错 Key: HADOOP-16731 URL: https://issues.apache.org/jira/browse/HADOOP-16731 Project: Hadoop Common Issue Type: Bug Compone

[GitHub] [hadoop] hadoop-yetus commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
hadoop-yetus commented on issue #1730: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1730#issuecomment-559117632 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[GitHub] [hadoop] hadoop-yetus commented on issue #1732: HADOOP-16729. Extract version numbers to head of pom.xml

2019-11-27 Thread GitBox
hadoop-yetus commented on issue #1732: HADOOP-16729. Extract version numbers to head of pom.xml URL: https://github.com/apache/hadoop/pull/1732#issuecomment-559123362 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1712: HADOOP-16699: Adding verbose TRACE logging

2019-11-27 Thread GitBox
hadoop-yetus removed a comment on issue #1712: HADOOP-16699: Adding verbose TRACE logging URL: https://github.com/apache/hadoop/pull/1712#issuecomment-553285423 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1712: HADOOP-16699: Adding verbose TRACE logging

2019-11-27 Thread GitBox
steveloughran commented on a change in pull request #1712: HADOOP-16699: Adding verbose TRACE logging URL: https://github.com/apache/hadoop/pull/1712#discussion_r351358065 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.j

[GitHub] [hadoop] steveloughran commented on issue #1712: HADOOP-16699: Adding verbose TRACE logging

2019-11-27 Thread GitBox
steveloughran commented on issue #1712: HADOOP-16699: Adding verbose TRACE logging URL: https://github.com/apache/hadoop/pull/1712#issuecomment-559143920 If you are actually trying to debug the behaviour of plug-in components I would prefer that you embrace `org.apache.hadoop.util.Duration

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1711: HADOOP-16455. ABFS: Implement FileSystem.access() method.

2019-11-27 Thread GitBox
hadoop-yetus removed a comment on issue #1711: HADOOP-16455. ABFS: Implement FileSystem.access() method. URL: https://github.com/apache/hadoop/pull/1711#issuecomment-555448798 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] steveloughran commented on issue #1711: HADOOP-16455. ABFS: Implement FileSystem.access() method.

2019-11-27 Thread GitBox
steveloughran commented on issue #1711: HADOOP-16455. ABFS: Implement FileSystem.access() method. URL: https://github.com/apache/hadoop/pull/1711#issuecomment-559146956 +1, merged via github. If you want on branch-3.2, cherry pick, retest and provide a new PR -

[GitHub] [hadoop] steveloughran merged pull request #1711: HADOOP-16455. ABFS: Implement FileSystem.access() method.

2019-11-27 Thread GitBox
steveloughran merged pull request #1711: HADOOP-16455. ABFS: Implement FileSystem.access() method. URL: https://github.com/apache/hadoop/pull/1711 This is an automated message from the Apache Git Service. To respond to the m

[jira] [Resolved] (HADOOP-16455) ABFS: Implement FileSystem.access() method

2019-11-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16455. - Fix Version/s: 3.3.0 Resolution: Fixed > ABFS: Implement FileSystem.access() met

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1702: HDFS-14788 Use dynamic regex filter to ignore copy of source files in…

2019-11-27 Thread GitBox
hadoop-yetus removed a comment on issue #1702: HDFS-14788 Use dynamic regex filter to ignore copy of source files in… URL: https://github.com/apache/hadoop/pull/1702#issuecomment-554912253 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |

[GitHub] [hadoop] steveloughran commented on a change in pull request #1702: HDFS-14788 Use dynamic regex filter to ignore copy of source files in…

2019-11-27 Thread GitBox
steveloughran commented on a change in pull request #1702: HDFS-14788 Use dynamic regex filter to ignore copy of source files in… URL: https://github.com/apache/hadoop/pull/1702#discussion_r351372167 ## File path: hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm ##

[GitHub] [hadoop] steveloughran commented on issue #1702: HDFS-14788 Use dynamic regex filter to ignore copy of source files in…

2019-11-27 Thread GitBox
steveloughran commented on issue #1702: HDFS-14788 Use dynamic regex filter to ignore copy of source files in… URL: https://github.com/apache/hadoop/pull/1702#issuecomment-559150164 LGTM other than doc tuning This is an autom

[jira] [Commented] (HADOOP-16455) ABFS: Implement FileSystem.access() method

2019-11-27 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983670#comment-16983670 ] Hudson commented on HADOOP-16455: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] steveloughran commented on issue #1707: HADOOP-16697. Tune/audit auth mode

2019-11-27 Thread GitBox
steveloughran commented on issue #1707: HADOOP-16697. Tune/audit auth mode URL: https://github.com/apache/hadoop/pull/1707#issuecomment-559176271 testing s3a ireland with & without auth. doing a local db test run too for completeness

[GitHub] [hadoop] hadoop-yetus commented on issue #1707: HADOOP-16697. Tune/audit auth mode

2019-11-27 Thread GitBox
hadoop-yetus commented on issue #1707: HADOOP-16697. Tune/audit auth mode URL: https://github.com/apache/hadoop/pull/1707#issuecomment-559224962 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| |

[jira] [Commented] (HADOOP-16455) ABFS: Implement FileSystem.access() method

2019-11-27 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983886#comment-16983886 ] Virajith Jalaparti commented on HADOOP-16455: - Thanks for completing this [

[GitHub] [hadoop] DadanielZ closed pull request #1697: Hadoop 16660: ABFS: Make RetryCount in ExponentialRetryPolicy Configurable

2019-11-27 Thread GitBox
DadanielZ closed pull request #1697: Hadoop 16660: ABFS: Make RetryCount in ExponentialRetryPolicy Configurable URL: https://github.com/apache/hadoop/pull/1697 This is an automated message from the Apache Git Service. To res

[GitHub] [hadoop] DadanielZ commented on issue #1697: Hadoop 16660: ABFS: Make RetryCount in ExponentialRetryPolicy Configurable

2019-11-27 Thread GitBox
DadanielZ commented on issue #1697: Hadoop 16660: ABFS: Make RetryCount in ExponentialRetryPolicy Configurable URL: https://github.com/apache/hadoop/pull/1697#issuecomment-559281473 Committed, thanks This is an automated mess

[jira] [Commented] (HADOOP-16660) ABFS: Make RetryCount in ExponentialRetryPolicy Configurable

2019-11-27 Thread Da Zhou (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984000#comment-16984000 ] Da Zhou commented on HADOOP-16660: -- Commited. > ABFS: Make RetryCount in ExponentialR

[jira] [Updated] (HADOOP-16660) ABFS: Make RetryCount in ExponentialRetryPolicy Configurable

2019-11-27 Thread Da Zhou (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Da Zhou updated HADOOP-16660: - Resolution: Fixed Status: Resolved (was: Patch Available) > ABFS: Make RetryCount in Exponenti

[jira] [Commented] (HADOOP-16660) ABFS: Make RetryCount in ExponentialRetryPolicy Configurable

2019-11-27 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984015#comment-16984015 ] Hudson commented on HADOOP-16660: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-11-27 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r351541745 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] [hadoop] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-11-27 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r351542962 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] [hadoop] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-11-27 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r351541785 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] [hadoop] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-11-27 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r351542440 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azure/NativeAzureFileSystemBaseTest

[GitHub] [hadoop] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-11-27 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r351542583 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemAt

[jira] [Updated] (HADOOP-14508) TestDFSIO throws NPE when set -sequential argument.

2019-11-27 Thread Wenxin He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenxin He updated HADOOP-14508: --- Status: Open (was: Patch Available) -seq seems trivial, so cancel patch. > TestDFSIO throws NPE w