[jira] [Commented] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092264#comment-17092264
]
YangY commented on HADOOP-17007:
[~ayushtkn] Thanks. :)
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Affects Versions: 3.3.0, 3.4.0
>Reporter: Wei-Chiu Chuang
>Assignee: YangY
>Priority: Major
> Labels: release-blocker
> Attachments: HADOOP-17007.001.patch
>
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092223#comment-17092223 ] YangY commented on HADOOP-16959: [~aajisaka] The patch has been submitted in HADOOP-17007. > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Fix For: 3.3.0 > > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch, > HADOOP-16959-branch-3.3.004.patch, HADOOP-16959-branch-3.3.005.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092220#comment-17092220
]
YangY commented on HADOOP-17007:
[~weichiu] [~aajisaka] [~liuml07] [~ayushtkn]
I think this error may be caused by the copy-dependency operation. I have
removed it and passed all tests.
The patch is available. Could you help me to review it?
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Affects Versions: 3.3.0, 3.4.0
>Reporter: Wei-Chiu Chuang
>Assignee: YangY
>Priority: Major
> Labels: release-blocker
> Attachments: HADOOP-17007.001.patch
>
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YangY updated HADOOP-17007:
---
Attachment: HADOOP-17007.001.patch
Affects Version/s: 3.4.0
3.3.0
Status: Patch Available (was: Open)
Remove the copy-dependency operation in the package phase.
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Affects Versions: 3.3.0, 3.4.0
>Reporter: Wei-Chiu Chuang
>Assignee: YangY
>Priority: Major
> Labels: release-blocker
> Attachments: HADOOP-17007.001.patch
>
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092212#comment-17092212
]
YangY commented on HADOOP-17007:
[~ayushtkn] I guess it may be a problem caused by copy-dependency, so I want
to remove this operation first.
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Reporter: Wei-Chiu Chuang
>Assignee: YangY
>Priority: Major
> Labels: release-blocker
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YangY reassigned HADOOP-17007:
--
Assignee: YangY
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Reporter: Wei-Chiu Chuang
>Assignee: YangY
>Priority: Major
> Labels: release-blocker
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091099#comment-17091099
]
YangY commented on HADOOP-17007:
[~weichiu] [~liuml07] [~aajisaka] I will check the issue and fix it as soon as
possible.
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Reporter: Wei-Chiu Chuang
>Priority: Major
> Labels: release-blocker
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Issue Comment Deleted] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
YangY updated HADOOP-17007:
---
Comment: was deleted
(was: Is it a compilation error on the 3.3.0 branch?)
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Reporter: Wei-Chiu Chuang
>Priority: Major
> Labels: release-blocker
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-17007) hadoop-cos fails to build
[
https://issues.apache.org/jira/browse/HADOOP-17007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091089#comment-17091089
]
YangY commented on HADOOP-17007:
Is it a compilation error on the 3.3.0 branch?
> hadoop-cos fails to build
> -
>
> Key: HADOOP-17007
> URL: https://issues.apache.org/jira/browse/HADOOP-17007
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/cos
>Reporter: Wei-Chiu Chuang
>Priority: Major
> Labels: release-blocker
>
> Found the following compilation error in a PR precommit. The failure doesn't
> seem related to the PR itself. Cant' reproduce locally though.
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1972/1/artifact/out/patch-compile-root.txt
> {noformat}
> [INFO] Apache Hadoop Tencent COS Support .. FAILURE [ 0.074
> s]
> [INFO] Apache Hadoop Cloud Storage SKIPPED
> [INFO] Apache Hadoop Cloud Storage Project SKIPPED
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 17:31 min
> [INFO] Finished at: 2020-04-22T07:37:51+00:00
> [INFO] Final Memory: 192M/1714M
> [INFO]
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies
> (package) on project hadoop-cos: Artifact has not been packaged yet. When
> used on reactor artifact, copy should be executed after packaging: see
> MDEP-187. -> [Help 1]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-17006) Fix the CosCrendentials Provider in core-site.xml for unit tests.
YangY created HADOOP-17006: -- Summary: Fix the CosCrendentials Provider in core-site.xml for unit tests. Key: HADOOP-17006 URL: https://issues.apache.org/jira/browse/HADOOP-17006 Project: Hadoop Common Issue Type: Sub-task Components: fs/cos Reporter: YangY Assignee: YangY Fix the CosCredentials Provider classpath in core-site.xml for unit tests. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[
https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086669#comment-17086669
]
YangY commented on HADOOP-16959:
Copy the dependencies of the Hadoop-cos into the ${project.build}/lib
directory, and output the dependency list to the
${project.build}/hadoop-cloud-storage-deps directory.
> Resolve hadoop-cos dependency conflict
> --
>
> Key: HADOOP-16959
> URL: https://issues.apache.org/jira/browse/HADOOP-16959
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build, fs/cos
>Reporter: YangY
>Assignee: YangY
>Priority: Major
> Attachments: HADOOP-16959-branch-3.3.001.patch,
> HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch,
> HADOOP-16959-branch-3.3.004.patch, HADOOP-16959-branch-3.3.005.patch
>
>
> There are some dependency conflicts between the Hadoop-common and Hadoop-cos.
> For example, joda time lib, HTTP client lib and etc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.005.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch, > HADOOP-16959-branch-3.3.004.patch, HADOOP-16959-branch-3.3.005.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.004.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch, > HADOOP-16959-branch-3.3.004.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.004.patch) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.004.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch, > HADOOP-16959-branch-3.3.004.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085664#comment-17085664 ] YangY commented on HADOOP-16959: The hint of the findbugs may be wrong. This error does not exist in the patch. > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.003.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch, HADOOP-16959-branch-3.3.003.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.002.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch, > HADOOP-16959-branch-3.3.002.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.001.patch) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Attachment: HADOOP-16968-branch-3.3.001.patch > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16968-branch-3.3.001.patch > > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Attachment: (was: HADOOP-16968-branch-3.3.001.patch) > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16968-branch-3.3.001.patch > > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.001.patch) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Attachment: HADOOP-16968-branch-3.3.001.patch Status: Patch Available (was: Open) This patch aims to optimize the upload buffer, and fix the buffer release failure caused by some upload exceptions. > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16968-branch-3.3.001.patch > > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Attachment: (was: HADOOP-16968-branch-3.3.001.patch) > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Status: Patch Available (was: In Progress) > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16968-branch-3.3.001.patch > > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Status: Open (was: Patch Available) > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16968-branch-3.3.001.patch > > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.001.patch) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16981) Support the CRC64 checksum
[ https://issues.apache.org/jira/browse/HADOOP-16981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16981: --- Target Version/s: (was: 3.3.1) > Support the CRC64 checksum > -- > > Key: HADOOP-16981 > URL: https://issues.apache.org/jira/browse/HADOOP-16981 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > Support the CRC64 checksum in Hadoop-cos, and implement the 'getFileChecksum' > method. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16980) Supporting the server encryption based on SSE-COS and SSE-C
[ https://issues.apache.org/jira/browse/HADOOP-16980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16980: --- Target Version/s: (was: 3.3.1) > Supporting the server encryption based on SSE-COS and SSE-C > --- > > Key: HADOOP-16980 > URL: https://issues.apache.org/jira/browse/HADOOP-16980 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Minor > > Support the server encryption based on SSE-COS and SSE-C in Hadoop-cos. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16969) Optimizing the retry mechanism when a server error occurs
[ https://issues.apache.org/jira/browse/HADOOP-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16969: --- Summary: Optimizing the retry mechanism when a server error occurs (was: Optimizing the retry mechanism when an server error occurs) > Optimizing the retry mechanism when a server error occurs > - > > Key: HADOOP-16969 > URL: https://issues.apache.org/jira/browse/HADOOP-16969 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: YangY >Assignee: YangY >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work started] (HADOOP-16969) Optimizing the retry mechanism when an server error occurs
[ https://issues.apache.org/jira/browse/HADOOP-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16969 started by YangY. -- > Optimizing the retry mechanism when an server error occurs > -- > > Key: HADOOP-16969 > URL: https://issues.apache.org/jira/browse/HADOOP-16969 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: YangY >Assignee: YangY >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16969) Optimizing the retry mechanism when an server error occurs
[ https://issues.apache.org/jira/browse/HADOOP-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16969: --- Summary: Optimizing the retry mechanism when an server error occurs (was: Optimizing 他和in Hadoop-cos) > Optimizing the retry mechanism when an server error occurs > -- > > Key: HADOOP-16969 > URL: https://issues.apache.org/jira/browse/HADOOP-16969 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: YangY >Assignee: YangY >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16969) Optimizing 他和in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16969: --- Summary: Optimizing 他和in Hadoop-cos (was: Fixing the issue that the single file upload can not be retried in Hadoop-cos) > Optimizing 他和in Hadoop-cos > -- > > Key: HADOOP-16969 > URL: https://issues.apache.org/jira/browse/HADOOP-16969 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: YangY >Assignee: YangY >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16968: --- Attachment: HADOOP-16968-branch-3.3.001.patch > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16968-branch-3.3.001.patch > > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16981) Support the CRC64 checksum
YangY created HADOOP-16981: -- Summary: Support the CRC64 checksum Key: HADOOP-16981 URL: https://issues.apache.org/jira/browse/HADOOP-16981 Project: Hadoop Common Issue Type: Sub-task Components: fs/cos Reporter: YangY Assignee: YangY Support the CRC64 checksum in Hadoop-cos, and implement the 'getFileChecksum' method. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16980) Supporting the server encryption based on SSE-COS and SSE-C
YangY created HADOOP-16980: -- Summary: Supporting the server encryption based on SSE-COS and SSE-C Key: HADOOP-16980 URL: https://issues.apache.org/jira/browse/HADOOP-16980 Project: Hadoop Common Issue Type: Sub-task Components: fs/cos Reporter: YangY Assignee: YangY Support the server encryption based on SSE-COS and SSE-C in Hadoop-cos. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-16969) Fixing the issue that the single file upload can not be retried in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY reassigned HADOOP-16969: -- Assignee: YangY > Fixing the issue that the single file upload can not be retried in Hadoop-cos > - > > Key: HADOOP-16969 > URL: https://issues.apache.org/jira/browse/HADOOP-16969 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: YangY >Assignee: YangY >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.001.patch) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work started] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16968 started by YangY. -- > Optimizing the upload buffer in Hadoop-cos > -- > > Key: HADOOP-16968 > URL: https://issues.apache.org/jira/browse/HADOOP-16968 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > This task focus on fixing the bug of returning an upload buffer failed when > some exceptions occur. > > What's more, the optimizing upload buffer management would be provided. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082507#comment-17082507 ] YangY commented on HADOOP-16959: Due to the COSCredentialsProvider interface updating in the new version of the bundle-SDK, the implementations in Hadoop-cos are also refactored accordingly. > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: (was: HADOOP-16959-branch-3.3.001.patch) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Attachment: HADOOP-16959-branch-3.3.001.patch > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Issue Comment Deleted] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Comment: was deleted (was: Thanks for your attention. I want to use the shaded plugin to package all related dependencies, shade the conflicting, and finally provide a uber jar. This uber jar is relatively independent and does not conflict with the dependencies of Hadoop. ) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16959-branch-3.3.001.patch > > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Target Version/s: 3.3.1 Status: Patch Available (was: In Progress) This patch modified the cos-java-sdk to cos-java-sdk-bundle, which packages all related dependencies relocated to a dependent namespace. > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16970) Supporting the new credentials provider in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16970: --- Description: This task aims to support three credentials provider in Hadoop-cos: * SessionCredentialsProvider * InstanceCredentialsProvider was: This task aims to support three credentials provider in Hadoop-cos: * SessionCredentialsProvider * CVMInstanceCredentialsProvider * CPMInstanceCredentialsProvider > Supporting the new credentials provider in Hadoop-cos > - > > Key: HADOOP-16970 > URL: https://issues.apache.org/jira/browse/HADOOP-16970 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > This task aims to support three credentials provider in Hadoop-cos: > * SessionCredentialsProvider > * InstanceCredentialsProvider -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16970) Supporting the new credentials provider in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16970: --- Summary: Supporting the new credentials provider in Hadoop-cos (was: Supporting the new Credentials Provider in Hadoop-cos) > Supporting the new credentials provider in Hadoop-cos > - > > Key: HADOOP-16970 > URL: https://issues.apache.org/jira/browse/HADOOP-16970 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > This task aims to support three credentials provider in Hadoop-cos: > * SessionCredentialsProvider > * CVMInstanceCredentialsProvider > * CPMInstanceCredentialsProvider -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16970) Supporting the new Credentials Provider in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16970: --- Summary: Supporting the new Credentials Provider in Hadoop-cos (was: Support the new Credentials Provider in Hadoop-cos) > Supporting the new Credentials Provider in Hadoop-cos > - > > Key: HADOOP-16970 > URL: https://issues.apache.org/jira/browse/HADOOP-16970 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > This task aims to support three credentials provider in Hadoop-cos: > * SessionCredentialsProvider > * CVMInstanceCredentialsProvider > * CPMInstanceCredentialsProvider -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16969) Fixing the issue that the single file upload can not be retried in Hadoop-cos
[ https://issues.apache.org/jira/browse/HADOOP-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16969: --- Summary: Fixing the issue that the single file upload can not be retried in Hadoop-cos (was: Fix the issue that the single file upload can not be retried in Hadoop-cos) > Fixing the issue that the single file upload can not be retried in Hadoop-cos > - > > Key: HADOOP-16969 > URL: https://issues.apache.org/jira/browse/HADOOP-16969 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: YangY >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16970) Support the new Credentials Provider in Hadoop-cos
YangY created HADOOP-16970: -- Summary: Support the new Credentials Provider in Hadoop-cos Key: HADOOP-16970 URL: https://issues.apache.org/jira/browse/HADOOP-16970 Project: Hadoop Common Issue Type: Sub-task Components: fs/cos Reporter: YangY Assignee: YangY This task aims to support three credentials provider in Hadoop-cos: * SessionCredentialsProvider * CVMInstanceCredentialsProvider * CPMInstanceCredentialsProvider -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Umbrella Jira for improving the Hadoop-cos support in Hadoop
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This Umbrella Jira focus on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the HTTP proxy settings; # support the storage class settings; # support the CRC64 checksum. was: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the HTTP proxy settings; # support the storage class settings; # support the CRC64 checksum. > Umbrella Jira for improving the Hadoop-cos support in Hadoop > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Umbrella Jira focus on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16969) Fix the issue that the single file upload can not be retried in Hadoop-cos
YangY created HADOOP-16969: -- Summary: Fix the issue that the single file upload can not be retried in Hadoop-cos Key: HADOOP-16969 URL: https://issues.apache.org/jira/browse/HADOOP-16969 Project: Hadoop Common Issue Type: Sub-task Reporter: YangY -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos
YangY created HADOOP-16968: -- Summary: Optimizing the upload buffer in Hadoop-cos Key: HADOOP-16968 URL: https://issues.apache.org/jira/browse/HADOOP-16968 Project: Hadoop Common Issue Type: Sub-task Components: fs/cos Reporter: YangY Assignee: YangY This task focus on fixing the bug of returning an upload buffer failed when some exceptions occur. What's more, the optimizing upload buffer management would be provided. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16959: --- Summary: Resolve hadoop-cos dependency conflict (was: resolve hadoop-cos dependency conflict) > Resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Umbrella Jira for improving the Hadoop-cos support in Hadoop
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Summary: Umbrella Jira for improving the Hadoop-cos support in Hadoop (was: Hadoop-cos: Fix some bugs and add some important features) > Umbrella Jira for improving the Hadoop-cos support in Hadoop > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080178#comment-17080178 ] YangY commented on HADOOP-16955: [~weichiu] Okay, Thanks for your suggestions. I will separate the patch file into multi subtasks as soon as possible. This work is mainly done by me. Thanks again for your continued attention.:) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Fix For: 3.3.1 > > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Attachment: (was: pom.xml) > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0, 3.3.1 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: pom.xml > > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079381#comment-17079381 ] YangY commented on HADOOP-16956: [~ste...@apache.org] It is mainly to shade the basic dependencies of the cos-java-sdk, excluding the conflicting which comes from the Hadoop-common and relocating them to the package: 'org.apache.hadoop.fs.cosn.shaded'. For example, HTTP lib, commons-codec, fasterxml and etc. The reason why I want to do this is that the version of the above dependencies is different from the Hadoop-common's, and may produce some runtime conflict. The following is the content of my pom.xml. [^pom.xml] Could you help me to check it and give me some advice? Thanks. > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0, 3.3.1 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: pom.xml, pom.xml > > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Attachment: pom.xml > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0, 3.3.1 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: pom.xml, pom.xml > > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Issue Comment Deleted] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Comment: was deleted (was: [~ste...@apache.org] It is mainly to shade the basic dependencies of the cos-java-sdk, excluding the conflicting which comes from the Hadoop-common and relocating them to the package: 'org.apache.hadoop.fs.cosn.shaded'. For example, HTTP lib, commons-codec, fasterxml and etc. The reason why I want to do this is that the version of the above dependencies is different from the Hadoop-common's, and may produce some runtime conflict. The following is the content of my pom.xml. [^pom.xml] Could you help me to check it and give me some advice? Thanks. ) > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0, 3.3.1 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: pom.xml, pom.xml > > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079376#comment-17079376 ] YangY commented on HADOOP-16956: [~ste...@apache.org] It is mainly to shade the basic dependencies of the cos-java-sdk, excluding the conflicting which comes from the Hadoop-common and relocating them to the package: 'org.apache.hadoop.fs.cosn.shaded'. For example, HTTP lib, commons-codec, fasterxml and etc. The reason why I want to do this is that the version of the above dependencies is different from the Hadoop-common's, and may produce some runtime conflict. The following is the content of my pom.xml. [^pom.xml] Could you help me to check it and give me some advice? Thanks. > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0, 3.3.1 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: pom.xml > > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Attachment: pom.xml > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0, 3.3.1 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: pom.xml > > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: (was: HADOOP-16955-branch-3.3.001.patch) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Fix For: 3.3.1 > > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: HADOOP-16955-branch-3.3.001.patch > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Fix For: 3.3.1 > > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: (was: HADOOP-16955-branch-3.3.001.patch) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Fix For: 3.3.1 > > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: HADOOP-16955-branch-3.3.001.patch > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Fix For: 3.3.1 > > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Affects Version/s: (was: 3.3.0) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Fix Version/s: 3.3.1 > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > Fix For: 3.3.1 > > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work started] (HADOOP-16959) resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16959 started by YangY. -- > resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: HADOOP-16955-branch-3.3.001.patch > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16955-branch-3.3.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: (was: HADOOP-16955.001.patch) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Affects Version/s: 3.3.1 > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0, 3.3.1 >Reporter: YangY >Assignee: YangY >Priority: Major > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: HADOOP-16955.001.patch > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16955.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: (was: HADOOP-16955.001.patch) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Work logged] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?focusedWorklogId=418468=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-418468 ] YangY logged work on HADOOP-16955: -- Author: YangY Created on: 08/Apr/20 12:11 Start Date: 08/Apr/20 12:11 Worklog Time Spent: 4h Issue Time Tracking --- Worklog Id: (was: 418468) Remaining Estimate: 44h (was: 48h) Time Spent: 4h > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16955.001.patch > > Original Estimate: 48h > Time Spent: 4h > Remaining Estimate: 44h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Attachment: HADOOP-16955.001.patch Release Note: bugfix: - resolve the dependency conflict; - fix the upload buffer returning failed when some exceptions occur; - fix the issue that the single file upload can not be retried; - fix the bug of checking if a file exists through listing the file frequently. features: - support SessionCredentialsProvider and InstanceCredentialsProvider, which - allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; - support the server encryption based on SSE-COS and SSE-C; - support the HTTP proxy settings; - support the storage class settings; Target Version/s: 3.3.0 Status: Patch Available (was: In Progress) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Attachments: HADOOP-16955.001.patch > > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16959) resolve hadoop-cos dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077923#comment-17077923 ] YangY commented on HADOOP-16959: Thanks for your attention. I want to use the shaded plugin to package all related dependencies, shade the conflicting, and finally provide a uber jar. This uber jar is relatively independent and does not conflict with the dependencies of Hadoop. > resolve hadoop-cos dependency conflict > -- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/cos >Reporter: YangY >Assignee: YangY >Priority: Major > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077910#comment-17077910 ] YangY commented on HADOOP-16956: [~ste...@apache.org] Thanks for your comments. I want to use the shaded plugin to package all related dependencies, shade the conflicting, and finally provide a uber jar. At the same time, add it as a dependency of hadoop-cloud-storage-project/hadoop-cloud-storage/pom.xml. Is this right? > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the HTTP proxy settings; # support the storage class settings; # support the CRC64 checksum. was: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the HTTP proxy settings; # support the CRC64 checksum. > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the storage class settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the HTTP proxy settings; # support the CRC64 checksum. was: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the custom domain; # support the HTTP proxy settings; # support the CRC64 checksum. > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the HTTP proxy settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Hadoop-cos: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Summary: Hadoop-cos: Fix some bugs and add some important features (was: Tencent Cloud COS: Fix some bugs and add some important features) > Hadoop-cos: Fix some bugs and add some important features > - > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the custom domain; > # support the HTTP proxy settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-16959) resolve the dependency conflict
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY reassigned HADOOP-16959: -- Assignee: YangY > resolve the dependency conflict > --- > > Key: HADOOP-16959 > URL: https://issues.apache.org/jira/browse/HADOOP-16959 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: YangY >Assignee: YangY >Priority: Major > > There are some dependency conflicts between the Hadoop-common and Hadoop-cos. > For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16959) resolve the dependency conflict
YangY created HADOOP-16959: -- Summary: resolve the dependency conflict Key: HADOOP-16959 URL: https://issues.apache.org/jira/browse/HADOOP-16959 Project: Hadoop Common Issue Type: Sub-task Reporter: YangY There are some dependency conflicts between the Hadoop-common and Hadoop-cos. For example, joda time lib, HTTP client lib and etc. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the custom domain; # support the HTTP proxy settings; # support the CRC64 checksum. was: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the custom domain; # support the HTTP proxy settings. > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the custom domain; > # support the HTTP proxy settings; > # support the CRC64 checksum. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This Jira focuses on fixing some known bugs and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # fix the bug of checking if a file exists through listing the file frequently. features: # support SessionCredentialsProvider and InstanceCredentialsProvider, which allows users to specify the credentials in URI or get it from the CVM (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS bucket; # support the server encryption based on SSE-COS and SSE-C; # support the custom domain; # support the HTTP proxy settings. was: This Jira focuses on fixing some known bugs of the Hadoop-cos and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs and adding some important > features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # fix the bug of checking if a file exists through listing the file > frequently. > features: > # support SessionCredentialsProvider and InstanceCredentialsProvider, which > allows users to specify the credentials in URI or get it from the CVM > (Tencent Cloud Virtual Machine) bound to the CAM role that can access the COS > bucket; > # support the server encryption based on SSE-COS and SSE-C; > # support the custom domain; > # support the HTTP proxy settings. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This Jira focuses on fixing some known bugs of the Hadoop-cos and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # fix the issue that the single file upload can not be retried; # was: This Jira focuses on fixing some known bugs of the Hadoop-cos and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs of the Hadoop-cos and adding some > important features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # fix the issue that the single file upload can not be retried; > # -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This Jira focuses on fixing some known bugs of the Hadoop-cos and adding some important features. bugfix: # resolve the dependency conflict; # fix the upload buffer returning failed when some exceptions occur; # was: This jira focuses on fixing some known bugs of the hadoop-cos and adding some important features. bug fix: # resolve the dependency conflict; # fix the upload buffer returning failed > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This Jira focuses on fixing some known bugs of the Hadoop-cos and adding some > important features. > > bugfix: > # resolve the dependency conflict; > # fix the upload buffer returning failed when some exceptions occur; > # -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This jira focuses on fixing some known bugs of the hadoop-cos and adding some important features. bug fix: # resolve the dependency conflict; # fix the upload buffer returning failed was: This jira focuses on fixing some known bugs of the hadoop-cos and adding some important features. bug fix: # resolve the dependency conflict; # > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This jira focuses on fixing some known bugs of the hadoop-cos and adding some > important features. > > bug fix: > # resolve the dependency conflict; > # fix the upload buffer returning failed > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This jira focuses on fixing some known bugs of the hadoop-cos and adding some important features. bug fix: # resolve the dependency conflict; # was: This jira focuses on fixing some known bugs of the hadoop-cos and adding some important features, such as the instance credentials fetching, the file checksum on CRC64, and the upload buffer optimizing. > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This jira focuses on fixing some known bugs of the hadoop-cos and adding some > important features. > > bug fix: > # resolve the dependency conflict; > # > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Description: This jira focuses on fixing some known bugs of the hadoop-cos and adding some important features, such as the instance credentials fetching, the file checksum on CRC64, and the upload buffer optimizing. was: Provides three types of upload buffers: mapped_disk (MappedByteBuffer), on-heap and off-heap memory. In addition, fixed the issue that the buffer may fail to release when some exceptions occur. > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > This jira focuses on fixing some known bugs of the hadoop-cos and adding some > important features, such as the instance credentials fetching, the file > checksum on CRC64, and the upload buffer optimizing. > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16955) Tencent Cloud COS: Fix some bugs and add some important features
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16955: --- Summary: Tencent Cloud COS: Fix some bugs and add some important features (was: Tencent Cloud COS: Optimize the upload buffer) > Tencent Cloud COS: Fix some bugs and add some important features > > > Key: HADOOP-16955 > URL: https://issues.apache.org/jira/browse/HADOOP-16955 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > Original Estimate: 48h > Remaining Estimate: 48h > > Provides three types of upload buffers: mapped_disk (MappedByteBuffer), > on-heap and off-heap memory. > > In addition, fixed the issue that the buffer may fail to release when some > exceptions occur. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Description: [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the trunk branch last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). I am the contributor and the maintainer of this patch. Considering that you are the expert on the object storage support in Hadoop, I have some questions for you. # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?* # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. Can you guide me how to solve these two problems? Thanks for your time and attention. :) was: [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the trunk branch last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). I am the contributor and the maintainer of this patch. Considering that you are the expert on the object storage support in Hadoop, I have some questions for you. # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?* # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. Can you guide me how to solve these two problems? Thank for your time and attention. :) > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thanks for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Description: [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the trunk branch last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). I am the contributor and the maintainer of this patch. Considering that you are the expert on the object storage support in Hadoop, I have some questions for you. # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?* # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. Can you guide me how to solve these two problems? Thank for your time and attention. :) was: [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the trunk branch last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). I am the contributor and the maintainer of this patch. Considering that you are the expert on the object storage support in Hadoop, I have some questions for you. # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?* # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. Can you guide me how to solve these two problems? Thank you for your time and attention. :) > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thank for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY reassigned HADOOP-16956: -- Assignee: YangY > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Assignee: YangY >Priority: Major > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thank you for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
[ https://issues.apache.org/jira/browse/HADOOP-16956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YangY updated HADOOP-16956: --- Description: [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the trunk branch last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). I am the contributor and the maintainer of this patch. Considering that you are the expert on the object storage support in Hadoop, I have some questions for you. # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?* # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. Can you guide me how to solve these two problems? Thank you for your time and attention. :) was: [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the trunk branch in last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). I am the contributor and the maintainer of this patch. Considering that you are the expert on the object storage support in Hadoop, I have some questions for you. # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?* # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. Can you guide me how to solve these two problems? Thank you for your time and attention. :) > Tencent Cloud COS: Package it into hadoop-dist > -- > > Key: HADOOP-16956 > URL: https://issues.apache.org/jira/browse/HADOOP-16956 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/cos >Affects Versions: 3.3.0 >Reporter: YangY >Priority: Major > > [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the > trunk branch last year. (Related jira: > https://issues.apache.org/jira/browse/HADOOP-15616). > I am the contributor and the maintainer of this patch. Considering that you > are the expert on the object storage support in Hadoop, I have some questions > for you. > # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project > directory. How to package it into the hadoop-dist directory as the > distribution package?* > # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I > use the maven to compile and package it, but only the > hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the > hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in > their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the > hadoop-cos does not. > Can you guide me how to solve these two problems? > > Thank you for your time and attention. :) > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16956) Tencent Cloud COS: Package it into hadoop-dist
YangY created HADOOP-16956: -- Summary: Tencent Cloud COS: Package it into hadoop-dist Key: HADOOP-16956 URL: https://issues.apache.org/jira/browse/HADOOP-16956 Project: Hadoop Common Issue Type: Improvement Components: fs/cos Affects Versions: 3.3.0 Reporter: YangY [~ste...@apache.org] Hi, Steve, the Hadoop-COS has been submitted to the trunk branch in last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). I am the contributor and the maintainer of this patch. Considering that you are the expert on the object storage support in Hadoop, I have some questions for you. # The Hadoop-cos patch is placed in the *hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?* # How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is '*compile*' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. Can you guide me how to solve these two problems? Thank you for your time and attention. :) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
