[jira] [Commented] (HDDS-2665) Implement new Ozone Filesystem scheme ofs://

2020-03-24 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066412#comment-17066412 ] Sammi Chen commented on HDDS-2665: -- Hi [~smeng], thanks for working on the feature. Need

[jira] [Updated] (HDDS-3287) Max key version number control support

2020-03-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3287: - Summary: Max key version number control support (was: keyLocationVersions become bigger and bigger when u

[jira] [Updated] (HDDS-3306) Support configurable data consistency level

2020-03-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3306: - Summary: Support configurable data consistency level (was: Support client side configurable data consiste

[jira] [Created] (HDDS-3306) Support client side configurable data consistency level

2020-03-31 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3306: Summary: Support client side configurable data consistency level Key: HDDS-3306 URL: https://issues.apache.org/jira/browse/HDDS-3306 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-04-29 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3512: Summary: s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar Key: HDDS-3512 URL: https://issues.apache.org/jira/browse/HDDS-3512 Project: Hadoop

[jira] [Updated] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-04-29 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3512: - Description: The default multi-part size is 5MB, which is 5242880 byte, while all the chunks saved by s3

[jira] [Commented] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-04-29 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096129#comment-17096129 ] Sammi Chen commented on HDDS-3512: -- I guess there might be some trailling checksums conte

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-04-29 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096129#comment-17096129 ] Sammi Chen edited comment on HDDS-3512 at 4/30/20, 5:04 AM: I

[jira] [Created] (HDDS-3544) Support multiple objects delete

2020-05-05 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3544: Summary: Support multiple objects delete Key: HDDS-3544 URL: https://issues.apache.org/jira/browse/HDDS-3544 Project: Hadoop Distributed Data Store Issue Type: Impro

[jira] [Updated] (HDDS-3385) Simplify S3 -> Ozone volume mapping

2020-05-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3385: - Labels: imcompatible pull-request-available (was: pull-request-available) > Simplify S3 -> Ozone volume m

[jira] [Commented] (HDDS-3385) Simplify S3 -> Ozone volume mapping

2020-05-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17105427#comment-17105427 ] Sammi Chen commented on HDDS-3385: -- Hi [~arp], would you kindly point out where can I fi

[jira] [Resolved] (HDDS-3326) Get INTERNAL_ERROR when cp file to mount dir(use s3g+ goofys ).

2020-05-13 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-3326. -- Resolution: Not A Problem > Get INTERNAL_ERROR when cp file to mount dir(use s3g+ goofys ). > --

[jira] [Commented] (HDDS-3326) Get INTERNAL_ERROR when cp file to mount dir(use s3g+ goofys ).

2020-05-13 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106089#comment-17106089 ] Sammi Chen commented on HDDS-3326: -- Close the issue since it's not a problem. > Get INTE

[jira] [Created] (HDDS-3579) Support object expiration TTL setting at bucket level

2020-05-13 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3579: Summary: Support object expiration TTL setting at bucket level Key: HDDS-3579 URL: https://issues.apache.org/jira/browse/HDDS-3579 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-2939) Ozone FS namespace

2020-05-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110822#comment-17110822 ] Sammi Chen commented on HDDS-2939: -- Hi [~msingh], thanks for the explanation. So will th

[jira] [Resolved] (HDDS-3606) Add datanode port into the printTopology command output

2020-05-19 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-3606. -- Resolution: Fixed > Add datanode port into the printTopology command output > --

[jira] [Created] (HDDS-3625) BadRequestException interception doesn't take effect in s3g

2020-05-19 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3625: Summary: BadRequestException interception doesn't take effect in s3g Key: HDDS-3625 URL: https://issues.apache.org/jira/browse/HDDS-3625 Project: Hadoop Distributed Data Sto

[jira] [Assigned] (HDDS-3625) BadRequestException interception doesn't take effect in s3g

2020-05-19 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-3625: Assignee: Sammi Chen > BadRequestException interception doesn't take effect in s3g > -

[jira] [Created] (HDDS-3633) Improve getUtcTime() and UniqueId.next() efficiency

2020-05-21 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3633: Summary: Improve getUtcTime() and UniqueId.next() efficiency Key: HDDS-3633 URL: https://issues.apache.org/jira/browse/HDDS-3633 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3644) Failed to delete chunk file due to chunk size mismatch

2020-05-21 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3644: Summary: Failed to delete chunk file due to chunk size mismatch Key: HDDS-3644 URL: https://issues.apache.org/jira/browse/HDDS-3644 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-3644) Failed to delete chunk file due to chunk size mismatch

2020-05-25 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116008#comment-17116008 ] Sammi Chen commented on HDDS-3644: -- Thanks [~adoroszlai] for reproduce and root cause the

[jira] [Updated] (HDDS-3633) Improve UniqueId.next() efficiency

2020-05-25 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3633: - Summary: Improve UniqueId.next() efficiency (was: Improve getUtcTime() and UniqueId.next() efficiency) >

[jira] [Updated] (HDDS-3633) Improve UniqueId.next() efficiency

2020-05-25 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3633: - Description: Currently, UniqueId.next leverages Calendar.getInstance(UTC_ZONE).getTimeInMillis() to get a

[jira] [Created] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-05-26 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3658: Summary: Remove container location information when persist key info into OM DB to reduce meta data db size Key: HDDS-3658 URL: https://issues.apache.org/jira/browse/HDDS-3658

[jira] [Assigned] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-05-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-3658: Assignee: Sammi Chen > Remove container location information when persist key info into OM DB to >

[jira] [Updated] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-05-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Description: An investigation result of serilized key size, RATIS with three replica. 1. empty key, se

[jira] [Updated] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-05-26 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Description: An investigation result of serilized key size, RATIS with three replica. 1. empty key, se

[jira] [Created] (HDDS-3672) Ozone fs failed to list intermiedate directory

2020-05-27 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3672: Summary: Ozone fs failed to list intermiedate directory Key: HDDS-3672 URL: https://issues.apache.org/jira/browse/HDDS-3672 Project: Hadoop Distributed Data Store Is

[jira] [Updated] (HDDS-3672) Ozone fs failed to list intermiedate directory

2020-05-27 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3672: - Description: bin/ozone fs -ls o3fs://ozone.hadoop/benchmarks/TestDFSIO 2020-05-28 11:46:32,028 INFO protoc

[jira] [Assigned] (HDDS-3672) Ozone fs failed to list intermiedate directory

2020-05-27 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-3672: Assignee: Sammi Chen > Ozone fs failed to list intermiedate directory > ---

[jira] [Commented] (HDDS-3672) Ozone fs failed to list intermiedate directory

2020-05-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118384#comment-17118384 ] Sammi Chen commented on HDDS-3672: -- Hi [~msingh] , the data is written by TestDFSIO using

[jira] [Updated] (HDDS-3672) Ozone o3fs failed to list intermiedate directory

2020-05-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3672: - Summary: Ozone o3fs failed to list intermiedate directory (was: Ozone fs failed to list intermiedate dire

[jira] [Updated] (HDDS-3672) Ozone fs failed to list intermiedate directory

2020-05-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3672: - Summary: Ozone fs failed to list intermiedate directory (was: Ozone o3fs failed to list intermiedate dire

[jira] [Commented] (HDDS-3644) Failed to delete chunk file due to chunk size mismatch

2020-05-28 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17119311#comment-17119311 ] Sammi Chen commented on HDDS-3644: -- For question 4, manually delete involved chunk files

[jira] [Commented] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124522#comment-17124522 ] Sammi Chen commented on HDDS-3658: -- Hi [~elek], the example is copied from the "ozone sh

[jira] [Updated] (HDDS-3658) Remove container location information when persist key info into OM DB to reduce meta data db size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Description: An investigation result of serilized key size, RATIS with three replica. Following examples

[jira] [Updated] (HDDS-3658) Stop persist container related pipeline info of each key into OM DB to reduce DB size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Summary: Stop persist container related pipeline info of each key into OM DB to reduce DB size (was: Remo

[jira] [Updated] (HDDS-3658) Stop to persist container related pipeline info of each key into OM DB to reduce DB size

2020-06-02 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3658: - Summary: Stop to persist container related pipeline info of each key into OM DB to reduce DB size (was: S

[jira] [Commented] (HDDS-2562) Handle InterruptedException in DatanodeStateMachine

2020-06-03 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124884#comment-17124884 ] Sammi Chen commented on HDDS-2562: -- Hi [~dineshchitlangia], with this patch, datanode doe

[jira] [Created] (HDDS-3715) Remaining obstacles for OzoneFS to work on Hadoop 2.x

2020-06-04 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3715: Summary: Remaining obstacles for OzoneFS to work on Hadoop 2.x Key: HDDS-3715 URL: https://issues.apache.org/jira/browse/HDDS-3715 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3715) Remaining obstacles for OzoneFS to work on Hadoop 2.7

2020-06-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3715: - Summary: Remaining obstacles for OzoneFS to work on Hadoop 2.7 (was: Remaining obstacles for OzoneFS to w

[jira] [Updated] (HDDS-3715) Remaining obstacles for OzoneFS client to work with Hadoop 2.7.2

2020-06-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3715: - Summary: Remaining obstacles for OzoneFS client to work with Hadoop 2.7.2 (was: Remaining obstacles for O

[jira] [Updated] (HDDS-3715) Remaining obstacles for OzoneFS to work on Hadoop 2.7.2

2020-06-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3715: - Summary: Remaining obstacles for OzoneFS to work on Hadoop 2.7.2 (was: Remaining obstacles for OzoneFS to

[jira] [Updated] (HDDS-3715) Remaining obstacles for OzoneFS client to work with Hadoop 2.7.3

2020-06-08 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3715: - Summary: Remaining obstacles for OzoneFS client to work with Hadoop 2.7.3 (was: Remaining obstacles for O

[jira] [Updated] (HDDS-3715) Improvement for OzoneFS client to work with Hadoop 2.7.3

2020-06-08 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3715: - Summary: Improvement for OzoneFS client to work with Hadoop 2.7.3 (was: Remaining obstacles for OzoneFS c

[jira] [Updated] (HDDS-3715) Improvement for OzoneFS client to work with Hadoop 2.7.3

2020-06-08 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3715: - Description: The background is the hadoop production clusters we used internally is based on Hadoop 2.7.3

[jira] [Updated] (HDDS-3715) Improvement for OzoneFS client to work with Hadoop 2.7.3

2020-06-08 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3715: - Description: The background is the hadoop production clusters we used internally is based on Hadoop 2.7.3

[jira] [Created] (HDDS-3752) ozone "fs -ls" cann't list "o3fs://bucket.volume" without tail "/"

2020-06-08 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3752: Summary: ozone "fs -ls" cann't list "o3fs://bucket.volume" without tail "/" Key: HDDS-3752 URL: https://issues.apache.org/jira/browse/HDDS-3752 Project: Hadoop Distributed Da

[jira] [Created] (HDDS-3761) "ozone fs -get" is way to slow than "ozone sh key get"

2020-06-09 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3761: Summary: "ozone fs -get" is way to slow than "ozone sh key get" Key: HDDS-3761 URL: https://issues.apache.org/jira/browse/HDDS-3761 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3761) "ozone fs -get" is way to slow than "ozone sh key get"

2020-06-09 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3761: - Description: Read time spend to download a 7GB+ object, time ozone fs -get o3fs://konajdk-profiler.s325

[jira] [Commented] (HDDS-3764) Spark is failing with no such method exception

2020-06-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130343#comment-17130343 ] Sammi Chen commented on HDDS-3764: -- Hi [~elek], fixes in HDDS-3715 covers this issue.

[jira] [Comment Edited] (HDDS-3764) Spark is failing with no such method exception

2020-06-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130343#comment-17130343 ] Sammi Chen edited comment on HDDS-3764 at 6/10/20, 7:34 AM: Hi

[jira] [Updated] (HDDS-3761) "ozone fs -get" is way to slow than "ozone sh key get"

2020-06-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3761: - Target Version/s: 0.7.0 > "ozone fs -get" is way to slow than "ozone sh key get" > ---

[jira] [Updated] (HDDS-3725) Ozone sh volume client support quota option.

2020-06-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3725: - Target Version/s: 0.7.0 > Ozone sh volume client support quota option. > -

[jira] [Commented] (HDDS-3761) "ozone fs -get" is way to slow than "ozone sh key get"

2020-06-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130574#comment-17130574 ] Sammi Chen commented on HDDS-3761: -- Hi [~msingh] and [~rakeshr], Please hold on the inve

[jira] [Created] (HDDS-3772) Add LOG to S3ErrorTable for easier problem locating

2020-06-10 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3772: Summary: Add LOG to S3ErrorTable for easier problem locating Key: HDDS-3772 URL: https://issues.apache.org/jira/browse/HDDS-3772 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3772) Add LOG to S3ErrorTable for easier problem locating

2020-06-10 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3772: - Description: Currently it's hard to directly tell the failure reason when something unexpected happened.

[jira] [Commented] (HDDS-3683) Ozone fuse support

2020-06-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134073#comment-17134073 ] Sammi Chen commented on HDDS-3683: -- Hi [~maobaolong], thanks for update the performance.

[jira] [Updated] (HDDS-3802) Incorrect data returned by reading a FILE_PER_CHUNK block

2020-06-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3802: - Description: FilePerChunkStrategy#readChunk {quote}// use offset only if file written by old datanode

[jira] [Created] (HDDS-3802) Incorrect data returned by reading a FILE_PER_CHUNK block

2020-06-15 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3802: Summary: Incorrect data returned by reading a FILE_PER_CHUNK block Key: HDDS-3802 URL: https://issues.apache.org/jira/browse/HDDS-3802 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3802) Incorrect data returned by reading a FILE_PER_CHUNK block

2020-06-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3802: - Description: FilePerChunkStrategy#readChunk {code:java} // use offset only if file written by old datan

[jira] [Updated] (HDDS-3802) Incorrect data returned by reading a FILE_PER_CHUNK block

2020-06-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3802: - Description: FilePerChunkStrategy#readChunk {code:java} // use offset only if file written by old datan

[jira] [Updated] (HDDS-3802) Incorrect data returned by reading a FILE_PER_CHUNK block

2020-06-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3802: - Description: FilePerChunkStrategy#readChunk {{// use offset only if file written by old datanode

[jira] [Updated] (HDDS-3802) Incorrect data returned by reading a FILE_PER_CHUNK block

2020-06-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3802: - Target Version/s: 0.6.0 > Incorrect data returned by reading a FILE_PER_CHUNK block >

[jira] [Updated] (HDDS-3802) Incorrect data returned by reading a FILE_PER_CHUNK block

2020-06-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3802: - Description: A summary of s3 big file download result with Apri 22th master branch code, 1. download with

[jira] [Created] (HDDS-3806) Support aws v2 authentication header

2020-06-15 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3806: Summary: Support aws v2 authentication header Key: HDDS-3806 URL: https://issues.apache.org/jira/browse/HDDS-3806 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Resolved] (HDDS-3761) "ozone fs -get" is way to slow than "ozone sh key get"

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-3761. -- Assignee: Sammi Chen Resolution: Fixed > "ozone fs -get" is way to slow than "ozone sh key get" >

[jira] [Commented] (HDDS-3761) "ozone fs -get" is way to slow than "ozone sh key get"

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136374#comment-17136374 ] Sammi Chen commented on HDDS-3761: -- Closed the issue since it cannot be reproduced with l

[jira] [Updated] (HDDS-3806) Support aws v2 authentication header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3806: - Description: too much v4 authentication parser failure logs in s3g log file. 2020-06-16 12:41:13,195 [qtp

[jira] [Updated] (HDDS-3806) Support parse aws v2 authentication header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3806: - Summary: Support parse aws v2 authentication header (was: Support aws v2 authentication header) > Suppor

[jira] [Updated] (HDDS-3806) Support parse aws v2 Authorization header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3806: - Summary: Support parse aws v2 Authorization header (was: Support parse aws v2 authentication header) > S

[jira] [Comment Edited] (HDDS-3806) Support parse aws v2 Authorization header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136410#comment-17136410 ] Sammi Chen edited comment on HDDS-3806 at 6/16/20, 8:01 AM: ht

[jira] [Commented] (HDDS-3806) Support parse aws v2 Authorization header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136410#comment-17136410 ] Sammi Chen commented on HDDS-3806: -- https://docs.aws.amazon.com/AmazonS3/latest/dev/RESTA

[jira] [Comment Edited] (HDDS-3806) Support parse aws v2 Authorization header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136410#comment-17136410 ] Sammi Chen edited comment on HDDS-3806 at 6/16/20, 8:05 AM: aw

[jira] [Comment Edited] (HDDS-3806) Support parse aws v2 Authorization header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136410#comment-17136410 ] Sammi Chen edited comment on HDDS-3806 at 6/16/20, 8:05 AM: aw

[jira] [Updated] (HDDS-3806) Support recognize aws v2 Authorization header

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3806: - Summary: Support recognize aws v2 Authorization header (was: Support parse aws v2 Authorization header)

[jira] [Commented] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136492#comment-17136492 ] Sammi Chen commented on HDDS-3512: -- [~elek], it's still a problem with my aws java sdk ba

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136492#comment-17136492 ] Sammi Chen edited comment on HDDS-3512 at 6/16/20, 9:57 AM: [~

[jira] [Updated] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3512: - Target Version/s: 0.7.0 (was: 0.6.0) > s3g multi-upload saved content incorrect when client uses aws java

[jira] [Created] (HDDS-3813) Integrate with ratis 0.6.0 release binaries

2020-06-16 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3813: Summary: Integrate with ratis 0.6.0 release binaries Key: HDDS-3813 URL: https://issues.apache.org/jira/browse/HDDS-3813 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-3813) Integrate with ratis 0.6.0 release binaries

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3813: - Target Version/s: 0.6.0 > Integrate with ratis 0.6.0 release binaries > --

[jira] [Updated] (HDDS-3813) Integrate with ratis 0.6.0 release binaries for ozone 0.6.0 release

2020-06-16 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3813: - Summary: Integrate with ratis 0.6.0 release binaries for ozone 0.6.0 release (was: Integrate with ratis 0

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136492#comment-17136492 ] Sammi Chen edited comment on HDDS-3512 at 6/17/20, 8:02 AM: [~

[jira] [Commented] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen commented on HDDS-3512: -- It turns out that aws sdk 1.11.* by default send the

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:07 AM: It

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:14 AM: It

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:15 AM: It

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* jar

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138974#comment-17138974 ] Sammi Chen edited comment on HDDS-3512 at 6/18/20, 3:16 AM: It

[jira] [Updated] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* version

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3512: - Summary: s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* version (was: s3g

[jira] [Commented] (HDDS-3764) Spark is failing with no such method exception

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138996#comment-17138996 ] Sammi Chen commented on HDDS-3764: -- [~elek], can we close this JIRA now? > Spark is fai

[jira] [Commented] (HDDS-3704) Update all the documentation to use ozonefs-hadoop2/3 instead of legacy/current

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138998#comment-17138998 ] Sammi Chen commented on HDDS-3704: -- Hi [~elek], this JIRA will go into 0.6.0 release, rig

[jira] [Updated] (HDDS-3806) Support recognize aws v2 Authorization header

2020-06-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3806: - Description: too much v4 authentication parser failure logs in s3g log file when client using v2 authenti

[jira] [Commented] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* version

2020-06-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140160#comment-17140160 ] Sammi Chen commented on HDDS-3512: -- [~elek] do you mind I take over this task? I find th

[jira] [Comment Edited] (HDDS-3512) s3g multi-upload saved content incorrect when client uses aws java sdk 1.11.* version

2020-06-18 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140160#comment-17140160 ] Sammi Chen edited comment on HDDS-3512 at 6/19/20, 3:24 AM: So

[jira] [Updated] (HDDS-3659) put a new file to exist key with different factor or type don't update the omkeyinfo

2020-06-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3659: - Target Version/s: 0.7.0 (was: 0.6.0) > put a new file to exist key with different factor or type don't up

[jira] [Commented] (HDDS-3554) Multipart Upload Failed because partName mismatch

2020-06-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17141720#comment-17141720 ] Sammi Chen commented on HDDS-3554: -- The issue is very hard to reproduce with latest maste

[jira] [Updated] (HDDS-3554) Multipart Upload Failed because partName mismatch

2020-06-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3554: - Priority: Major (was: Critical) > Multipart Upload Failed because partName mismatch > ---

[jira] [Updated] (HDDS-3554) Multipart Upload Failed because partName mismatch

2020-06-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3554: - Target Version/s: 0.7.0 (was: 0.6.0) > Multipart Upload Failed because partName mismatch > --

[jira] [Commented] (HDDS-3619) OzoneManager fails with IllegalArgumentException for cmdType RenameKey

2020-06-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17141728#comment-17141728 ] Sammi Chen commented on HDDS-3619: -- Hi, [~ljain], would you help to verify if it's covere

[jira] [Resolved] (HDDS-3823) Hadoop3 artifact should depend on the ozonefs-shaded

2020-06-22 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-3823. -- Fix Version/s: 0.6.0 Resolution: Fixed > Hadoop3 artifact should depend on the ozonefs-shaded > -

  1   2   3   4   5   >