[jira] [Commented] (HBASE-20952) Re-visit the WAL API

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677639#comment-16677639 ] Ted Yu commented on HBASE-20952: >From https://builds.apache.org/job/HBase%20Nightly/job/HBASE-20952

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Patch Available (was: Open) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Open (was: Patch Available) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Patch Available (was: Open) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: (was: 21387.v9.txt) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v9.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Open (was: Patch Available) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Patch Available (was: Open) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677347#comment-16677347 ] Ted Yu commented on HBASE-21387: In 21387.v9.txt , I propose another approach. At the beginning

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v9.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Updated] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21247: --- Resolution: Fixed Fix Version/s: 2.1.2 2.2.0 Status: Resolved

[jira] [Commented] (HBASE-21347) Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677156#comment-16677156 ] Ted Yu commented on HBASE-21347: Josh: Please go ahead. > Backport HBASE-21200 "Memstore flush

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677152#comment-16677152 ] Ted Yu commented on SPARK-25954: Looking at Kafka thread, message from Satish indicated there may

[jira] [Updated] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21247: --- Attachment: HBASE-21247.branch-2.001.patch > Custom Meta WAL Provider doesn't default to custom

[jira] [Reopened] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-21247: > Custom Meta WAL Provider doesn't default to custom WAL Provider whose > configuration value is o

[jira] [Updated] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21247: --- Attachment: 21247.branch-2.patch > Custom Meta WAL Provider doesn't default to custom WAL Provider wh

[jira] [Updated] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21247: --- Status: Patch Available (was: Reopened) > Custom Meta WAL Provider doesn't default to custom WAL Provi

[jira] [Reopened] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-21247: > Custom Meta WAL Provider doesn't default to custom WAL Provider whose > configuration value is o

[jira] [Updated] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21247: --- Description: Currently all the WAL Providers acceptable to hbase are specified in Providers enum

[jira] [Updated] (HBASE-21247) Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21247: --- Summary: Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676977#comment-16676977 ] Ted Yu commented on HBASE-21387: In patch v9, I added shouldTrackPreviousRound to FileCleanerDelegate

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: two-pass-cleaner.v9.txt > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21381) Document the hadoop versions using which backup and restore feature works

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21381: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Commented] (HBASE-21347) Backport HBASE-21200 "Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner." to branch-1

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676052#comment-16676052 ] Ted Yu commented on HBASE-21347: lgtm > Backport HBASE-21200 "Memstore flush doesn't finish

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: two-pass-cleaner.v6.txt > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: (was: two-pass-cleaner.v6.txt) > Race condition surrounding in progress snapshot handl

[jira] [Comment Edited] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675900#comment-16675900 ] Ted Yu edited comment on HBASE-21387 at 11/6/18 12:47 AM: -- In two-pass

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: two-pass-cleaner.v6.txt > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: (was: two-pass-cleaner.v5.txt) > Race condition surrounding in progress snapshot handl

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675900#comment-16675900 ] Ted Yu commented on HBASE-21387: In two-pass-cleaner.v5.txt , the reference to previous round is changed

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: two-pass-cleaner.v5.txt > Race condition surrounding in progress snapshot handling in snaps

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675867#comment-16675867 ] Ted Yu commented on HBASE-21387: bq. holding onto file names in memory We don't need to continue

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675805#comment-16675805 ] Ted Yu commented on HBASE-21387: Solving the in progress snapshot race condition is tricky. Please take

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: two-pass-cleaner.v4.txt > Race condition surrounding in progress snapshot handling in snaps

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Open (was: Patch Available) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Commented] (HBASE-21381) Document the hadoop versions using which backup and restore feature works

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675762#comment-16675762 ] Ted Yu commented on HBASE-21381: liubang: 2.7.x and 2.8.y should be added as supported hadoop releases

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675738#comment-16675738 ] Ted Yu commented on HBASE-21387: Thanks for giving the timeline, Josh. The scenario you described

[jira] [Updated] (HBASE-21438) TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21438: --- Attachment: 21438.v1.txt > TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessi

[jira] [Commented] (HBASE-21438) TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675573#comment-16675573 ] Ted Yu commented on HBASE-21438: Ran TestAdmin2 with patch which passed. > TestAdmin2#testGetProcedu

[jira] [Updated] (HBASE-21438) TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21438: --- Status: Patch Available (was: Open) > TestAdmin2#testGetProcedures fails due to FailedProced

[jira] [Created] (HBASE-21438) TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible

2018-11-05 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21438: -- Summary: TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible Key: HBASE-21438 URL: https://issues.apache.org/jira/browse/HBASE-21438 Project: HBase

[jira] [Created] (HBASE-21438) TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible

2018-11-05 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21438: -- Summary: TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessible Key: HBASE-21438 URL: https://issues.apache.org/jira/browse/HBASE-21438 Project: HBase

[jira] [Commented] (HBASE-21381) Document the hadoop versions using which backup and restore feature works

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675530#comment-16675530 ] Ted Yu commented on HBASE-21381: lgtm > Document the hadoop versions using which backup and rest

[jira] [Comment Edited] (HBASE-21246) Introduce WALIdentity interface

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675528#comment-16675528 ] Ted Yu edited comment on HBASE-21246 at 11/5/18 6:20 PM: - In patch v24, I

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675528#comment-16675528 ] Ted Yu commented on HBASE-21246: In patch v24, I dropped the static methods from WALFactory

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.24.txt > Introduce WALIdentity interf

Re: [VOTE] Apache Ratis Thirdparty 0.1.0rc1

2018-11-05 Thread Ted Yu
+1 On Sat, Nov 3, 2018 at 10:51 PM Tsz Wo Sze wrote: > +1 > > - Verified the signature and checksums. > - Checked LICENSE, NOTICE and NOTICE in the gz and the jar files > - Checked file names -- all file in > > https://dist.apache.org/repos/dist/dev/incubator/ratis/thirdparty/0.1.0-rc1/ > have

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675458#comment-16675458 ] Ted Yu commented on HBASE-21246: replication-src-creates-wal-reader.jpg shows how WAL Reader is created

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: replication-src-creates-wal-reader.jpg > Introduce WALIdentity interf

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: wal-splitter-writer.jpg wal-splitter-reader.jpg > Introduce WALIdent

[jira] [Updated] (HBASE-21247) Custom WAL Provider cannot be specified by configuration whose value is outside the enums in Providers

2018-11-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21247: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the review, Sean and Josh

[jira] [Commented] (HBASE-21381) Document the hadoop versions using which backup and restore feature works

2018-11-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674650#comment-16674650 ] Ted Yu commented on HBASE-21381: {code} 61 * 3.2.0+ 62 * 2.9.2+ 63 * 3.0.4+ {code

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674432#comment-16674432 ] Ted Yu commented on HBASE-21387: Patch v8 adds a boolean, needToCheckInProgressSnapshots

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v8.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v7.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Patch Available (was: Open) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673793#comment-16673793 ] Ted Yu commented on HBASE-21387: In patch v6, I try to detect discrepancy w.r.t. the number

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v6.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673480#comment-16673480 ] Ted Yu commented on HBASE-21387: Currently refreshCache has void return type: {code} private

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673467#comment-16673467 ] Ted Yu commented on HBASE-21387: For the unit test, first idea is to use CountDownLatch to reproduce

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.dbg.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: (was: 21387.v1.txt) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673419#comment-16673419 ] Ted Yu commented on HBASE-21387: Josh, the race condition surrounding in progress snapshot is described

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Description: During recent report from customer where ExportSnapshot failed: {code} 2018-10-09 18:54:32,559

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Status: Open (was: Patch Available) > Race condition surrounding in progress snapshot handling in snaps

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673171#comment-16673171 ] Ted Yu commented on HBASE-21387: >From https://builds.apache.org/job/PreCommit-HBASE-Build/14932/cons

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672436#comment-16672436 ] Ted Yu commented on HBASE-21387: {code} [ERROR

[jira] [Comment Edited] (HBASE-21246) Introduce WALIdentity interface

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670472#comment-16670472 ] Ted Yu edited comment on HBASE-21246 at 11/2/18 12:27 AM: -- wal-providers.png

[jira] [Comment Edited] (HBASE-21246) Introduce WALIdentity interface

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670472#comment-16670472 ] Ted Yu edited comment on HBASE-21246 at 11/2/18 12:04 AM: -- wal-providers.png

[jira] [Comment Edited] (HBASE-21246) Introduce WALIdentity interface

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670472#comment-16670472 ] Ted Yu edited comment on HBASE-21246 at 11/1/18 11:58 PM: -- wal-providers.png

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672271#comment-16672271 ] Ted Yu commented on HBASE-21387: You're right - with the Filter in place, the check is not needed

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v3.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672246#comment-16672246 ] Ted Yu commented on HBASE-21387: Current code would include in progress snapshot(s): {code

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Summary: Race condition surrounding in progress snapshot handling in snapshot cache leads to loss

[jira] [Updated] (HBASE-21387) Race condition in snapshot cache refreshing leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v2.txt > Race condition in snapshot cache refreshing leads to loss of snapshot fi

[jira] [Updated] (HBASE-21387) Race condition in snapshot cache refreshing leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Description: During recent report from customer where ExportSnapshot failed: {code} 2018-10-09 18:54:32,559

[jira] [Commented] (HBASE-21387) Race condition in snapshot cache refreshing leads to loss of snapshot files

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672059#comment-16672059 ] Ted Yu commented on HBASE-21387: Thanks for the review, Josh. The cache was introduced by HBASE-6865

[jira] [Commented] (SOLR-7381) Improve Debuggability of SolrCloud using MDC

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671925#comment-16671925 ] Ted Yu commented on SOLR-7381: -- I was looking at MDCAwareFixedThreadPool and found this JIRA. I wonder

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671880#comment-16671880 ] Ted Yu commented on HBASE-21246: bq. Why as attachments to the issue and not integrated into design doc

[jira] [Comment Edited] (HBASE-21246) Introduce WALIdentity interface

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670472#comment-16670472 ] Ted Yu edited comment on HBASE-21246 at 11/1/18 5:03 PM: - wal-providers.png

[jira] [Comment Edited] (HBASE-21246) Introduce WALIdentity interface

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670472#comment-16670472 ] Ted Yu edited comment on HBASE-21246 at 11/1/18 4:26 PM: - wal-providers.png

[jira] [Commented] (HBASE-21418) Reduce a number of reseek operations in MemstoreScanner when seek point is close to the current row.

2018-11-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671750#comment-16671750 ] Ted Yu commented on HBASE-21418: For the new test, I ran it without the rest of the patch: {code

[jira] [Commented] (HBASE-21387) Race condition in snapshot cache refreshing leads to loss of snapshot files

2018-10-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671033#comment-16671033 ] Ted Yu commented on HBASE-21387: In the old code, to simulate the race condition, we can use

[jira] [Created] (SOLR-12950) Consolidate the comparator in IndexSizeTrigger#run

2018-10-31 Thread Ted Yu (JIRA)
Ted Yu created SOLR-12950: - Summary: Consolidate the comparator in IndexSizeTrigger#run Key: SOLR-12950 URL: https://issues.apache.org/jira/browse/SOLR-12950 Project: Solr Issue Type: Improvement

[jira] [Created] (SOLR-12949) metricTags Map in IndexSizeTrigger#run can be created outside the for loop

2018-10-31 Thread Ted Yu (JIRA)
Ted Yu created SOLR-12949: - Summary: metricTags Map in IndexSizeTrigger#run can be created outside the for loop Key: SOLR-12949 URL: https://issues.apache.org/jira/browse/SOLR-12949 Project: Solr

[jira] [Created] (HBASE-21416) Intermittent TestRegionInfoDisplay failure due to shift in relTime of RegionState#toDescriptiveString

2018-10-31 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21416: -- Summary: Intermittent TestRegionInfoDisplay failure due to shift in relTime of RegionState#toDescriptiveString Key: HBASE-21416 URL: https://issues.apache.org/jira/browse/HBASE-21416

[jira] [Created] (HBASE-21416) Intermittent TestRegionInfoDisplay failure due to shift in relTime of RegionState#toDescriptiveString

2018-10-31 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21416: -- Summary: Intermittent TestRegionInfoDisplay failure due to shift in relTime of RegionState#toDescriptiveString Key: HBASE-21416 URL: https://issues.apache.org/jira/browse/HBASE-21416

[jira] [Assigned] (HBASE-21381) Document the hadoop versions using which backup and restore feature works

2018-10-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-21381: -- Assignee: (was: Ted Yu) > Document the hadoop versions using which backup and restore feat

[jira] [Commented] (HBASE-21381) Document the hadoop versions using which backup and restore feature works

2018-10-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670811#comment-16670811 ] Ted Yu commented on HBASE-21381: Putting the supported version under http://hbase.apache.org/book.html

[jira] [Assigned] (HBASE-21381) Document the hadoop versions using which backup and restore feature works

2018-10-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-21381: -- Assignee: Ted Yu > Document the hadoop versions using which backup and restore feature wo

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-10-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670472#comment-16670472 ] Ted Yu commented on HBASE-21246: wal-providers.png is diagram for WALProvider related classes. wal

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-10-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: wal-providers.png wal-factory-providers.png > Introduce WALIdentity interf

[jira] [Updated] (HBASE-21387) Race condition in snapshot cache refreshing leads to loss of snapshot files

2018-10-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Labels: snapshot (was: ) > Race condition in snapshot cache refreshing leads to loss of snapshot fi

[jira] [Commented] (HBASE-21407) Resolve NPE in backup Master UI

2018-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669515#comment-16669515 ] Ted Yu commented on HBASE-21407: [~openinx]: Can you commit this patch ? Thanks > Resolve

[jira] [Commented] (HBASE-21407) Resolve NPE in backup Master UI

2018-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669505#comment-16669505 ] Ted Yu commented on HBASE-21407: lgtm > Resolve NPE in backup Master

[jira] [Created] (OMID-120) Utilize protobuf-maven-plugin for build

2018-10-30 Thread Ted Yu (JIRA)
Ted Yu created OMID-120: --- Summary: Utilize protobuf-maven-plugin for build Key: OMID-120 URL: https://issues.apache.org/jira/browse/OMID-120 Project: Apache Omid Issue Type: Improvement

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668955#comment-16668955 ] Ted Yu commented on HBASE-21246: bq. Missed push-down into WALProvider The push-down is implemented

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.23.txt > Introduce WALIdentity interf

[jira] [Commented] (RATIS-377) Tolerate partially written log header

2018-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/RATIS-377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668849#comment-16668849 ] Ted Yu commented on RATIS-377: -- bq. How could this be possible? May I know how the contents of HEADER_BYTES

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668840#comment-16668840 ] Ted Yu commented on HBASE-21246: bq. This is extracting the creation time, right? The start time

<    1   2   3   4   5   6   7   8   9   10   >