[jira] [Updated] (HDFS-7332) Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.
[
https://issues.apache.org/jira/browse/HDFS-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lei (Eddy) Xu updated HDFS-7332:
Resolution: Duplicate
Status: Resolved (was: Patch Available)
> Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.
> -
>
> Key: HDFS-7332
> URL: https://issues.apache.org/jira/browse/HDFS-7332
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
>Affects Versions: 2.5.1
>Reporter: Lei (Eddy) Xu
>Assignee: Lei (Eddy) Xu
> Attachments: HDFS-7332.000.patch
>
>
> {{BlockPoolSliceScanner}} sorts {{BlockScanInfo}} by its {{lastScanTime}}.
> Each time, the scanner picks a {{BlockScanInfo}} with the smallest
> {{lastScanTime}} to scan and then updates its {{lastScanTime =
> Time.mononicNow()}}.
> Since the Jenkins test slave VM is usually rebooted for each job, the
> {{Time.mononicNow()}} in the VM returns a small number, which is smaller than
> the initial values of {{BlockScanInfo}}. Thus {{BlockPoolSliceScanner}} stops
> at the first block that has been scanned and could not finish scanning all
> blocks. The result of it is that
> {{TestMultipleNNDataBlockScanner#testDataBlockScanner}} times out due to
> unfinished scanning job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-7332) Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.
[
https://issues.apache.org/jira/browse/HDFS-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lei (Eddy) Xu updated HDFS-7332:
Attachment: HDFS-7332.000.patch
Use {{Timer}} to control the initial values of {{BlockScanInfo}} sorting keys
to make sure that {{timer.monotonicNow()}} is larger than any
{{BlockScanInfo#lastScanTime}} in {{BlockPoolSliceScanner#blockInfoSet}}.
Therefore, all existing blocks will be scanned once in
{{TestMultipleNNDataBlockScanner}}.
> Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.
> -
>
> Key: HDFS-7332
> URL: https://issues.apache.org/jira/browse/HDFS-7332
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
>Affects Versions: 2.5.1
>Reporter: Lei (Eddy) Xu
>Assignee: Lei (Eddy) Xu
> Attachments: HDFS-7332.000.patch
>
>
> {{BlockPoolSliceScanner}} sorts {{BlockScanInfo}} by its {{lastScanTime}}.
> Each time, the scanner picks a {{BlockScanInfo}} with the smallest
> {{lastScanTime}} to scan and then updates its {{lastScanTime =
> Time.mononicNow()}}.
> Since the Jenkins test slave VM is usually rebooted for each job, the
> {{Time.mononicNow()}} in the VM returns a small number, which is smaller than
> the initial values of {{BlockScanInfo}}. Thus {{BlockPoolSliceScanner}} stops
> at the first block that has been scanned and could not finish scanning all
> blocks. The result of it is that
> {{TestMultipleNNDataBlockScanner#testDataBlockScanner}} times out due to
> unfinished scanning job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-7332) Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.
[
https://issues.apache.org/jira/browse/HDFS-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lei (Eddy) Xu updated HDFS-7332:
Status: Patch Available (was: Open)
> Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.
> -
>
> Key: HDFS-7332
> URL: https://issues.apache.org/jira/browse/HDFS-7332
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
>Affects Versions: 2.5.1
>Reporter: Lei (Eddy) Xu
>Assignee: Lei (Eddy) Xu
> Attachments: HDFS-7332.000.patch
>
>
> {{BlockPoolSliceScanner}} sorts {{BlockScanInfo}} by its {{lastScanTime}}.
> Each time, the scanner picks a {{BlockScanInfo}} with the smallest
> {{lastScanTime}} to scan and then updates its {{lastScanTime =
> Time.mononicNow()}}.
> Since the Jenkins test slave VM is usually rebooted for each job, the
> {{Time.mononicNow()}} in the VM returns a small number, which is smaller than
> the initial values of {{BlockScanInfo}}. Thus {{BlockPoolSliceScanner}} stops
> at the first block that has been scanned and could not finish scanning all
> blocks. The result of it is that
> {{TestMultipleNNDataBlockScanner#testDataBlockScanner}} times out due to
> unfinished scanning job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
