Nigel Daley wrote:
So shouldn't fixing this test to conform to the new model in HADOOP-1134
be the concern of the patch for HADOOP-1134? As it stand, I can't run
NNBench at scale without using a raw file system, which is what this
patch is intended to allow. HADOOP-928 caused this test to use a
ChecksumFileSystem and subsequently we saw our "read" TPS metric plummet
from 20,000 to a couple hundred.
Wow! this would be a good test for 1134. I didn't expect the TPS to be
so different. I would expect TPS to remain closer to 20000 with CRCs
with 1134
Raghu.
Let's get our current benchmark back on track before we commit
HADOOP-1134 (which will likely take a while before it is "Patch
Available").
On Mar 29, 2007, at 11:29 AM, Doug Cutting (JIRA) wrote:
[
https://issues.apache.org/jira/browse/HADOOP-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Cutting updated HADOOP-1180:
---------------------------------
Status: Open (was: Patch Available)
-1 This patch may be rendered obsolete by HADOOP-1134. And, the way
it is written, the 'useChecksum=false' mode will silently fail to work
once HADOOP-1134 is completed. So, if we feel we'll want to continue
to support this feature after HADOOP-1134, then we should add an
explicit way of constructing an HDFS FileSystem that does not perform
checksumming, rather than relying on 'instanceof ChecksumFileSystem'.
NNbench test should be able to test the checksumfilesystem as well as
the raw filesystem
----------------------------------------------------------------------------------------
Key: HADOOP-1180
URL: https://issues.apache.org/jira/browse/HADOOP-1180
Project: Hadoop
Issue Type: Bug
Components: dfs
Reporter: dhruba borthakur
Assigned To: dhruba borthakur
Attachments: nnbench.patch
The NNbench test should have the option of testing a file system with
checksums turned on and with checksums turned off. The original
behaviour of nnbench test was to test hdfs without checksums.
--This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
