[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542698 ] Hudson commented on HADOOP-2172: Integrated in Hadoop-Nightly #303 (See [http://lucene.zones.apache.org:8080/hudson

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542293 ] Hadoop QA commented on HADOOP-2172: --- +1 overall. Here are the results of testing the latest attachment http://is

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-13 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542242 ] Raghu Angadi commented on HADOOP-2172: -- >> Only correction needed there is that return value of 0 from fis.read

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-09 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541394 ] Hairong Kuang commented on HADOOP-2172: --- I took a look at BufferedFSInputStream. It is quite hard to implement

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-09 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541389 ] Hairong Kuang commented on HADOOP-2172: --- Yes, DFS and any ChecksumFileSystem like LocalFileSystem all already

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-09 Thread Johan Oskarsson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541290 ] Johan Oskarsson commented on HADOOP-2172: - If the cache is moved to local filesystem only I assume the dfs a

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541191 ] Raghu Angadi commented on HADOOP-2172: -- > The patch looks good. But personally I'd like to cache the file posit

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541190 ] Hairong Kuang commented on HADOOP-2172: --- The patch looks good. But personally I'd like to cache the file posit

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541159 ] Doug Cutting commented on HADOOP-2172: -- > So the file position is cached in FSInputChecker. The stack traces I

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541147 ] Raghu Angadi commented on HADOOP-2172: -- > I take it you're voting for caching in local FS? pretty much. I was

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541144 ] Hairong Kuang commented on HADOOP-2172: --- LocalFileSystem is a ChecksumFileSystem. So the file position is cach

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541142 ] Doug Cutting commented on HADOOP-2172: -- Raghu: I take it you're voting for caching in local FS? Another place

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541140 ] Raghu Angadi commented on HADOOP-2172: -- I was going to write the following at the same time as above comment :

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541130 ] Hadoop QA commented on HADOOP-2172: --- +1 overall. Here are the results of testing the latest attachment http://is

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541110 ] Doug Cutting commented on HADOOP-2172: -- The claim in particular (from IRC) is that random access to a MapFile s