[
https://issues.apache.org/jira/browse/HCATALOG-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418630#comment-13418630
]
Sushanth Sowmyan edited comment on HCATALOG-448 at 7/19/12 8:16 PM:
--------------------------------------------------------------------
Ok, on testing with just a 115MB file (6M records across 1000 partitions) on my
local mac, the difference in speed is between 1607 seconds vs 27 seconds. Not
to mention that my cpu was close to 100% usage for most of that time!
>From the code, it's obviously needed as well, the write() function should be
>as thin as possible.
Going ahead and committing this patch. Thanks all, this was a crucial patch!
was (Author: sushanth):
Ok, on testing with just a 115MB file (6M records across 1000 partitions)
on my local mac, the difference in speed is between 1607 seconds vs 2.7 seconds.
>From the code, it's obviously needed as well, the write() function should be
>as thin as possible.
Going ahead and committing this patch. Thanks all, this was a crucial patch!
> HCatStorer performance is 4x slower in HCat 0.4 than HCat 0.2
> -------------------------------------------------------------
>
> Key: HCATALOG-448
> URL: https://issues.apache.org/jira/browse/HCATALOG-448
> Project: HCatalog
> Issue Type: Bug
> Affects Versions: 0.4.1
> Reporter: Rohini Palaniswamy
> Assignee: Mithun Radhakrishnan
> Priority: Critical
> Attachments: hcatalog-448-for-0.4-codebase.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
