[
https://issues.apache.org/jira/browse/PIG-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12784468#action_12784468
]
Chao Wang commented on PIG-1098:
--------------------------------
Ideally, should have a better structure for methods such as: advance(),
advanceCG(), getKey(), getCGKey(), getValue(), getCGValue() (ColumnGroup.java).
The only difference of new *CG* methods is that they do not do the check "if
(atEnd())". This gives some performance gain while degrading code readability a
bit.
Considering this is the first cut for performance improvement and all the above
changes are inside ColumnGroup class, which is package private, as a result,
these are Zebra's internal implementation details and we can safely improve
them in the future, overall +1
> [zebra] Zebra Performance Optimizations
> ---------------------------------------
>
> Key: PIG-1098
> URL: https://issues.apache.org/jira/browse/PIG-1098
> Project: Pig
> Issue Type: Improvement
> Reporter: Yan Zhou
> Assignee: Yan Zhou
> Priority: Minor
> Fix For: 0.6.0, 0.7.0
>
> Attachments: PIG-1098.patch
>
>
> Many in-core performance optimization opportunities exist in zebra, such as
> removal of redundant precautionary checks, use of better collection types to
> reduce levels of indirection to the memory objects, changing of input splits
> in ascending sizes to descending sizes. Observed improvements of wall clock
> time of some PIG LOAD queries are around 10%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
