[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12871719#action_12871719
]
Dirk Schmid commented on PIG-766:
-
{quote}1. Are you getting the exact same stack trace as
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12871046#action_12871046
]
Dirk Schmid commented on PIG-766:
-
Many memory changes went in. Please, reopen if this is
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12871253#action_12871253
]
Ashutosh Chauhan commented on PIG-766:
--
Dirk,
1. Are you getting the exact same stack
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699915#action_12699915
]
Vadim Zaliva commented on PIG-766:
--
I have 1Gb now, could not go any higher.
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699277#action_12699277
]
Vadim Zaliva commented on PIG-766:
--
increasing sort buffer to 500Mb did not work for me.
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699376#action_12699376
]
Vadim Zaliva commented on PIG-766:
--
I have increased it to 500Mb and it is still not enough.
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699427#action_12699427
]
Olga Natkovich commented on PIG-766:
I did not mean increasing combiner buffer size - I
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12698996#action_12698996
]
Alan Gates commented on PIG-766:
It isn't overall data size that matters. It is the size of a
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699000#action_12699000
]
Vadim Zaliva commented on PIG-766:
--
I have at most 17m rows in my dataset.
At some point I am
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699017#action_12699017
]
Olga Natkovich commented on PIG-766:
I asked a member of hadoop team to take a look. A
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699019#action_12699019
]
Olga Natkovich commented on PIG-766:
I got confirmation from Hadoop dev that this is a
[
https://issues.apache.org/jira/browse/PIG-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699026#action_12699026
]
Santhosh Srinivasan commented on PIG-766:
-
You can specify the I/O sort buffer size on
12 matches
Mail list logo
