[
https://issues.apache.org/jira/browse/CASSANDRA-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815352#comment-13815352
]
Jeremiah Jordan commented on CASSANDRA-6268:
--------------------------------------------
Double check you are using the right version of thrift for each one. A bunch
of the stuff in the original patch look like formatting changes.
> Poor performance of Hadoop if any DC is using VNodes
> ----------------------------------------------------
>
> Key: CASSANDRA-6268
> URL: https://issues.apache.org/jira/browse/CASSANDRA-6268
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop
> Reporter: Piotr Kołaczkowski
> Assignee: Piotr Kołaczkowski
> Attachments: 6268-2.txt, 6268-cassandra-2.0.txt
>
>
> Some customers are complaining about huge number of splits in Hadoop caused
> by VNodes. Disabling vnodes only in Hadoop DC does not fix it. Splits are
> generated from the results of describe_ring, which returns a huge number of
> ranges anyways, and doesn't take into account that there will be huge number
> of consecutive ranges residing on the nodes we'd like the M/R job to be run.
> The proposed fix:
> 1. allows for specifying the DC(s) the Hadoop job should be run in (in DSE -
> defaults to all Hadoop DCs)
> 2. merges consecutive ranges before generating Hadoop splits, so we don't
> have artificial range splitting caused by vnodes in the other DCs
> For non-DSE users this feature is turned off by default and doesn't change
> the old behaviour.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
