[
https://issues.apache.org/jira/browse/CASSANDRA-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871124#action_12871124
]
Hudson commented on CASSANDRA-1050:
-----------------------------------
Integrated in Cassandra #445 (See
[http://hudson.zones.apache.org/hudson/job/Cassandra/445/])
Hadoop input format now uses the specified column family to figure out the
number of splits instead of the whole keyspace. Patch by johan, review by
jbellis. CASSANDRA-1050
> Too many splits for ColumnFamily with only a few rows
> -----------------------------------------------------
>
> Key: CASSANDRA-1050
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1050
> Project: Cassandra
> Issue Type: Bug
> Components: Hadoop
> Affects Versions: 0.6
> Reporter: Joost Ouwerkerk
> Assignee: Johan Oskarsson
> Fix For: 0.7
>
> Attachments: CASSANDRA-0.6-1050.patch, CASSANDRA-1050.patch
>
>
> ColumnFamilyInputFormat creates splits for the entire Keyspace. If one
> ColumnFamily has 100 Million rows and another has only 100 rows, the number
> of splits will be the 1,526 (assuming 64k rows per split) for either one,
> since it is based on the total number of unique keys across the whole
> keyspace, and not on the number of rows in the ColumnFamily.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
