[
https://issues.apache.org/jira/browse/CASSANDRA-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202107#comment-13202107
]
Samarth Gahire commented on CASSANDRA-3859:
-------------------------------------------
I think the getProgress() method you are talking about is not related to Hadoop
progress reporting.
We should implement the hadoop progress reporting to resolve this problem.
I guess {code}org.apache.hadoop.mapreduce.TaskAttemptContext.progress(){code}
is the method provided by Hadoop to report the progress.
I was trying to figure out the part of the code where it streams the sstables
to the cassandra and taking time.I will try to report progress from that part
of the code.Need your help to figure out the same.
> Add Progress Reporting to Cassandra SstableLoader for BulkOutputFormat
> ----------------------------------------------------------------------
>
> Key: CASSANDRA-3859
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3859
> Project: Cassandra
> Issue Type: Improvement
> Components: Hadoop, Tools
> Affects Versions: 1.1
> Reporter: Samarth Gahire
> Assignee: Brandon Williams
> Priority: Minor
> Labels: bulkloader, hadoop, mapreduce, sstableloader
> Fix For: 1.1
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> When we are using the BulkOutputFormat to load the data to cassandra. We
> should use the progress reporting to Hadoop Job within Sstable loader because
> while loading the data for particular task if streaming is taking more time
> and progress is not reported to Job it may kill the task with timeout
> exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
