[
https://issues.apache.org/jira/browse/HCATALOG-154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153077#comment-13153077
]
Francis Liu commented on HCATALOG-154:
--------------------------------------
The race condition is cause because the base getOutputLocation() method these
two subclasses share will return a path based on System.currentTimeInMillis(),
therefore calling the method twice in succession doesn't guarantee that they
will be the same, this is why our build is intermitently failing.
Writing out data for bulk load requires an intermediate format (in this case
sequenceFile) since the final outputformat HFileOutputFormat needs to be
written out with an MR job that uses a TotalOrderPartitioner. Since the job
upstream doesn't guarantee that, we will have to do it.
> HBase bulkOSD and directOSD return inconsistent path for getOutputLocation()
> ----------------------------------------------------------------------------
>
> Key: HCATALOG-154
> URL: https://issues.apache.org/jira/browse/HCATALOG-154
> Project: HCatalog
> Issue Type: Bug
> Components: hbase
> Affects Versions: 0.3
> Reporter: David Capwell
> Assignee: Francis Liu
> Labels: hbase
> Fix For: 0.3
>
> Attachments: HCATALOG-154.patch, HCATALOG-154_rev2.patch,
> HCATALOG-154_rev3.patch, HCATALOG-154_rev3_svn.patch
>
>
> org.apache.hcatalog.common.HCatException : 2001 : Error setting output
> information. Cause : java.io.IOException: bulkOSD and directOSD return
> inconsistent path for getOutputLocation()
> at
> org.apache.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:257)
> ...
> at java.lang.Thread.run(Thread.java:619)
> Caused by: java.io.IOException: bulkOSD and directOSD return inconsistent
> path for getOutputLocation()
> at
> org.apache.hcatalog.hbase.HBaseOutputStorageDriver.getOutputLocation(HBaseOutputStorageDriver.java:52)
> at
> org.apache.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:155)
> ... 24 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
