[
https://issues.apache.org/jira/browse/CRUNCH-24?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421265#comment-13421265
]
Rahul Sharma commented on CRUNCH-24:
------------------------------------
It looks like the file did not got copied to cache but was there on local file
system on the machine. Then while loading the file, it could not be found in
job cache but was there on OS local path. This would work for local runners
but would break on clustered environment. At the first place the file should
have been copied to cache. This was the same issue reported when I ran the
system with Hadoop 2 version on my linux box.
> Make test suite suitable for continuous integration
> ---------------------------------------------------
>
> Key: CRUNCH-24
> URL: https://issues.apache.org/jira/browse/CRUNCH-24
> Project: Crunch
> Issue Type: Task
> Affects Versions: 0.3.0
> Reporter: Matthias Friedrich
> Assignee: Matthias Friedrich
> Fix For: 0.3.0
>
> Attachments: 0001-CRUNCH-24-Clean-up-test-suite-output.patch,
> 0001-CRUNCH-24-make-testsuite-sutable-for-CI.patch,
> 0001-CRUNCH-24-make-testsuite-sutable-for-CI.patch, CRUNCH-24-josh.patch
>
>
> Right now the integration test suite leaves about 80 files behind on /tmp
> making it unsuitable for a shared continuous integration environment.
> Examples for these files are test case output ("output*") and Crunch's own
> temporary files ("crunch*", see CRUNCH-21).
> We have to delete these files or make sure they aren't created on /tmp in the
> first place.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
