[
https://issues.apache.org/jira/browse/VFS-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Nauroth updated VFS-530:
------------------------------
Attachment: winutils.exe
hadoop.dll
VFS-530-3.patch
Hello, [~b.eckenfels]. I work on Hadoop, and I had replied to your question to
the hdfs-dev list:
https://mail-archives.apache.org/mod_mbox/hadoop-hdfs-dev/201406.mbox/%3CCABCYYb8U0KUDZLZVgsZ6%3DDa9xfxOT1c9SC%3D5bcTmb-Q4CMi_%2Bw%40mail.gmail.com%3E
To summarize, we have a weakness in that the Apache releases don't yet bundle
the Windows native build artifacts, and I also think it will take a lot of work
(and possibly cause some problematic behavior) to try to provide a no-native
fallback code path.
I've had a chance to check out the Commons VFS code and experiment a bit, and I
have a suggestion to unblock the Windows tests for your new release. Would you
consider checking in the built binaries of winutils.exe and hadoop.dll and
adding pom.xml changes to reference these files during test runs? This would
be a quick and easy fix. The downside is that you may need to refresh these
builds later when you upgrade your Hadoop version again. This would only be
required if we add new native code. If Commons VFS doesn't have the
infrastructure to rebuild these Hadoop artifacts, then I or someone else from
the Hadoop community would be glad to help in your future versions.
I'm attaching 3 files. VFS-530-3.patch is almost the same as VFS-530-2.patch,
but adds configuration to maven-surefire-plugin so that test runs can find
winutils.exe and hadoop.dll. The winutils.exe and hadoop.dll are built from
the Apache Hadoop 2.4.0 source. These need to go in a new directory, core/bin,
and it's important that they get checked in with 755 permissions. I have the
whole change visible in a private GitHub branch here:
https://github.com/cnauroth/commons-vfs/tree/VFS-530
With these changes, I successfully ran {{HdfsFileProviderTest}} and
{{HdfsFileProviderTestCase}} on my Windows machine.
I hope this helps, and let me know if you have any other questions.
> Update HDFS to latest release in prep for VFS 2.1 release
> ---------------------------------------------------------
>
> Key: VFS-530
> URL: https://issues.apache.org/jira/browse/VFS-530
> Project: Commons VFS
> Issue Type: Task
> Affects Versions: 2.1
> Reporter: Dave Marion
> Fix For: 2.1
>
> Attachments: VFS-530-1.patch, VFS-530-2.patch, VFS-530-3.patch,
> hadoop.dll, winutils.exe
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
