[
https://issues.apache.org/jira/browse/HADOOP-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16719546#comment-16719546
]
Brian Grunkemeyer commented on HADOOP-15998:
--------------------------------------------
The script was written assuming you could separate paths with a colon. It just
doesn't work on Windows when paths always start with something like C:\, or
where : is also used to access NTFS streams (ie,
c:\tmp\foo.txt:SeparateDataStream creates a different part of foo.txt that is
not visible to most tools, similar to Apple's resource fork and data fork in
files). Fortunately no one was using this feature of supporting multiple files
as input.
I don't see a good way of maintaining compatibility that isn't overly
complicated. Simply changing the input to the script is a lot simpler.
> Jar validation bash scripts don't work on Windows due to platform differences
> (colons in paths, \r\n)
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-15998
> URL: https://issues.apache.org/jira/browse/HADOOP-15998
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
> Affects Versions: 3.2.0, 3.3.0
> Environment: Windows 10
> Visual Studio 2017
> Reporter: Brian Grunkemeyer
> Priority: Blocker
> Labels: build, newbie, windows
> Fix For: 3.3.0
>
> Attachments: HADOOP-15998.v2.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> Building Hadoop fails on Windows due to a few shell scripts that make invalid
> assumptions:
> 1) Colon shouldn't be used to separate multiple paths in command line
> parameters. Colons occur in Windows paths.
> 2) Shell scripts that rely on running external tools need to deal with
> carriage return - line feed differences (lines ending in \r\n, not just \n)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
