[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Attachment: patch-787-1-ydist.txt Patch updates streaming doc, missed in earlier patch. -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.21.0 Attachments: patch-787-1-ydist.txt, patch-787-1.txt, patch-787-2.txt, patch-787-3.txt, patch-787-3.txt, patch-787-ydist.txt, patch-787-ydist.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Attachment: patch-787-ydist.txt Patch for Yahoo! distribution security branch. -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.21.0 Attachments: patch-787-1.txt, patch-787-2.txt, patch-787-3.txt, patch-787-3.txt, patch-787-ydist.txt, patch-787-ydist.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated MAPREDUCE-787: - Resolution: Fixed Fix Version/s: 0.21.0 Release Note: Fix JobSubmitter to honor user given symlink in the path. Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I just committed this to 0.21 and trunk. Thanks Amareshwari. -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Fix For: 0.21.0 Attachments: patch-787-1.txt, patch-787-2.txt, patch-787-3.txt, patch-787-3.txt, patch-787-ydist.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Status: Open (was: Patch Available) -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787-2.txt, patch-787-3.txt, patch-787-ydist.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Status: Patch Available (was: Open) -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787-2.txt, patch-787-3.txt, patch-787-3.txt, patch-787-ydist.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Attachment: patch-787-3.txt Re-submitting the same patch for hudson, since the common jars will be picked up from maven. -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787-2.txt, patch-787-3.txt, patch-787-3.txt, patch-787-ydist.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Status: Open (was: Patch Available) -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Status: Patch Available (was: Open) -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787-2.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Attachment: patch-787-2.txt Patch incorporates comments 2 and 3. bq. In TaskDistributedCacheManager.makeCacheFiles, I think we should compare URI's instead of paths This looks like an intrusive change. This would require more public apis to changes. Can be done in different jira. -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787-2.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Attachment: patch-787-1.txt Updated forrest documentation -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Status: Open (was: Patch Available) -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Status: Patch Available (was: Open) -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787-1.txt, patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Attachment: patch-787.txt Patch fixes JobSubmitter to understand URI for -files, -archives option. Also fixed a minor bug in TaskDistributedCacheManager. Updated the testcase TestCommandLineJobSubmission to test the above. -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-787) -files, -archives should honor user given symlink path
[ https://issues.apache.org/jira/browse/MAPREDUCE-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-787: -- Status: Patch Available (was: Open) -files, -archives should honor user given symlink path -- Key: MAPREDUCE-787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-787 Project: Hadoop Map/Reduce Issue Type: Bug Components: client Reporter: Amareshwari Sriramadasu Assignee: Amareshwari Sriramadasu Attachments: patch-787.txt Currently, if user gives an option such as -files hdfs://host:fs_port/user/testfile.txt#testlink The symlink name testlink is not honored. It alwasys creates symlink with name testfile.txt in cwd of the task. If the user has given a symlink name, it should be honored. If no symlink-name is given, then the path.getName() can be used. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
