[jira] [Commented] (TEZ-870) LocalContainerLauncher improvement

2014-08-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082365#comment-14082365 ] Chen He commented on TEZ-870: - I can answer the last question. Local mode does not reuse

[jira] [Comment Edited] (TEZ-870) LocalContainerLauncher improvement

2014-08-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082365#comment-14082365 ] Chen He edited comment on TEZ-870 at 8/1/14 3:43 PM: - I can answer the

[jira] [Updated] (TEZ-1359) SimpleMRProcessor commit should handle IO/Interrupted exceptions

2014-08-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1359: Description: The commit should have some retries against RPC IO exceptions. Interrupted exceptions should

[jira] [Updated] (TEZ-1359) SimpleMRProcessor commit should handle IO/Interrupted exceptions

2014-08-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1359: Summary: SimpleMRProcessor commit should handle IO/Interrupted exceptions (was: SimpleMRProcessor commit

[jira] [Created] (TEZ-1359) SimpleMRProcessor commit should handle IO exceptions

2014-08-01 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1359: --- Summary: SimpleMRProcessor commit should handle IO exceptions Key: TEZ-1359 URL: https://issues.apache.org/jira/browse/TEZ-1359 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1351) Need to invoke isCommitRequired inside MROutput.commit()

2014-08-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1351: Attachment: TEZ-1351.1.patch [~daijy] can you please try out this patch and see if it works for you. Need

[jira] [Created] (TEZ-1361) Move SimpleMRProcessor into runtime-library

2014-08-01 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-1361: --- Summary: Move SimpleMRProcessor into runtime-library Key: TEZ-1361 URL: https://issues.apache.org/jira/browse/TEZ-1361 Project: Apache Tez Issue Type: Sub-task

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1065: Attachment: Tez-1065.patch DAGStatus.getVertexStatus and other vertex related API's should maintain

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082534#comment-14082534 ] Jeff Zhang commented on TEZ-1065: - Attach the patch. DAGStatus.getVertexStatus and other

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1065: Attachment: Tez-1065-2.patch Update the patch. ( Missing apache header in the previous patch )

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082543#comment-14082543 ] Jeff Zhang commented on TEZ-1065: - Attach the patch. [~bikassaha] Please help review it.

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

2014-08-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1065: Priority: Major (was: Blocker) DAGStatus.getVertexStatus and other vertex related API's should maintain

[jira] [Assigned] (TEZ-1057) Replace interfaces with abstract classes for Processor/Input/Output classes

2014-08-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-1057: --- Assignee: Bikas Saha (was: Mohammad Kamrul Islam) Replace interfaces with abstract classes for

[jira] [Assigned] (TEZ-1041) Use VertexLocationHint consistently everywhere in the API

2014-08-01 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-1041: --- Assignee: Bikas Saha (was: Rekha Joshi) Use VertexLocationHint consistently everywhere in the API

[jira] [Updated] (TEZ-870) LocalContainerLauncher improvement

2014-08-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-870: --- Attachment: TEZ-870.2.txt Updated patch with the review comments addressed. Verified that mkdir is not

[jira] [Commented] (TEZ-1337) Handling of local-dirs for Local Mode

2014-08-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082788#comment-14082788 ] Chen He commented on TEZ-1337: -- Sounds good to me. I am working on this and will attach patch

[jira] [Commented] (TEZ-1342) tez.am.client.am.port-range not taking effect

2014-08-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082916#comment-14082916 ] Siddharth Seth commented on TEZ-1342: - +1. Committing. Thanks [~zjffdu]

[jira] [Commented] (TEZ-1317) Simplify MRinput/MROutput configuration

2014-08-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082972#comment-14082972 ] Siddharth Seth commented on TEZ-1317: - Comments. - Should MRInputConfigurer be a proper

[jira] [Commented] (TEZ-1355) Only read host and port for OnFileSortedOutput and OnFileUnorderedKVOutput when data is generated

2014-08-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082980#comment-14082980 ] Siddharth Seth commented on TEZ-1355: - +1. Looks good. Thanks [~jeagles] Only read

[jira] [Created] (TEZ-1365) Session mode and ignore-lib-uris needs to be set for session mode

2014-08-01 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-1365: --- Summary: Session mode and ignore-lib-uris needs to be set for session mode Key: TEZ-1365 URL: https://issues.apache.org/jira/browse/TEZ-1365 Project: Apache Tez

[jira] [Commented] (TEZ-1343) Bypass the Fetcher and read directly from the local filesystem if source vertex ran on the same host

2014-08-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083325#comment-14083325 ] Siddharth Seth commented on TEZ-1343: - TEZ-1365 fixes the problems that [~daijy]

[jira] [Commented] (TEZ-684) Uber/Local modes for Tez

2014-08-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083337#comment-14083337 ] Siddharth Seth commented on TEZ-684: Once TEZ-1343 goes in (it's almost ready - patch

[jira] [Assigned] (TEZ-1360) Provide vertex parallelism to each vertex task

2014-08-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned TEZ-1360: Assignee: Gopal V Provide vertex parallelism to each vertex task