[jira] [Commented] (TEZ-1593) Refactor PipelinedSorter to remove all MMAP based ByteBuffer references

2015-01-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14281032#comment-14281032 ] Gopal V commented on TEZ-1593: -- +1. This made the sorted data movement scale tests go from 23m

[jira] [Updated] (TEZ-1593) Refactor PipelinedSorter to remove all MMAP based ByteBuffer references

2015-01-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1593: - Assignee: Rajesh Balamohan (was: Gopal V) > Refactor PipelinedSorter to remove all MMAP based ByteBuffer references

[jira] [Created] (TEZ-1971) test-patch script improvements to reduce email volume

2015-01-16 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1971: Summary: test-patch script improvements to reduce email volume Key: TEZ-1971 URL: https://issues.apache.org/jira/browse/TEZ-1971 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1970) Fix javadoc warnings in code

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1970: - Target Version/s: 0.6.1 > Fix javadoc warnings in code > > > Ke

[jira] [Commented] (TEZ-1970) Fix javadoc warnings in code

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280981#comment-14280981 ] Hitesh Shah commented on TEZ-1970: -- [WARNING] /home/jenkins/jenkins-slave/workspace/PreCom

[jira] [Comment Edited] (TEZ-1970) Fix javadoc warnings in code

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280981#comment-14280981 ] Hitesh Shah edited comment on TEZ-1970 at 1/16/15 11:20 PM: [WAR

[jira] [Created] (TEZ-1970) Fix javadoc warnings in code

2015-01-16 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-1970: Summary: Fix javadoc warnings in code Key: TEZ-1970 URL: https://issues.apache.org/jira/browse/TEZ-1970 Project: Apache Tez Issue Type: Bug Reporter: Hit

[jira] [Commented] (TEZ-1949) Whitelist TEZ_RUNTIME_OPTIMIZE_SHARED_FETCH for broadcast edges

2015-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280958#comment-14280958 ] Hadoop QA commented on TEZ-1949: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (TEZ-1941) Memory provided by *Context.getAvailableMemory needs to be setup explicitly

2015-01-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280784#comment-14280784 ] Siddharth Seth commented on TEZ-1941: - Thanks for the review. Committing. > Memory prov

[jira] [Updated] (TEZ-1949) Whitelist TEZ_RUNTIME_OPTIMIZE_SHARED_FETCH for broadcast edges

2015-01-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1949: - Attachment: TEZ-1949.3.patch Added the extra test. > Whitelist TEZ_RUNTIME_OPTIMIZE_SHARED_FETCH for broadcast edge

[jira] [Commented] (TEZ-1941) Memory provided by *Context.getAvailableMemory needs to be setup explicitly

2015-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280770#comment-14280770 ] Hadoop QA commented on TEZ-1941: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (TEZ-1941) Memory provided by *Context.getAvailableMemory needs to be setup explicitly

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280752#comment-14280752 ] Hitesh Shah commented on TEZ-1941: -- +1 ( pending test patch results ). > Memory provided b

[jira] [Updated] (TEZ-1931) Publish tez version info to Timeline

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1931: - Attachment: TEZ-1931.1.branch-0.5.patch Seems like a safe enough and useful option in case anyone wants to t

[jira] [Created] (TEZ-1969) Stop the DAGAppMaster when a local mode client is stopped

2015-01-16 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-1969: --- Summary: Stop the DAGAppMaster when a local mode client is stopped Key: TEZ-1969 URL: https://issues.apache.org/jira/browse/TEZ-1969 Project: Apache Tez Issue

[jira] [Commented] (TEZ-1661) LocalTaskScheduler hangs when shutdown

2015-01-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280718#comment-14280718 ] Siddharth Seth commented on TEZ-1661: - That's equivalent to changing the example - but s

[jira] [Updated] (TEZ-1941) Memory provided by *Context.getAvailableMemory needs to be setup explicitly

2015-01-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1941: Attachment: TEZ-1941.2.txt The ExecutionContext is supposed to be shared by multiple tasks within a JV

[jira] [Updated] (TEZ-1879) Create local UGI instances for each task and the AM, when running in LocalMode

2015-01-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-1879: Attachment: TEZ-1879.4.1.txt Thanks for the reviews. Attaching commit patch with amTokens renamed, and

[jira] [Commented] (TEZ-1942) Number of tasks show in Tez UI with auto-reduce parallelism is misleading

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280642#comment-14280642 ] Hitesh Shah commented on TEZ-1942: -- Committed to master and branch 0.6. [~pramachandran] T

[jira] [Commented] (TEZ-1942) Number of tasks show in Tez UI with auto-reduce parallelism is misleading

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280625#comment-14280625 ] Hitesh Shah commented on TEZ-1942: -- +1. Committing shortly. > Number of tasks show in

[jira] [Comment Edited] (TEZ-1661) LocalTaskScheduler hangs when shutdown

2015-01-16 Thread Oleg Zhurakousky (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280507#comment-14280507 ] Oleg Zhurakousky edited comment on TEZ-1661 at 1/16/15 5:38 PM: --

[jira] [Comment Edited] (TEZ-1661) LocalTaskScheduler hangs when shutdown

2015-01-16 Thread Oleg Zhurakousky (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280507#comment-14280507 ] Oleg Zhurakousky edited comment on TEZ-1661 at 1/16/15 5:11 PM: --

[jira] [Commented] (TEZ-1661) LocalTaskScheduler hangs when shutdown

2015-01-16 Thread Oleg Zhurakousky (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280507#comment-14280507 ] Oleg Zhurakousky commented on TEZ-1661: --- Here is the code to reproduce it: {code} publ

[jira] [Commented] (TEZ-1879) Create local UGI instances for each task and the AM, when running in LocalMode

2015-01-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280439#comment-14280439 ] Hitesh Shah commented on TEZ-1879: -- +1 > Create local UGI instances for each task and the

[jira] [Commented] (TEZ-1968) Tez UI - All vertices of DAG are not listed in vertices page

2015-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280424#comment-14280424 ] Hadoop QA commented on TEZ-1968: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (TEZ-1968) Tez UI - All vertices of DAG are not listed in vertices page

2015-01-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280420#comment-14280420 ] Jonathan Eagles commented on TEZ-1968: -- +1. Committed to master and branch-0.6 > Tez U

[jira] [Commented] (TEZ-1942) Number of tasks show in Tez UI with auto-reduce parallelism is misleading

2015-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280317#comment-14280317 ] Hadoop QA commented on TEZ-1942: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (TEZ-1968) Tez UI - All vertices of DAG are not listed in vertices page

2015-01-16 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280255#comment-14280255 ] Sreenath Somarajapuram commented on TEZ-1968: - +1 LGTM > Tez UI - All vertices

[jira] [Updated] (TEZ-1968) Tez UI - All vertices of DAG are not listed in vertices page

2015-01-16 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-1968: -- Priority: Blocker (was: Major) > Tez UI - All vertices of DAG are not listed in vertices

[jira] [Updated] (TEZ-1968) Tez UI - All vertices of DAG are not listed in vertices page

2015-01-16 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-1968: -- Target Version/s: 0.6.0 > Tez UI - All vertices of DAG are not listed in vertices page > -

[jira] [Updated] (TEZ-1968) Tez UI - All vertices of DAG are not listed in vertices page

2015-01-16 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-1968: -- Attachment: TEZ-1968.1.patch The list of vertexes are paginated. so it would appear in the

[jira] [Updated] (TEZ-1942) Number of tasks show in Tez UI with auto-reduce parallelism is misleading

2015-01-16 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-1942: -- Attachment: TEZ-1942.3.patch patch 3 * added test cases > Number of tasks show in Tez UI

[jira] [Assigned] (TEZ-1855) Avoid scanning for previously written files within Inputs / Outputs

2015-01-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-1855: - Assignee: Rajesh Balamohan > Avoid scanning for previously written files within Inputs / Ou

[jira] [Updated] (TEZ-1855) Avoid scanning for previously written files within Inputs / Outputs

2015-01-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1855: -- Attachment: TEZ-1855.1.patch [~sseth], [~gopalv] - Please review. > Avoid scanning for previously

[jira] [Assigned] (TEZ-1968) Tez UI - All vertices of DAG are not listed in vertices page

2015-01-16 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran reassigned TEZ-1968: - Assignee: Prakash Ramachandran > Tez UI - All vertices of DAG are not listed in ver

[jira] [Updated] (TEZ-1934) TestAMRecovery may fail due to the execution order is not determined

2015-01-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1934: Fix Version/s: 0.7.0 > TestAMRecovery may fail due to the execution order is not determined > ---

[jira] [Commented] (TEZ-1661) LocalTaskScheduler hangs when shutdown

2015-01-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280117#comment-14280117 ] Jeff Zhang commented on TEZ-1661: - committed to master > LocalTaskScheduler hangs when shut

[jira] [Commented] (TEZ-1934) TestAMRecovery may fail due to the execution order is not determined

2015-01-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280116#comment-14280116 ] Jeff Zhang commented on TEZ-1934: - committed to master > TestAMRecovery may fail due to the

[jira] [Commented] (TEZ-1593) Refactor PipelinedSorter to remove all MMAP based ByteBuffer references

2015-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14280059#comment-14280059 ] Hadoop QA commented on TEZ-1593: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (TEZ-1593) Refactor PipelinedSorter to remove all MMAP based ByteBuffer references

2015-01-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1593: -- Attachment: TEZ-1593.2.patch > Refactor PipelinedSorter to remove all MMAP based ByteBuffer refere

[jira] [Commented] (TEZ-1421) MRCombiner throws NPE in MapredWordCount on master branch

2015-01-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14279972#comment-14279972 ] Tsuyoshi OZAWA commented on TEZ-1421: - Feel free to contact me if you cannot reproduce t

[jira] [Assigned] (TEZ-391) SharedEdge - Support for passing same output from a vertex as input to two different vertices

2015-01-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-391: -- Assignee: Jeff Zhang > SharedEdge - Support for passing same output from a vertex as input to two > diffe