[jira] [Created] (TEZ-3576) Tez UI: Add button to download list of log links under a DAG

2017-01-11 Thread Sreenath Somarajapuram (JIRA)
Sreenath Somarajapuram created TEZ-3576:
---

 Summary: Tez UI: Add button to download list of log links under a 
DAG
 Key: TEZ-3576
 URL: https://issues.apache.org/jira/browse/TEZ-3576
 Project: Apache Tez
  Issue Type: Bug
Reporter: Sreenath Somarajapuram
Assignee: Sreenath Somarajapuram


- Its hard to get all log files under a DAG for deep diving.
- As the logs could be very heavy in size it might not be ideal to download it 
via the UI.

- This ticket is to add a feature, that would collate links to all logs under a 
DAG, and provide user with the option to download that file from the UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (TEZ-3575) RM have started forwarding origin. Use that in AMWebController for CORS support

2017-01-11 Thread Sreenath Somarajapuram (JIRA)
Sreenath Somarajapuram created TEZ-3575:
---

 Summary: RM have started forwarding origin. Use that in 
AMWebController for CORS support
 Key: TEZ-3575
 URL: https://issues.apache.org/jira/browse/TEZ-3575
 Project: Apache Tez
  Issue Type: Bug
Reporter: Sreenath Somarajapuram
Assignee: Sreenath Somarajapuram


YARN-3148 added support for forwarding origin headers. AM can start using the 
same as avoid dependency on "tez-ui.history-url.base".
Probably as a fallback we can still use the configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (TEZ-3573) Allow user to cap number of task in cartesian product (unpartitioned case)

2017-01-11 Thread TezQA (JIRA)

[ 
https://issues.apache.org/jira/browse/TEZ-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819761#comment-15819761
 ] 

TezQA commented on TEZ-3573:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment
  http://issues.apache.org/jira/secure/attachment/12847127/TEZ-3573.2.patch
  against master revision d67faeb.

{color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2180//console

This message is automatically generated.

> Allow user to cap number of task in cartesian product (unpartitioned case)
> --
>
> Key: TEZ-3573
> URL: https://issues.apache.org/jira/browse/TEZ-3573
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Zhiyuan Yang
>Assignee: Zhiyuan Yang
> Attachments: TEZ-3573.1.patch, TEZ-3573.2.patch
>
>
> Auto grouping can help reduce #tasks in cartesian product but may still 
> result in too many tasks in case of huge input data. It will be useful for 
> user to cap #task, so that cartesian product won't abuse available resource. 
> The primary limiter will still be auto grouping, but this will be a hard 
> limit which cannot be exceeded anyway.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Failed: TEZ-3573 PreCommit Build #2180

2017-01-11 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3573
Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2180/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 21 lines...]
[PreCommit-TEZ-Build] $ /bin/bash /tmp/hudson2115603066752387558.sh
Running in Jenkins mode


==
==
Testing patch for TEZ-3573.
==
==


HEAD is now at d67faeb TEZ-3551: FrameworkClient created twice causing minor 
delay (rbalamohan)
Switched to branch 'master'
Your branch is up-to-date with 'origin/master'.
Current branch master is up to date.
TEZ-3573 patch is being downloaded at Thu Jan 12 01:09:00 UTC 2017 from
http://issues.apache.org/jira/secure/attachment/12847127/TEZ-3573.2.patch
The patch does not appear to apply with p0 to p2
PATCH APPLICATION FAILED




{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment
  http://issues.apache.org/jira/secure/attachment/12847127/TEZ-3573.2.patch
  against master revision d67faeb.

{color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2180//console

This message is automatically generated.


==
==
Adding comment to Jira.
==
==


Comment added.
e007d4d764468e982c0bf32948c45329df49e8b6 logged out


==
==
Finished build.
==
==


Build step 'Execute shell' marked build as failure
Archiving artifacts
[description-setter] Could not determine description.
Recording test results
ERROR: Step ?Publish JUnit test result report? failed: No test report files 
were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
No tests ran.

[jira] [Updated] (TEZ-3573) Allow user to cap number of task in cartesian product (unpartitioned case)

2017-01-11 Thread Zhiyuan Yang (JIRA)

 [ 
https://issues.apache.org/jira/browse/TEZ-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhiyuan Yang updated TEZ-3573:
--
Attachment: TEZ-3573.2.patch

Logging more info for debugging in new patch.

> Allow user to cap number of task in cartesian product (unpartitioned case)
> --
>
> Key: TEZ-3573
> URL: https://issues.apache.org/jira/browse/TEZ-3573
> Project: Apache Tez
>  Issue Type: Sub-task
>Reporter: Zhiyuan Yang
>Assignee: Zhiyuan Yang
> Attachments: TEZ-3573.1.patch, TEZ-3573.2.patch
>
>
> Auto grouping can help reduce #tasks in cartesian product but may still 
> result in too many tasks in case of huge input data. It will be useful for 
> user to cap #task, so that cartesian product won't abuse available resource. 
> The primary limiter will still be auto grouping, but this will be a hard 
> limit which cannot be exceeded anyway.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (TEZ-3574) Container reuse won't pickup extra dag level local resource

2017-01-11 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created TEZ-3574:
-

 Summary: Container reuse won't pickup extra dag level local 
resource
 Key: TEZ-3574
 URL: https://issues.apache.org/jira/browse/TEZ-3574
 Project: Apache Tez
  Issue Type: Bug
Reporter: Zhiyuan Yang
Assignee: Zhiyuan Yang


When a container gets reused, it is able to pick up additional vertex level 
local resource but never checks additional dag level local resource.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (TEZ-3571) Tez UI: Display a Total Timeline View for Hive Queries

2017-01-11 Thread Sreenath Somarajapuram (JIRA)

 [ 
https://issues.apache.org/jira/browse/TEZ-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sreenath Somarajapuram updated TEZ-3571:

Attachment: TEZ-3571.2.patch

Added changes to handle cases in which some perf logs could be missing in query 
data.

> Tez UI: Display a Total Timeline View for Hive Queries
> --
>
> Key: TEZ-3571
> URL: https://issues.apache.org/jira/browse/TEZ-3571
> Project: Apache Tez
>  Issue Type: Bug
>Reporter: Sreenath Somarajapuram
>Assignee: Sreenath Somarajapuram
> Attachments: TEZ-3571.1.patch, TEZ-3571.2.patch
>
>
> This view would visualize perfLogs, and gives a graphical representation of 
> whats happened while in the query.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (TEZ-3571) Tez UI: Display a Total Timeline View for Hive Queries

2017-01-11 Thread Sreenath Somarajapuram (JIRA)

 [ 
https://issues.apache.org/jira/browse/TEZ-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sreenath Somarajapuram updated TEZ-3571:

Attachment: TEZ-3571.1.patch

Attaching patch. Not marking submitted as this patch is depended on other 
patches under review.

> Tez UI: Display a Total Timeline View for Hive Queries
> --
>
> Key: TEZ-3571
> URL: https://issues.apache.org/jira/browse/TEZ-3571
> Project: Apache Tez
>  Issue Type: Bug
>Reporter: Sreenath Somarajapuram
>Assignee: Sreenath Somarajapuram
> Attachments: TEZ-3571.1.patch
>
>
> This view would visualize perfLogs, and gives a graphical representation of 
> whats happened while in the query.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (TEZ-3182) linux superuser use maven compile bower always fail

2017-01-11 Thread shenxianqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/TEZ-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

shenxianqiang resolved TEZ-3182.

Resolution: Won't Fix

> linux superuser use maven compile bower always fail
> ---
>
> Key: TEZ-3182
> URL: https://issues.apache.org/jira/browse/TEZ-3182
> Project: Apache Tez
>  Issue Type: Bug
>  Components: UI
>Affects Versions: 0.6.2, 0.8.2
> Environment: linux rh6
>Reporter: shenxianqiang
>Assignee: shenxianqiang
>Priority: Trivial
> Attachments: TEZ-3182.1.patch, TEZ-3182.4.patch, TEZ-3182.patch
>
>   Original Estimate: 96h
>  Remaining Estimate: 96h
>
> When I am root. Using 'mvn clean package -DskipTests=true' command always 
> fail.
> [INFO] --- exec-maven-plugin:1.3.2:exec (Bower install) @ tez-ui ---
> bower ESUDO Cannot be run with sudo
> Additional error details:
> Since bower is a user command, there is no need to execute it with superuser 
> permissions.
> If you're having permission errors when using bower without sudo, please 
> spend a few minutes learning more about how your system should work and make 
> any necessary repairs.
> http://www.joyent.com/blog/installing-node-and-npm
> https://gist.github.com/isaacs/579814
> You can however run a command with sudo using --allow-root option
> I have to modify pom.xml.Why not modify pom.xml in future?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)