[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650894#comment-16650894 ] Zian Chen commented on YARN-8776: - Still work on refine the patch. Will update initial one

[jira] [Assigned] (YARN-8778) Add Command Line interface to invoke interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8778: --- Assignee: Eric Yang (was: Zian Chen) > Add Command Line interface to invoke interactive docker shell

[jira] [Commented] (YARN-8778) Add Command Line interface to invoke interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650892#comment-16650892 ] Zian Chen commented on YARN-8778: - Hi [~eyang], sure, please take this one. I'll assign it

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642220#comment-16642220 ] Zian Chen commented on YARN-8777: - +1 for patch 7.  > Container Executor C binary change

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642219#comment-16642219 ] Zian Chen commented on YARN-8763: - [~eyang], thanks for +1. Could you help me commit this

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.005.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Comment Edited] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640482#comment-16640482 ] Zian Chen edited comment on YARN-8763 at 10/6/18 12:01 AM: --- [~ey

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640482#comment-16640482 ] Zian Chen commented on YARN-8763: - [~eyang] sorry for getting back late. I'm curious why T

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638734#comment-16638734 ] Zian Chen commented on YARN-8777: - Hi [~eyang], thanks for patch 006. Seems we still have

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638730#comment-16638730 ] Zian Chen commented on YARN-8763: - [~eyang], just uploaded patch 004, please help review i

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.004.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638658#comment-16638658 ] Zian Chen commented on YARN-8763: - Thanks for the comments, Eric, I'll update the patch la

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636543#comment-16636543 ] Zian Chen commented on YARN-8763: - Hi [~eyang], could you help review patch 003? It addres

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.003.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634486#comment-16634486 ] Zian Chen commented on YARN-8763: - Hi [~eyang] , make sense.  I'll work on patch 003 to ad

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632636#comment-16632636 ] Zian Chen commented on YARN-8763: - Update patch-002 for review. really appreciate the help

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.002.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626601#comment-16626601 ] Zian Chen commented on YARN-8758: - Hi [~sunilg] [~weiweiyagn666], could you help review th

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8758: Attachment: YARN-8758.001.patch > PreemptionMessage when using AMRMClientAsync > ---

[jira] [Commented] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626513#comment-16626513 ] Zian Chen commented on YARN-8758: - I'll work on this Jira and provide an initial patch. >

[jira] [Assigned] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8758: --- Assignee: Zian Chen > PreemptionMessage when using AMRMClientAsync >

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624007#comment-16624007 ] Zian Chen commented on YARN-8785: - Hi [~simonprewo], thanks for the patch. The patch itsel

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623999#comment-16623999 ] Zian Chen commented on YARN-8777: - Thanks [~eyang] for the work. I'm ok with patch 003. On

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622555#comment-16622555 ] Zian Chen commented on YARN-8805: - Thanks [~shaneku...@gmail.com], I'll work on the patch

[jira] [Assigned] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8805: --- Assignee: Zian Chen > Automatically convert the launch command to the exec form when using > entrypo

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622499#comment-16622499 ] Zian Chen commented on YARN-8805: - Yes, just checked the latest released doc, [https://ha

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622495#comment-16622495 ] Zian Chen commented on YARN-8785: - Hi [~simonprewo], would you like to work on this Jira a

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622438#comment-16622438 ] Zian Chen commented on YARN-8801: - Thank you [~eyang] > java doc comments in docker-util.

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621350#comment-16621350 ] Zian Chen commented on YARN-8801: - Provide patch for the fix. Don't need to add UTs here.

[jira] [Updated] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8801: Labels: Docker (was: ) > java doc comments in docker-util.h is confusing >

[jira] [Created] (YARN-8801) java doc comments in docker-util.h is confusing

Zian Chen created YARN-8801: --- Summary: java doc comments in docker-util.h is confusing Key: YARN-8801 URL: https://issues.apache.org/jira/browse/YARN-8801 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8790) Authentication Filter change to force security check

Zian Chen created YARN-8790: --- Summary: Authentication Filter change to force security check Key: YARN-8790 URL: https://issues.apache.org/jira/browse/YARN-8790 Project: Hadoop YARN Issue Type: Sub

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619569#comment-16619569 ] Zian Chen commented on YARN-8777: - Hi [~eyang], thanks for the patch, some quick suggestio

[jira] [Resolved] (YARN-8781) back-port YARN-8091 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen resolved YARN-8781. - Resolution: Invalid > back-port YARN-8091 to branch-2.6.4 > --- > >

[jira] [Commented] (YARN-8781) back-port YARN-8091 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16616961#comment-16616961 ] Zian Chen commented on YARN-8781: - Close as invalid. > back-port YARN-8091 to branch-2.6.

[jira] [Commented] (YARN-8781) back-port YARN-8091 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16616416#comment-16616416 ] Zian Chen commented on YARN-8781: - Rework the YARN 8091 patch to fix conflicts with trunk

[jira] [Created] (YARN-8781) back-port YARN-8091 to branch-2.6.4

Zian Chen created YARN-8781: --- Summary: back-port YARN-8091 to branch-2.6.4 Key: YARN-8781 URL: https://issues.apache.org/jira/browse/YARN-8781 Project: Hadoop YARN Issue Type: Bug Affects Versi

[jira] [Updated] (YARN-8780) back-port YARN-8028 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8780: Attachment: YARN-8028-branch-2.6.4-001.patch > back-port YARN-8028 to branch-2.6.4 > ---

[jira] [Commented] (YARN-8780) back-port YARN-802 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16616409#comment-16616409 ] Zian Chen commented on YARN-8780: - Rework the YARN-8028 patch to fix conflicts with trunk

[jira] [Updated] (YARN-8780) back-port YARN-8028 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8780: Summary: back-port YARN-8028 to branch-2.6.4 (was: back-port YARN-802 to branch-2.6.4) > back-port YARN-80

[jira] [Created] (YARN-8780) back-port YARN-802 to branch-2.6.4

Zian Chen created YARN-8780: --- Summary: back-port YARN-802 to branch-2.6.4 Key: YARN-8780 URL: https://issues.apache.org/jira/browse/YARN-8780 Project: Hadoop YARN Issue Type: Bug Report

[jira] [Created] (YARN-8778) Add Command Line interface to invoke interactive docker shell

Zian Chen created YARN-8778: --- Summary: Add Command Line interface to invoke interactive docker shell Key: YARN-8778 URL: https://issues.apache.org/jira/browse/YARN-8778 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8777) Container Executor C binary change to execute interactive docker command

Zian Chen created YARN-8777: --- Summary: Container Executor C binary change to execute interactive docker command Key: YARN-8777 URL: https://issues.apache.org/jira/browse/YARN-8777 Project: Hadoop YARN

[jira] [Created] (YARN-8776) Container Executor change to create stdin/stdout pipeline

Zian Chen created YARN-8776: --- Summary: Container Executor change to create stdin/stdout pipeline Key: YARN-8776 URL: https://issues.apache.org/jira/browse/YARN-8776 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610186#comment-16610186 ] Zian Chen commented on YARN-8763: - Hi [~eyang], thanks for the detailed suggestions. Make

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609919#comment-16609919 ] Zian Chen commented on YARN-8763: - Hi [~eyang], could you help review the patch? Thanks!

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763-001.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609917#comment-16609917 ] Zian Chen commented on YARN-8763: - Provide initial patch for this. > Add WebSocket logic

[jira] [Created] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

Zian Chen created YARN-8763: --- Summary: Add WebSocket logic to the Node Manager web server to establish servlet Key: YARN-8763 URL: https://issues.apache.org/jira/browse/YARN-8763 Project: Hadoop YARN

[jira] [Updated] (YARN-8762) [Umbrella] Support Interactive Docker Shell to running Containers

[ https://issues.apache.org/jira/browse/YARN-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8762: Attachment: Interactive Docker Shell design doc.pdf > [Umbrella] Support Interactive Docker Shell to running

[jira] [Commented] (YARN-8762) [Umbrella] Support Interactive Docker Shell to running Containers

[ https://issues.apache.org/jira/browse/YARN-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609916#comment-16609916 ] Zian Chen commented on YARN-8762: - Provide design doc for this.  > [Umbrella] Support Int

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609914#comment-16609914 ] Zian Chen commented on YARN-8523: - Offline discussed with Eric and Wangda, this feature in

[jira] [Created] (YARN-8762) [Umbrella] Support Interactive Docker Shell to running Containers

Zian Chen created YARN-8762: --- Summary: [Umbrella] Support Interactive Docker Shell to running Containers Key: YARN-8762 URL: https://issues.apache.org/jira/browse/YARN-8762 Project: Hadoop YARN Is

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592307#comment-16592307 ] Zian Chen commented on YARN-8509: - Hi [~eepayne], sorry for getting back late. I took some

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588010#comment-16588010 ] Zian Chen commented on YARN-8509: - Fix failed UTs and re-upload the patch > Total pending

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.005.patch > Total pending resource calculation in preemption should use user-limit fac

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.004.patch > Total pending resource calculation in preemption should use user-limit fac

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16581573#comment-16581573 ] Zian Chen commented on YARN-8509: - Offline discussed with Eric and Wangda, will upload a n

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16578859#comment-16578859 ] Zian Chen commented on YARN-7417: - Hi [~eyang], thanks for the comments. I think we don't

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Attachment: YARN-7417.003.patch > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to

[jira] [Assigned] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8523: --- Assignee: Zian Chen > Interactive docker shell > > > Key: YA

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576945#comment-16576945 ] Zian Chen commented on YARN-8523: - Make sense. I'll work on provide an initial patch for t

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576917#comment-16576917 ] Zian Chen commented on YARN-7417: - But looks like we can make AggregatedLogFormat.Containe

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576900#comment-16576900 ] Zian Chen commented on YARN-8509: - Hi [~eepayne], sure, let address these two questions,

[jira] [Comment Edited] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573997#comment-16573997 ] Zian Chen edited comment on YARN-8509 at 8/10/18 9:21 PM: -- Hi Eri

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576815#comment-16576815 ] Zian Chen commented on YARN-7417: - Thanks for the review [~eyang], that was my original pl

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: This Jira is focus on refactor code for IndexedFileAggregatedLogsBlock and  TFileAggregatedLogs

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: This Jira is focus on refactor code for IndexedFileAggregatedLogsBlock We have duplicate code

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: We have duplicate code in current implementation of  IndexedFileAggregatedLogsBlock and  > re-f

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576697#comment-16576697 ] Zian Chen commented on YARN-8523: - Good point, I think we can make this Jira focus on buil

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573997#comment-16573997 ] Zian Chen commented on YARN-8509: - Hi Eric, thanks for the comments. Discussed with Wangda

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573946#comment-16573946 ] Zian Chen commented on YARN-8523: - [~eyang], thanks for raising this feature. This is very

[jira] [Comment Edited] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573946#comment-16573946 ] Zian Chen edited comment on YARN-8523 at 8/8/18 10:07 PM: -- [~eyan

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Summary: Total pending resource calculation in preemption should use user-limit factor instead of minimum-us

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570836#comment-16570836 ] Zian Chen commented on YARN-7417: - Update the patch 003 to address the findbugs issue. >

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570838#comment-16570838 ] Zian Chen commented on YARN-7417: - [~sunilg], could you help review the patch? Thanks > r

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Attachment: YARN-7417.002.patch > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to

[jira] [Commented] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570780#comment-16570780 ] Zian Chen commented on YARN-7089: - Hi [~leftnoteasy], could you help review this patch? Th

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Attachment: YARN-7417.001.patch > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568795#comment-16568795 ] Zian Chen commented on YARN-7417: - Thanks [~xgong] for report this issue. I'll work on it

[jira] [Assigned] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-7417: --- Assignee: Zian Chen > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to > re

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16566490#comment-16566490 ] Zian Chen commented on YARN-8509: - Thanks [~csingh] for the review. The failed UT are not

[jira] [Assigned] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-7089: --- Assignee: Zian Chen (was: Xuan Gong) > Mark the log-aggregation-controller APIs as public >

[jira] [Commented] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16565895#comment-16565895 ] Zian Chen commented on YARN-7089: - [~djp] [~xgong], [~rkanter] could you help review the p

[jira] [Updated] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7089: Attachment: YARN-7089.001.patch > Mark the log-aggregation-controller APIs as public > -

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.003.patch > Fix UserLimit calculation for preemption to balance scenario after queue

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16562513#comment-16562513 ] Zian Chen commented on YARN-8509: - Thanks [~csingh] for reviewing the patch. Fix the javad

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: (was: YARN-8509.003.patch) > Fix UserLimit calculation for preemption to balance scenario af

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.003.patch > Fix UserLimit calculation for preemption to balance scenario after queue

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558965#comment-16558965 ] Zian Chen commented on YARN-8522: - [~sunilg], could you help review the latest patch? > A

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558936#comment-16558936 ] Zian Chen commented on YARN-8509: - Update patch fixing failed UTs. > Fix UserLimit calcul

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.002.patch > Fix UserLimit calculation for preemption to balance scenario after queue

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Description: In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending resource

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558882#comment-16558882 ] Zian Chen commented on YARN-8509: - talked with [~sunilg], It can go beyond maxCap - usedCa

[jira] [Updated] (YARN-8522) Application fails with InvalidResourceRequestException

[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8522: Attachment: YARN-8522.002.patch > Application fails with InvalidResourceRequestException > -

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558870#comment-16558870 ] Zian Chen commented on YARN-8522: - Thanks for the suggestions [~sunilg], Update patch 002.

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554956#comment-16554956 ] Zian Chen commented on YARN-8509: - [~sunilg], I found something interesting while address

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16551467#comment-16551467 ] Zian Chen commented on YARN-8509: - [~sunilg], Let me address the failed UTs first. > Fix

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16551334#comment-16551334 ] Zian Chen commented on YARN-8509: - Upload first patch for review. [~sunilg],could you help

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.001.patch > Fix UserLimit calculation for preemption to balance scenario after queue

  1   2   3   4   >