[
https://issues.apache.org/jira/browse/TEZ-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415613#comment-15415613
]
Hitesh Shah commented on TEZ-3406:
----------------------------------
There are a bunch of issues with the docs:
- What is "grouping" in "Timeline with ACLs and Grouping" ?
- Please confirm that grouping support is indeed in Hadoop 2.7.2?
- Could you clarify what you mean by "By default, Tez writes its history data
into a file on HDFS." ? I am not sure if that is the case.
- What is "Yarn Timeline server v1.5" ? More details will help with reference
to YARN docs.
- "And you'll have to configure yarn to use TimelineEntityGroupPlugin by
specifying the following in yarn-site.xml" - how do the Tez plugin/class in
question get loaded by the YARN timeline daemon?
- "Optimization for Timeline server v1.5" - it might be good to explain the
basics of how Timeline v1.5 works or a reference to YARN docs followed by the
general problems/issues and then talk about optimizations/solutions
- "Reduce amount of data being logged:" - Isn't this a general problem and
not specific to timeline v1.5 ?
- "The valid values for this are:" - how will this be kept in sync with the
actual source?
- "you should ideally restrict it to about 3 unique values" - why 3? Say if
someone sets 5 or 10 values? What would be the perf overhead of 3 vs 5 vs 10?
Would the Timeline Server end up reading too much data? Are there any
recommendations on how someone should scale that number up or down to reduce
collisions and reduce perf overhead?
Some of the general design concepts could be covered on wiki with links to the
wiki from these docs. For that matter, most of this documentation can also go
to the wiki too.
> Documentation for history logging for tez.
> ------------------------------------------
>
> Key: TEZ-3406
> URL: https://issues.apache.org/jira/browse/TEZ-3406
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Harish Jaiprakash
> Assignee: Harish Jaiprakash
> Attachments: TEZ-3406.01.patch
>
>
> Document history logging configurations for Tez.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
