State of the docs

[Lefty Leverenz]

The backlog of Hive wikidoc tasks is large, and keeps on growing.

Jiras that need documentation:

   25 for releases 0.10, 0.11, and 0.12  (only 17 have TODOC labels)
   37 for release 0.13  (only 25 have TODOC13 label)
   99 for release 0.14  (only 72 have TODOC14 label)

Also:

 5 doc tasks not associated with jiras
   36 wish-list tasks (clarifications, new docs, improvements)
 ~10 tasks or projects not associated with email

These numbers are probably inaccurate but they give the general idea.

Lately I've been making progress at a rate of 1 or 2 per day.  I could do
more if I stopped monitoring the mailing lists, but then (a) we'd miss a
fair number of doc tasks, and (b) at best I might manage 4 a day.

Some doc tasks can and should be done by developers, but IMHO the bulk of
these tasks should be handled by tech writers.  My attempts to recruit more
volunteers have failed so far, although I'll keep trying.  Can we get some
corporate support for the Hive wiki?

-- Lefty

State of the docs

[Lefty Leverenz]

Here's the tally of Hive JIRA issues that need documentation, as determined
by TODOC labels:


   - 76 for 2.2 (master)
   - 12 for 2.1.1
   - 60 for 2.1
   - 64 for 2.0
   - 32 for 1.3
   - 49 for 1.2
   - 48 for 15 (1.1.0, also known as 0.15.0)
   -   5 for 1.0 (also known as 0.14.1)
   - 63 for 14 (0.14)
   - 21 for 13 (0.13)
   - 13 for 12 (0.12)
   -   9 for 11 (0.11)
   -   8 for 10 (0.10)

Grand total January 2017:460 issues need wikidoc
   March 2016:   353
   February 2015:  166

-- Lefty

Re: State of the docs

[Damien Carol]

I seen few inaccuracies in the wiki about some properties.

Just few questions, how to report it? To who?

For example, this page (1) say that property 
"hive.fetch.task.conversion" has default value of  "minimal".

But that's wrong.

(1) 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution


Regards,

Damien CAROL

 * tél : +33 (0)4 74 96 88 14
 * fax : +33 (0)4 74 96 31 88
 * email :dca...@blitzbs.com 

BLITZ BUSINESS SERVICE

Le 22/08/2014 09:50, Lefty Leverenz a écrit :

The backlog of Hive wikidoc tasks is large, and keeps on growing.

Jiras that need documentation:

25 for releases 0.10, 0.11, and 0.12  (only 17 have TODOC labels)
37 for release 0.13  (only 25 have TODOC13 label)
99 for release 0.14  (only 72 have TODOC14 label)

Also:

  5 doc tasks not associated with jiras
36 wish-list tasks (clarifications, new docs, improvements)
  ~10 tasks or projects not associated with email

These numbers are probably inaccurate but they give the general idea.

Lately I've been making progress at a rate of 1 or 2 per day.  I could do
more if I stopped monitoring the mailing lists, but then (a) we'd miss a
fair number of doc tasks, and (b) at best I might manage 4 a day.

Some doc tasks can and should be done by developers, but IMHO the bulk of
these tasks should be handled by tech writers.  My attempts to recruit more
volunteers have failed so far, although I'll keep trying.  Can we get some
corporate support for the Hive wiki?

-- Lefty

Re: State of the docs

[Lars Francke]

Damien,

thank you for contributing. You have multiple options. You can either
report documentation issues here on the mailinglist, you can create a JIRA
ticket or comment on an existing one or you could create an account on the
Wiki yourself and post a request for access on this mailing list. That way
you could edit the documentation yourself.

For the specific issue you reported. This has recently been changed in this
ticket:  and as you can
see Lefty already left a comment there that it needs to be documented on
release of Hive 0.14.

Cheers,
Lars


On Fri, Aug 22, 2014 at 10:59 AM, Damien Carol  wrote:

>  I seen few inaccuracies in the wiki about some properties.
>
> Just few questions, how to report it? To who?
>
> For example, this page (1) say that property "hive.fetch.task.conversion"
> has default value of  "minimal".
> But that's wrong.
>
> (1)
> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution
>
> Regards,
>
>  Damien CAROL
>
>- tél : +33 (0)4 74 96 88 14
>- fax : +33 (0)4 74 96 31 88
>- email : dca...@blitzbs.com
>
> BLITZ BUSINESS SERVICE
>  Le 22/08/2014 09:50, Lefty Leverenz a écrit :
>
> The backlog of Hive wikidoc tasks is large, and keeps on growing.
>
> Jiras that need documentation:
>
>25 for releases 0.10, 0.11, and 0.12  (only 17 have TODOC labels)
>37 for release 0.13  (only 25 have TODOC13 label)
>99 for release 0.14  (only 72 have TODOC14 label)
>
> Also:
>
>  5 doc tasks not associated with jiras
>36 wish-list tasks (clarifications, new docs, improvements)
>  ~10 tasks or projects not associated with email
>
> These numbers are probably inaccurate but they give the general idea.
>
> Lately I've been making progress at a rate of 1 or 2 per day.  I could do
> more if I stopped monitoring the mailing lists, but then (a) we'd miss a
> fair number of doc tasks, and (b) at best I might manage 4 a day.
>
> Some doc tasks can and should be done by developers, but IMHO the bulk of
> these tasks should be handled by tech writers.  My attempts to recruit more
> volunteers have failed so far, although I'll keep trying.  Can we get some
> corporate support for the Hive wiki?
>
> -- Lefty
>
>
>
>

Re: State of the docs

[Lefty Leverenz]

Those to-do statistics paint a grim picture, so here's some doc-done data
as an offset.

By my incomplete & error-prone records, collectively we're averaging 0.94
doc tasks per day over the last year.  Bump that up a bit if you count each
HCat and WebHCat wikidoc separately.  Bump it down for duplicate records.
Bump it back up for tasks I did on the fly, without email records.

That's 336 tasks done vs. 212 on the to-do list (99 for 0.14, 36 lower
priority wish-list) roughly speaking.

What, me worry?

-- Lefty


On Fri, Aug 22, 2014 at 7:17 PM, Lars Francke 
wrote:

> Damien,
>
> thank you for contributing. You have multiple options. You can either
> report documentation issues here on the mailinglist, you can create a JIRA
> ticket or comment on an existing one or you could create an account on the
> Wiki yourself and post a request for access on this mailing list. That way
> you could edit the documentation yourself.
>
> For the specific issue you reported. This has recently been changed in
> this ticket:  and as you
> can see Lefty already left a comment there that it needs to be documented
> on release of Hive 0.14.
>
> Cheers,
> Lars
>
>
> On Fri, Aug 22, 2014 at 10:59 AM, Damien Carol  wrote:
>
>>  I seen few inaccuracies in the wiki about some properties.
>>
>> Just few questions, how to report it? To who?
>>
>> For example, this page (1) say that property "hive.fetch.task.conversion"
>> has default value of  "minimal".
>> But that's wrong.
>>
>> (1)
>> https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution
>>
>> Regards,
>>
>>  Damien CAROL
>>
>>- tél : +33 (0)4 74 96 88 14
>>- fax : +33 (0)4 74 96 31 88
>>- email : dca...@blitzbs.com
>>
>> BLITZ BUSINESS SERVICE
>>  Le 22/08/2014 09:50, Lefty Leverenz a écrit :
>>
>> The backlog of Hive wikidoc tasks is large, and keeps on growing.
>>
>> Jiras that need documentation:
>>
>>25 for releases 0.10, 0.11, and 0.12  (only 17 have TODOC labels)
>>37 for release 0.13  (only 25 have TODOC13 label)
>>99 for release 0.14  (only 72 have TODOC14 label)
>>
>> Also:
>>
>>  5 doc tasks not associated with jiras
>>36 wish-list tasks (clarifications, new docs, improvements)
>>  ~10 tasks or projects not associated with email
>>
>> These numbers are probably inaccurate but they give the general idea.
>>
>> Lately I've been making progress at a rate of 1 or 2 per day.  I could do
>> more if I stopped monitoring the mailing lists, but then (a) we'd miss a
>> fair number of doc tasks, and (b) at best I might manage 4 a day.
>>
>> Some doc tasks can and should be done by developers, but IMHO the bulk of
>> these tasks should be handled by tech writers.  My attempts to recruit more
>> volunteers have failed so far, although I'll keep trying.  Can we get some
>> corporate support for the Hive wiki?
>>
>> -- Lefty
>>
>>
>>
>>
>

State of the docs (with contributor list)

[Lefty Leverenz]

Here's the current tally of JIRA issues that need documentation, as
determined by TODOC labels:

   - 39 TODOC15 (aka 1.1.0) -- unreleased
   - 5 TODOC1.0 (aka 0.14.1)
   -

   70 TODOC14
   -

   25 TODOC13
   -

   12 TODOC12
   -

   8 TODOC11
   -

   7 TODOC10

Those include a few open issues, such as doc issues and one umbrella issue
for which all subtasks are fixed.

Not counting 1.1.0, these issues are assigned to 50 contributors plus
*unassigned*.  They don't all have to be documented by assignee, but
perhaps assignees could suggest documenters for issues they won't document
themselves.  So here's a JIRA filter sorted by assignee

.

As an extra nudge, here's a list of the number of issues per person:

Alan Gates - 1
Anthony Hsu - 1
Ashutosh Chauhan - 2
Bing Li - 1
Carl Steinbach - 1
Chaoyu Tang - 1
Chinna Rao Lalam - 1
Daniel Weeks - 1
Deepesh Khandelwal - 1
Dong Chen - 1
Dr. Wendell Urth - 1
Edward Capriolo - 4
Eugene Koifman - 4
Ferdinand Xu - 1
Gang Tim Liu - 1
Gopal V - 1
Gunther Hagleitner - 3
Harish Butani - 9
Jason Dere - 5
Jean Xu - 1
Kevin Wilfong - 1
Laljo John Pullokkaran - 1
Lefty Leverenz - 1
Mark Wagner - 1
Mithun Radhakrishnan - 1
Mohammad Kamrul Islam - 1
Namit Jain - 3
Naveen Gangam - 1
Navis - 11
Nick Dimiduk - 2
Pengcheng Xiong - 2
Prasad Mujumdar - 2
Remus Rusanu - 1
Rui Li - 1
Samuel Yuan - 1
Satish Mittal - 1
Sergey Shelukhin - 2
Shanyu Zhao - 1
Shreepadma Venugopalan - 2
Shuaishuai Nie - 3
Suma Shivaprasad - 1
Sushanth Sowmyan - 2
Swarnim Kulkarni - 3
Ted Xu - 1
Thejas M Nair - 9
Travis Crawford - 1
Vaibhav Gumashta - 13
Xiaobing Zhou - 2
Xuefu Zhang - 5
Zhenxiao Luo - 3
*Unassigned* - 4

Thanks and kudos to everyone who has contributed to the Hive documentation
so far!

-- Lefty

Re: State of the docs (with contributor list)

[Gopal Vijayaraghavan]

Hi Lefty,

Can you add me to the Hive docs edit permissions?

Cheers,
Gopal

On 2/25/15, 8:32 PM, "Lefty Leverenz"  wrote:

>Here's the current tally of JIRA issues that need documentation, as
>determined by TODOC labels:
>
>   - 39 TODOC15 (aka 1.1.0) -- unreleased
>   - 5 TODOC1.0 (aka 0.14.1)
>   -
>
>   70 TODOC14
>   -
>
>   25 TODOC13
>   -
>
>   12 TODOC12
>   -
>
>   8 TODOC11
>   -
>
>   7 TODOC10
>
>Those include a few open issues, such as doc issues and one umbrella issue
>for which all subtasks are fixed.
>
>Not counting 1.1.0, these issues are assigned to 50 contributors plus
>*unassigned*.  They don't all have to be documented by assignee, but
>perhaps assignees could suggest documenters for issues they won't document
>themselves.  So here's a JIRA filter sorted by assignee
>abels%20in%20(TODOC10%2C%20TODOC11%2C%20TODOC12%2C%20TODOC13%2C%20TODOC1.0
>%2C%20TODOC14)%20ORDER%20BY%20assignee%20ASC>
>.
>
>As an extra nudge, here's a list of the number of issues per person:
>
>Alan Gates - 1
>Anthony Hsu - 1
>Ashutosh Chauhan - 2
>Bing Li - 1
>Carl Steinbach - 1
>Chaoyu Tang - 1
>Chinna Rao Lalam - 1
>Daniel Weeks - 1
>Deepesh Khandelwal - 1
>Dong Chen - 1
>Dr. Wendell Urth - 1
>Edward Capriolo - 4
>Eugene Koifman - 4
>Ferdinand Xu - 1
>Gang Tim Liu - 1
>Gopal V - 1
>Gunther Hagleitner - 3
>Harish Butani - 9
>Jason Dere - 5
>Jean Xu - 1
>Kevin Wilfong - 1
>Laljo John Pullokkaran - 1
>Lefty Leverenz - 1
>Mark Wagner - 1
>Mithun Radhakrishnan - 1
>Mohammad Kamrul Islam - 1
>Namit Jain - 3
>Naveen Gangam - 1
>Navis - 11
>Nick Dimiduk - 2
>Pengcheng Xiong - 2
>Prasad Mujumdar - 2
>Remus Rusanu - 1
>Rui Li - 1
>Samuel Yuan - 1
>Satish Mittal - 1
>Sergey Shelukhin - 2
>Shanyu Zhao - 1
>Shreepadma Venugopalan - 2
>Shuaishuai Nie - 3
>Suma Shivaprasad - 1
>Sushanth Sowmyan - 2
>Swarnim Kulkarni - 3
>Ted Xu - 1
>Thejas M Nair - 9
>Travis Crawford - 1
>Vaibhav Gumashta - 13
>Xiaobing Zhou - 2
>Xuefu Zhang - 5
>Zhenxiao Luo - 3
>*Unassigned* - 4
>
>Thanks and kudos to everyone who has contributed to the Hive documentation
>so far!
>
>-- Lefty

Re: State of the docs (with contributor list)

[Lefty Leverenz]

Sure thing Gopal, but to give you edit permission I'll need your Confluence
ID (see
https://cwiki.apache.org/confluence/display/Hive/AboutThisWiki#AboutThisWiki-Howtogetpermissiontoedit
).

Thanks for asking.

-- Lefty

On Wed, Feb 25, 2015 at 9:46 PM, Gopal Vijayaraghavan 
wrote:

> Hi Lefty,
>
> Can you add me to the Hive docs edit permissions?
>
> Cheers,
> Gopal
>
> On 2/25/15, 8:32 PM, "Lefty Leverenz"  wrote:
>
> >Here's the current tally of JIRA issues that need documentation, as
> >determined by TODOC labels:
> >
> >   - 39 TODOC15 (aka 1.1.0) -- unreleased
> >   - 5 TODOC1.0 (aka 0.14.1)
> >   -
> >
> >   70 TODOC14
> >   -
> >
> >   25 TODOC13
> >   -
> >
> >   12 TODOC12
> >   -
> >
> >   8 TODOC11
> >   -
> >
> >   7 TODOC10
> >
> >Those include a few open issues, such as doc issues and one umbrella issue
> >for which all subtasks are fixed.
> >
> >Not counting 1.1.0, these issues are assigned to 50 contributors plus
> >*unassigned*.  They don't all have to be documented by assignee, but
> >perhaps assignees could suggest documenters for issues they won't document
> >themselves.  So here's a JIRA filter sorted by assignee
> ><
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20HIVE%20AND%20l
> >abels%20in%20(TODOC10%2C%20TODOC11%2C%20TODOC12%2C%20TODOC13%2C%20TODOC1.0
> >%2C%20TODOC14)%20ORDER%20BY%20assignee%20ASC>
> >.
> >
> >As an extra nudge, here's a list of the number of issues per person:
> >
> >Alan Gates - 1
> >Anthony Hsu - 1
> >Ashutosh Chauhan - 2
> >Bing Li - 1
> >Carl Steinbach - 1
> >Chaoyu Tang - 1
> >Chinna Rao Lalam - 1
> >Daniel Weeks - 1
> >Deepesh Khandelwal - 1
> >Dong Chen - 1
> >Dr. Wendell Urth - 1
> >Edward Capriolo - 4
> >Eugene Koifman - 4
> >Ferdinand Xu - 1
> >Gang Tim Liu - 1
> >Gopal V - 1
> >Gunther Hagleitner - 3
> >Harish Butani - 9
> >Jason Dere - 5
> >Jean Xu - 1
> >Kevin Wilfong - 1
> >Laljo John Pullokkaran - 1
> >Lefty Leverenz - 1
> >Mark Wagner - 1
> >Mithun Radhakrishnan - 1
> >Mohammad Kamrul Islam - 1
> >Namit Jain - 3
> >Naveen Gangam - 1
> >Navis - 11
> >Nick Dimiduk - 2
> >Pengcheng Xiong - 2
> >Prasad Mujumdar - 2
> >Remus Rusanu - 1
> >Rui Li - 1
> >Samuel Yuan - 1
> >Satish Mittal - 1
> >Sergey Shelukhin - 2
> >Shanyu Zhao - 1
> >Shreepadma Venugopalan - 2
> >Shuaishuai Nie - 3
> >Suma Shivaprasad - 1
> >Sushanth Sowmyan - 2
> >Swarnim Kulkarni - 3
> >Ted Xu - 1
> >Thejas M Nair - 9
> >Travis Crawford - 1
> >Vaibhav Gumashta - 13
> >Xiaobing Zhou - 2
> >Xuefu Zhang - 5
> >Zhenxiao Luo - 3
> >*Unassigned* - 4
> >
> >Thanks and kudos to everyone who has contributed to the Hive documentation
> >so far!
> >
> >-- Lefty
>
>
>