[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-26 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Attachment: HADOOP-11553-06.patch

-06:
* Fixed those spelling errors

Thanks for the reviews, btw. :)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch, 
 HADOOP-11553-05.patch, HADOOP-11553-06.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-26 Thread Chris Nauroth (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Nauroth updated HADOOP-11553:
---
Hadoop Flags: Incompatible change,Reviewed  (was: Incompatible change)

+1 for patch v06.  Thank you for the documentation, Allen.

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch, 
 HADOOP-11553-05.patch, HADOOP-11553-06.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-26 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
   Resolution: Fixed
Fix Version/s: 3.0.0
   Status: Resolved  (was: Patch Available)

This has been committed to trunk.

Thanks for the review!

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: New Feature
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Fix For: 3.0.0

 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch, 
 HADOOP-11553-05.patch, HADOOP-11553-06.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-26 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Issue Type: New Feature  (was: Improvement)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: New Feature
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch, 
 HADOOP-11553-05.patch, HADOOP-11553-06.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-24 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Attachment: HADOOP-11553-04.patch

-04:
* toc on the API guide
* integration into site index
* minor typo fixed in do_classpath
* minor cleanup in the shell guide

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-24 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Status: Patch Available  (was: Open)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-24 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Status: Open  (was: Patch Available)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-24 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Attachment: HADOOP-11553-05.patch

-05:
* Address [~cnauroth]'s feedback (I think)
* shelldocs.py: added the extremely obvious --skipprnorep option to prevent 
private + not replaceable functions from being output'ed


 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch, 
 HADOOP-11553-05.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-24 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Status: Patch Available  (was: Open)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch, 
 HADOOP-11553-05.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-24 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Status: Open  (was: Patch Available)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch, HADOOP-11553-04.patch, 
 HADOOP-11553-05.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-21 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Release Note: Python is now required to build the documentation.
Hadoop Flags: Incompatible change

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-21 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Attachment: HADOOP-11553-03.patch

-03:
* Integrate shelldocmd.py into the build process.
* Fix up some minor problems in pom.xml
* shelldocmd.py now takes options, builds a toc, minor formatting fixes
* moar dox

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-21 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Status: Patch Available  (was: Open)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch, HADOOP-11553-03.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-19 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Component/s: documentation

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-19 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Attachment: HADOOP-11553-02.patch

-02:
* reformatted documentation in the hadoop-functions.sh
* shelldocmd.py


shelldocmd.py is like my first, from scratch python program. It is a 
javadoc-inspired markdown documentation generator for shell code.  I have no 
idea how to integrate this into Maven however so that we get nice shell 
function docs so will definitely be looking for help there.

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation, scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch, 
 HADOOP-11553-02.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-18 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Attachment: HADOOP-11553-01.patch

-01:
* start of some docs

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch, HADOOP-11553-01.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-17 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Attachment: HADOOP-11553-00.patch

-00:
* Initial patch, code-level only

This patch doesn't change any functions but does:

* puts a stability level, param, etc, comment in front of every function, in a 
kind of a fake javadoc format
* re-arranges hadoop-functions to be grouped by those stability levels

Some things I'm looking for here:

* Are these the right settings for these functions?  Too liberal? Too 
conservative?
* Is re-arranging the right thing to do?

I recognize that the last point isn't something we normally do, breaks patches, 
etc, etc. However, in the case of the shell code, since there is one big file 
rather than multiple, I think it would be useful for others reading this file.  
It forces the most interesting functions closer to the top of a very big file.

To-do:
* Write all the docs (function hint guide, shell profile docs, .hadooprc, etc, 
etc)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker
 Attachments: HADOOP-11553-00.patch


 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-11553) Formalize the shell API

2015-03-17 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated HADOOP-11553:
--
Priority: Blocker  (was: Major)

 Formalize the shell API
 ---

 Key: HADOOP-11553
 URL: https://issues.apache.org/jira/browse/HADOOP-11553
 Project: Hadoop Common
  Issue Type: Improvement
  Components: scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Assignee: Allen Wittenauer
Priority: Blocker

 After HADOOP-11485, we need to formally document functions and environment 
 variables that 3rd parties can expect to be able to exist/use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)