[jira] [Commented] (HADOOP-15118) Change default classpath to be only shaded jars

2017-12-14 Thread Allen Wittenauer (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16291869#comment-16291869
 ] 

Allen Wittenauer commented on HADOOP-15118:
---

Ideally, yes. Also, just to clarify:

bq. give complete hdfs classpath?

This isn't a thing. There is no specific hdfs classpath.  hdfs classpath = yarn 
classpath = hadoop classpath

If we're going to break the world, that should get undone as well.  i.e., hdfs 
classpath really does return just what HDFS needs. In order to do that, we'd 
need to take the logic that we use to build the tools dependencies and apply it 
everywhere.  For example, 'hdfs namenode' would build the specific classpath 
for the NN.  'hdfs classpath' would build the specific classpath just for hdfs 
clients.  In the end, we'd likely break up the share directory even further.  
That's not a bad thing.

Things get tricky with tools like AWS, but we could treat it like we do now:  
everything gets them.

All that said, this is a project for 4.x.  And 3.x just got a release today.  
So we're looking at least 4 years out.

> Change default classpath to be only shaded jars
> ---
>
> Key: HADOOP-15118
> URL: https://issues.apache.org/jira/browse/HADOOP-15118
> Project: Hadoop Common
>  Issue Type: New Feature
>Reporter: Bharat Viswanadham
>Assignee: Bharat Viswanadham
>
> It would be desirable to change the default classpath to be just the shaded 
> jars.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-15118) Change default classpath to be only shaded jars

2017-12-14 Thread Bharat Viswanadham (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16291863#comment-16291863
 ] 

Bharat Viswanadham commented on HADOOP-15118:
-

Thank You [~aw] for your response.
So, now when users run we need to give classpath of only shaded jars, and have 
other option like --full(for example) to give complete hdfs classpath?

> Change default classpath to be only shaded jars
> ---
>
> Key: HADOOP-15118
> URL: https://issues.apache.org/jira/browse/HADOOP-15118
> Project: Hadoop Common
>  Issue Type: New Feature
>Reporter: Bharat Viswanadham
>Assignee: Bharat Viswanadham
>
> It would be desirable to change the default classpath to be just the shaded 
> jars.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org



[jira] [Commented] (HADOOP-15118) Change default classpath to be only shaded jars

2017-12-14 Thread Allen Wittenauer (JIRA)

[ 
https://issues.apache.org/jira/browse/HADOOP-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16291858#comment-16291858
 ] 

Allen Wittenauer commented on HADOOP-15118:
---

Linking HADOOP-13952 to show where we know tools that have external 
dependencies.  Any change here will impact that JIRA issue as well.

> Change default classpath to be only shaded jars
> ---
>
> Key: HADOOP-15118
> URL: https://issues.apache.org/jira/browse/HADOOP-15118
> Project: Hadoop Common
>  Issue Type: New Feature
>Reporter: Bharat Viswanadham
>Assignee: Bharat Viswanadham
>
> It would be desirable to change the default classpath to be just the shaded 
> jars.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org