[ 
https://issues.apache.org/jira/browse/AMBARI-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555507#comment-14555507
 ] 

Alejandro Fernandez commented on AMBARI-11306:
----------------------------------------------

I verified the fix copied the tarballs from the right version.
{code}
su hdfs -c 'hdfs dfs -lsr -h /hdp/apps/2.3.0.0-2075/'
-r--r--r--   3 hdfs hadoop     91.4 M 2015-05-22 02:14 
/hdp/apps/2.3.0.0-2075/hive/hive.tar.gz
-r--r--r--   3 hdfs hadoop    198.1 M 2015-05-22 02:14 
/hdp/apps/2.3.0.0-2075/mapreduce/mapreduce.tar.gz
-r--r--r--   3 hdfs hadoop     92.6 M 2015-05-22 02:14 
/hdp/apps/2.3.0.0-2075/pig/pig.tar.gz
-r--r--r--   3 hdfs hadoop     15.1 M 2015-05-22 02:14 
/hdp/apps/2.3.0.0-2075/sqoop/sqoop.tar.gz
-r--r--r--   3 hdfs hadoop     41.6 M 2015-05-22 02:14 
/hdp/apps/2.3.0.0-2075/tez/tez.tar.gz

92M May 20 19:04 /usr/hdp/2.3.0.0-2075/hive/hive.tar.gz
199M May 20 18:25 /usr/hdp/2.3.0.0-2075/hadoop/mapreduce.tar.gz
93M May 20 19:10 /usr/hdp/2.3.0.0-2075/pig/pig.tar.gz
16M May 20 19:47 /usr/hdp/2.3.0.0-2075/sqoop/sqoop.tar.gz
42M May 20 18:57 /usr/hdp/2.3.0.0-2075/tez/lib/tez.tar.gz
{code}

> RU to copy correct version of tarball, including tez.tar.gz and 
> mapreduce.tar.gz
> --------------------------------------------------------------------------------
>
>                 Key: AMBARI-11306
>                 URL: https://issues.apache.org/jira/browse/AMBARI-11306
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.0.0
>            Reporter: Alejandro Fernandez
>            Assignee: Alejandro Fernandez
>             Fix For: 2.1.0
>
>
> We copy tarballs to HDFS in several places. The problem is that during 
> Resource Manager Start in RU it copies 
> /usr/hdp/current/tez-client/lib/tez.tar.gz to hdfs:///hdp/apps/{{ 
> hdp_stack_version }}/tez/
> for the hdp_stack_version value that comes from running "hdp-select status 
> hadoop-yarn-resourcemanager".
> So the destination is correct (uses the "to" version), but the source is 
> incorrect because the tez-client symlink is still pointing to the older 
> version, since tez-client only switches to the newer version when the Clients 
> are upgraded, which occurs later during the orchestration.
> The fix is that during RU, the source location of the tarballs must be 
> /usr/hdp/{{ hdp_version }}/component/tarball.tar.gz
> where {{ hdp_version }} is the version going to.
> Another problem is that during RU, HiveServer2 Start is not copying 
> mapreduce.tar.gz tarball to HDFS. In this Jira, we should also clean up the 
> tarball source and destination variables to come from a file instead of 
> configs in cluster-env.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to