Re: How to determine hdfs metadata upgrade complete in hadoop 3.0?

2020-05-21 Thread Debraj Manna
Anyone any thoughts on this? The same has been posted in StackOverflow
<https://stackoverflow.com/questions/61937247/how-to-determine-hdfs-metadata-upgrade-complete-in-hadoop-3-0>
also. But no update there also.


On Sat, May 2, 2020 at 6:13 PM Debraj Manna 
wrote:

> Hi
>
> I am upgrading from hadoop 2.6 to hadoop 3.0.
>
> In the process, I am upgrading HDFS metadata by executing the below
> command.
>
> sudo -u hdfs hdfs --daemon start namenode -upgrade -renameReserved
>
> I am not able to locate any upgradeProgress command. How can I determine
> that the metadata upgrade is complete?
>
> Thanks,
>


How to determine hdfs metadata upgrade complete in hadoop 3.0?

2020-05-02 Thread Debraj Manna
Hi

I am upgrading from hadoop 2.6 to hadoop 3.0.

In the process, I am upgrading HDFS metadata by executing the below
command.

sudo -u hdfs hdfs --daemon start namenode -upgrade -renameReserved

I am not able to locate any upgradeProgress command. How can I determine
that the metadata upgrade is complete?

Thanks,


Re: Hadoop 3.0 doesn't detect the correct conf folder

2018-01-05 Thread Allen Wittenauer
On 2017-12-21 00:25, Jeff Zhang  wrote: 
> I tried the hadoop 3.0, and can start dfs properly, but when I start yarn,
> it fails with the following error
> ERROR: Cannot find configuration directory
> "/Users/jzhang/Java/lib/hadoop-3.0.0/conf"
> 
> Actually, this is not the correct conf folder. It should be
> /Users/jzhang/Java/lib/hadoop-3.0.0/etc/hadoop.  hdfs could detect that
> correctly, but seems yarn couldn't, might be something wrong in yarn
> starting script.


This kind of weirdness is indicative of having YARN_CONF_DIR defined 
somewhere.
-
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
For additional commands, e-mail: user-h...@hadoop.apache.org



Hadoop 3.0 doesn't detect the correct conf folder

2017-12-21 Thread Jeff Zhang
I tried the hadoop 3.0, and can start dfs properly, but when I start yarn,
it fails with the following error
ERROR: Cannot find configuration directory
"/Users/jzhang/Java/lib/hadoop-3.0.0/conf"

Actually, this is not the correct conf folder. It should be
/Users/jzhang/Java/lib/hadoop-3.0.0/etc/hadoop.  hdfs could detect that
correctly, but seems yarn couldn't, might be something wrong in yarn
starting script.


Re: Hadoop 3.0

2017-07-10 Thread Sunil G
Yes. Latest changes in alpha-4 could be found here
http://hadoop.apache.org/docs/r3.0.0-alpha4/hadoop-project-dist/hadoop-common/release/3.0.0-alpha4/CHANGES.3.0.0-alpha4.html

- Sunil

On Sun, Jul 9, 2017 at 9:21 PM Hariharan  wrote:

> Some of the major changes are listed here:
> https://blog.cloudera.com/blog/2016/09/getting-to-know-the-apache-hadoop-3-alpha/
>
> You can also follow the release notes here:
> http://hadoop.apache.org/docs/r3.0.0-alpha1/hadoop-project-dist/hadoop-common/release/
>
> HTH,
> Hari
>
> On Sun, Jul 9, 2017 at 7:47 PM, sidharth kumar 
> wrote:
>
>> Hi,
>>
>> Is there any documentation through which we can know what are the changes
>> targeted in Hadoop 3.0
>>
>> Warm Regards
>>
>> Sidharth Kumar | Mob: +91 8197 555 599 <+91%2081975%2055599> / 7892 192
>> 367
>> LinkedIn:www.linkedin.com/in/sidharthkumar2792
>>
>>
>>
>>
>


Re: Hadoop 3.0

2017-07-09 Thread Hariharan
Some of the major changes are listed here:
https://blog.cloudera.com/blog/2016/09/getting-to-know-the-apache-hadoop-3-alpha/

You can also follow the release notes here:
http://hadoop.apache.org/docs/r3.0.0-alpha1/hadoop-project-dist/hadoop-common/release/

HTH,
Hari

On Sun, Jul 9, 2017 at 7:47 PM, sidharth kumar 
wrote:

> Hi,
>
> Is there any documentation through which we can know what are the changes
> targeted in Hadoop 3.0
>
> Warm Regards
>
> Sidharth Kumar | Mob: +91 8197 555 599 / 7892 192 367
> LinkedIn:www.linkedin.com/in/sidharthkumar2792
>
>
>
>


Hadoop 3.0

2017-07-09 Thread sidharth kumar
Hi,




Is there any documentation through which we can know what are the changes 
targeted in Hadoop 3.0




Warm Regards




Sidharth Kumar | Mob: +91 8197 555 599 / 7892 192 367 


LinkedIn:www.linkedin.com/in/sidharthkumar2792