Re: HDFS Overwriting undo
Hi, The command to check if the file exists recursively is hadoop fs -lsr Vinod On Mon, Jun 2, 2014 at 12:40 AM, Amjad ALSHABANI wrote: > Hello Ashish, > > Unfortunately,I got this error when running the commande you provided: > > pns@app11:~$ hadoop fs -ls -lrt /user/hive/warehouse > -ls: Illegal option -lrt > Usage: hadoop fs [generic options] -ls [-d] [-h] [-R] [ ...] > > > > On Sun, Jun 1, 2014 at 8:17 PM, Ashish Garg > wrote: > >> Try this command: >> hadoop fs -ls -lrt /user/hive/warehouse/ >> >> Regards. >> >> >> On Fri, May 30, 2014 at 6:10 AM, Amjad ALSHABANI >> wrote: >> >>> Hello Everybody, >>> >>> I know that this question may concern Hadoop list but i ve made this >>> mistake when using Hive. >>> I created new database giving the location on HDFS but i found that it >>> removed all other data that exist already. >>> >>> = >>> before creation, the directory on HDFS contains : >>> pns@app11:~$ hadoop fs -ls /user/hive/warehouse >>> Found 25 items >>> drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 >>> */user/hive/warehouse/*dfy_ans_autres >>> drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 >>> /user/hive/warehouse/dfy_ans_maillog >>> drwxr-xr-x - user1 supergroup 0 2013-11-20 14:28 >>> /user/hive/warehouse/dfy_cnx >>> drwxr-xr-x - user2 supergroup 0 2014-05-30 06:05 >>> /user/hive/warehouse/pns.db >>> drwxr-xr-x - user2 supergroup 0 2014-02-24 17:00 >>> /user/hive/warehouse/pns_fr_integ >>> drwxr-xr-x - user2 supergroup 0 2014-05-06 15:33 >>> /user/hive/warehouse/pns_logstat.db >>> >>> >>> hive -e "CREATE DATABASE my_stats LOCATION 'hdfs://:9000 >>> */user/hive/warehouse/*mystats.db'" >>> >>> but now I couldn't see the other directories on HDFS: >>> >>> pns@app11:~/aalshabani$ hls /user/hive/warehouse >>> Found 1 items >>> drwxr-xr-x - user2 supergroup 0 2014-05-30 11:37 >>> */user/hive/warehouse*/mystats.db >>> >>> >>> Is there anyway I could restore the other data?? >>> >>> >>> Best regards. >>> >>> Amjad >>> >>> >>> >>> >> >
Re: HDFS Overwriting undo
hive -e "CREATE DATABASE my_stats LOCATION 'hdfs://:9000 */user/hive/warehouse/*mystats.db'" This command should be like as follows: hive -e 'Create Database my_stats' you do not need to specify the location because the default location of database is the warehouse directory. On Mon, Jun 2, 2014 at 3:57 AM, Amjad ALSHABANI wrote: > I think it is worth to mention that I tried doing this before on locally > deployed HDFS and it went well. > > So my question now, what has gone wrong with creation database with given > location?? > > > thanx for your rplies > > Amjad > > > On Mon, Jun 2, 2014 at 9:50 AM, Siddharth Tiwari < > siddharth.tiw...@live.com> wrote: > >> Sorry Amzad, I am afraid u can't >> >> Sent from my iPhone >> >> On May 30, 2014, at 3:12 AM, "Amjad ALSHABANI" >> wrote: >> >> Hello Everybody, >> >> I know that this question may concern Hadoop list but i ve made this >> mistake when using Hive. >> I created new database giving the location on HDFS but i found that it >> removed all other data that exist already. >> >> = >> before creation, the directory on HDFS contains : >> pns@app11:~$ hadoop fs -ls /user/hive/warehouse >> Found 25 items >> drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 >> */user/hive/warehouse/*dfy_ans_autres >> drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 >> /user/hive/warehouse/dfy_ans_maillog >> drwxr-xr-x - user1 supergroup 0 2013-11-20 14:28 >> /user/hive/warehouse/dfy_cnx >> drwxr-xr-x - user2 supergroup 0 2014-05-30 06:05 >> /user/hive/warehouse/pns.db >> drwxr-xr-x - user2 supergroup 0 2014-02-24 17:00 >> /user/hive/warehouse/pns_fr_integ >> drwxr-xr-x - user2 supergroup 0 2014-05-06 15:33 >> /user/hive/warehouse/pns_logstat.db >> >> >> hive -e "CREATE DATABASE my_stats LOCATION 'hdfs://:9000 >> */user/hive/warehouse/*mystats.db'" >> >> but now I couldn't see the other directories on HDFS: >> >> pns@app11:~/aalshabani$ hls /user/hive/warehouse >> Found 1 items >> drwxr-xr-x - user2 supergroup 0 2014-05-30 11:37 >> */user/hive/warehouse*/mystats.db >> >> >> Is there anyway I could restore the other data?? >> >> >> Best regards. >> >> Amjad >> >> >> >> >
Re: HDFS Overwriting undo
I think it is worth to mention that I tried doing this before on locally deployed HDFS and it went well. So my question now, what has gone wrong with creation database with given location?? thanx for your rplies Amjad On Mon, Jun 2, 2014 at 9:50 AM, Siddharth Tiwari wrote: > Sorry Amzad, I am afraid u can't > > Sent from my iPhone > > On May 30, 2014, at 3:12 AM, "Amjad ALSHABANI" > wrote: > > Hello Everybody, > > I know that this question may concern Hadoop list but i ve made this > mistake when using Hive. > I created new database giving the location on HDFS but i found that it > removed all other data that exist already. > > = > before creation, the directory on HDFS contains : > pns@app11:~$ hadoop fs -ls /user/hive/warehouse > Found 25 items > drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 > */user/hive/warehouse/*dfy_ans_autres > drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 > /user/hive/warehouse/dfy_ans_maillog > drwxr-xr-x - user1 supergroup 0 2013-11-20 14:28 > /user/hive/warehouse/dfy_cnx > drwxr-xr-x - user2 supergroup 0 2014-05-30 06:05 > /user/hive/warehouse/pns.db > drwxr-xr-x - user2 supergroup 0 2014-02-24 17:00 > /user/hive/warehouse/pns_fr_integ > drwxr-xr-x - user2 supergroup 0 2014-05-06 15:33 > /user/hive/warehouse/pns_logstat.db > > > hive -e "CREATE DATABASE my_stats LOCATION 'hdfs://:9000 > */user/hive/warehouse/*mystats.db'" > > but now I couldn't see the other directories on HDFS: > > pns@app11:~/aalshabani$ hls /user/hive/warehouse > Found 1 items > drwxr-xr-x - user2 supergroup 0 2014-05-30 11:37 > */user/hive/warehouse*/mystats.db > > > Is there anyway I could restore the other data?? > > > Best regards. > > Amjad > > > >
Re: HDFS Overwriting undo
Sorry Amzad, I am afraid u can't Sent from my iPhone > On May 30, 2014, at 3:12 AM, "Amjad ALSHABANI" wrote: > > Hello Everybody, > > I know that this question may concern Hadoop list but i ve made this mistake > when using Hive. > I created new database giving the location on HDFS but i found that it > removed all other data that exist already. > > = > before creation, the directory on HDFS contains : > pns@app11:~$ hadoop fs -ls /user/hive/warehouse > Found 25 items > drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 > /user/hive/warehouse/dfy_ans_autres > drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 > /user/hive/warehouse/dfy_ans_maillog > drwxr-xr-x - user1 supergroup 0 2013-11-20 14:28 > /user/hive/warehouse/dfy_cnx > drwxr-xr-x - user2 supergroup 0 2014-05-30 06:05 > /user/hive/warehouse/pns.db > drwxr-xr-x - user2 supergroup 0 2014-02-24 17:00 > /user/hive/warehouse/pns_fr_integ > drwxr-xr-x - user2 supergroup 0 2014-05-06 15:33 > /user/hive/warehouse/pns_logstat.db > > > hive -e "CREATE DATABASE my_stats LOCATION > 'hdfs://:9000/user/hive/warehouse/mystats.db'" > > but now I couldn't see the other directories on HDFS: > > pns@app11:~/aalshabani$ hls /user/hive/warehouse > Found 1 items > drwxr-xr-x - user2 supergroup 0 2014-05-30 11:37 > /user/hive/warehouse/mystats.db > > > Is there anyway I could restore the other data?? > > > Best regards. > > Amjad > > >
Re: HDFS Overwriting undo
Hello Ashish, Unfortunately,I got this error when running the commande you provided: pns@app11:~$ hadoop fs -ls -lrt /user/hive/warehouse -ls: Illegal option -lrt Usage: hadoop fs [generic options] -ls [-d] [-h] [-R] [ ...] On Sun, Jun 1, 2014 at 8:17 PM, Ashish Garg wrote: > Try this command: > hadoop fs -ls -lrt /user/hive/warehouse/ > > Regards. > > > On Fri, May 30, 2014 at 6:10 AM, Amjad ALSHABANI > wrote: > >> Hello Everybody, >> >> I know that this question may concern Hadoop list but i ve made this >> mistake when using Hive. >> I created new database giving the location on HDFS but i found that it >> removed all other data that exist already. >> >> = >> before creation, the directory on HDFS contains : >> pns@app11:~$ hadoop fs -ls /user/hive/warehouse >> Found 25 items >> drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 >> */user/hive/warehouse/*dfy_ans_autres >> drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 >> /user/hive/warehouse/dfy_ans_maillog >> drwxr-xr-x - user1 supergroup 0 2013-11-20 14:28 >> /user/hive/warehouse/dfy_cnx >> drwxr-xr-x - user2 supergroup 0 2014-05-30 06:05 >> /user/hive/warehouse/pns.db >> drwxr-xr-x - user2 supergroup 0 2014-02-24 17:00 >> /user/hive/warehouse/pns_fr_integ >> drwxr-xr-x - user2 supergroup 0 2014-05-06 15:33 >> /user/hive/warehouse/pns_logstat.db >> >> >> hive -e "CREATE DATABASE my_stats LOCATION 'hdfs://:9000 >> */user/hive/warehouse/*mystats.db'" >> >> but now I couldn't see the other directories on HDFS: >> >> pns@app11:~/aalshabani$ hls /user/hive/warehouse >> Found 1 items >> drwxr-xr-x - user2 supergroup 0 2014-05-30 11:37 >> */user/hive/warehouse*/mystats.db >> >> >> Is there anyway I could restore the other data?? >> >> >> Best regards. >> >> Amjad >> >> >> >> >
Re: HDFS Overwriting undo
Try this command: hadoop fs -ls -lrt /user/hive/warehouse/ Regards. On Fri, May 30, 2014 at 6:10 AM, Amjad ALSHABANI wrote: > Hello Everybody, > > I know that this question may concern Hadoop list but i ve made this > mistake when using Hive. > I created new database giving the location on HDFS but i found that it > removed all other data that exist already. > > = > before creation, the directory on HDFS contains : > pns@app11:~$ hadoop fs -ls /user/hive/warehouse > Found 25 items > drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 > */user/hive/warehouse/*dfy_ans_autres > drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 > /user/hive/warehouse/dfy_ans_maillog > drwxr-xr-x - user1 supergroup 0 2013-11-20 14:28 > /user/hive/warehouse/dfy_cnx > drwxr-xr-x - user2 supergroup 0 2014-05-30 06:05 > /user/hive/warehouse/pns.db > drwxr-xr-x - user2 supergroup 0 2014-02-24 17:00 > /user/hive/warehouse/pns_fr_integ > drwxr-xr-x - user2 supergroup 0 2014-05-06 15:33 > /user/hive/warehouse/pns_logstat.db > > > hive -e "CREATE DATABASE my_stats LOCATION 'hdfs://:9000 > */user/hive/warehouse/*mystats.db'" > > but now I couldn't see the other directories on HDFS: > > pns@app11:~/aalshabani$ hls /user/hive/warehouse > Found 1 items > drwxr-xr-x - user2 supergroup 0 2014-05-30 11:37 > */user/hive/warehouse*/mystats.db > > > Is there anyway I could restore the other data?? > > > Best regards. > > Amjad > > > >
HDFS Overwriting undo
Hello Everybody, I know that this question may concern Hadoop list but i ve made this mistake when using Hive. I created new database giving the location on HDFS but i found that it removed all other data that exist already. = before creation, the directory on HDFS contains : pns@app11:~$ hadoop fs -ls /user/hive/warehouse Found 25 items drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 */user/hive/warehouse/*dfy_ans_autres drwxr-xr-x - user1 supergroup 0 2013-11-20 13:40 /user/hive/warehouse/dfy_ans_maillog drwxr-xr-x - user1 supergroup 0 2013-11-20 14:28 /user/hive/warehouse/dfy_cnx drwxr-xr-x - user2 supergroup 0 2014-05-30 06:05 /user/hive/warehouse/pns.db drwxr-xr-x - user2 supergroup 0 2014-02-24 17:00 /user/hive/warehouse/pns_fr_integ drwxr-xr-x - user2 supergroup 0 2014-05-06 15:33 /user/hive/warehouse/pns_logstat.db hive -e "CREATE DATABASE my_stats LOCATION 'hdfs://:9000 */user/hive/warehouse/*mystats.db'" but now I couldn't see the other directories on HDFS: pns@app11:~/aalshabani$ hls /user/hive/warehouse Found 1 items drwxr-xr-x - user2 supergroup 0 2014-05-30 11:37 */user/hive/warehouse*/mystats.db Is there anyway I could restore the other data?? Best regards. Amjad