I'm taking a look at the HDFS directories through the web interface and I can see only 5 files there, not 6. I tried creating the partition using the ADD PARTITION command. After that all 6 files get imported successfully.
Saurabh. On Wed, Dec 30, 2009 at 11:39 AM, Zheng Shao <[email protected]> wrote: > Can you list the HDFS directories? Are the files in the corresponding > directories yet? > > > Zheng > > On Tue, Dec 29, 2009 at 9:57 PM, Saurabh Nanda <[email protected]> > wrote: > > Hi, > > > > I'm revisiting Hive after a long hiatus, so I may not be aware of any new > > developments. I had written a script some time back to import webserver > logs > > for a day into a new partition. The same script now running on the latest > > version of Hive (r894548 compiled off trunk) seems to be misbehaving. > > > > I'm importing about 6 files into each partition. However, after the > script > > ends, only 5 files show up in each partition. Do I need to explicitly > issue > > the ADD PARTITION command before loading data? Isn't the partition > > implicitly created? > > > > Saurabh. > > -- > > http://nandz.blogspot.com > > http://foodieforlife.blogspot.com > > > > > > -- > Yours, > Zheng > -- http://nandz.blogspot.com http://foodieforlife.blogspot.com
