@gmail.com]
Sent: Wednesday, December 18, 2013 1:49 PM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are
created?
I did jstack one such process and can see the following output in the
terminal, and I guess this info told us
Subject: Re: Why so many unexpected files like partitions_ are
created?
I did jstack one such process and can see the following output in the
terminal, and I guess this info told us that the processes started by
the
command LoadIncrementalHFiles never exit. Why didn't they exit after
: Tuesday, December 17, 2013 9:34 AM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_
are
created?
Indeed these files are produced by
org.apache.hadoop.hbase.mapreduce.
LoadIncrementalHFiles in the directory specified
@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are
created?
I did jstack one such process and can see the following output in the
terminal, and I guess this info told us that the processes started by
the
command LoadIncrementalHFiles never exit. Why didn't
RegionServer process also?
Which version are you using?
Jieshan.
-Original Message-
From: Tao Xiao [mailto:xiaotao.cs@gmail.com]
Sent: Wednesday, December 18, 2013 1:49 PM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are created?
I did
Yes, it should be cleaned up. But not included in current code in my
understanding.
Jieshan.
-Original Message-
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Tuesday, December 17, 2013 10:55 AM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_
. But not included in current code in my
understanding.
Jieshan.
-Original Message-
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Tuesday, December 17, 2013 10:55 AM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are created?
Should bulk load
...@gmail.com]
Sent: Tuesday, December 17, 2013 10:55 AM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are
created?
Should bulk load task clean up partitions_ upon completion ?
Cheers
On Mon, Dec 16, 2013 at 6:53 PM, Bijieshan bijies
understanding.
Jieshan.
-Original Message-
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Tuesday, December 17, 2013 10:55 AM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are
created?
Should bulk load task clean up
: Re: Why so many unexpected files like partitions_ are created?
I did jstack one such process and can see the following output in the terminal,
and I guess this info told us that the processes started by the command
LoadIncrementalHFiles never exit. Why didn't they exit after finished running
The reduce partition information is stored in this partition_ file. See the
below code:
HFileOutputFormat#configureIncrementalLoad:
.
Path partitionsPath = new Path(job.getWorkingDirectory(),
partitions_ + UUID.randomUUID());
Indeed these files are produced by org.apache.hadoop.hbase.mapreduce.
LoadIncrementalHFiles in the directory specified by what
job.getWorkingDirectory()
returns, and I think I should delete these files immediately after I have
finished bulk loading data into HBase since they are useless at that
]
Sent: Tuesday, December 17, 2013 9:34 AM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are created?
Indeed these files are produced by org.apache.hadoop.hbase.mapreduce.
LoadIncrementalHFiles in the directory specified by what
job.getWorkingDirectory
?
Ya. I think so. They are useless once bulk load task finished.
Jieshan.
-Original Message-
From: Tao Xiao [mailto:xiaotao.cs@gmail.com]
Sent: Tuesday, December 17, 2013 9:34 AM
To: user@hbase.apache.org
Subject: Re: Why so many unexpected files like partitions_ are created
14 matches
Mail list logo
