In a manner of speaking. I would imagine that you would like to take advantage of resource management that comes with yarn. If you're planning to make this a product that your customers can submit jobs to do some image processing, then you're better off creating a yarn application master that would
I'd recommend you start by reading https://smile.amazon.com/gp/aw/d/1449327052/ref=mp_s_a_1_1?ie=UTF8&qid=1469166631&sr=8-1&pi=SY200_QL40&keywords=hadoop+operations&dpPl=1&dpID=51MXFYjl3rL&ref=plSrch
It gives the basics of Hadoop with a flavor towards operations...
Thanks,
Ron
On Jul 21, 2016 8:01
Great that's good to know...
Sent from my iPhone
> On Mar 23, 2016, at 8:43 AM, tkg_cangkul wrote:
>
> hi ron. thx for your reply.
> i think my problem has been solved now.
> the storage of log dir not sufficient. i don't know if the logs need much
> storage.
Did you take a look at the node manager logs?
Thanks,
Ron
Sent from my iPhone
> On Mar 23, 2016, at 7:18 AM, Youzha wrote:
>
> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when
> the job running. i check the hdfs storage only use 20%. and i think the yarn
> resour
I think you can pick the compression algorithm when using sqoop - either
deflate or snappy when specifying the --compress option.
Is that what you were asking?
Thanks,
Ron
On 07/29/2015 03:40 PM, Ted Yu wrote:
You can use the following command to see options for gzip:
gzip -h
For snappy, see:
