Re: Should ToolRunner call UserGroupInformation.setConfiguration?

2017-07-27 Thread Erik Krogen
I have found this troublesome as well, +1 to this unless there is a good reason not to. Erik On 7/26/17, 10:05 PM, "John Zhuge" wrote: The static UGI.conf is set to a new Configuration object in UGI.ensureInitialized if setConfiguration is not already called. ToolRunner.c

Re: Should ToolRunner call UserGroupInformation.setConfiguration?

2017-07-26 Thread John Zhuge
The static UGI.conf is set to a new Configuration object in UGI.ensureInitialized if setConfiguration is not already called. ToolRunner.conf does take -D overrides but it is not copied to UGI.conf. On Wed, Jul 26, 2017 at 8:42 PM, John Zhuge wrote: > Hi Gurus, > > Unlike YarnChild, DN, NN, and

Should ToolRunner call UserGroupInformation.setConfiguration?

2017-07-26 Thread John Zhuge
Hi Gurus, Unlike YarnChild, DN, NN, and many others, ToolRunner does not call UserGroupInformation.setConfiguration. Is this by design? The means you can not use "-D" to override any conf property used in UGI. The only direct call I found is: String cmd = conf.get("hadoop.kerberos.kinit.