On Jun 12, 2015, at 12:37 AM, Sitaraman Vilayannur
<[email protected]> wrote:
> Hi,
> What is the limit on the number of properties that can be set using
> set(String s1, String s2) on the Configuration object for hadoop?
> Is this limit configurable if so what is the maximum that can be set?
It's a "total size of the conf" limit, not a "number of" limit.
In general, you shouldn't pack it full of stuff as calling
Configuration is expensive. Use a side-input/distributed cache file for mass
quantities of bits.