Thanks Allen, what is the total size limit? Sitaraman
On Fri, Jun 12, 2015 at 10:53 PM, Allen Wittenauer <a...@altiscale.com> wrote: > > On Jun 12, 2015, at 12:37 AM, Sitaraman Vilayannur < > vrsitaramanietfli...@gmail.com> wrote: > > > Hi, > > What is the limit on the number of properties that can be set using > > set(String s1, String s2) on the Configuration object for hadoop? > > Is this limit configurable if so what is the maximum that can be set? > > It's a "total size of the conf" limit, not a "number of" limit. > > In general, you shouldn't pack it full of stuff as calling > Configuration is expensive. Use a side-input/distributed cache file for > mass quantities of bits. > > >
