Thanks Richard. How would one decide on the number of column family and columns?
Is there a ballpark approach Cheers Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On 28 November 2016 at 16:04, Richard Startin <richardstar...@outlook.com> wrote: > Hi Mich, > > If you want to store the file whole, you'll need to enforce a 10MB limit > to the file size, otherwise you will flush too often (each time the me > store fills up) which will slow down writes. > > Maybe you could deconstruct the xml by extracting columns from the xml > using xpath? > > If the files are small there might be a tangible performance benefit by > limiting the number of columns. > > Cheers, > Richard > > Sent from my iPhone > > > On 28 Nov 2016, at 15:53, Dima Spivak <dimaspi...@apache.org> wrote: > > > > Hi Mich, > > > > How many files are you looking to store? How often do you need to read > > them? What's the total size of all the files you need to serve? > > > > Cheers, > > Dima > > > > On Mon, Nov 28, 2016 at 7:04 AM Mich Talebzadeh < > mich.talebza...@gmail.com> > > wrote: > > > >> Hi, > >> > >> Storing XML file in Big Data. Are there any strategies to create > multiple > >> column families or just one column family and in that case how many > columns > >> would be optional? > >> > >> thanks > >> > >> Dr Mich Talebzadeh > >> > >> > >> > >> LinkedIn * > >> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCd > OABUrV8Pw > >> < > >> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCd > OABUrV8Pw > >>> * > >> > >> > >> > >> http://talebzadehmich.wordpress.com > >> > >> > >> *Disclaimer:* Use it at your own risk. Any and all responsibility for > any > >> loss, damage or destruction of data or any other property which may > arise > >> from relying on this email's technical content is explicitly disclaimed. > >> The author will in no case be liable for any monetary damages arising > from > >> such loss, damage or destruction. > >> >
