On Wed, Nov 6, 2019 at 7:22 PM Jens Alfke <j...@mooseyard.com> wrote:
> > > > On Nov 6, 2019, at 9:25 AM, Digital Dog <digitald...@gmail.com> wrote: > > > > If there are millions or billions of rows > > in the data set I consider it big data and the only reasonable format for > > storing it is a column store format. > > There are many types of stores for "big data". My employer, Couchbase, has > customers who would disagree with you; they use our document database to > store millions or billions of rows. > I was talking about this specific data set with very well defined columns. However I'm not sure if Parquet will be able to store this amount of columns, or query them efficiently. _______________________________________________ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users