Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-08-12 Thread Wes McKinney
t; -Original Message- > From: Wes McKinney > Sent: Tuesday, May 21, 2019 8:17 AM > To: dev@arrow.apache.org > Subject: Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ > libraries > > On Tue, May 21, 2019, 8:43 AM Antoine Pitrou wrote: > &g

RE: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-08-12 Thread Eric Erhardt
ng a "data frame" subproject in the Arrow C++ libraries On Tue, May 21, 2019, 8:43 AM Antoine Pitrou wrote: > > Le 21/05/2019 à 13:42, Wes McKinney a écrit : > > hi Antoine, > > > > On Tue, May 21, 2019 at 5:48 AM Antoine Pitrou > wrote: > >> > >

Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-05-21 Thread Wes McKinney
On Tue, May 21, 2019, 8:43 AM Antoine Pitrou wrote: > > Le 21/05/2019 à 13:42, Wes McKinney a écrit : > > hi Antoine, > > > > On Tue, May 21, 2019 at 5:48 AM Antoine Pitrou > wrote: > >> > >> > >> Hi Wes, > >> > >> How does copy-on-write play together with memory-mapped data? It seems > >> that

Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-05-21 Thread Antoine Pitrou
Le 21/05/2019 à 13:42, Wes McKinney a écrit : > hi Antoine, > > On Tue, May 21, 2019 at 5:48 AM Antoine Pitrou wrote: >> >> >> Hi Wes, >> >> How does copy-on-write play together with memory-mapped data? It seems >> that, depending on whether the memory map has several concurrent users >> (a co

Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-05-21 Thread Wes McKinney
hi Antoine, On Tue, May 21, 2019 at 5:48 AM Antoine Pitrou wrote: > > > Hi Wes, > > How does copy-on-write play together with memory-mapped data? It seems > that, depending on whether the memory map has several concurrent users > (a condition which may be timing-dependent), we will either persis

Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-05-21 Thread Wes McKinney
Comments are on now, sorry about that. On Tue, May 21, 2019, 1:06 AM Micah Kornfield wrote: > Hi Wes, > It looks like comments are turned off on the doc, this intentional? > > Thanks, > Micah > > On Mon, May 20, 2019 at 3:49 PM Wes McKinney wrote: > > > hi folks, > > > > I'm interested in start

Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-05-21 Thread Antoine Pitrou
Hi Wes, How does copy-on-write play together with memory-mapped data? It seems that, depending on whether the memory map has several concurrent users (a condition which may be timing-dependent), we will either persist changes on disk or make them ephemeral in memory. That doesn't sound very us

Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-05-20 Thread Micah Kornfield
Hi Wes, It looks like comments are turned off on the doc, this intentional? Thanks, Micah On Mon, May 20, 2019 at 3:49 PM Wes McKinney wrote: > hi folks, > > I'm interested in starting to build a so-called "data frame" interface > as a moderately opinionated, higher-level usability layer for >