Hi Chris, I haven't been using R much at all over the last few years, so haven't had much to do with tibbles. Just looked them up now and they do seem more sane. Most of my recent work has been with Polars Dataframes ( https://github.com/pola-rs/polars) which are based on Apache Arrow Columnar format and so are much more analogous to inverted tables. I'd be interested in collaborating on the design of an interface to named, inverted tables - do you see that as a tibble analogue? Or were you thinking of working with R tibbles? I spend a fair bit of time wrangling data formatted as C structs, CSV and am trying to move more to Parquet as a file storage format. I've also had on my list to investigate what would be involved in reading/writing Parquet from J. Do you know if anyone out there has looked into this? Ric
On Wed, Feb 2, 2022 at 1:17 PM chris burke <cbu...@jsoftware.com> wrote: > Ric > > For the dataframes equivalent, are you thinking of the more recent tibble > structure in tidyverse? This is easier to understand than the original > dataframes. > > If so, this is a worthwhile addon for J. I worked on something similar > recently. If you or anyone else is interested, we could collaborate at > least on the design. > > Chris > > On Mon, Jan 31, 2022 at 10:21 AM Ric Sherlock <tikk...@gmail.com> wrote: > > > Yes, I've been thinking that a Dataframes equivalent in J would be > useful. > > Most things are already possible with J's arrays, but conceptually > > DataFrames are well understood by many now, and they make it easy to work > > with datasets as named fields. > > I've spent a reasonable amount of time working with Pandas, but have > > recently been using Polars (Rust backend with Python bindings) which > really > > shines for larger datasets. Performance (especially read/write) is > awesome, > > and the LazyFrames which optimise your query/analysis plan make a big > > difference too. > > I haven't taken enough time to explore it, but maybe Jd is the starting > > point in this space for J? > > > ---------------------------------------------------------------------- > For information about J forums see http://www.jsoftware.com/forums.htm > ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
