Thanks again for pointing me at this repo Aaron. I can confirm that I was able to get the project working and have successfully been able to read the test parquet files into J. Will investigate further & let you know where I get to. Cheers,
On Thu, Feb 3, 2022 at 1:46 AM Aaron Ash <[email protected]> wrote: > I’ve successfully tested it on linux at least, looking through the source > though it looks like it only reads from parquet at the moment, I must not > have tested writing yet. > > The bindings aren’t too complex though, it might be straightforward to add > a writeParquet verb if that functionality is still missing. > > > On Wed, 2 Feb 2022 at 7:34 pm, Ric Sherlock <[email protected]> wrote: > > > Thanks Aaron - that looks really promising. Will check it out & see if I > > can get it to work. > > > > On Wed, Feb 2, 2022 at 8:48 PM Aaron Ash <[email protected]> wrote: > > > > > There's also these J bindings that can be used to read/write parquet > > > files directly from J: https://github.com/interregna/JArrow > > > > > > On Wed, Feb 2, 2022 at 5:27 PM Stefan Baumann <[email protected]> wrote: > > > > > > > > Ric, You might want to check out DuckDB (https://duckdb.org/), I > > > recently > > > > used it for reading and writing Parquet files. > > > > It's similar to SQLite but intended to be used for analytics. > > > > Stefan. > > > > > > > > On Wed, Feb 2, 2022 at 5:29 AM Ric Sherlock <[email protected]> > wrote: > > > > > > > > > I spend a fair bit of time wrangling data formatted as C structs, > CSV > > > and > > > > > am trying to move more to Parquet as a file storage format. > > > > > I've also had on my list to investigate what would be involved in > > > > > reading/writing Parquet from J. Do you know if anyone out there has > > > looked > > > > > into this? > > > > > Ric ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
