Re: Arrow JS Meetup (02/13)

2021-04-23 Thread Naveen Michaud-Agrawal
dit?usp=sharing. > After the meetup, a few people gathered in the arrow-js channel on the ASF > Slack where we Paul has been helping us with dev setup questions. > > Best wishes, > Dominik > > On Apr 20, 2021 at 06:53:08, Naveen Michaud-Agrawal < > naveen.mich

Re: Arrow JS Meetup (02/13)

2021-04-20 Thread Naveen Michaud-Agrawal
Lightning Talks from Arrow JS users > - Discussions/breakouts as needed > > If anyone is interested in joining please reach out to Dominik at > domor...@cmu.edu > For anyone who can't join - I will try my best to capture notes and share > them with the mailing list afterward. > >

Re: [JS] Exploring usage of apache arrow at my company for complex table rendering

2021-04-18 Thread Naveen Michaud-Agrawal
> > > >render the data column or not. > > > > 2. It seems like there is a well developed javascript SDK that we > can > > > >use. I am still reading the source code and the Observable > articles to > > > >truly understand how it works. > > > > 1. I read one of the issues is that the JS library might be out > > > > sync, so do people know how actively that repo is maintained. > > > > 2. If there needs to be work done I think we would be able to > help > > > > if we had some help getting started with understanding that > repo. > > > > > > > > > > > > > > > > If possible we would be interested to continue to chat about the > above > > > > ideas, get more information about if Apache Arrow is right for the > job, > > > and > > > > if there is already discussion of other people are using arrow for > > > > rendering in addition to analytics. > > > > > > > > > > > > > > > > To clarify what I mean for existing render technologies I know stuff > like > > > > Falcon and Perspective exist, but those seem to be for basic table > > > > rendering for simple tables. I mean to create a superset of arrow by > > > > definfing metadata that allows for complex nested headers and nested > > > rows. > > > > Something like the image below. Then you can imagine even more data > > > > attached such as describing the data and relationships to other data > on > > > the > > > > page. You can image in the dataset there is some `personId` that is > set > > > to > > > > not be rendered. This personId can then be used to gather more > > > information > > > > in another api call if you wanted to render a tooltip with maybe > some bio > > > > information. In short, rendered tables require a lot more information > > > than > > > > just the data. Does it make sense to build this upon Arrow. > > > > > > > > > > > > > > > > > > > > > > > > -Thanks > > > > > > > > Michael > > > > > > > > > > > > > > > > -- --- Naveen Michaud-Agrawal

Re: CDataInterface object from IPC format buffer

2020-12-12 Thread Naveen Michaud-Agrawal
Hi Antoine, Thanks for the information, that should work for my purposes. Regards, Naveen On Sat, Dec 12, 2020 at 1:49 PM Antoine Pitrou wrote: > > Hello Naveen, > > Le 12/12/2020 à 19:43, Naveen Michaud-Agrawal a écrit : > > Is there any util code in the project (C++ or C)

CDataInterface object from IPC format buffer

2020-12-12 Thread Naveen Michaud-Agrawal
arrow output. DuckDB natively supports arrow data but only using the CDataInterface. Thanks, Naveen Michaud-Agrawal

Re: Upcoming JS fixes and release timeline

2020-08-25 Thread Naveen Michaud-Agrawal
Hi Paul, Is there a github location where I could track this upgrade? I'm interested in using arrow JS in a project that is currently migrating to tsc 3.9, so I am definitely keen on seeing the JS version continue forward. Regards, Naveen Michaud-Agrawal On Wed, Jul 1, 2020 at 12:23 PM

pyarrow and DictionaryBatches

2018-12-20 Thread Naveen Michaud-Agrawal
Hello, Is there any way to created DictionaryBatches from pyarrow? From the docs it looks like they are just regular RecordBatches with some extra metadata, but I don't see an API to create them directly. Thanks, Naveen

[JS] Arrow output from JS library?

2018-04-17 Thread Naveen Michaud-Agrawal
Hi, Are there any plans to be able to create arrow objects from the JS library? Naveen Michaud-Agrawal

Re: Making a bugfix Arrow JS release

2018-03-07 Thread Naveen Michaud-Agrawal
Hi Brian, Any thoughts on splitting out the dataframe like parts into a separate library, keeping arrowjs to just handle loading data out of the arrow buffer? Regards, Naveen Michaud-Agrawal

[jira] [Created] (ARROW-2106) pyarrow.array can't take a pandas Series of python datetime objects.

2018-02-06 Thread Naveen Michaud-Agrawal (JIRA)
Naveen Michaud-Agrawal created ARROW-2106: - Summary: pyarrow.array can't take a pandas Series of python datetime objects. Key: ARROW-2106 URL: https://issues.apache.org/jira/browse/ARROW