Re: [VOTE] Release Apache Arrow 16.0.0 - RC0

tty stable (this took a lot of time to achieve :) > ) and has already enough votes for it to be released. Would that be > ok? > > Thanks, > Raúl > > [1] https://lists.apache.org/thread/lhdxnk4j0rl3sbtswlyvkp2rq13539fg > > > El mié, 17 abr 2024 a las 19:20, Dominik

Re: [VOTE] Release Apache Arrow 16.0.0 - RC0

I’m sorry that we missed the announcement for the release but there are a few ArrowJS changes that we had marked for arrow 16 that are now in main. I created a PR with those changes to make it easier to see: https://github.com/apache/arrow/pull/41261. Can you add those to the RC1 if not into RC0?

Re: Arrow NPM package name

> Neal > > On Tue, Mar 1, 2022 at 9:41 AM Dominik Moritz wrote: > > Hi All, > > > I got in touch with NPM to see whether we can get the arrow package name on > > NPM (right now, we use apache-arrow). The arrow package at > > https://www.npmjs.com/package/arrow ha

Arrow NPM package name

Hi All, I got in touch with NPM to see whether we can get the arrow package name on NPM (right now, we use apache-arrow). The arrow package at https://www.npmjs.com/package/arrow has been unused for years and so I asked whether we can use it for Apache Arrow. While they rejected my request for no

Re: [JavaScript] Appending Nulls to a Struct (Bug)

Can someone clarify whether the spec is clear about the behavior? On Feb 18, 2022 at 07:23:19, Alfie Mountfield wrote: > Hello all, > I've raised a JIRA ticket ( > https://issues.apache.org/jira/browse/ARROW-15705) > for this, but I'm still uncertain on my reading of the spec so I thought > I'd

Re: [VOTE] Release Apache Arrow JS 6.0.2

(webpack, rollup, esbuild, and we could add more if people want) and run the generated bundles. To run the tests locally, run `yarn test:bundle` in the js directory. On Jan 4, 2022 at 09:53:50, Dominik Moritz wrote: > Hi Wes, > > Thanks for the follow up and I’m sorry for not following

Re: [VOTE] Release Apache Arrow JS 6.0.2

-wasm-cpp> > > (Note that neither utilize all of arrow, just a carve out of IPC stuff) > > > > > > Tim Paine > > tim.paine.nyc > > 908.721.1185 > > > > On Dec 9, 2021, at 14:18, Dominik Moritz wrote: > > > > > >> > > >&

Re: [VOTE] Release Apache Arrow JS 6.0.2

MC workload. > > > Benson > > > On 12/6/21 1:01 AM, Wes McKinney wrote: > > > hi Dominik — can you provide instructions for how we should verify the > > > release, aside from checking the GPG signature and checksums? > > > > > > On Sun

Re: [VOTE] Release Apache Arrow JS 6.0.2

ce then the process of > creating and verifying signed software would minimize PMC workload. > > Benson > > On 12/6/21 1:01 AM, Wes McKinney wrote: > > hi Dominik — can you provide instructions for how we should verify the > > release, aside from checking the GPG signature a

Re: [VOTE] Release Apache Arrow JS 6.0.2

MC workload. > > > Benson > > > On 12/6/21 1:01 AM, Wes McKinney wrote: > > > hi Dominik — can you provide instructions for how we should verify the > > > release, aside from checking the GPG signature and checksums? > > > > > > On Sun

Re: [VOTE] Release Apache Arrow JS 6.0.2

could be some collaboration to reduce > duplicated efforts? > > > On 11/23/21 9:52 PM, Dominik Moritz wrote: > > Ahh, thank you for the clarification. There are no breaking changes in > > this point release, just fixes. > > > @PMC, could you please vote on this poin

Re: [VOTE] Release Apache Arrow JS 6.0.2

. > > > [1] https://infra.apache.org/release-publishing.html > > On 11/23/21 7:33 PM, Dominik Moritz wrote: > > I tested Node v14.18.1 and tests pass. I think we can go ahead and make a > > release. > > > @Benson, could you help me update the script to work

Re: [VOTE] Release Apache Arrow JS 6.0.2

, Dominik Moritz wrote: > Thanks for catching that. > > Jest is used for running the tests and jest supports node 14.15. Could we > switch to node 14.15 instead of 14.0 for this test? > > On Nov 20, 2021 at 05:37:00, Benson Muite > wrote: > >> Hi, >> >> T

Re: [VOTE] Release Apache Arrow JS 6.0.2

|| ^12.13.0 || ^14.15.0 || >=15.0.0". Got > "14.0.0" > error Found incompatible module. > > > The current release verification script could be update to support > testing directly from a branch if this will be the point release process > in future. > > On 11/20

[VOTE] Release Apache Arrow JS 6.0.2

Hi, I would like to propose a patch release for Arrow JS. The release is forked off of maint-6.0.x and available at https://github.com/apache/arrow/tree/release-6.0.2-js. The release contains two fixes for the js bundle: ARROW-14773: [JS] Fix sourcemap paths

Re: Independent JS patch releases

gt; script to help streamline votes (like we have for the Rust releases, > for example) > > > https://github.com/apache/arrow/blob/ea0fb370e2ee0d11b2fbdb149247af3695fd394a/dev/release/js-source-release.sh > > On Fri, Nov 12, 2021 at 9:46 AM Dominik Moritz > wrote: > > &

Continuous releases for Arrow JS

Dear Arrow Devs, Could someone set up continuous or nightly arrow releases for the JS package? I’m happy to help but I don’t understand the CI infrastructure enough to lead the charge on this. The JIRA is at https://issues.apache.org/jira/browse/ARROW-14508. Thank you, Dominik

Re: Independent JS patch releases

lease management but if it's a source-only > release it shouldn't be _that_ difficult. > > On Fri, Nov 5, 2021 at 9:50 AM Dominik Moritz wrote: > > > Hi Neal, > > > Great questions. We could potentially add an integration test for major > > bundlers. Howev

Re: [VOTE] Remove compute from Arrow JS

ussions)? or in another forum? > > -Micah > > On Wed, Nov 3, 2021 at 9:23 AM Dominik Moritz wrote: > > Thank you, Micah. We plan to rewrite a lot of the API in Arrow 7 so I > > think option 1 would add a lot of overhead. I added a note to the Arrow 6 > > release notes i

[JS] Proposed updates to the Vector, Table, and RecordBatch classes

Dear Arrow Devs, Paul and I are working on a refactoring of the Arrow JS library. The biggest change is that Table and RecordBatch don’t extend Vector anymore. This allows us to simplify the library code and reduce the amount of code that needs to be pulled in to use only some parts of Arrow. It w

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

When can we expect the 6.0.1 release? I thought the plan was to release it before the announcement at https://arrow.apache.org/blog/2021/11/04/6.0.0-release/. On Nov 3, 2021 at 20:22:01, Sutou Kouhei wrote: > Oh, sorry for introducing wrong instruction. (merging into > release-6.0.0.) > > In >

Re: Independent JS patch releases

dask) that we don't want to break support with. Are there additional > JS builds we could add that would increase our confidence in the quality of > our releases? > > Neal > > On Thu, Nov 4, 2021 at 12:04 PM Dominik Moritz > wrote: > > Dear Arrow Devs, > > >

Independent JS patch releases

Dear Arrow Devs, We would like to ask to have independent patch releases for the Arrow JS library. Having independent patch releases will help us resolve issues that only become visible when people start to use the library. The JS ecosystem is diverse and only recently has become more standardized

Re: [VOTE] Remove compute from Arrow JS

g to the 6.0.0 release > notes indicating the removal. > > Cheers, > Micah > > On Tue, Nov 2, 2021 at 1:54 PM Dominik Moritz wrote: > > +1 from me as well. > > > That brings us to 3 times +1 and no -1 or +0. > > > Thank you, all. We will remove the compute code

Re: [VOTE] Remove compute from Arrow JS

g to the 6.0.0 release > notes indicating the removal. > > Cheers, > Micah > > On Tue, Nov 2, 2021 at 1:54 PM Dominik Moritz wrote: > > +1 from me as well. > > > That brings us to 3 times +1 and no -1 or +0. > > > Thank you, all. We will remove the compute code

Re: [VOTE] Remove compute from Arrow JS

added this to Arquero > almost a year ago now [1]. > > Brian > > [1] https://github.com/uwdata/arquero/issues/86 > > On Wed, Oct 27, 2021 at 4:46 PM Dominik Moritz > wrote: > >> Dear Arrow community, >> >> We are proposing to remove the compute code fr

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

eople are able to upgrade to v6.0.1 for Go easily. > > > That PR would also need to get merged before such a patch release. Thanks > > everyone. > > > -Original Message- > > From: Dominik Moritz > > Sent: Wednesday, October 27, 2021 5:35 PM > > To

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

st for a > > > > > > 6.0.1 release with a patch before the release post goes out to ensure > > that > > > > > > people are able to upgrade to v6.0.1 for Go easily. > > > > > > > > > That PR would also need to get merged before such a patch release. Th

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

le to upgrade to v6.0.1 for Go easily. > > > That PR would also need to get merged before such a patch release. Thanks > > everyone. > > > -Original Message- > > From: Dominik Moritz > > Sent: Wednesday, October 27, 2021 5:35 PM > > To: dev@arrow.apache.o

[VOTE] Remove compute from Arrow JS

Dear Arrow community, We are proposing to remove the compute code from Arrow JS. Right now, the compute code is encapsulated in a DataFrame class that extends Table. The DataFrame implements a few functions such as filtering and counting with expressions. However, the predicate code is not very ef

Re: [VOTE][RESULT] Release Apache Arrow 6.0.0 - RC3

We have found an issue with the JavaScript packages that prevents people from using Arrow in browser bundles. The fix is in https://github.com/apache/arrow/pull/11565. Could we make a 6.0.1 release of the NPM package with the patch before the release post goes out? On Oct 27, 2021 at 02:55:20, Su

Re: Proposal to include JS bundle description fix in Arrow 5.0.1

ouple of > weeks (mid-October), in my opinion it makes most sense to focus our efforts > on making the next release excellent. > > Neal > > > On Mon, Sep 20, 2021 at 4:25 PM Dominik Moritz > wrote: > > Neal, could you make a release? > > > On Aug 27, 2021 at

Re: Proposal to include JS bundle description fix in Arrow 5.0.1

Neal, could you make a release? On Aug 27, 2021 at 14:43:10, Dominik Moritz wrote: > Are there any other changes for 5.0.1? It would be great to release a > version with the fixes to the JS bundles since it prevents people from > upgrading from Arrow 3. > > On Jul 30, 2021 at

Re: Proposal to include JS bundle description fix in Arrow 5.0.1

; Neal > > On Fri, Jul 30, 2021 at 1:15 PM Dominik Moritz > wrote: > > Hi all, > > > We introduced a regression in Arrow that sometimes leads JS code bundlers > > to emitting code that is missing some functionality. We have a patch for > > this problem in http

Proposal to include JS bundle description fix in Arrow 5.0.1

Hi all, We introduced a regression in Arrow that sometimes leads JS code bundlers to emitting code that is missing some functionality. We have a patch for this problem in https://github.com/apache/arrow/pull/10826 that is now in master. I would like to propose to release Arrow JS 5.0.1 with this c

Re: Javascript object => Arrow Table

Hi Lana, We don’t right now but it’s certainly something we would like to add. I recently added support for typed arrays in Table.new ( https://github.com/apache/arrow/pull/10151) and filed a Jira to support constructing Tables from arrays of objects in https://issues.apache.

Re: Long title on github page

t; > >>>> > > > > > > > > > >>>> > > > > > > > > > >>>> > > > > > > > > > >>>> On Mon, May 17, 2021 at 10:11 AM Brian Hulette < > > > > > > bhule...@apache.org> > > > > > > >

Re: [ANNOUNCE] New Arrow committer: Dominik Moritz

Thank you for the warm welcome, Wes. I look forward to continue working with you all on Arrow and in particular the Arrow JavaScript library. Dominik On Jun 2, 2021 at 14:19:51, Wes McKinney wrote: > On behalf of the Arrow PMC, I'm happy to announce that Dominik has > accepted an > invitation

Long title on github page

Super minor issue but could someone make the description on GitHub shorter? 🙏 GitHub puts the description into the title of the page and makes it hard to find it in URL autocomplete.

Re: Including JS patch in 4.0.1 if released

Thank you for the pull request. I’m curious regarding, CSP (which restricts the use of eval), did you try that Arrow 3 works? I’m wondering since Arrow already uses a Function constructor in https://github.com/apache/arrow/blob/0d11014ee8e6ce408ddbbdfb788d901dd6c6374f/js/src/builder/valid.ts#L66 .

Re: Arrow JS Meetup (02/13)

eeting? > > Thanks, > Naveen > > On Tue, Feb 9, 2021 at 11:38 AM Brian Hulette wrote: > >> Hi all, >> >> +Dominik Moritz recently reached out to +Paul Taylor >> and myself to set up an Arrow JS meetup with the >> goal >> of re-building some mom

Re: [DISCUSS] [Rust] Move Rust components to new repos and process

I have been working on an arrow-was library that uses the rust crate. I was hoping to eventually merge this into the arrow repo. Since wasm is often used on the web, I was hoping to maybe use the wasm library as a core for the arrow-js library (which is in the main arrow repo). So there is just o

Re: [Rust] Is Rust Arrow's deserialization code zero-copy?

I ran into this issue as well. See https://issues.apache.org/jira/projects/ARROW/issues/ARROW-11696 . As I understand it, https://github.com/jorgecarleitao/arrow2 will make reading more efficient. On Apr 6, 2021

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

s going to demo the use of Arrow but I > can't remember exactly what that was now > > On Tue, Feb 16, 2021 at 10:59 AM Dominik Moritz wrote: > > Somewhat related, I tried to compile DataFusion to WASM and it didn’t work > > because of some dependencies: > > https

Re: [Rust] Arrow in WebAssemby

/projects/ARROW/issues/ARROW-11696). On Mar 1, 2021 at 23:29:18, Dominik Moritz wrote: > I am looking forward to speaking with you then. I’ll talk about the > motivation. > > My experience with the library has been good. I ran into a few limitations > that I filed Jiras for. I struggled

Re: [Rust] Arrow in WebAssemby

ntation and > > what advantages you have seen over javascript > > > thanks > > Fernando > > > On Thu, Feb 25, 2021 at 10:39 PM Dominik Moritz wrote: > > > > Hello Rust Arrow Devs, > > > > > > I have been working on a wasm version of Arrow usi

[Rust] Arrow in WebAssemby

Hello Rust Arrow Devs, I have been working on a wasm version of Arrow using the Rust library ( https://github.com/domoritz/arrow-wasm). I was wondering whether you would be interested in having me demo it in the Arrow Rust sync call. If so, when would be the next one and how much time would you wa

Re: [Rust] [DataFusion] Topic for next Rust Sync Call

Somewhat related, I tried to compile DataFusion to WASM and it didn’t work because of some dependencies: https://issues.apache.org/jira/projects/ARROW/issues/ARROW-11615. I wonder whether DataFusion could have a feature flag for only shipping what is WASM compatible? On Feb 15, 2021 at 12:13:04,

[jira] [Created] (ARROW-6282) Support lossy compression

Dominik Moritz created ARROW-6282: - Summary: Support lossy compression Key: ARROW-6282 URL: https://issues.apache.org/jira/browse/ARROW-6282 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-4588) [JS] add logging

Dominik Moritz created ARROW-4588: - Summary: [JS] add logging Key: ARROW-4588 URL: https://issues.apache.org/jira/browse/ARROW-4588 Project: Apache Arrow Issue Type: Bug Components

[jira] [Created] (ARROW-4550) [JS] Fix AMD pattern

Dominik Moritz created ARROW-4550: - Summary: [JS] Fix AMD pattern Key: ARROW-4550 URL: https://issues.apache.org/jira/browse/ARROW-4550 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4522) [JS] Remove Webpack dependency

Dominik Moritz created ARROW-4522: - Summary: [JS] Remove Webpack dependency Key: ARROW-4522 URL: https://issues.apache.org/jira/browse/ARROW-4522 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-4521) Improve performance of row proxy object

Dominik Moritz created ARROW-4521: - Summary: Improve performance of row proxy object Key: ARROW-4521 URL: https://issues.apache.org/jira/browse/ARROW-4521 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-4518) add jsdelivr to package.json

Dominik Moritz created ARROW-4518: - Summary: add jsdelivr to package.json Key: ARROW-4518 URL: https://issues.apache.org/jira/browse/ARROW-4518 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-4517) [JS] remove version number as it is not used

Dominik Moritz created ARROW-4517: - Summary: [JS] remove version number as it is not used Key: ARROW-4517 URL: https://issues.apache.org/jira/browse/ARROW-4517 Project: Apache Arrow Issue

[jira] [Created] (ARROW-3561) [JS] Update ts-jest

Dominik Moritz created ARROW-3561: - Summary: [JS] Update ts-jest Key: ARROW-3561 URL: https://issues.apache.org/jira/browse/ARROW-3561 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-3560) Remove @std/esm

Dominik Moritz created ARROW-3560: - Summary: Remove @std/esm Key: ARROW-3560 URL: https://issues.apache.org/jira/browse/ARROW-3560 Project: Apache Arrow Issue Type: Task Components

[jira] [Created] (ARROW-3302) Reduce number of dependencies

Dominik Moritz created ARROW-3302: - Summary: Reduce number of dependencies Key: ARROW-3302 URL: https://issues.apache.org/jira/browse/ARROW-3302 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-2705) CombinationPredicates should take list or predicates

Dominik Moritz created ARROW-2705: - Summary: CombinationPredicates should take list or predicates Key: ARROW-2705 URL: https://issues.apache.org/jira/browse/ARROW-2705 Project: Apache Arrow

[jira] [Created] (ARROW-2698) Get column by name

Dominik Moritz created ARROW-2698: - Summary: Get column by name Key: ARROW-2698 URL: https://issues.apache.org/jira/browse/ARROW-2698 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-2689) timestamps_to_ms should be removed from docs

Dominik Moritz created ARROW-2689: - Summary: timestamps_to_ms should be removed from docs Key: ARROW-2689 URL: https://issues.apache.org/jira/browse/ARROW-2689 Project: Apache Arrow Issue

[jira] [Created] (ARROW-2688) Create Documentation

Dominik Moritz created ARROW-2688: - Summary: Create Documentation Key: ARROW-2688 URL: https://issues.apache.org/jira/browse/ARROW-2688 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-2687) JS example is outdated

Dominik Moritz created ARROW-2687: - Summary: JS example is outdated Key: ARROW-2687 URL: https://issues.apache.org/jira/browse/ARROW-2687 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-2686) Cannot load .arrow file in JavaScript

Dominik Moritz created ARROW-2686: - Summary: Cannot load .arrow file in JavaScript Key: ARROW-2686 URL: https://issues.apache.org/jira/browse/ARROW-2686 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-2684) Improve Python documentation

Dominik Moritz created ARROW-2684: - Summary: Improve Python documentation Key: ARROW-2684 URL: https://issues.apache.org/jira/browse/ARROW-2684 Project: Apache Arrow Issue Type: Improvement