Re: [ANNOUNCE] Copying Rust components to new repositories

Hi, I created ARROW-12444 to handle the changes on the apache/arrow side and fielded https://github.com/apache/arrow/pull/10096 to address it. It: * removes rust/ * updates CI * runs integration tests via git clone * removes rust from archery li

Re: [JS] Exploring usage of apache arrow at my company for complex table rendering

Sorry, looks like I never replied to this. > Do you have any public code examples I could take a look at? This does sound > very related to what I am doing. No, this was a proprietary project unfortunately. > One particular question I have related to grouping is how you define > row-grouping.

Re: [JS] Exploring usage of apache arrow at my company for complex table rendering

Hi Michael, How much data are you sending over the wire to javascript? For grouping, you might be able to send the original ungrouped table as an arrow buffer and use a new javascript library from the University of Washington called arquero (https://github.com/uwdata/arquero), which natively suppo

Re: [ANNOUNCE] Copying Rust components to new repositories

CI is now working for arrow-datafusion so we are at a state where people can fork and open PRs. There is plenty of follow-up work to do (tracked in the google doc shared earlier) and this work will continue over the next few days. Thanks to everyone who has been involved in making this happen.

Re: [ANNOUNCE] Copying Rust components to new repositories

We were making good progress, and working through getting CI working for arrow-datafusion, but now crates.io seems to be having an outage so I am blocked now. I will be out for a few hours but will see if I can get this resolved when I am back. On Sun, Apr 18, 2021 at 12:10 PM Andy Grove wrote:

Re: [ANNOUNCE] Copying Rust components to new repositories

I found out how to enable GitHub issues and control other GitHub features by editing .asf.yaml Pretty cool actually. https://cwiki.apache.org/confluence/display/INFRA/Git+-+.asf.yaml+features On Sun, Apr 18, 2021 at 11:52 AM Krisztián Szűcs wrote: > On Sun, Apr 18, 2021 at 7:03 PM Antoine Pitr

RE: [VOTE] Release Apache Arrow 4.0.0 - RC0

Doing a little digging, it appears one was created almost exactly a year ago: https://issues.apache.org/jira/browse/ARROW-8621 It appears someone beat me to the punch, but I'm happy to revive the issue. I'll comment on it to revive it, is there anyone in particular I should tag to bring attenti

Re: [ANNOUNCE] Copying Rust components to new repositories

On Sun, Apr 18, 2021 at 7:03 PM Antoine Pitrou wrote: > > On Sun, 18 Apr 2021 18:27:27 +0200 > Jorge Cardoso Leitão wrote: > > > Yes, we are not touching apache/arrow. > > > > Does anyone know how to request permissions on github repos? We can't even > > see "Settings" atm (we can push to master)

Re: [VOTE] Release Apache Arrow 4.0.0 - RC0

Hey Matthew, Could you please create a jira issue where we could further discuss it? Thanks, Krisztian On Sun, Apr 18, 2021 at 6:52 PM Matthew Topol wrote: > > Hey All, > > So I'm not familiar enough with the release scripts to do this myself and > offer up a PR, but could the release config b

Re: [ANNOUNCE] Copying Rust components to new repositories

We aren’t allowed to access the Settings tab on the repos, if you need to configure anything, file an Infrastructure Jira and they’ll take care of it for you. On Sun, Apr 18, 2021 at 11:27 AM Jorge Cardoso Leitão < jorgecarlei...@gmail.com> wrote: > Yes, we are not touching apache/arrow. > > Does

Re: [ANNOUNCE] Copying Rust components to new repositories

On Sun, 18 Apr 2021 18:27:27 +0200 Jorge Cardoso Leitão wrote: > Yes, we are not touching apache/arrow. > > Does anyone know how to request permissions on github repos? We can't even > see "Settings" atm (we can push to master). A JIRA on INFRA? "Settings" are only available by INFRA AFAIU :-(

RE: [VOTE] Release Apache Arrow 4.0.0 - RC0

Hey All, So I'm not familiar enough with the release scripts to do this myself and offer up a PR, but could the release config be modified to also create the appropriate tags for Go module versioning with the releases? In the case of the Arrow Repo these would be "go/arrow/v4.0.0-rc0" and "go/p

Re: [ANNOUNCE] Copying Rust components to new repositories

Yes, we are not touching apache/arrow. Does anyone know how to request permissions on github repos? We can't even see "Settings" atm (we can push to master). A JIRA on INFRA? Thanks, Jorge On Sun, Apr 18, 2021 at 5:54 PM Krisztián Szűcs wrote: > On Sun, Apr 18, 2021 at 5:47 PM Antoine Pitro

Re: [ANNOUNCE] Copying Rust components to new repositories

On Sun, Apr 18, 2021 at 5:47 PM Antoine Pitrou wrote: > > > Le 18/04/2021 à 17:43, Krisztián Szűcs a écrit : > > I wouldn't overwrite the git history since there can be explicit > > commit references in other projects. > > > > Either way, please don't overwrite any of the branches until I'm > > wo

Re: [ANNOUNCE] Copying Rust components to new repositories

Le 18/04/2021 à 17:43, Krisztián Szűcs a écrit : I wouldn't overwrite the git history since there can be explicit commit references in other projects. Either way, please don't overwrite any of the branches until I'm working on the release. Ah, I think we're only talking about the arrow-rs re

Re: [ANNOUNCE] Copying Rust components to new repositories

I wouldn't overwrite the git history since there can be explicit commit references in other projects. Either way, please don't overwrite any of the branches until I'm working on the release. On Sun, Apr 18, 2021 at 5:09 PM Antoine Pitrou wrote: > > > Le 18/04/2021 à 16:36, Andy Grove a écrit : >

Re: [ANNOUNCE] Copying Rust components to new repositories

Thanks all for the info, we are going to run git filter branch next. On Sun, Apr 18, 2021 at 9:28 AM Jed Brown wrote: > Andy Grove writes: > > > We started looking at the documentation for git filter-branch and it > > recommends not to use it. It states that "git-filter-branch is riddled > with

Re: [VOTE] Release Apache Arrow 4.0.0 - RC0

On Fri, Apr 16, 2021 at 11:18 PM Sutou Kouhei wrote: > > +0 > > I got C++, C#, Java and Python related problems. Could someone > take a look at them? > > I ran the followings on Debian GNU/Linux sid: > > * TZ=UTC \ > ARROW_CMAKE_OPTIONS="-DBoost_NO_BOOST_CMAKE=ON" \ > CUDA_TOOLKIT_RO

Re: [ANNOUNCE] Copying Rust components to new repositories

Andy Grove writes: > We started looking at the documentation for git filter-branch and it > recommends not to use it. It states that "git-filter-branch is riddled with > gotchas resulting in various ways to easily corrupt repos or end up with a > mess worse than what you started with:". I've use

Re: [ANNOUNCE] Copying Rust components to new repositories

Le 18/04/2021 à 16:36, Andy Grove a écrit : Hi Wes, We started looking at the documentation for git filter-branch and it recommends not to use it. It states that "git-filter-branch is riddled with gotchas resulting in various ways to easily corrupt repos or end up with a mess worse than what y

Re: [ANNOUNCE] Copying Rust components to new repositories

Hi Wes, We started looking at the documentation for git filter-branch and it recommends not to use it. It states that "git-filter-branch is riddled with gotchas resulting in various ways to easily corrupt repos or end up with a mess worse than what you started with:". I guess we can decide to run

Re: [ANNOUNCE] Copying Rust components to new repositories

Hi Andy — are you planning to use git filter-branch to remove non-Rust-related commits from the git history? This would seem helpful to trim the repository sizes. It changes commit hashes but I suppose this is a fair trade off. On Sun, Apr 18, 2021 at 9:11 AM Andy Grove wrote: > We are now start

[ANNOUNCE] Copying Rust components to new repositories

We are now starting the process of copying the Rust components to the new repositories. There is a tracking document that we are working from [1]. We will send an update once the code is in the new repositories. We do not plan on removing code from the monorepo until after the 4.0.0 release. [1]

Re: [Rust][Datafusion] Timestamp Millisecond support

I think the `to_timestamp_*` sounds like a good idea to me On Sat, Apr 17, 2021 at 3:00 PM Evan Chan wrote: > Andrew and others, > > Thanks for your input. > > > > > 3. For functions (e.g. date_trunc(...)), I think the infrastructure for > > multiple type signatures exists, we just need implemen

[NIGHTLY] Arrow Build Report for Job nightly-2021-04-18-0

Arrow Build Report for Job nightly-2021-04-18-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-04-18-0 Failed Tasks: - conda-linux-gcc-py36-arm64: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-04-18-0-drone-conda-linux-g