Hi,
One more concern:
* ASF's Bintray -> Artifactory migration isn't finished yet.
https://lists.apache.org/thread.html/r9200fed3fa812f8c7de07a2500425f258db3231baa8e05f288175e4a%40%3Cbuilds.apache.org%3E
I think that this is not a blocker. We'll not release
deb/rpm packages when we releas
Arrow Build Report for Job nightly-2021-04-09-0
All tasks:
https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-04-09-0
Failed Tasks:
- conda-linux-gcc-py36-aarch64:
URL:
https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-04-09-0-drone-conda-linux
I agree -- thank you Andy for your perseverance through the process. Things
are looking bright from my perspective as well
On Thu, Apr 8, 2021 at 9:14 PM Wes McKinney wrote:
> Congrats Andy! I know this was a lot of work, but I think it speaks to
> a bright future for the Arrow ecosystem. Once w
When I use "pd.read_parquet(path,engine='pyarrow??)?? to load my dataset,the
loaded dataset appears where one piece of data is copied into two??but
fastparquet will not.
Following on from the email thread "Rust sync meeting" I would like to
start a new discussion about moving the Rust components out to new GitHub
repositories and using a new process for issues and release management.
I have started a Google document [1] with details and to track the work
required
Looks like we aren't quite ready to release. Nightly build failures seem to
have increased rather than decreased, and we're still at 66 open issues on
https://cwiki.apache.org/confluence/display/ARROW/Arrow+4.0.0+Release
despite our work this week (and despite my attempts to bump issues out of
scop
As Jorge points out here [1], the tests in datafusion/src/context.rs are
not really unit tests. They are more like SQL integration tests. There is
also a small and languishing set of sql tests in `rust/datafusion/tests/
sql.rs`.
These tests are critical for DataFusion's quality and I would like to
Thank you for the report. So you have a minimal repro to reproduce the
issue you are seeing?
On Friday, April 9, 2021, 谢旗旺 <1415850...@qq.com> wrote:
> When I use "pd.read_parquet(path,engine='pyarrow’)” to load my
> dataset,the loaded dataset appears where one piece of data is copied into
> two
Thanks, Andy. Two areas of concern I think we should have some answer for
before going forward with this (and I make no opinions as to what the
"right" answers are, just raising them for discussion):
1. Integration testing: what is our workflow for ensuring that our
implementations are integration
I personally believe we should continue to release the rust arrow crate in
such a way that the major versions match the other implementations, for
precisely the reasons you mention.
On Fri, Apr 9, 2021 at 4:34 PM Neal Richardson
wrote:
> Thanks, Andy. Two areas of concern I think we should hav
>
> " Crates can depend on GitHub commit hashes between releases"
This sounds like it might not align with ASF release policies [1].
[1] https://www.apache.org/legal/release-policy.html#release-definition
On Fri, Apr 9, 2021 at 1:34 PM Neal Richardson
wrote:
> Thanks, Andy. Two areas of conc
Hi Micah,
During development, the Rust crates have local dependencies on each other
based on relative file system paths. At release time, we change these to
versioned dependencies before publishing, because it isn't possible to
publish a crate that depends on non-published crates.
With the code i
>
> With this explanation do you still have a concern? There is no suggestion
> of making releases that depend on GitHub hashes.
No, I don't think so. IIUC you are saying the crates dependency does not
imply the crate artifacts are published elsewhere. This sounds inline with
policies to me. Fo
> I'm assuming the idea is that the existing integration tests will remain in
> apache/arrow. Will you also run the integration test suites on your rust
> repository CI checks?
Furthermore, against what version will these tests run?
* If Arrow runs against the latest release of Rust then it wil
On Fri, Apr 9, 2021 at 4:57 PM Weston Pace wrote:
> Note, these problems technically exist now with the concept that any
> language can release a patch at any time. Also, since Rust isn't
> directly compiling against other Arrow libs and we are only talking
> about interoperability it's probably
Hi Kou,
Thank you for the reply.
I am busy in some other stuff as well, will wait for Flight APIs integration
into c_glib.
Regards,
Tanveer Ahmad
From: Sutou Kouhei
Sent: Friday, April 9, 2021 6:40:08 AM
To: dev@arrow.apache.org
Cc: u...@arrow.apache.org
Subj
Hi,
The major problem that we are addressing with an independent release cycle
is that the
large majority of our users do not use released versions, neither from ASF
archives nor
from Cargo crates. They use a git hash commit. This is a problem because
our git hashes
are *de facto* releases.
This
17 matches
Mail list logo