Re: [C++] adopting an SIMD library - xsimd

Thanks for comments on the SIMD related PR: https://github.com/apache/arrow/pull/9424. Agree to adopt the *xsimd *as the SIMD wrapper library for Arrow to avoid a large maintenance burden. It makes sense. It seems *ximd *is designed for mathematics calculating and it lacks the functions like bit/b

[C++] Why are these two tables unequal?

Hi, This is an extremely weird phenomenon. There are two 2*1 tables that are supposedly different when I got a confusing error message like this: [ RUN ] TestAdapterWriteNested.writeList /Users/karlkatzen/Documents/code/arrow-dev/arrow/cpp/src/arrow/testing/gtest_util.cc:459: Failure Faile

[CI] Stale Github Actions runs now automatically cancelled

Hello, Just an announcement that, since https://github.com/apache/arrow/pull/9455 has been merged, stale CI jobs on Github Actions should now be automatically cancelled. By "stale jobs", we mean a job that concerns a changeset that has been superseded by another changeset on the same PR (note t

[Rust] [DataFusion] Target-typing for string literal scalars in queries

Hey all, I'm currently running some UX testing for a prototype DB engine integrating DataFusion, and one recurring point that crops up is that specifying literal timestamps, e.g. as gt/lt predicates in a where clause, is a bit awkward right now. Most of the testing is borrowing existing queries

Re: [MATLAB] Developing a MATLAB Interface for Apache Arrow

Hi All, Just a friendly reminder that today is the soft feedback deadline mentioned in my previous email for providing feedback on the MATLAB interface design doc ( https://mathworks-my.sharepoint.com/:w:/p/kgurney/EcNXJh5S-HBCit-YNL6ZYnEB4Mv9ZPTVEs7a72SWlywIsg ). Please feel free to comment on

Arrow JS Meetup (02/13)

Hi all, +Dominik Moritz recently reached out to +Paul Taylor and myself to set up an Arrow JS meetup with the goal of re-building some momentum around the Arrow JS library. We've scheduled it for this coming Saturday, 02/13 at 11:30 AM PST. Rough Agenda: - Arrow JS Design Principles, Future Pla

Re: [C++] adopting an SIMD library - xsimd

Le 09/02/2021 à 10:36, Antoine Pitrou a écrit : > > Note that we need to decouple the SIMD level available at compile-time > from the SIMD level available at runtime. That is, we typically build > optional AVX512 accelerations at compile-time, but only enable them at > runtime if the CPU suppor

Re: [FlightRPC] Add a "Flight SQL" extension on top of FlightRPC

Hi Tiffany, Great! Thanks for the update, I'll take another look today. Best, David On Mon, Feb 8, 2021, at 20:52, Hoi Ling Tiffany Lam wrote: > HI David, > > I will be taking over the work for Flight SQL. Last week, I created a draft > PR to Arrow Main

[NIGHTLY] Arrow Build Report for Job nightly-2021-02-09-0

Arrow Build Report for Job nightly-2021-02-09-0 All tasks: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-09-0 Failed Tasks: - conda-linux-gcc-py36-aarch64: URL: https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-09-0-drone-conda-linux

Re: [C++] adopting an SIMD library

Note that we need to decouple the SIMD level available at compile-time from the SIMD level available at runtime. That is, we typically build optional AVX512 accelerations at compile-time, but only enable them at runtime if the CPU supports AVX512 (and if the environment variable ARROW_USER_SIMD_

Re: [C++] adopting an SIMD library

For what it's worth, I have been using xsimd at my job for ~1 year, and can only recommend it (optimization of ML clustering code on CPU). Straightforward to use, easy to extend to support additional instructions. The API is clear and the implementation follows modern C++ practices. On Tue, Feb