Re: [DISCUSS] Move sqlparser-rs back into DataFusion project?

2024-02-27 Thread Chak-Pong Chung
There are cases where people need datafusion but not a SQL parser. For example, people building a composable query engine for graph or other data modality may not choose SQL as the DSL. Decoupling them seems to be a good idea. On Tue, Feb 27, 2024, 6:20 AM Mehmet Ozan Kabak wrote: > In this

Is there a way we can read a data frame from a cpp program in Apache fusion program in Rust?

2024-02-08 Thread Chak-Pong Chung
Hi the arrow community, https://stackoverflow.com/q/77964825/1611102 Trying to get some attention to this performance question.

Re: [DataFusion] Cypher Query Language

2022-11-16 Thread Chak-Pong Chung
Do you have some large cypher queries as test cases? Those from LDBC are relatively small. On Tue, Nov 15, 2022 at 12:40 PM Anthony GRIFFON wrote: > Hi, I wanted to discuss about the possible support of Cypher query > planning for the Datafusion project, I would like to know if you would be >

Re: vectorized processing for arrow::take()

2022-06-24 Thread Chak-Pong Chung
ce PhD Student > UC Santa Cruz > > > On Thu, Jun 23, 2022 at 12:41 PM Chak-Pong Chung > wrote: > > > correction: not clang, I meant the Vectorizers from LLVM > > > > https://llvm.org/docs/Vectorizers.html > > > > if we can use it with arrow array >

Re: vectorized processing for arrow::take()

2022-06-23 Thread Chak-Pong Chung
correction: not clang, I meant the Vectorizers from LLVM https://llvm.org/docs/Vectorizers.html if we can use it with arrow array On Thu, Jun 23, 2022 at 3:35 PM Chak-Pong Chung wrote: > I asked a question here about vectorized processing. > > > https://stackoverflow.com/questi

vectorized processing for arrow::take()

2022-06-23 Thread Chak-Pong Chung
I asked a question here about vectorized processing. https://stackoverflow.com/questions/72735678/how-to-vectorize-arrowcomputetake Any idea? I am also open to the approaches like Intel MKL, xsimd, clang and so on. -- Regards, Chak-Pong

create a debug build using arrow-cpp-feedstock

2022-03-23 Thread Chak-Pong Chung
I am trying to create a debug build using the following repo https://github.com/conda-forge/arrow-cpp-feedstock After running ``` export cuda_compiler_version=None mamba build . ``` I saw this error: ``` conda_build.exceptions.DependencyNeedsBuildingError: Unsatisfiable dependencies for

Re: Re: debug build error for arrow and gandiva

2022-03-17 Thread Chak-Pong Chung
, 2022 at 3:11 PM Chak-Pong Chung wrote: > Hi Weston, > > Thank you for taking a look at this. I have updated the build-arrow.sh > script and checked the yml for dependencies as you suggested. > > > https://drive.google.com/file/d/1F3vlIXsf_9-RAhmuIiEPLAi_CXpECgUq/view?us

Re: Re: debug build error for arrow and gandiva

2022-03-17 Thread Chak-Pong Chung
CMakeLists.txt:546 (include) > > > > > > Can anyone share the build instruction steps? > > > > > > On 2022/02/21 01:37:49 Chak-Pong Chung wrote: > > > I just tried `--preset ninja-debug-basic`, same error. > > > > > &g

Re: debug build error for arrow and gandiva

2022-02-20 Thread Chak-Pong Chung
, Feb 20, 2022 at 12:24 PM Chak-Pong Chung wrote: > I am trying to create a debug build for arrow and gandiva to be used in > c++, possibly in python as well. > > Using the following step > > cd $ARROW_SOURCE_DIR > cd cpp > > rm -rf build > mkd

debug build error for arrow and gandiva

2022-02-20 Thread Chak-Pong Chung
I am trying to create a debug build for arrow and gandiva to be used in c++, possibly in python as well. Using the following step cd $ARROW_SOURCE_DIR cd cpp rm -rf build mkdir build cd build/ cmake .. \ -DBUILD_WARNING_LEVEL=PRODUCTION \ --preset ninja-debug-gandiva cmake --build . -j 14