FelixYBW commented on code in PR #11261: URL: https://github.com/apache/incubator-gluten/pull/11261#discussion_r2665916494
########## README.md: ########## @@ -154,6 +154,52 @@ ClickHouse backend demonstrated an average speedup of 2.12x, with up to 3.48x sp <sub>Test environment: a 8-nodes AWS cluster with 1TB data, using Spark 3.1.1 as the baseline and with Gluten integrated into the same Spark version.</sub> +### Bolt Backend +#### Prerequisites +* Linux operating system +* GCC 10/11/12 or Clang 16 +* python 3 (virtualenv or Conda) for conan + +Linux with kernel version(>5.4) is preferred, since Bolt will enable io-uring when the kernel supports. + +if the system gcc version is too older, it is recommended to install GCC from source code: +```shell +# run with root privilege +bash ./dev/install-gcc.sh 12.5.0 +``` + +Bolt adopts Conan as its package manager. Conan is an open-source, cross-platform package management tool. +We provide dedicated scripts to assist developers in setting up and installing Bolt's dependencies. +```shell +bash ./dev/install-conan.sh +``` + + +To install bolt recipe for Gluten: +```shell +# Install the recipes of Bolt and its third-party dependencies +make bolt-recipe + +# specific a version of Bolt (release or branch) +# `main` branch is the default +make bolt-recipe BOLT_BUILD_VERSION=main +``` + +To build bolt backend: +```shell +make release + +# or specific the version for Bolt, and the version for Gluten +make release BOLT_BUILD_VERSION=main GLUTEN_BUILD_VERSION=main +``` +Note that, the missing third-parties binaries will be built from source for the first time. Review Comment: we need to build arrow before gluten: make arrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
