zhztheplayer opened a new issue, #6421:
URL: https://github.com/apache/incubator-gluten/issues/6421
### Problem description
Assuming build root is `/opt/gluten`
Dynamic build using command:
```
dev/builddeps-veloxbe.sh --build_type=RelWithDebInfo --enable_ep_cache=ON
--build_tests=ON --build_benchmarks=ON --build_arrow=OFF
```
Then execute:
```
root@55f8ad28c275:/opt/gluten# cat
/opt/gluten/cpp/build/velox/CMakeFiles/velox.dir/link.txt
ccache /usr/bin/c++ -fPIC -Wno-error=maybe-uninitialized
-Wno-error=unused-but-set-variable -Wall -Wno-sign-compare
-Wno-comment -Werror -Wno-error=parentheses
-Wno-error=unused-function -Wno-error=unused-variable
-Wno-strict-aliasing -Wno-ignored-qualifiers
-Wno-deprecated-declarations -Wno-attributes -Wno-class-memaccess -march=native
-std=c++17 -mno-avx512f -mbmi2 -O2 -g -DNDEBUG -shared -Wl,-soname,libvelox.so
-o ../releases/libvelox.so CMakeFiles/velox.dir/compute/VeloxBackend.cc.o
CMakeFiles/velox.dir/compute/VeloxRuntime.cc.o
CMakeFiles/velox.dir/compute/WholeStageResultIterator.cc.o
CMakeFiles/velox.dir/compute/VeloxPlanConverter.cc.o
CMakeFiles/velox.dir/compute/iceberg/IcebergPlanConverter.cc.o
CMakeFiles/velox.dir/jni/VeloxJniWrapper.cc.o
CMakeFiles/velox.dir/jni/JniFileSystem.cc.o
CMakeFiles/velox.dir/jni/JniUdf.cc.o
CMakeFiles/velox.dir/memory/BufferOutputStream.cc.o
CMakeFiles/velox.dir/memory/Velox
ColumnarBatch.cc.o CMakeFiles/velox.dir/memory/VeloxMemoryManager.cc.o
CMakeFiles/velox.dir/operators/functions/RegistrationAllFunctions.cc.o
CMakeFiles/velox.dir/operators/functions/RowConstructorWithNull.cc.o
CMakeFiles/velox.dir/operators/functions/SparkTokenizer.cc.o
CMakeFiles/velox.dir/operators/serializer/VeloxColumnarToRowConverter.cc.o
CMakeFiles/velox.dir/operators/serializer/VeloxColumnarBatchSerializer.cc.o
CMakeFiles/velox.dir/operators/serializer/VeloxRowToColumnarConverter.cc.o
CMakeFiles/velox.dir/operators/writer/VeloxParquetDatasource.cc.o
CMakeFiles/velox.dir/shuffle/VeloxShuffleReader.cc.o
CMakeFiles/velox.dir/shuffle/VeloxShuffleWriter.cc.o
CMakeFiles/velox.dir/shuffle/VeloxHashBasedShuffleWriter.cc.o
CMakeFiles/velox.dir/shuffle/VeloxSortBasedShuffleWriter.cc.o
CMakeFiles/velox.dir/substrait/SubstraitParser.cc.o
CMakeFiles/velox.dir/substrait/SubstraitToVeloxExpr.cc.o
CMakeFiles/velox.dir/substrait/SubstraitToVeloxPlan.cc.o
CMakeFiles/velox.dir/substrait/Substr
aitToVeloxPlanValidator.cc.o
CMakeFiles/velox.dir/substrait/VariantToVectorConverter.cc.o
CMakeFiles/velox.dir/substrait/SubstraitExtensionCollector.cc.o
CMakeFiles/velox.dir/substrait/VeloxSubstraitSignature.cc.o
CMakeFiles/velox.dir/substrait/VeloxToSubstraitExpr.cc.o
CMakeFiles/velox.dir/substrait/VeloxToSubstraitPlan.cc.o
CMakeFiles/velox.dir/substrait/VeloxToSubstraitType.cc.o
CMakeFiles/velox.dir/udf/UdfLoader.cc.o
CMakeFiles/velox.dir/utils/VeloxArrowUtils.cc.o
CMakeFiles/velox.dir/utils/ConfigExtractor.cc.o
CMakeFiles/velox.dir/utils/Common.cc.o
CMakeFiles/velox.dir/utils/VeloxBatchAppender.cc.o
CMakeFiles/velox.dir/utils/tests/MemoryPoolUtils.cc.o
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/FileHandle.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/HiveConfig.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/
connectors/hive/CMakeFiles/velox_hive_connector.dir/HiveConnector.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/HiveDataSink.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/HiveDataSource.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/HivePartitionUtil.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/PartitionIdGenerator.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/SplitReader.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velox_hive_connector.dir/TableHandle.cpp.o"
"/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/connectors/hive/CMakeFiles/velo
x_hive_connector.dir/HiveConnectorUtil.cpp.o"
-Wl,-rpath,/opt/gluten/cpp/build/releases:/usr/local/lib
../releases/libgluten.so
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/expression/signature_parser/libvelox_signature_parser.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/functions/sparksql/libvelox_functions_spark.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/functions/sparksql/aggregates/libvelox_functions_spark_aggregates.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/functions/sparksql/window/libvelox_functions_spark_window.a
...
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/common/compression/libvelox_common_compression.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/common/io/libvelox_common_io.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/velox/common/base/libvelox_status.a
/usr/local/lib/libfolly.a /usr/lib/x86_64-linux-gnu/libre2.so
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/_deps/libstemmer/src/libstemmer/libstemmer.a
/usr/local/lib/libsimdjson.a /usr/lib/x86_64-linux-gnu/libthrift.so
/usr/local/lib/libprotobuf.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/CMake/resolve_dependency_modules/arrow/arrow_ep/install/lib/libparquet.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/CMake/resolve_dependency_modules/arrow/arrow_ep/install/lib/libarrow.a
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/CMake/resolve_dependency_modules/arrow/arrow_ep/install/lib/libarrow_bundled_dependencies.a
/usr/local/lib/libduckdb_fss
t.a /usr/local/lib/libduckdb_fmt.a /usr/local/lib/libduckdb_pg_query.a
/usr/local/lib/libduckdb_re2.a /usr/local/lib/libduckdb_miniz.a
/usr/local/lib/libduckdb_utf8proc.a /usr/local/lib/libduckdb_hyperloglog.a
/usr/local/lib/libduckdb_fastpforlib.a /usr/local/lib/libduckdb_mbedtls.a
/usr/local/lib/libjemalloc_extension.a /usr/local/lib/libfmt.a
/usr/local/lib/libboost_context.so.1.84.0
/usr/local/lib/libboost_filesystem.so.1.84.0
/usr/local/lib/libboost_atomic.so.1.84.0
/usr/local/lib/libboost_program_options.so.1.84.0
/usr/local/lib/libboost_regex.so.1.84.0
/usr/local/lib/libboost_system.so.1.84.0
/usr/local/lib/libboost_thread.so.1.84.0
/usr/lib/x86_64-linux-gnu/libdouble-conversion.so
/usr/lib/x86_64-linux-gnu/libgflags.so.2.2.2 -lpthread
/usr/lib/x86_64-linux-gnu/libglog.so /usr/lib/x86_64-linux-gnu/libevent.so
/usr/local/lib/libz.a /usr/lib/x86_64-linux-gnu/libssl.so
/usr/lib/x86_64-linux-gnu/libcrypto.so /usr/lib/x86_64-linux-gnu/libbz2.so
/usr/lib/x86_64-linux-gnu/liblzma.so
/usr/lib/x86_64-linux-gnu/liblz4.so /usr/lib/x86_64-linux-gnu/libzstd.so
/usr/lib/x86_64-linux-gnu/libsnappy.so /usr/lib/x86_64-linux-gnu/libdwarf.so
/usr/lib/x86_64-linux-gnu/libiberty.a /usr/lib/x86_64-linux-gnu/libsodium.so
-ldl -pthread
```
Then execute:
```
root@55f8ad28c275:/opt/gluten/ep/build-velox/build/velox_ep# cat
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/CMake/resolve_dependency_modules/arrow/arrow_ep/src/arrow_ep-build/.ninja_log
# ninja log v5
...
7046 7056 1720687570111435294
/opt/gluten/ep/build-velox/build/velox_ep/_build/release/CMake/resolve_dependency_modules/arrow/arrow_ep/src/arrow_ep-build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-mkdir
2c0ea5d02d8076c5
16 10981 1720745021072192377
src/arrow/CMakeFiles/arrow_objlib.dir/util/decimal.cc.o 3c686a9f0c426c0c
22558 31075 1720687585611435498 thrift_ep-install/lib/libthrift.a
129e2494dab81d34
49573 59081 1720687622111435979
src/parquet/CMakeFiles/parquet_objlib.dir/encryption/internal_file_encryptor.cc.o
9ccbd1ab17f80b14
46811 47470 1720687610515435826
src/arrow/CMakeFiles/arrow_objlib.dir/vendored/uriparser/UriShorten.c.o
57f317106c1095a1
...
```
Gave reason that `libvelox.so` uses `/usr/lib/x86_64-linux-gnu/libthrift.so`
and `libarrow.a` uses
`/opt/gluten/ep/build-velox/build/velox_ep/_build/release/CMake/resolve_dependency_modules/arrow/arrow_ep/src/arrow_ep-build/thrift_ep-install/lib/libthrift.a`.
### System information
Velox System Info v0.0.2
Commit: e2ad9148b7dfa114a1bbb72d94db0d2f8e5cb26e
CMake Version: 3.29.2
System: Linux-5.4.0-156-generic
Arch: x86_64
CPU Name: Model name: Intel(R) Xeon(R) Platinum 8280
CPU @ 2.70GHz
C++ Compiler: /usr/bin/c++
C++ Compiler Version: 9.4.0
C Compiler: /usr/bin/cc
C Compiler Version: 12.0.0
CMake Prefix Path:
/usr/local;/usr;/;/opt/cmake;/usr/local;/usr/X11R6;/usr/pkg;/opt
### CMake log
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
