[
https://issues.apache.org/jira/browse/IMPALA-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17792170#comment-17792170
]
ASF subversion and git services commented on IMPALA-11542:
----------------------------------------------------------
Commit 67e4ff67cff6d6a77bfca43ef0c06b91f7a6661e in impala's branch
refs/heads/master from Michael Smith
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=67e4ff67c ]
IMPALA-11542: Implement pre-allocation in LLVM memory manager
Implements up-front allocation for the LLVM memory manager to avoid
disparate sections on ARM which can exceed the 4GB limit for ADRP
instructions and crash (or hit an assertion in debug mode).
This is an LLVM issue that we're fixing by providing a custom memory
manager. See the JIRA and
https://discourse.llvm.org/t/llvm-rtdyld-aarch64-abi-relocation-restrictions/74616
for further discussion.
Testing:
- passes debug test run on ARM
- pre-commit tests
Change-Id: I9f224edcdbdcb05fce663c18b4a5f03c8e985675
Reviewed-on: http://gerrit.cloudera.org:8080/20692
Tested-by: Michael Smith <michael.sm...@cloudera.com>
Reviewed-by: Joe McDonnell <joemcdonn...@cloudera.com>
> TestFailpoints::test_failpoints crash in ARM build
> --------------------------------------------------
>
> Key: IMPALA-11542
> URL: https://issues.apache.org/jira/browse/IMPALA-11542
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 4.1.0
> Reporter: Quanlong Huang
> Assignee: Michael Smith
> Priority: Critical
> Labels: arm
> Fix For: Impala 4.4.0
>
>
> Saw the crash in
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch-ARM/13]
> In the ERROR log:
> {noformat}
> Picked up JAVA_TOOL_OPTIONS:
> -agentlib:jdwp=transport=dt_socket,address=30000,server=y,suspend=n
> impalad:
> /home/ubuntu/native-toolchain/source/llvm/llvm-5.0.1-asserts.src-p3/lib/ExecutionEngine/RuntimeDyld/RuntimeDyldELF.cpp:400:
> void llvm::RuntimeDyldELF::resolveAArch64Relocation(const
> llvm::SectionEntry&, uint64_t, uint64_t, uint32_t, int64_t): Assertion
> `isInt<33>(Result) && "overflow check failed for relocation"' failed.
> Minidump in thread [20013]exec-finstance
> (finst:1e4a0f56622f2a15:51c2970900000005) running query
> 1e4a0f56622f2a15:51c2970900000000, fragment instance
> 1e4a0f56622f2a15:51c2970900000005
> Wrote minidump to
> /home/ubuntu/Impala/logs/ee_tests/minidumps/impalad/de4830d8-009d-47f4-f14bb68a-f0d8cd4c.dmp
> {noformat}
> In the INFO log:
> {noformat}
> I0830 06:54:49.173234 11329 impala-beeswax-server.cc:516] query: Query {
> 01: query (string) = "SELECT STRAIGHT_JOIN *\n FROM alltypes t1\n
> JOIN /*+broadcast*/ alltypesagg t2 ON t1.id = t2.id\n
> WHERE t2.int_col < 1000",
> 03: configuration (list) = list<string>[10] {
> [0] = "CLIENT_IDENTIFIE[...](273)",
> [1] = "TEST_REPLAN=1",
> [2] = "DISABLE_CODEGEN=False",
> [3] = "BATCH_SIZE=0",
> [4] = "NUM_NODES=0",
> [5] = "DISABLE_CODEGEN_ROWS_THRESHOLD=0",
> [6] = "MT_DOP=4",
> [7] = "ABORT_ON_ERROR=1",
> [8] =
> "DEBUG_ACTION=4:GETNEXT:MEM_LIMIT_EXCEEDED|COORD_BEFORE_EXEC_RPC:JITTER@100@0.3",
> [9] = "EXEC_SINGLE_NODE_ROWS_THRESHOLD=0",
> },
> 04: hadoop_user (string) = "ubuntu",
> }
> ...
> 74: client_identifier (string) =
> "failure/test_failpoints.py::TestFailpoints::()::test_failpoints[protocol:beeswax|table_format:seq/snap/block|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_sing",
> ...
> I0830 06:54:49.173739 11329 Frontend.java:1877]
> 1e4a0f56622f2a15:51c2970900000000] Analyzing query: SELECT STRAIGHT_JOIN *
> FROM alltypes t1
> JOIN /*+broadcast*/ alltypesagg t2 ON t1.id = t2.id
> WHERE t2.int_col < 1000 db: functional_seq_snap {noformat}
> The client_identifier shows it's TestFailpoints::test_failpoints.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
