[ https://issues.apache.org/jira/browse/SPARK-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mauro Pirrone updated SPARK-10712: ---------------------------------- Description: When turning on tungsten, I get the following error when executing a query/job with a few joins. When tungsten is turned off, the error does not appear. Also note that tungsten works for me in other cases. # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007ffadaf59200, pid=7598, tid=140710015645440 # # JRE version: Java(TM) SE Runtime Environment (8.0_45-b14) (build 1.8.0_45-b14) # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.45-b02 mixed mode linux-amd64 compressed oops) # Problematic frame: # V [libjvm.so+0x7eb200] # # Core dump written. Default location: //core or core.7598 (max size 1000000 kB). To ensure a full core dump, try "ulimit -c unlimited" before starting Java again # # An error report file with more information is saved as: # //hs_err_pid7598.log Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory (native) total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872 relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72 main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504 Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory (native) total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872 relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72 main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504 # # If you would like to submit a bug report, please visit: # http://bugreport.java.com/bugreport/crash.jsp # --------------- T H R E A D --------------- Current thread (0x00007ff7902e7800): JavaThread "broadcast-hash-join-1" daemon [_thread_in_vm, id=16548, stack(0x00007ff66bd98000,0x00007ff66be99000)] siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: 0x000000069f572b10 Registers: RAX=0x000000069f672b08, RBX=0x00007ff7902e7800, RCX=0x0000000394132140, RDX=0xfffffffffffe0004 RSP=0x00007ff66be97048, RBP=0x00007ff66be970a0, RSI=0x0000000394032148, RDI=0x000000069f572b10 R8 =0x00007ff66be970d0, R9 =0x0000000000000028, R10=0x00007ff79cc0e1e7, R11=0x00007ff79cc0e198 R12=0x00007ff66be970c0, R13=0x00007ff66be970d0, R14=0x0000000000000028, R15=0x0000000030323048 RIP=0x00007ff7b0dae200, EFLAGS=0x0000000000010282, CSGSFS=0x000000000000e033, ERR=0x0000000000000004 TRAPNO=0x000000000000000e Top of Stack: (sp=0x00007ff66be97048) 0x00007ff66be97048: 00007ff7b1042b1a 00007ff7902e7800 0x00007ff66be97058: 00007ff700000000 00007ff7902e7800 0x00007ff66be97068: 00007ff7902e7800 00007ff7ad2846a0 0x00007ff66be97078: 00007ff7897048d8 0000000000000000 0x00007ff66be97088: 00007ff66be97110 00007ff66be971f0 0x00007ff66be97098: 00007ff7902e7800 00007ff66be970f0 0x00007ff66be970a8: 00007ff79cc0e261 0000000000100000 0x00007ff66be970b8: 0000000390c04048 000000066f24fac8 0x00007ff66be970c8: 00007ff7902e7800 0000000394032120 0x00007ff66be970d8: 00007ff7902e7800 00007ff66f971af0 0x00007ff66be970e8: 00007ff7902e7800 00007ff66be97198 0x00007ff66be970f8: 00007ff79c9d4c4d 00007ff66a454b10 0x00007ff66be97108: 00007ff79c9d4c4d 0000000000100000 0x00007ff66be97118: 00007ff7902e5a90 0000000000000028 0x00007ff66be97128: 00007ff79c9d4760 0000000394032120 0x00007ff66be97138: 0000000030323048 00007ff66be97160 0x00007ff66be97148: 000000066f24fac8 0000000390c04048 0x00007ff66be97158: 00007ff66be97158 00007ff66f978eeb 0x00007ff66be97168: 00007ff66be971f0 00007ff66f9791c8 0x00007ff66be97178: 00007ff668e90c60 00007ff66f978f60 0x00007ff66be97188: 00007ff66be97110 00007ff66be971b8 0x00007ff66be97198: 00007ff66be97238 00007ff79c9d4c4d 0x00007ff66be971a8: 0000000000100000 0000000000000000 0x00007ff66be971b8: 0000000038363130 0000000038363130 0x00007ff66be971c8: 0000000000000028 00007ff66f973388 0x00007ff66be971d8: 0000000394032120 0000000030323048 0x00007ff66be971e8: 0000000665823080 000000066f24fac8 0x00007ff66be971f8: 00007ff66be971f8 00007ff66f973357 0x00007ff66be97208: 00007ff66be97260 00007ff66f976fe0 0x00007ff66be97218: 0000000000000000 00007ff66f973388 0x00007ff66be97228: 00007ff66be971b8 00007ff66be97248 0x00007ff66be97238: 00007ff66be972a8 00007ff79c9d4c4d Instructions: (pc=0x00007ff7b0dae200) 0x00007ff7b0dae1e0: 00 00 00 48 8d 4c d6 f8 48 f7 da eb 39 48 8b 74 0x00007ff7b0dae1f0: d0 08 48 89 74 d1 08 48 83 c2 01 75 f0 c3 66 90 0x00007ff7b0dae200: 48 8b 74 d0 e8 48 89 74 d1 e8 48 8b 74 d0 f0 48 0x00007ff7b0dae210: 89 74 d1 f0 48 8b 74 d0 f8 48 89 74 d1 f8 48 8b Register to memory mapping: RAX=0x000000069f672b08 is an unallocated location in the heap RBX=0x00007ff7902e7800 is a thread RCX=0x0000000394132140 is pointing into object: 0x0000000394032120 [B - klass: {type array byte} - length: 1886151312 RDX=0xfffffffffffe0004 is an unknown value RSP=0x00007ff66be97048 is pointing into the stack for thread: 0x00007ff7902e7800 RBP=0x00007ff66be970a0 is pointing into the stack for thread: 0x00007ff7902e7800 RSI=0x0000000394032148 is pointing into object: 0x0000000394032120 [B - klass: {type array byte} - length: 1886151312 RDI=0x000000069f572b10 is an unallocated location in the heap R8 =0x00007ff66be970d0 is pointing into the stack for thread: 0x00007ff7902e7800 R9 =0x0000000000000028 is an unknown value R10=0x00007ff79cc0e1e7 is at entry_point+103 in (nmethod*)0x00007ff79cc0e010 R11=0x00007ff79cc0e198 is at entry_point+24 in (nmethod*)0x00007ff79cc0e010 R12=0x00007ff66be970c0 is pointing into the stack for thread: 0x00007ff7902e7800 R13=0x00007ff66be970d0 is pointing into the stack for thread: 0x00007ff7902e7800 R14=0x0000000000000028 is an unknown value R15=0x0000000030323048 is an unknown value Stack: [0x00007ff66bd98000,0x00007ff66be99000], sp=0x00007ff66be97048, free space=1020k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x7eb200] J 8305 sun.misc.Unsafe.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V (0 bytes) @ 0x00007ff79cc0e261 [0x00007ff79cc0e180+0xe1] j org.apache.spark.unsafe.Platform.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V+27 j org.apache.spark.unsafe.types.UTF8String.writeToMemory(Ljava/lang/Object;J)V+15 j org.apache.spark.sql.catalyst.expressions.UnsafeRowWriters$UTF8StringWriter.write(Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;IILorg/apache/spark/unsafe/types/UTF8String;)I+48 j org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(Lorg/apache/spark/sql/catalyst/InternalRow;)Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;+160 j org.apache.spark.sql.execution.joins.UnsafeHashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/UnsafeProjection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+39 j org.apache.spark.sql.execution.joins.HashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/package$Projection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+18 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Lorg/apache/spark/broadcast/Broadcast;+88 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Ljava/lang/Object;+1 j org.apache.spark.sql.execution.SQLExecution$.withExecutionId(Lorg/apache/spark/SparkContext;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;+20 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Lorg/apache/spark/broadcast/Broadcast;+22 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Ljava/lang/Object;+1 j scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1()Lscala/util/Try;+8 j scala.concurrent.impl.Future$PromiseCompletingRunnable.run()V+39 j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95 j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5 j java.lang.Thread.run()V+11 v ~StubRoutines::call_stub V [libjvm.so+0x681a26] V [libjvm.so+0x681f31] V [libjvm.so+0x6823d7] V [libjvm.so+0x718280] V [libjvm.so+0xa5c86f] V [libjvm.so+0xa5c99c] V [libjvm.so+0x910de8] C [libpthread.so.0+0x7a51] Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) J 8305 sun.misc.Unsafe.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V (0 bytes) @ 0x00007ff79cc0e1e7 [0x00007ff79cc0e180+0x67] j org.apache.spark.unsafe.Platform.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V+27 j org.apache.spark.unsafe.types.UTF8String.writeToMemory(Ljava/lang/Object;J)V+15 j org.apache.spark.sql.catalyst.expressions.UnsafeRowWriters$UTF8StringWriter.write(Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;IILorg/apache/spark/unsafe/types/UTF8String;)I+48 j org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(Lorg/apache/spark/sql/catalyst/InternalRow;)Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;+160 j org.apache.spark.sql.execution.joins.UnsafeHashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/UnsafeProjection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+39 j org.apache.spark.sql.execution.joins.HashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/package$Projection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+18 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Lorg/apache/spark/broadcast/Broadcast;+88 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Ljava/lang/Object;+1 j org.apache.spark.sql.execution.SQLExecution$.withExecutionId(Lorg/apache/spark/SparkContext;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;+20 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Lorg/apache/spark/broadcast/Broadcast;+22 j org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Ljava/lang/Object;+1 j scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1()Lscala/util/Try;+8 j scala.concurrent.impl.Future$PromiseCompletingRunnable.run()V+39 j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95 j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5 j java.lang.Thread.run()V+11 v ~StubRoutines::call_stub was: When turning on tungsten, I get the following error when executing a query/job with a few joins. When tungsten is turned off, the error does not appear. Also note that tungsten works for me in other cases. # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007ffadaf59200, pid=7598, tid=140710015645440 # # JRE version: Java(TM) SE Runtime Environment (8.0_45-b14) (build 1.8.0_45-b14) # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.45-b02 mixed mode linux-amd64 compressed oops) # Problematic frame: # V [libjvm.so+0x7eb200] # # Core dump written. Default location: //core or core.7598 (max size 1000000 kB). To ensure a full core dump, try "ulimit -c unlimited" before starting Java again # # An error report file with more information is saved as: # //hs_err_pid7598.log Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory (native) total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872 relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72 main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504 Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory (native) total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872 relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72 main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504 # # If you would like to submit a bug report, please visit: # http://bugreport.java.com/bugreport/crash.jsp # > JVM crashes with spark.sql.tungsten.enabled = true > -------------------------------------------------- > > Key: SPARK-10712 > URL: https://issues.apache.org/jira/browse/SPARK-10712 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.5.0 > Environment: 1 node - Linux, 64GB ram, 8 core > Reporter: Mauro Pirrone > Priority: Critical > > When turning on tungsten, I get the following error when executing a > query/job with a few joins. When tungsten is turned off, the error does not > appear. Also note that tungsten works for me in other cases. > # A fatal error has been detected by the Java Runtime Environment: > # > # SIGSEGV (0xb) at pc=0x00007ffadaf59200, pid=7598, tid=140710015645440 > # > # JRE version: Java(TM) SE Runtime Environment (8.0_45-b14) (build > 1.8.0_45-b14) > # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.45-b02 mixed mode > linux-amd64 compressed oops) > # Problematic frame: > # V [libjvm.so+0x7eb200] > # > # Core dump written. Default location: //core or core.7598 (max size 1000000 > kB). To ensure a full core dump, try "ulimit -c unlimited" before starting > Java again > # > # An error report file with more information is saved as: > # //hs_err_pid7598.log > Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory > (native) > total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872 > relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72 > main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504 > Compiled method (nm) 44403 10436 n 0 sun.misc.Unsafe::copyMemory > (native) > total in heap [0x00007ffac6b49290,0x00007ffac6b495f8] = 872 > relocation [0x00007ffac6b493b8,0x00007ffac6b49400] = 72 > main code [0x00007ffac6b49400,0x00007ffac6b495f8] = 504 > # > # If you would like to submit a bug report, please visit: > # http://bugreport.java.com/bugreport/crash.jsp > # > --------------- T H R E A D --------------- > Current thread (0x00007ff7902e7800): JavaThread "broadcast-hash-join-1" > daemon [_thread_in_vm, id=16548, stack(0x00007ff66bd98000,0x00007ff66be99000)] > siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: > 0x000000069f572b10 > Registers: > RAX=0x000000069f672b08, RBX=0x00007ff7902e7800, RCX=0x0000000394132140, > RDX=0xfffffffffffe0004 > RSP=0x00007ff66be97048, RBP=0x00007ff66be970a0, RSI=0x0000000394032148, > RDI=0x000000069f572b10 > R8 =0x00007ff66be970d0, R9 =0x0000000000000028, R10=0x00007ff79cc0e1e7, > R11=0x00007ff79cc0e198 > R12=0x00007ff66be970c0, R13=0x00007ff66be970d0, R14=0x0000000000000028, > R15=0x0000000030323048 > RIP=0x00007ff7b0dae200, EFLAGS=0x0000000000010282, CSGSFS=0x000000000000e033, > ERR=0x0000000000000004 > TRAPNO=0x000000000000000e > Top of Stack: (sp=0x00007ff66be97048) > 0x00007ff66be97048: 00007ff7b1042b1a 00007ff7902e7800 > 0x00007ff66be97058: 00007ff700000000 00007ff7902e7800 > 0x00007ff66be97068: 00007ff7902e7800 00007ff7ad2846a0 > 0x00007ff66be97078: 00007ff7897048d8 0000000000000000 > 0x00007ff66be97088: 00007ff66be97110 00007ff66be971f0 > 0x00007ff66be97098: 00007ff7902e7800 00007ff66be970f0 > 0x00007ff66be970a8: 00007ff79cc0e261 0000000000100000 > 0x00007ff66be970b8: 0000000390c04048 000000066f24fac8 > 0x00007ff66be970c8: 00007ff7902e7800 0000000394032120 > 0x00007ff66be970d8: 00007ff7902e7800 00007ff66f971af0 > 0x00007ff66be970e8: 00007ff7902e7800 00007ff66be97198 > 0x00007ff66be970f8: 00007ff79c9d4c4d 00007ff66a454b10 > 0x00007ff66be97108: 00007ff79c9d4c4d 0000000000100000 > 0x00007ff66be97118: 00007ff7902e5a90 0000000000000028 > 0x00007ff66be97128: 00007ff79c9d4760 0000000394032120 > 0x00007ff66be97138: 0000000030323048 00007ff66be97160 > 0x00007ff66be97148: 000000066f24fac8 0000000390c04048 > 0x00007ff66be97158: 00007ff66be97158 00007ff66f978eeb > 0x00007ff66be97168: 00007ff66be971f0 00007ff66f9791c8 > 0x00007ff66be97178: 00007ff668e90c60 00007ff66f978f60 > 0x00007ff66be97188: 00007ff66be97110 00007ff66be971b8 > 0x00007ff66be97198: 00007ff66be97238 00007ff79c9d4c4d > 0x00007ff66be971a8: 0000000000100000 0000000000000000 > 0x00007ff66be971b8: 0000000038363130 0000000038363130 > 0x00007ff66be971c8: 0000000000000028 00007ff66f973388 > 0x00007ff66be971d8: 0000000394032120 0000000030323048 > 0x00007ff66be971e8: 0000000665823080 000000066f24fac8 > 0x00007ff66be971f8: 00007ff66be971f8 00007ff66f973357 > 0x00007ff66be97208: 00007ff66be97260 00007ff66f976fe0 > 0x00007ff66be97218: 0000000000000000 00007ff66f973388 > 0x00007ff66be97228: 00007ff66be971b8 00007ff66be97248 > 0x00007ff66be97238: 00007ff66be972a8 00007ff79c9d4c4d > Instructions: (pc=0x00007ff7b0dae200) > 0x00007ff7b0dae1e0: 00 00 00 48 8d 4c d6 f8 48 f7 da eb 39 48 8b 74 > 0x00007ff7b0dae1f0: d0 08 48 89 74 d1 08 48 83 c2 01 75 f0 c3 66 90 > 0x00007ff7b0dae200: 48 8b 74 d0 e8 48 89 74 d1 e8 48 8b 74 d0 f0 48 > 0x00007ff7b0dae210: 89 74 d1 f0 48 8b 74 d0 f8 48 89 74 d1 f8 48 8b > Register to memory mapping: > RAX=0x000000069f672b08 is an unallocated location in the heap > RBX=0x00007ff7902e7800 is a thread > RCX=0x0000000394132140 is pointing into object: 0x0000000394032120 > [B > - klass: {type array byte} > - length: 1886151312 > RDX=0xfffffffffffe0004 is an unknown value > RSP=0x00007ff66be97048 is pointing into the stack for thread: > 0x00007ff7902e7800 > RBP=0x00007ff66be970a0 is pointing into the stack for thread: > 0x00007ff7902e7800 > RSI=0x0000000394032148 is pointing into object: 0x0000000394032120 > [B > - klass: {type array byte} > - length: 1886151312 > RDI=0x000000069f572b10 is an unallocated location in the heap > R8 =0x00007ff66be970d0 is pointing into the stack for thread: > 0x00007ff7902e7800 > R9 =0x0000000000000028 is an unknown value > R10=0x00007ff79cc0e1e7 is at entry_point+103 in (nmethod*)0x00007ff79cc0e010 > R11=0x00007ff79cc0e198 is at entry_point+24 in (nmethod*)0x00007ff79cc0e010 > R12=0x00007ff66be970c0 is pointing into the stack for thread: > 0x00007ff7902e7800 > R13=0x00007ff66be970d0 is pointing into the stack for thread: > 0x00007ff7902e7800 > R14=0x0000000000000028 is an unknown value > R15=0x0000000030323048 is an unknown value > Stack: [0x00007ff66bd98000,0x00007ff66be99000], sp=0x00007ff66be97048, free > space=1020k > Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native > code) > V [libjvm.so+0x7eb200] > J 8305 sun.misc.Unsafe.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V > (0 bytes) @ 0x00007ff79cc0e261 [0x00007ff79cc0e180+0xe1] > j > org.apache.spark.unsafe.Platform.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V+27 > j > org.apache.spark.unsafe.types.UTF8String.writeToMemory(Ljava/lang/Object;J)V+15 > j > org.apache.spark.sql.catalyst.expressions.UnsafeRowWriters$UTF8StringWriter.write(Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;IILorg/apache/spark/unsafe/types/UTF8String;)I+48 > j > org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(Lorg/apache/spark/sql/catalyst/InternalRow;)Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;+160 > j > org.apache.spark.sql.execution.joins.UnsafeHashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/UnsafeProjection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+39 > j > org.apache.spark.sql.execution.joins.HashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/package$Projection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+18 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Lorg/apache/spark/broadcast/Broadcast;+88 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Ljava/lang/Object;+1 > j > org.apache.spark.sql.execution.SQLExecution$.withExecutionId(Lorg/apache/spark/SparkContext;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;+20 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Lorg/apache/spark/broadcast/Broadcast;+22 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Ljava/lang/Object;+1 > j > scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1()Lscala/util/Try;+8 > j scala.concurrent.impl.Future$PromiseCompletingRunnable.run()V+39 > j > java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95 > j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5 > j java.lang.Thread.run()V+11 > v ~StubRoutines::call_stub > V [libjvm.so+0x681a26] > V [libjvm.so+0x681f31] > V [libjvm.so+0x6823d7] > V [libjvm.so+0x718280] > V [libjvm.so+0xa5c86f] > V [libjvm.so+0xa5c99c] > V [libjvm.so+0x910de8] > C [libpthread.so.0+0x7a51] > Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) > J 8305 sun.misc.Unsafe.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V > (0 bytes) @ 0x00007ff79cc0e1e7 [0x00007ff79cc0e180+0x67] > j > org.apache.spark.unsafe.Platform.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V+27 > j > org.apache.spark.unsafe.types.UTF8String.writeToMemory(Ljava/lang/Object;J)V+15 > j > org.apache.spark.sql.catalyst.expressions.UnsafeRowWriters$UTF8StringWriter.write(Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;IILorg/apache/spark/unsafe/types/UTF8String;)I+48 > j > org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(Lorg/apache/spark/sql/catalyst/InternalRow;)Lorg/apache/spark/sql/catalyst/expressions/UnsafeRow;+160 > j > org.apache.spark.sql.execution.joins.UnsafeHashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/UnsafeProjection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+39 > j > org.apache.spark.sql.execution.joins.HashedRelation$.apply(Lscala/collection/Iterator;Lorg/apache/spark/sql/execution/metric/LongSQLMetric;Lorg/apache/spark/sql/catalyst/expressions/package$Projection;I)Lorg/apache/spark/sql/execution/joins/HashedRelation;+18 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Lorg/apache/spark/broadcast/Broadcast;+88 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1$$anonfun$apply$1.apply()Ljava/lang/Object;+1 > j > org.apache.spark.sql.execution.SQLExecution$.withExecutionId(Lorg/apache/spark/SparkContext;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;+20 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Lorg/apache/spark/broadcast/Broadcast;+22 > j > org.apache.spark.sql.execution.joins.BroadcastHashOuterJoin$$anonfun$broadcastFuture$1.apply()Ljava/lang/Object;+1 > j > scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1()Lscala/util/Try;+8 > j scala.concurrent.impl.Future$PromiseCompletingRunnable.run()V+39 > j > java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95 > j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5 > j java.lang.Thread.run()V+11 > v ~StubRoutines::call_stub -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org