[
https://issues.apache.org/jira/browse/DRILL-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123331#comment-15123331
]
Khurram Faraaz commented on DRILL-4249:
---------------------------------------
Yes the DROP TABLE hang is reproducible on my 4 node cluster, MapR Drill 1.4.0
GA and MapR FS 5.0.0 GA and JDK8
kill -QUIT 5194 , did not output the stack trace of the hung process to
standard output.
Doing this (Ctril+\) gave me the stack trace on sqlline prompt, for the hung
drop table process
{noformat}
0: jdbc:drill:schema=dfs.tmp> drop table tblMD332_wp;
2016-01-29 10:31:26
Full thread dump OpenJDK 64-Bit Server VM (25.65-b01 mixed mode):
"threadDeathWatcher-2-1" #29 daemon prio=1 os_prio=0 tid=0x00007ffe40254000
nid=0x1b51 waiting on condition [0x00007ffe305db000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
io.netty.util.ThreadDeathWatcher$Watcher.run(ThreadDeathWatcher.java:137)
at
io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
at java.lang.Thread.run(Thread.java:745)
"Client-1" #27 daemon prio=10 os_prio=0 tid=0x00007ffe90f01000 nid=0x1b3a
runnable [0x00007ffe30c8c000]
java.lang.Thread.State: RUNNABLE
at io.netty.channel.epoll.Native.epollWait0(Native Method)
at io.netty.channel.epoll.Native.epollWait(Native.java:148)
at
io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:180)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:205)
at
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
at java.lang.Thread.run(Thread.java:745)
"Curator-ServiceCache-0" #26 daemon prio=5 os_prio=0 tid=0x00007ffe90e2d000
nid=0x1ae0 waiting on condition [0x00007ffe30ae6000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000006c0033898> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Curator-Framework-0" #25 daemon prio=5 os_prio=0 tid=0x00007ffe90dde800
nid=0x1adf waiting on condition [0x00007ffe30d8d000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000006c003b878> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
at
org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:780)
at
org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:62)
at
org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:257)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"main-EventThread" #24 daemon prio=5 os_prio=0 tid=0x00007ffe90dc3000
nid=0x1ade waiting on condition [0x00007ffe30f33000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000006c00436a0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
"main-SendThread(centos-01.qa.lab:5181)" #23 daemon prio=5 os_prio=0
tid=0x00007ffe90dcf000 nid=0x1add runnable [0x00007ffe4410c000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000006c004b710> (a sun.nio.ch.Util$2)
- locked <0x00000006c004b720> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000006c004b6c8> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1070)
"Curator-ConnectionStateManager-0" #22 daemon prio=5 os_prio=0
tid=0x00007ffe90de7000 nid=0x1ada waiting on condition [0x00007ffe31234000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000006c0053648> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
at
org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
at
org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
at
org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"NonBlockingInputStreamThread" #20 daemon prio=5 os_prio=0
tid=0x00007ffe90a7c800 nid=0x1acb in Object.wait() [0x00007ffe44293000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at
jline.internal.NonBlockingInputStream.run(NonBlockingInputStream.java:278)
- locked <0x00000006c0033b20> (a jline.internal.NonBlockingInputStream)
at java.lang.Thread.run(Thread.java:745)
"Service Thread" #17 daemon prio=9 os_prio=0 tid=0x00007ffe90123800 nid=0x1ab8
runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread11" #16 daemon prio=9 os_prio=0 tid=0x00007ffe90118800
nid=0x1ab7 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread10" #15 daemon prio=9 os_prio=0 tid=0x00007ffe90116800
nid=0x1ab6 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread9" #14 daemon prio=9 os_prio=0 tid=0x00007ffe90115000
nid=0x1ab5 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C1 CompilerThread8" #13 daemon prio=9 os_prio=0 tid=0x00007ffe90112800
nid=0x1ab4 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread7" #12 daemon prio=9 os_prio=0 tid=0x00007ffe90108000
nid=0x1ab3 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread6" #11 daemon prio=9 os_prio=0 tid=0x00007ffe90106000
nid=0x1ab2 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread5" #10 daemon prio=9 os_prio=0 tid=0x00007ffe90104800
nid=0x1ab1 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread4" #9 daemon prio=9 os_prio=0 tid=0x00007ffe900fa000
nid=0x1ab0 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread3" #8 daemon prio=9 os_prio=0 tid=0x00007ffe900f8000
nid=0x1aaf waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread2" #7 daemon prio=9 os_prio=0 tid=0x00007ffe900f6000
nid=0x1aae waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" #6 daemon prio=9 os_prio=0 tid=0x00007ffe900f4000
nid=0x1aad waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" #5 daemon prio=9 os_prio=0 tid=0x00007ffe900e7000
nid=0x1aac waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007ffe900e5000
nid=0x1aab waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007ffe900b6800 nid=0x1aaa in
Object.wait() [0x00007ffe45d72000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00000006c0015088> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007ffe900ae800
nid=0x1aa9 in Object.wait() [0x00007ffe45e73000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
- locked <0x00000006c0033b10> (a java.lang.ref.Reference$Lock)
"main" #1 prio=5 os_prio=0 tid=0x00007ffe90011800 nid=0x1a95 waiting on
condition [0x00007ffe96825000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000076ae9ab70> (a
java.util.concurrent.CountDownLatch$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
at
org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:1909)
at
org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:73)
at
net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:404)
at
net.hydromatic.avatica.AvaticaStatement.executeQueryInternal(AvaticaStatement.java:351)
at
net.hydromatic.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:338)
at
net.hydromatic.avatica.AvaticaStatement.execute(AvaticaStatement.java:69)
at
org.apache.drill.jdbc.impl.DrillStatementImpl.execute(DrillStatementImpl.java:101)
at sqlline.Commands.execute(Commands.java:841)
at sqlline.Commands.sql(Commands.java:751)
at sqlline.SqlLine.dispatch(SqlLine.java:746)
at sqlline.SqlLine.begin(SqlLine.java:621)
at sqlline.SqlLine.start(SqlLine.java:375)
at sqlline.SqlLine.main(SqlLine.java:268)
"VM Thread" os_prio=0 tid=0x00007ffe900a9800 nid=0x1aa8 runnable
"GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007ffe90027000 nid=0x1a96
runnable
"GC task thread#1 (ParallelGC)" os_prio=0 tid=0x00007ffe90028800 nid=0x1a97
runnable
"GC task thread#2 (ParallelGC)" os_prio=0 tid=0x00007ffe9002a800 nid=0x1a98
runnable
"GC task thread#3 (ParallelGC)" os_prio=0 tid=0x00007ffe9002c000 nid=0x1a99
runnable
"GC task thread#4 (ParallelGC)" os_prio=0 tid=0x00007ffe9002e000 nid=0x1a9a
runnable
"GC task thread#5 (ParallelGC)" os_prio=0 tid=0x00007ffe9002f800 nid=0x1a9b
runnable
"GC task thread#6 (ParallelGC)" os_prio=0 tid=0x00007ffe90031800 nid=0x1a9c
runnable
"GC task thread#7 (ParallelGC)" os_prio=0 tid=0x00007ffe90033000 nid=0x1a9d
runnable
"GC task thread#8 (ParallelGC)" os_prio=0 tid=0x00007ffe90035000 nid=0x1a9e
runnable
"GC task thread#9 (ParallelGC)" os_prio=0 tid=0x00007ffe90036800 nid=0x1a9f
runnable
"GC task thread#10 (ParallelGC)" os_prio=0 tid=0x00007ffe90038800 nid=0x1aa0
runnable
"GC task thread#11 (ParallelGC)" os_prio=0 tid=0x00007ffe9003a000 nid=0x1aa1
runnable
"GC task thread#12 (ParallelGC)" os_prio=0 tid=0x00007ffe9003b800 nid=0x1aa2
runnable
"GC task thread#13 (ParallelGC)" os_prio=0 tid=0x00007ffe9003d800 nid=0x1aa3
runnable
"GC task thread#14 (ParallelGC)" os_prio=0 tid=0x00007ffe9003f000 nid=0x1aa4
runnable
"GC task thread#15 (ParallelGC)" os_prio=0 tid=0x00007ffe90041000 nid=0x1aa5
runnable
"GC task thread#16 (ParallelGC)" os_prio=0 tid=0x00007ffe90042800 nid=0x1aa6
runnable
"GC task thread#17 (ParallelGC)" os_prio=0 tid=0x00007ffe90044800 nid=0x1aa7
runnable
"VM Periodic Task Thread" os_prio=0 tid=0x00007ffe90126000 nid=0x1ab9 waiting
on condition
JNI global references: 342
Heap
PSYoungGen total 1223168K, used 146801K [0x000000076ab00000,
0x00000007c0000000, 0x00000007c0000000)
eden space 1048576K, 14% used
[0x000000076ab00000,0x0000000773a5c420,0x00000007aab00000)
from space 174592K, 0% used
[0x00000007aab00000,0x00000007aab00000,0x00000007b5580000)
to space 174592K, 0% used
[0x00000007b5580000,0x00000007b5580000,0x00000007c0000000)
ParOldGen total 2796544K, used 15530K [0x00000006c0000000,
0x000000076ab00000, 0x000000076ab00000)
object space 2796544K, 0% used
[0x00000006c0000000,0x00000006c0f2a8a8,0x000000076ab00000)
Metaspace used 22218K, capacity 22366K, committed 22400K, reserved
1069056K
class space used 2590K, capacity 2659K, committed 2688K, reserved 1048576K
{noformat}
>From the file to which jmap output was written, it appears that there is a
>deadlock!
{noformat}
Attaching to process ID 5194, please wait...
Debugger attached successfully.
Server compiler detected.
JVM version is 25.65-b01
Deadlock Detection:
Can't print deadlocks:Unable to deduce type of thread from address
0x00007fd412df8000 (expected type JavaThread, CompilerThread, ServiceThread,
JvmtiAgentThread, or SurrogateLockerThread)
{noformat}
Details of hung process from /proc/5194/task/5194
{noformat}
[root@centos-01 5194]# cat status
Name: java
State: S (sleeping)
Tgid: 5194
Pid: 5194
PPid: 5069
TracerPid: 0
Uid: 2000 2000 2000 2000
Gid: 2000 2000 2000 2000
Utrace: 0
FDSize: 512
Groups: 2000 2001
VmPeak: 7401296 kB
VmSize: 7335760 kB
VmLck: 0 kB
VmHWM: 1072800 kB
VmRSS: 1072760 kB
VmData: 7119568 kB
VmStk: 88 kB
VmExe: 4 kB
VmLib: 29436 kB
VmPTE: 2668 kB
VmSwap: 0 kB
Threads: 119
SigQ: 0/385903
SigPnd: 0000000000000000
ShdPnd: 0000000000000000
SigBlk: 0000000000000004
SigIgn: 0000000000001003
SigCgt: 2000000181004ccc
CapInh: 0000000000000000
CapPrm: 0000000000000000
CapEff: 0000000000000000
CapBnd: ffffffffffffffff
Cpus_allowed: ffffff
Cpus_allowed_list: 0-23
Mems_allowed:
00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000003
Mems_allowed_list: 0-1
voluntary_ctxt_switches: 24
nonvoluntary_ctxt_switches: 3
{noformat}
JMAP output for hung process
{noformat}
[root@centos-01 framework]# jmap 5194
Attaching to process ID 5194, please wait...
Debugger attached successfully.
Server compiler detected.
JVM version is 25.65-b01
0x0000000000400000 9K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/bin/java
0x00000030d7e00000 153K /lib64/ld-2.12.so
0x00000030d8600000 1881K /lib64/libc-2.12.so
0x00000030d8a00000 142K /lib64/libpthread-2.12.so
0x00000030d8e00000 45K /lib64/librt-2.12.so
0x00000030d9200000 88K /lib64/libz.so.1.2.3
0x00000030d9600000 585K /lib64/libm-2.12.so
0x00000030da200000 111K /lib64/libresolv-2.12.so
0x00000030db600000 91K /lib64/libgcc_s-4.4.7-20120601.so.1
0x00000030dbe00000 966K /usr/lib64/libstdc++.so.6.0.13
0x0000003aea000000 22K /lib64/libdl-2.12.so
0x0000003aea400000 42K /lib64/libcrypt-2.12.so
0x0000003aea800000 461K /lib64/libfreebl3.so
0x0000003ff8e00000 57K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/jli/libjli.so
0x0000003ff9200000 57K /lib64/libpam.so.0.82.2
0x00007fd3ab15d000 5K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libjaas_unix.so
0x00007fd3ab65f000 70074K /tmp/mapr-mapr-libMapRClient.4.1.0.34989-mapr.so
0x00007fd3acc5d000 71K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libnio.so
0x00007fd3ace6f000 51K
/tmp/libnetty-transport-native-epoll8942720480120192851.so
0x00007fd3ad64b000 35K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libmanagement.so
0x00007fd3ad854000 26K /lib64/libnss_dns-2.12.so
0x00007fd3ade7d000 91K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libnet.so
0x00007fd415fc4000 32K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libzip.so
0x00007fd4161cc000 64K /lib64/libnss_files-2.12.so
0x00007fd4163e3000 173K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libjava.so
0x00007fd41660e000 58K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/libverify.so
0x00007fd41691e000 13284K
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-0.b17.el6_7.x86_64/jre/lib/amd64/server/libjvm.so
0x00007fd41783c000 112K /lib64/libaudit.so.1.0.0
[root@centos-01 framework]#
{noformat}
jstack did not give me the required stack trace, instead it reported some
Exception.
{noformat}
[root@centos-01 framework]# jstack 5194
5194: Unable to open socket file: target process not responding or HotSpot VM
not loaded
The -F option can be used when the target process is not responding
[root@centos-01 framework]# jstack -F 5194 > jstk_out_droptbl
java.lang.RuntimeException: Unable to deduce type of thread from address
0x00007fd412df8000 (expected type JavaThread, CompilerThread, ServiceThread,
JvmtiAgentThread, or SurrogateLockerThread)
at
sun.jvm.hotspot.runtime.Threads.createJavaThreadWrapper(Threads.java:166)
at sun.jvm.hotspot.runtime.Threads.first(Threads.java:150)
at
sun.jvm.hotspot.runtime.DeadlockDetector.createThreadTable(DeadlockDetector.java:149)
at
sun.jvm.hotspot.runtime.DeadlockDetector.print(DeadlockDetector.java:56)
at
sun.jvm.hotspot.runtime.DeadlockDetector.print(DeadlockDetector.java:39)
at sun.jvm.hotspot.tools.StackTrace.run(StackTrace.java:62)
at sun.jvm.hotspot.tools.StackTrace.run(StackTrace.java:45)
at sun.jvm.hotspot.tools.JStack.run(JStack.java:66)
at sun.jvm.hotspot.tools.Tool.startInternal(Tool.java:260)
at sun.jvm.hotspot.tools.Tool.start(Tool.java:223)
at sun.jvm.hotspot.tools.Tool.execute(Tool.java:118)
at sun.jvm.hotspot.tools.JStack.main(JStack.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at sun.tools.jstack.JStack.runJStackTool(JStack.java:140)
at sun.tools.jstack.JStack.main(JStack.java:106)
Caused by: sun.jvm.hotspot.types.WrongTypeException: No suitable match for type
of address 0x00007fd412df8000
at
sun.jvm.hotspot.runtime.InstanceConstructor.newWrongTypeException(InstanceConstructor.java:62)
at
sun.jvm.hotspot.runtime.VirtualConstructor.instantiateWrapperFor(VirtualConstructor.java:80)
at
sun.jvm.hotspot.runtime.Threads.createJavaThreadWrapper(Threads.java:162)
...
{noformat}
> DROP TABLE HANGS indefinitely
> -----------------------------
>
> Key: DRILL-4249
> URL: https://issues.apache.org/jira/browse/DRILL-4249
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
> Affects Versions: 1.4.0
> Environment: 4 node cluster on CentOS
> Reporter: Khurram Faraaz
>
> DROP TABLE hangs. Table was created using CTAS and the input to CTAS was a
> directory that had 2000 JSON files.
> There is no Exception or error message on sqlline prompt nor in drillbit.log
> Drill 1.4.0, git commitID: 32b85160
> hadoop fs -ls /tmp shows that the directory exists (at the time when DROP
> TABLE was hung)
> drwxr-xr-x - mapr mapr 10550677 2016-01-05 12:14 /tmp/tblMD332_wp
> {noformat}
> Snippet from drillbit.log, there's no further information after the below
> text in drillbit.log
> 2016-01-06 10:03:09,817 [297319a1-fb9d-8247-7d12-c8d551d56d2d:foreman] INFO
> o.a.drill.exec.work.foreman.Foreman - Query text for query id
> 297319a1-fb9d-8247-7d12-c8d551d56d2d: drop table tblMD332_wp
> 2016-01-06 10:03:11,516 [297319a1-fb9d-8247-7d12-c8d551d56d2d:foreman] INFO
> o.a.d.exec.store.dfs.FileSelection - FileSelection.create() took 6 ms
> 2016-01-06 10:03:11,517 [297319a1-fb9d-8247-7d12-c8d551d56d2d:foreman] INFO
> o.a.d.exec.store.dfs.FileSelection - FileSelection.getStatuses() took 0 ms,
> numFiles: 1
> {noformat}
> {noformat}
> Note that DROP TABLE commands hangs indefinitely.
> [root@centos-01 bin]# ./sqlline -u "jdbc:drill:schema=dfs.tmp -n mapr -p mapr"
> apache drill 1.4.0
> "got drill?"
> 0: jdbc:drill:schema=dfs.tmp> drop table tblMD332_wp;
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
