Sravya Tirukkovalur created SENTRY-901:
------------------------------------------
Summary: Possible memory leak in the sentry thrift server
Key: SENTRY-901
URL: https://issues.apache.org/jira/browse/SENTRY-901
Project: Sentry
Issue Type: Bug
Affects Versions: 1.4.0
Reporter: Sravya Tirukkovalur
Took memory dumps at various times and looks like there are 4 major objects
holding almost 100% of the memory. Three of them are byte[] and one of them is
a HashMapEntry[].
1. byte[]
- Looks like there is a leak in the transport layer
- The thread java.lang.Thread @ 0x787991fc8 pool-3-thread-2224 keeps local
variables with total size 184,551,168 (24.84%) bytes. The memory is accumulated
in one instance of "byte[]" loaded by "<system class loader>".
- Thread stack:
{noformat}
pool-3-thread-2224
at java.net.SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I
(Native Method)
at java.net.SocketInputStream.read([BIII)I (SocketInputStream.java:152)
at java.net.SocketInputStream.read([BII)I (SocketInputStream.java:122)
at java.io.BufferedInputStream.fill()V (BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1([BII)I (BufferedInputStream.java:275)
at java.io.BufferedInputStream.read([BII)I (BufferedInputStream.java:334)
at sentry.org.apache.thrift.transport.TIOStreamTransport.read([BII)I
(TIOStreamTransport.java:127)
at sentry.org.apache.thrift.transport.TTransport.readAll([BII)I
(TTransport.java:84)
at sentry.org.apache.thrift.transport.TSaslTransport.readLength()I
(TSaslTransport.java:346)
at sentry.org.apache.thrift.transport.TSaslTransport.readFrame()V
(TSaslTransport.java:423)
at sentry.org.apache.thrift.transport.TSaslTransport.read([BII)I
(TSaslTransport.java:405)
at sentry.org.apache.thrift.transport.TSaslServerTransport.read([BII)I
(TSaslServerTransport.java:1)
at sentry.org.apache.thrift.transport.TTransport.readAll([BII)I
(TTransport.java:84)
at
sentry.org.apache.thrift.protocol.TBinaryProtocol.readStringBody(I)Ljava/lang/String;
(TBinaryProtocol.java:354)
at
sentry.org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin()Lsentry/org/apache/thrift/protocol/TMessage;
(TBinaryProtocol.java:215)
at
sentry.org.apache.thrift.TMultiplexedProcessor.process(Lsentry/org/apache/thrift/protocol/TProtocol;Lsentry/org/apache/thrift/protocol/TProtocol;)Z
(TMultiplexedProcessor.java:92)
at sentry.org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run()V
(TThreadPoolServer.java:244)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V
(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run()V
(ThreadPoolExecutor.java:615)
at java.lang.Thread.run()V (Thread.java:745)
{noformat}
- Value looks like is like a series of RPC requests concatenated together
{noformat}
......................server1.......<db_name>.......<tablename>............................server1.......<db_name>......<table_name>.........<rolename>.......................7SentryPolicyService:list_sentry_privileges_for_provider....e..........server1.........xxx...............xxx..............xxxr.......7SentryPolicyService:list_sentry_privileges_for_provider...xx.....................xxx..........................server1.......xxx.......xxx..........7SentryPolicyService:list_sentry_privileges_for_provider...g......................polystar..........................server1.......xxx.......xxx..........7SentryPolicyService:list_sentry_privileges_for_provider...h......................xxx..........................server1.......xxx.......xxx.....................................................................................................................................
{noformat}
2. HashMapEntry[]
- One instance of "org.datanucleus.NucleusContext" loaded by
"sun.misc.Launcher$AppClassLoader @ 0x77ffbb410" occupies 164,277,416 (22.11%)
bytes. The memory is accumulated in one instance of "java.util.HashMap$Entry[]"
loaded by "<system class loader>".
- Some entires are null. It has total of ~16000 entries.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
