Amareshwari Sriramadasu created LENS-569:
--------------------------------------------
Summary: Too many "set param key" on session restoration upon
restart
Key: LENS-569
URL: https://issues.apache.org/jira/browse/LENS-569
Project: Apache Lens
Issue Type: Bug
Reporter: Amareshwari Sriramadasu
We are seeing too may "set param key :" logs on session restoration upon
restrat. And each set param is involving IO with disk, which in turn increases
restart time.
Here is a log snippet :
{noformat}
21 May 2015 06:05:50,806 [main] INFO
org.apache.lens.server.session.HiveSessionService - Set param
key:lens.query.output.enable.compression value:true
21 May 2015 06:05:50,806 [main] INFO
org.apache.lens.server.session.HiveSessionService - Request to Set param
key:hive.metastore.client.socket.timeout value:600
21 May 2015 06:05:50,806 [main] INFO
org.apache.hive.service.cli.operation.Operation - Putting temp output to file
/tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
21 May 2015 06:05:50,806 [main] INFO
org.apache.lens.server.session.HiveSessionService - Set param
key:hive.metastore.client.socket.timeout value:600
21 May 2015 06:05:50,806 [main] INFO
org.apache.lens.server.session.HiveSessionService - Request to Set param
key:hive.metastore.connect.retries value:5
21 May 2015 06:05:50,806 [main] INFO
org.apache.hive.service.cli.operation.Operation - Putting temp output to file
/tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
21 May 2015 06:05:50,806 [main] INFO
org.apache.lens.server.session.HiveSessionService - Set param
key:hive.metastore.connect.retries value:5
21 May 2015 06:05:50,806 [main] INFO
org.apache.lens.server.session.HiveSessionService - Request to Set param
key:lens.query.enable.mail.notify value:true
21 May 2015 06:05:50,806 [main] INFO
org.apache.hive.service.cli.operation.Operation - Putting temp output to file
/tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
21 May 2015 06:05:50,807 [main] INFO
org.apache.lens.server.session.HiveSessionService - Set param
key:lens.query.enable.mail.notify value:true
21 May 2015 06:05:50,807 [main] INFO
org.apache.lens.server.session.HiveSessionService - Restored session
26064577-7a38-4279-ad73-0daa4a32a767
21 May 2015 06:05:50,807 [main] INFO
org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at
this point. hive.execution.engine=mr.
21 May 2015 06:05:50,808 [main] INFO
org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at
this point. hive.execution.engine=mr.
21 May 2015 06:05:50,808 [main] INFO
org.apache.lens.server.session.HiveSessionService - Request to Set param
key:hive.metastore.failure.retries value:3
21 May 2015 06:05:50,810 [main] INFO
org.apache.hive.service.cli.operation.Operation - Putting temp output to file
/tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
21 May 2015 06:05:50,810 [main] INFO
org.apache.lens.server.session.HiveSessionService - Set param
key:hive.metastore.failure.retries value:3
21 May 2015 06:05:50,810 [main] INFO
org.apache.lens.server.session.HiveSessionService - Request to Set param
key:hive.metastore.client.connect.retry.delay value:1
21 May 2015 06:05:50,811 [main] INFO
org.apache.hive.service.cli.operation.Operation - Putting temp output to file
/tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
