[
https://issues.apache.org/jira/browse/LENS-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin closed LENS-569.
-----------------------------
> Too many "set param key" on session restoration upon restart
> ------------------------------------------------------------
>
> Key: LENS-569
> URL: https://issues.apache.org/jira/browse/LENS-569
> Project: Apache Lens
> Issue Type: Improvement
> Components: server
> Reporter: Amareshwari Sriramadasu
> Assignee: Rajat Khandelwal
> Fix For: 2.3
>
> Attachments: LENS-569_07.patch
>
>
> We are seeing too may "set param key :" logs on session restoration upon
> restrat. And each set param is involving IO with disk, which in turn
> increases restart time.
> Here is a log snippet :
> {noformat}
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Set param
> key:lens.query.output.enable.compression value:true
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Request to Set param
> key:hive.metastore.client.socket.timeout value:600
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.hive.service.cli.operation.Operation - Putting temp output to
> file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Set param
> key:hive.metastore.client.socket.timeout value:600
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Request to Set param
> key:hive.metastore.connect.retries value:5
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.hive.service.cli.operation.Operation - Putting temp output to
> file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Set param
> key:hive.metastore.connect.retries value:5
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Request to Set param
> key:lens.query.enable.mail.notify value:true
> 21 May 2015 06:05:50,806 [main] INFO
> org.apache.hive.service.cli.operation.Operation - Putting temp output to
> file /tmp/lens/26064577-7a38-4279-ad73-0daa4a32a7671862119368791234528.pipeout
> 21 May 2015 06:05:50,807 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Set param
> key:lens.query.enable.mail.notify value:true
> 21 May 2015 06:05:50,807 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Restored session
> 26064577-7a38-4279-ad73-0daa4a32a767
> 21 May 2015 06:05:50,807 [main] INFO
> org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at
> this point. hive.execution.engine=mr.
> 21 May 2015 06:05:50,808 [main] INFO
> org.apache.hadoop.hive.ql.session.SessionState - No Tez session required at
> this point. hive.execution.engine=mr.
> 21 May 2015 06:05:50,808 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Request to Set param
> key:hive.metastore.failure.retries value:3
> 21 May 2015 06:05:50,810 [main] INFO
> org.apache.hive.service.cli.operation.Operation - Putting temp output to
> file /tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
> 21 May 2015 06:05:50,810 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Set param
> key:hive.metastore.failure.retries value:3
> 21 May 2015 06:05:50,810 [main] INFO
> org.apache.lens.server.session.HiveSessionService - Request to Set param
> key:hive.metastore.client.connect.retry.delay value:1
> 21 May 2015 06:05:50,811 [main] INFO
> org.apache.hive.service.cli.operation.Operation - Putting temp output to
> file /tmp/lens/4d63f0f8-699c-4a3e-ae2d-6eaf03a5a3437220243919237070139.pipeout
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
