[
https://issues.apache.org/jira/browse/TRAFODION-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944233#comment-15944233
]
ASF GitHub Bot commented on TRAFODION-2420:
-------------------------------------------
GitHub user selvaganesang opened a pull request:
https://github.com/apache/incubator-trafodion/pull/1027
[TRAFODION-2420] RMS enhancements
Introduced 2 new counters
HeapWM: - "SQL Heap WM" - Tracks the high water mark of the used memory
including space buffer and bmo operator memory. It is enough to
monitor this counter alone to track the memory utilization of the
query.
scrIOTime: "Scr. IO Time" - Tracks the IO time taken to read/write to
the scratch files at BMO operator level
Introduced a 'Single line Format' option to display BMO stats and SE stats
in a single line format to enable exporting the output to Excel easily.
GET STATISTICS FOR QID CURRENT PROGRESS, OPTIONS 'SL'
Removed and cleaned up the code further
Also fixed memory corruption issues seen with GET STATISTICS command.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/selvaganesang/incubator-trafodion
trafoddion-2420
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/1027.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1027
----
commit ae3eca8a46779828281143db01c171f052947d33
Author: selvaganesang <selva.govindara...@esgyn.com>
Date: 2017-03-27T23:13:10Z
[TRAFODION-2420] RMS enhancements
Introduced 2 new counters
HeapWM: - "SQL Heap WM" - Tracks the high water mark of the used memory
including space buffer and bmo operator memory. It is enough to
monitor this counter alone to track the memory utilization of the
query.
scrIOTime: "Scr. IO Time" - Tracks the IO time taken to read/write to
the scratch files at BMO operator level
Introduced a 'Single line Format' option to display BMO stats and SE stats
in a single line format to enable exporting the output to Excel easily.
GET STATISTICS FOR QID CURRENT PROGRESS, OPTIONS 'SL'
Removed and cleaned up the code further
Also fixed memory corruption issues seen with GET STATISTICS command.
----
> RMS enhancements
> ----------------
>
> Key: TRAFODION-2420
> URL: https://issues.apache.org/jira/browse/TRAFODION-2420
> Project: Apache Trafodion
> Issue Type: Improvement
> Components: sql-general
> Affects Versions: 2.1-incubating
> Reporter: Selvaganesan Govindarajan
> Assignee: Selvaganesan Govindarajan
>
> Improve RMS to provide the following features/capabilities:
> 1. Currently RMS can list queries that consumed cpu time between two time
> points. However, the calls to storage engine like hbase, hdfs etc are
> blocking and these blocked APIs will not allow the Trafodion SQL engine
> scheduler to detect the cpu time spent during the time the call was blocked.
> Introduce a feature called SE offender (storage engine offender) to list the
> queries that are blocked in storage engine more than a certain duration.
> 2. Remove counters that are no longer updated or needed
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
