[
https://issues.apache.org/jira/browse/HIVE-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-4632:
------------------------------
Attachment: D11001.4.patch
navis updated the revision "HIVE-4632 [jira] Use hadoop counter as a stat
publisher".
1. Fixed tests
2. Made StatsFactory thread-safe
Reviewers: ashutoshc, JIRA
REVISION DETAIL
https://reviews.facebook.net/D11001
CHANGE SINCE LAST DIFF
https://reviews.facebook.net/D11001?vs=43839&id=43989#toc
AFFECTED FILES
common/src/java/org/apache/hadoop/hive/common/StatsSetupConst.java
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
conf/hive-default.xml.template
data/conf/hive-site.xml
hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStatsAggregator.java
itests/qtest/pom.xml
itests/util/src/main/java/org/apache/hadoop/hive/ql/stats/DummyStatsAggregator.java
itests/util/src/main/java/org/apache/hadoop/hive/ql/stats/KeyVerifyingStatsAggregator.java
ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java
ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java
ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/stats/PartialScanTask.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java
ql/src/java/org/apache/hadoop/hive/ql/plan/StatsWork.java
ql/src/java/org/apache/hadoop/hive/ql/stats/CounterStatsAggregator.java
ql/src/java/org/apache/hadoop/hive/ql/stats/CounterStatsPublisher.java
ql/src/java/org/apache/hadoop/hive/ql/stats/StatsAggregator.java
ql/src/java/org/apache/hadoop/hive/ql/stats/StatsFactory.java
ql/src/java/org/apache/hadoop/hive/ql/stats/StatsSetupConst.java
ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java
ql/src/test/org/apache/hadoop/hive/ql/exec/TestStatsPublisherEnhanced.java
ql/src/test/queries/clientnegative/stats_aggregator_error_1.q
ql/src/test/queries/clientnegative/stats_aggregator_error_2.q
ql/src/test/queries/clientnegative/stats_publisher_error_1.q
ql/src/test/queries/clientnegative/stats_publisher_error_2.q
ql/src/test/queries/clientpositive/stats19.q
ql/src/test/queries/clientpositive/stats_aggregator_error_1.q
ql/src/test/queries/clientpositive/stats_counter.q
ql/src/test/queries/clientpositive/stats_publisher_error_1.q
ql/src/test/results/clientpositive/stats_aggregator_error_1.q.out
ql/src/test/results/clientpositive/stats_counter.q.out
ql/src/test/results/compiler/plan/case_sensitivity.q.xml
ql/src/test/results/compiler/plan/groupby1.q.xml
ql/src/test/results/compiler/plan/input1.q.xml
ql/src/test/results/compiler/plan/input2.q.xml
ql/src/test/results/compiler/plan/input3.q.xml
ql/src/test/results/compiler/plan/input4.q.xml
ql/src/test/results/compiler/plan/input5.q.xml
ql/src/test/results/compiler/plan/input6.q.xml
ql/src/test/results/compiler/plan/input7.q.xml
ql/src/test/results/compiler/plan/input9.q.xml
ql/src/test/results/compiler/plan/input_testsequencefile.q.xml
ql/src/test/results/compiler/plan/join1.q.xml
ql/src/test/results/compiler/plan/join2.q.xml
ql/src/test/results/compiler/plan/join3.q.xml
ql/src/test/results/compiler/plan/sample2.q.xml
ql/src/test/results/compiler/plan/sample3.q.xml
ql/src/test/results/compiler/plan/sample4.q.xml
ql/src/test/results/compiler/plan/sample5.q.xml
ql/src/test/results/compiler/plan/sample6.q.xml
ql/src/test/results/compiler/plan/sample7.q.xml
To: JIRA, ashutoshc, navis
Cc: ashutoshc
> Use hadoop counter as a stat publisher
> --------------------------------------
>
> Key: HIVE-4632
> URL: https://issues.apache.org/jira/browse/HIVE-4632
> Project: Hive
> Issue Type: Improvement
> Components: Statistics
> Affects Versions: 0.12.0
> Reporter: Navis
> Assignee: Navis
> Priority: Minor
> Attachments: D11001.4.patch, HIVE-4632.4.patch.txt,
> HIVE-4632.5.patch.txt, HIVE-4632.6.patch.txt
>
>
> Currently stats are all long/aggregation type and can be safely acquired by
> hadoop counter without other db or hbase.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
