[jira] [Commented] (HIVE-15909) HiveMetaStoreChecker::checkTable can be expensive in ObjectStores

2017-02-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866913#comment-15866913 ] Rajesh Balamohan commented on HIVE-15909: - Thanks [~vihangk1]. Please feel free to assign this in

[jira] [Commented] (HIVE-15909) HiveMetaStoreChecker::checkTable can be expensive in ObjectStores

2017-02-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865334#comment-15865334 ] Rajesh Balamohan commented on HIVE-15909: - Instead of multi-threading, one option could be to

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Attachment: HIVE-15889.3.patch Thanks [~sershe]. Attaching .3 patch to address review

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Attachment: HIVE-15889.2.patch Attaching .2 version of the patch.

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Status: Patch Available (was: Open) > LLAP: Some tasks still run after hive cli is

[jira] [Commented] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863255#comment-15863255 ] Rajesh Balamohan commented on HIVE-15889: - originally reported by [~gopalv]. > LLAP: Some tasks

[jira] [Updated] (HIVE-15889) LLAP: Some tasks still run after hive cli is shutdown

2017-02-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15889: Attachment: HIVE-15889.1.patch > LLAP: Some tasks still run after hive cli is shutdown >

[jira] [Updated] (HIVE-15336) LLAP UI: Expand the UI to multiple pages

2017-02-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15336: Attachment: HIVE-15336.WIP.master.rebase.patch > LLAP UI: Expand the UI to multiple pages >

[jira] [Assigned] (HIVE-15336) LLAP UI: Expand the UI to multiple pages

2017-02-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15336: --- Assignee: Gopal V (was: Rajesh Balamohan) > LLAP UI: Expand the UI to multiple

[jira] [Assigned] (HIVE-15336) LLAP UI: Expand the UI to multiple pages

2017-02-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15336: --- Assignee: Rajesh Balamohan (was: Gopal V) > LLAP UI: Expand the UI to multiple

[jira] [Updated] (HIVE-15875) LLAP UI: Rename Executors "used" --> "used (wait queue + executors)"

2017-02-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15875: Attachment: Llap_ui.png > LLAP UI: Rename Executors "used" --> "used (wait queue +

[jira] [Commented] (HIVE-15869) LLAP: move metadata cache off-heap

2017-02-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860517#comment-15860517 ] Rajesh Balamohan commented on HIVE-15869: - Would this be on similar lines like HIVE-15665? >

[jira] [Updated] (HIVE-15803) msck can hang when nested partitions are present

2017-02-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15803: Attachment: HIVE-15803.2.patch modified debug logs in .2 version. > msck can hang when

[jira] [Updated] (HIVE-15803) msck can hang when nested partitions are present

2017-02-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15803: Attachment: HIVE-15803.1.patch Modified patch, which checks for thread pool's usage.

[jira] [Commented] (HIVE-15803) msck can hang when nested partitions are present

2017-02-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857305#comment-15857305 ] Rajesh Balamohan commented on HIVE-15803: - Thank you for sharing the patch. Deadlock would happen

[jira] [Commented] (HIVE-15803) msck can hang when nested partitions are present

2017-02-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852245#comment-15852245 ] Rajesh Balamohan commented on HIVE-15803: - [~hagleitn] - It is not slow, it gets stuck. Another

[jira] [Assigned] (HIVE-15803) msck can hang when nested partitions are present

2017-02-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15803: --- Assignee: Rajesh Balamohan > msck can hang when nested partitions are present >

[jira] [Commented] (HIVE-15803) msck can hang when nested partitions are present

2017-02-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851352#comment-15851352 ] Rajesh Balamohan commented on HIVE-15803: - Stack: {noformat} "main" #1 prio=5 os_prio=0

[jira] [Updated] (HIVE-15803) msck can hang when nested partitions are present

2017-02-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15803: Description: Steps to reproduce. {noformat} CREATE TABLE `repairtable`( `col` string)

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

2017-02-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Status: Patch Available (was: Open) > Improve performance for ServiceInstanceSet.getByHost

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.5.patch "instance.getHost()" had to be used in populating

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

2017-02-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Status: Patch Available (was: Open) > LLAP: WaitQueue comparators should return 0 when

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Status: Open (was: Patch Available) > Improve performance for ServiceInstanceSet.getByHost

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.4.patch > Improve performance for ServiceInstanceSet.getByHost >

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.3.patch Attaching .3 patch. > Improve performance for

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Attachment: HIVE-15779.2.patch > LLAP: WaitQueue comparators should return 0 when tasks of

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Status: Open (was: Patch Available) > LLAP: WaitQueue comparators should return 0 when

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Attachment: (was: HIVE-15779.2.patch) > LLAP: WaitQueue comparators should return 0

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks of the same DAG are of same priority

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Attachment: HIVE-15779.2.patch Attaching .2 patch to fix review comments and to address

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.2.patch Attaching .2 patch to address review comments > Improve

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks are of same priority

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Attachment: HIVE-15779.1.patch [~sseth] - Can you please review when you find time? >

[jira] [Updated] (HIVE-15779) LLAP: WaitQueue comparators should return 0 when tasks are of same priority

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15779: Status: Patch Available (was: Open) > LLAP: WaitQueue comparators should return 0 when

[jira] [Commented] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848115#comment-15848115 ] Rajesh Balamohan commented on HIVE-13667: - RB link: https://reviews.apache.org/r/56159/ > Improve

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Status: Patch Available (was: Open) > Improve performance for ServiceInstanceSet.getByHost

[jira] [Updated] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-13667: Attachment: HIVE-13667.1.patch Changes: 1. Use local cache in LlapZookeeperRegistryImpl.

[jira] [Assigned] (HIVE-13667) Improve performance for ServiceInstanceSet.getByHost

2017-02-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-13667: --- Assignee: Rajesh Balamohan (was: Prasanth Jayachandran) > Improve performance for

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.5.patch Thanks [~leftylev]. Attaching .5 patch > LLAP: cached

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.4.patch Thanks [~sseth]. Will commit it after jenkin results. >

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Status: Patch Available (was: Open) > LLAP: cached threadpool in AMReporter creates too

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.3.patch Attaching .3 version of the patch. > LLAP: cached

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Status: Open (was: Patch Available) > LLAP: cached threadpool in AMReporter creates too

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Attachment: HIVE-15693.2.patch Attaching .2 version addressing review comments. > LLAP:

[jira] [Commented] (HIVE-15669) LLAP: Improve aging in shortest job first scheduler

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840584#comment-15840584 ] Rajesh Balamohan commented on HIVE-15669: - Thanks for the patch [~prasanth_j]. LGTM. +1. >

[jira] [Commented] (HIVE-15679) Some metastore metrics always contains column=null (write_column_statistics, write_partition_column_statistics)

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833929#comment-15833929 ] Rajesh Balamohan commented on HIVE-15679: - LGTM. +1. Thanks [~pvary] > Some metastore metrics

[jira] [Updated] (HIVE-15693) LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15693: Description: branch: master {noformat} 2017-01-22T19:52:42,470 WARN [IPC Server handler

[jira] [Commented] (HIVE-15669) LLAP: Improve aging in shortest job first scheduler

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833777#comment-15833777 ] Rajesh Balamohan commented on HIVE-15669: - [~prasanth_j] - Should the comparison be based on

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~prasanth_j],

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Status: Patch Available (was: Reopened) > LLAP: GroupByOperator flushes hash table too

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Attachment: HIVE-15565.2.patch > LLAP: GroupByOperator flushes hash table too frequently >

[jira] [Commented] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829231#comment-15829231 ] Rajesh Balamohan commented on HIVE-15565: - Reverted the patch. Will post a separate patch for

[jira] [Reopened] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reopened HIVE-15565: - > LLAP: GroupByOperator flushes hash table too frequently >

[jira] [Commented] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829228#comment-15829228 ] Rajesh Balamohan commented on HIVE-15565: - Had offline discussion with [~prasanth_j] on this. We

[jira] [Commented] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824756#comment-15824756 ] Rajesh Balamohan commented on HIVE-15565: - As per old impl, maxMemory in {{GroupByOperator}} was

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-11 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Commented] (HIVE-15570) LLAP: Exception in HostAffinitySplitLocationProvider when running in container mode

2017-01-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816506#comment-15816506 ] Rajesh Balamohan commented on HIVE-15570: - When locations is empty, it would fall back to

[jira] [Updated] (HIVE-15570) LLAP: Exception in HostAffinitySplitLocationProvider when running in container mode

2017-01-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15570: Attachment: HIVE-15570.1.patch > LLAP: Exception in HostAffinitySplitLocationProvider when

[jira] [Updated] (HIVE-15570) LLAP: Exception in HostAffinitySplitLocationProvider when running in container mode

2017-01-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15570: Status: Patch Available (was: Open) > LLAP: Exception in HostAffinitySplitLocationProvider

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Description: {{GroupByOperator::isTez}} would be true in LLAP mode. Current memory

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Status: Patch Available (was: Open) > LLAP: GroupByOperator flushes hash table too

[jira] [Updated] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15565: Attachment: HIVE-15565.1.patch > LLAP: GroupByOperator flushes hash table too frequently >

[jira] [Assigned] (HIVE-15565) LLAP: GroupByOperator flushes hash table too frequently

2017-01-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15565: --- Assignee: Rajesh Balamohan > LLAP: GroupByOperator flushes hash table too frequently

[jira] [Updated] (HIVE-15542) NPE in StatsUtils::getColStatistics when all values in DATE column are NULL

2017-01-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15542: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15542) NPE in StatsUtils::getColStatistics when all values in DATE column are NULL

2017-01-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15542: Attachment: HIVE-15542.2.patch number of nulls for date columns was not populated. Added

[jira] [Updated] (HIVE-15542) NPE in StatsUtils::getColStatistics when all values in DATE column are NULL

2017-01-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15542: Status: Patch Available (was: Open) > NPE in StatsUtils::getColStatistics when all values

[jira] [Updated] (HIVE-15542) NPE in StatsUtils::getColStatistics when all values in DATE column are NULL

2017-01-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15542: Attachment: HIVE-15542.1.patch > NPE in StatsUtils::getColStatistics when all values in

[jira] [Updated] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduling tasks as disabled node is not re-enabled in NodeEnablerCallable

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15529: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduling tasks as disabled node is not re-enabled in NodeEnablerCallable

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15529: Summary: LLAP: TaskSchedulerService can get stuck when scheduling tasks as disabled node is

[jira] [Updated] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduling tasks as disabled node is not re-enabled in Node

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15529: Summary: LLAP: TaskSchedulerService can get stuck when scheduling tasks as disabled node is

[jira] [Commented] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduleTask returns DELAYED_RESOURCES

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15796620#comment-15796620 ] Rajesh Balamohan commented on HIVE-15529: - Yes, issue is with

[jira] [Updated] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduleTask returns DELAYED_RESOURCES

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15529: Attachment: HIVE-15529.1.patch Basically, re-enabling the node was not kicking off

[jira] [Updated] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduleTask returns DELAYED_RESOURCES

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15529: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > LLAP:

[jira] [Commented] (HIVE-15529) LLAP: TaskSchedulerService can get stuck when scheduleTask returns DELAYED_RESOURCES

2017-01-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794069#comment-15794069 ] Rajesh Balamohan commented on HIVE-15529: - [~pxiong] - Yes, on task failure the node gets into

[jira] [Updated] (HIVE-15511) Provide an option in months_between UDF to disable rounding-off

2016-12-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15511: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15511) Provide an option in months_between UDF to disable rounding-off

2016-12-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15511: Attachment: HIVE-15511.4.patch > Provide an option in months_between UDF to disable

[jira] [Updated] (HIVE-15511) Provide an option in months_between UDF to disable rounding-off

2016-12-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15511: Attachment: HIVE-15511.3.patch > Provide an option in months_between UDF to disable

[jira] [Commented] (HIVE-15511) Provide an option in months_between UDF to disable rounding-off

2016-12-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15777860#comment-15777860 ] Rajesh Balamohan commented on HIVE-15511: - Config option would not be needed. Patch does not

[jira] [Updated] (HIVE-15511) Provide an option in months_between UDF to disable rounding-off

2016-12-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15511: Attachment: HIVE-15511.2.patch Missed "TestGenericUDFMonthsBetween" changes earlier.

[jira] [Updated] (HIVE-15511) Provide an option in months_between UDF to disable rounding-off

2016-12-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15511: Attachment: HIVE-15511.1.patch Sample query: select distinct

[jira] [Updated] (HIVE-15511) Provide an option in months_between UDF to disable rounding-off

2016-12-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15511: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > Provide an option

[jira] [Updated] (HIVE-15504) ArrayIndexOutOfBoundsException in GenericUDFTrunc::initialize

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15504: Status: Patch Available (was: Open) > ArrayIndexOutOfBoundsException in

[jira] [Updated] (HIVE-15504) ArrayIndexOutOfBoundsException in GenericUDFTrunc::initialize

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15504: Attachment: HIVE-15504.1.patch > ArrayIndexOutOfBoundsException in

[jira] [Updated] (HIVE-15504) ArrayIndexOutOfBoundsException in GenericUDFTrunc::initialize

2016-12-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15504: Priority: Trivial (was: Minor) > ArrayIndexOutOfBoundsException in

[jira] [Updated] (HIVE-15471) LLAP UI: NPE when getting thread metrics

2016-12-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15471: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15471) LLAP UI: NPE when getting thread metrics

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15471: Attachment: HIVE-15471.2.patch Attaching .2 version to address review comments. > LLAP UI:

[jira] [Updated] (HIVE-15471) LLAP UI: NPE when getting thread metrics

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15471: Status: Open (was: Patch Available) > LLAP UI: NPE when getting thread metrics >

[jira] [Updated] (HIVE-15471) LLAP UI: NPE when getting thread metrics

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15471: Status: Patch Available (was: Open) > LLAP UI: NPE when getting thread metrics >

[jira] [Updated] (HIVE-15471) LLAP UI: NPE when getting thread metrics

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15471: Assignee: Rajesh Balamohan Status: Patch Available (was: Open) > LLAP UI: NPE when

[jira] [Updated] (HIVE-15471) LLAP UI: NPE when getting thread metrics

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15471: Attachment: HIVE-15471.1.patch Also, observed lots of objects created when accessing

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15463) EncodedReaderImpl::readEncodedColumns in io elevator path printing lots of logs

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15463: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Updated] (HIVE-15463) EncodedReaderImpl::readEncodedColumns in io elevator path printing lots of logs

2016-12-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15463: Status: Patch Available (was: Open) > EncodedReaderImpl::readEncodedColumns in io elevator

[jira] [Commented] (HIVE-15462) Failing test: TestCliDriver::udf_sort_array.q

2016-12-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760072#comment-15760072 ] Rajesh Balamohan commented on HIVE-15462: - [~aihuaxu] - Can you please suggest on whether

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-12-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Attachment: HIVE-15300.3.patch Incorporated [~pxiong]'s comments. My last run was on old

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Attachment: HIVE-15339.6.patch Attaching .6 patch which addresses the following 1. Added

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Status: Patch Available (was: Open) > Batch metastore calls to get column stats for fields

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Status: Open (was: Patch Available) > Batch metastore calls to get column stats for fields

<    4   5   6   7   8   9   10   11   12   13   >