[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Status: Patch Available (was: Open) > Batch metastore calls to get column stats for fields

[jira] [Assigned] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15339: --- Assignee: Rajesh Balamohan > Batch metastore calls to get column stats for fields

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Attachment: HIVE-15339.5.patch License header got changed accidentally in .4 patch.

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Status: Open (was: Patch Available) > Batch metastore calls to get column stats for fields

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Attachment: HIVE-15339.4.patch Attaching .4 patch based on the earlier suggestion. Checked

[jira] [Commented] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753530#comment-15753530 ] Rajesh Balamohan commented on HIVE-15339: - Thanks [~jcamachorodriguez]. I agree that it would be

[jira] [Comment Edited] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753530#comment-15753530 ] Rajesh Balamohan edited comment on HIVE-15339 at 12/16/16 5:38 AM: ---

[jira] [Commented] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750688#comment-15750688 ] Rajesh Balamohan commented on HIVE-15339: - Thank you for the comments [~jcamachorodriguez]. If

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Commented] (HIVE-15395) Don't try to intern strings from empty map

2016-12-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749647#comment-15749647 ] Rajesh Balamohan commented on HIVE-15395: - +1. Thanks [~ashutoshc]. > Don't try to intern strings

[jira] [Commented] (HIVE-15420) LLAP UI: Relativize resources to allow proxied/secured views

2016-12-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747748#comment-15747748 ] Rajesh Balamohan commented on HIVE-15420: - +1 > LLAP UI: Relativize resources to allow

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Attachment: HIVE-15422.3.patch There is one additional place in

[jira] [Assigned] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15422: --- Assignee: Rajesh Balamohan > HiveInputFormat::pushProjectionsAndFilters paths

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Attachment: HIVE-15422.2.patch Thanks [~sershe]. Addressed the review comments in latest

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Summary: HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters path comparisons create huge number of objects for partitioned dataset

2016-12-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Status: Patch Available (was: Open) > HiveInputFormat::pushProjectionsAndFilters path

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters path comparisons create huge number of objects for partitioned dataset

2016-12-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Attachment: Profiler_Snapshot_HIVE-15422.png > HiveInputFormat::pushProjectionsAndFilters

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters path comparisons create huge number of objects for partitioned dataset

2016-12-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Attachment: HIVE-15422.1.patch > HiveInputFormat::pushProjectionsAndFilters path

[jira] [Commented] (HIVE-15415) Random "java.util.ConcurrentModificationException"

2016-12-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15741622#comment-15741622 ] Rajesh Balamohan commented on HIVE-15415: - HIVE-15355? > Random

[jira] [Commented] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-12-11 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15741085#comment-15741085 ] Rajesh Balamohan commented on HIVE-15300: - Thanks [~pxiong]. I had tried that and it was throwing

[jira] [Commented] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736970#comment-15736970 ] Rajesh Balamohan commented on HIVE-15405: - Thanks [~sershe].

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Status: Patch Available (was: Open) > Improve FileUtils.isPathWithinSubtree >

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Attachment: HIVE-15405.2.patch Uploading the correct version of the patch. > Improve

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Status: Open (was: Patch Available) > Improve FileUtils.isPathWithinSubtree >

[jira] [Assigned] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15405: --- Assignee: Rajesh Balamohan > Improve FileUtils.isPathWithinSubtree >

[jira] [Commented] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734751#comment-15734751 ] Rajesh Balamohan commented on HIVE-15405: - \cc [~ashutoshc] > Improve

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Status: Patch Available (was: Open) > Improve FileUtils.isPathWithinSubtree >

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Attachment: HIVE-15405.1.patch > Improve FileUtils.isPathWithinSubtree >

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Description: When running single node LLAP with the following query multiple number of

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Description: When running single node LLAP with the following query multiple number of

[jira] [Updated] (HIVE-15405) Improve FileUtils.isPathWithinSubtree

2016-12-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15405: Attachment: HIVE-15405-profiler.view.png > Improve FileUtils.isPathWithinSubtree >

[jira] [Updated] (HIVE-15388) HiveParser spends lots of time in parsing queries with lots of "("

2016-12-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15388: Description: Branch: apache-master (applicable with previous releases as well) Queries

[jira] [Updated] (HIVE-15388) HiveParser spends lots of time in parsing queries with lots "("

2016-12-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15388: Description: Branch: apache-master (applicable with previous releases as well) Queries

[jira] [Updated] (HIVE-15388) HiveParser spends lots of time in parsing queries with lots of "("

2016-12-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15388: Summary: HiveParser spends lots of time in parsing queries with lots of "(" (was:

[jira] [Updated] (HIVE-15388) HiveParser spends lots of time in parsing queries with lots "("

2016-12-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15388: Description: Branch: apache-master (applicable with previous releases as well) Queries

[jira] [Updated] (HIVE-15388) HiveParser spends lots of time in parsing queries with lots "("

2016-12-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15388: Attachment: hive-15388.stacktrace.txt Attaching stack trace for reference. > HiveParser

[jira] [Updated] (HIVE-15388) HiveParser spends lots of time in parsing queries with lots "("

2016-12-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15388: Affects Version/s: 2.2.0 > HiveParser spends lots of time in parsing queries with lots "("

[jira] [Updated] (HIVE-15339) Prefetch column stats for fields needed in FilterSelectivityEstimator

2016-12-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Attachment: HIVE-15339.3.patch > Prefetch column stats for fields needed in

[jira] [Updated] (HIVE-15368) consider optimizing Utilities::handleMmTableFinalPath

2016-12-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15368: Attachment: HIVE-15368.branch.14535.1.patch > consider optimizing

[jira] [Commented] (HIVE-15355) Concurrency issues during parallel moveFile due to HDFSUtils.setFullFileStatus

2016-12-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15720961#comment-15720961 ] Rajesh Balamohan commented on HIVE-15355: - Thanks for reporting the issue [~vihangk1].

[jira] [Updated] (HIVE-15339) Prefetch column stats for fields needed in FilterSelectivityEstimator

2016-12-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Status: Patch Available (was: Open) > Prefetch column stats for fields needed in

[jira] [Comment Edited] (HIVE-15339) Prefetch column stats for fields needed in FilterSelectivityEstimator

2016-12-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714800#comment-15714800 ] Rajesh Balamohan edited comment on HIVE-15339 at 12/2/16 11:12 AM: ---

[jira] [Comment Edited] (HIVE-15339) Prefetch column stats for fields needed in FilterSelectivityEstimator

2016-12-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714800#comment-15714800 ] Rajesh Balamohan edited comment on HIVE-15339 at 12/2/16 11:12 AM: ---

[jira] [Comment Edited] (HIVE-15339) Prefetch column stats for fields needed in FilterSelectivityEstimator

2016-12-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714800#comment-15714800 ] Rajesh Balamohan edited comment on HIVE-15339 at 12/2/16 11:00 AM: ---

[jira] [Updated] (HIVE-15339) Prefetch column stats for fields needed in FilterSelectivityEstimator

2016-12-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15339: Attachment: HIVE-15339.1.patch Attaching .1 patch. {noformat} Without any patch: (compile

[jira] [Resolved] (HIVE-15315) Query compilation: PartitionDesc can reduce the number of table metadata calls

2016-11-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved HIVE-15315. - Resolution: Invalid > Query compilation: PartitionDesc can reduce the number of table

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-11-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Status: Patch Available (was: Open) > Reuse table information in

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-11-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Attachment: HIVE-15300.2.patch > Reuse table information in SemanticAnalyzer::getMetaData

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-11-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Status: Open (was: Patch Available) > Reuse table information in

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-11-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Status: Patch Available (was: Open) > Reuse table information in

[jira] [Assigned] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-11-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15300: --- Assignee: Rajesh Balamohan > Reuse table information in

[jira] [Updated] (HIVE-15300) Reuse table information in SemanticAnalyzer::getMetaData to reduce compilation time

2016-11-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15300: Attachment: HIVE-15300.1.patch {noformat} Without Patch: == 2016-11-29

[jira] [Commented] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15697784#comment-15697784 ] Rajesh Balamohan commented on HIVE-15240: - Above test failures are unrelated to this patch.

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.6.patch > Updating/Altering stats in metastore can be expensive in

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Status: Open (was: Patch Available) > Updating/Altering stats in metastore can be

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Status: Patch Available (was: Open) > Updating/Altering stats in metastore can be

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.5.patch > Updating/Altering stats in metastore can be expensive in

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Attachment: HIVE-15250.3.patch Thanks [~sershe]. Attaching .3 patch with comments

[jira] [Commented] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15689001#comment-15689001 ] Rajesh Balamohan commented on HIVE-15250: - test case failures are related to HIVE-15201,

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: (was: HIVE-15240.3.patch) > Updating/Altering stats in metastore can be

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.3.patch > Updating/Altering stats in metastore can be expensive in

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Status: Patch Available (was: Open) > Updating/Altering stats in metastore can be

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Status: Open (was: Patch Available) > Updating/Altering stats in metastore can be

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Status: Patch Available (was: Open) > Updating/Altering stats in metastore can be

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Status: Patch Available (was: Open) > Reuse partitions info generated in MoveTask to its

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Attachment: HIVE-15250.2.patch > Reuse partitions info generated in MoveTask to its

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.3.patch > Updating/Altering stats in metastore can be expensive in

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.2.patch Thanks [~sershe]. Attaching .2 patch. > Updating/Altering

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Status: Open (was: Patch Available) > Reuse partitions info generated in MoveTask to its

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Status: Patch Available (was: Open) > Reuse partitions info generated in MoveTask to its

[jira] [Assigned] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15250: --- Assignee: Rajesh Balamohan > Reuse partitions info generated in MoveTask to its

[jira] [Updated] (HIVE-15250) Reuse partitions info generated in MoveTask to its subscribers (StatsTask)

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15250: Attachment: HIVE-15250.1.patch Observed 10% improvement on top of HIVE-15240 in 5 node

[jira] [Commented] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682915#comment-15682915 ] Rajesh Balamohan commented on HIVE-15240: - \cc [~sershe], [~pxiong], [~ashutoshc] >

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Status: Patch Available (was: Open) > Updating/Altering stats in metastore can be

[jira] [Updated] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15240: Attachment: HIVE-15240.1.patch As part of "StatsTask -> updateQuickStats" itself,

[jira] [Assigned] (HIVE-15240) Updating/Altering stats in metastore can be expensive in S3

2016-11-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15240: --- Assignee: Rajesh Balamohan > Updating/Altering stats in metastore can be expensive

[jira] [Resolved] (HIVE-15241) Update/Alter stats in metastore can be expensive in S3

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved HIVE-15241. - Resolution: Duplicate > Update/Alter stats in metastore can be expensive in S3 >

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675748#comment-15675748 ] Rajesh Balamohan commented on HIVE-14803: - Thanks [~pxiong].

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.7.patch Minor change in exception handling > S3: Stats gathering

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15673389#comment-15673389 ] Rajesh Balamohan commented on HIVE-14803: - Test failures are not related to this patch. Here are

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.6.patch > S3: Stats gathering for insert queries can be expensive

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Patch Available (was: Open) > S3: Stats gathering for insert queries can be

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Open (was: Patch Available) > S3: Stats gathering for insert queries can be

[jira] [Commented] (HIVE-15199) INSERT INTO data on S3 is replacing the old rows with the new ones

2016-11-15 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666900#comment-15666900 ] Rajesh Balamohan commented on HIVE-15199: - This is covered in test cases in branch-2 for S3

[jira] [Commented] (HIVE-15203) Hive export command does export to non HDFS file system

2016-11-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666334#comment-15666334 ] Rajesh Balamohan commented on HIVE-15203: - [~thejas] - Does this happen with

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Attachment: HIVE-15129.3.patch Removing the last change w.r.t to footer cache. Will create

[jira] [Commented] (HIVE-15138) String + Integer gets converted to UDFToDouble causing number format exceptions

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643514#comment-15643514 ] Rajesh Balamohan commented on HIVE-15138: - Yeah, HIVE-5021 would be needed for better handling of

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Attachment: HIVE-15129.2.patch Footer information can be reused in {{loadMissingIndexes}}

[jira] [Commented] (HIVE-15138) String + Integer gets converted to UDFToDouble causing number format exceptions

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643274#comment-15643274 ] Rajesh Balamohan commented on HIVE-15138: - \cc [~jcamachorodriguez], [~gopalv] > String + Integer

[jira] [Comment Edited] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642719#comment-15642719 ] Rajesh Balamohan edited comment on HIVE-15129 at 11/7/16 2:46 AM: -- Thanks

[jira] [Comment Edited] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642890#comment-15642890 ] Rajesh Balamohan edited comment on HIVE-15038 at 11/7/16 2:43 AM: -- Thanks

[jira] [Commented] (HIVE-15038) Reuse OrcTail in OrcEncodedDataReader::ReaderOptions in Llap

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642890#comment-15642890 ] Rajesh Balamohan commented on HIVE-15038: - Thanks [~sershe]. Test failures are unrelated to this

[jira] [Commented] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15642719#comment-15642719 ] Rajesh Balamohan commented on HIVE-15129: - Thanks [~sershe]. Test failures are not related to this

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Status: Patch Available (was: Open) > LLAP : Enhance cache hits for stripe metadata across

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Attachment: HIVE-15129.1.patch \cc [~gopalv], [~sershe] > LLAP : Enhance cache hits for

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were

[jira] [Updated] (HIVE-15129) LLAP : Enhance cache hits for stripe metadata across queries

2016-11-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15129: Description: When multiple queries are run in LLAP, stripe metadata cache misses were

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-11-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Status: Patch Available (was: Open) > S3: Stats gathering for insert queries can be

<    5   6   7   8   9   10   11   12   13   >