[jira] [Commented] (IMPALA-3471) TopN should be able to spill

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134613#comment-17134613 ] Tim Armstrong commented on IMPALA-3471: --- I think we still want to use the regular external sort

[jira] [Assigned] (IMPALA-9853) Push rank() predicates into sort

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-9853: - Assignee: (was: Tim Armstrong) > Push rank() predicates into sort >

[jira] [Commented] (IMPALA-5296) Codegen for aggregation with 1K grouping columns takes several seconds

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134607#comment-17134607 ] Tim Armstrong commented on IMPALA-5296: --- This has gotten a little faster, but still took over a

[jira] [Assigned] (IMPALA-6746) Reduce the number of comparison for analytical functions with partitioning when incoming data is clustered

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-6746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-6746: - Assignee: (was: Adrian Ng) > Reduce the number of comparison for analytical

[jira] [Assigned] (IMPALA-6354) Consider using Guava LoadingCache to cache metadata objects opposed to a ConcurrentHashMap

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-6354: - Assignee: (was: Tianyi Wang) > Consider using Guava LoadingCache to cache metadata

[jira] [Assigned] (IMPALA-6404) Evenly distribute local and remote scan ranges across Impalad(s) when 100% locality is not achievable

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-6404: - Assignee: (was: Lars Volker) > Evenly distribute local and remote scan ranges

[jira] [Assigned] (IMPALA-6006) Incorrect cardinality estimation when dimension table has inequality predicate

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-6006: - Assignee: (was: Philip Martin) > Incorrect cardinality estimation when dimension

[jira] [Resolved] (IMPALA-4062) Create thread pool for HdfsScanNode::ScannerThread to limit Kernel contention

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-4062. --- Resolution: Won't Fix Not relevant with the IMPALA-3902 changes. > Create thread pool for

[jira] [Resolved] (IMPALA-4062) Create thread pool for HdfsScanNode::ScannerThread to limit Kernel contention

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-4062. --- Resolution: Won't Fix Not relevant with the IMPALA-3902 changes. > Create thread pool for

[jira] [Assigned] (IMPALA-3731) Runtime filters from the same source arrive at different times

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-3731: - Assignee: (was: Henry Robinson) > Runtime filters from the same source arrive at

[jira] [Resolved] (IMPALA-3701) Evaluate compressing Runtime filters to save coordinator network bandwidth

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-3701. --- Resolution: Won't Fix We expect these to be generally incompressible, so not worth

[jira] [Resolved] (IMPALA-3701) Evaluate compressing Runtime filters to save coordinator network bandwidth

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-3701. --- Resolution: Won't Fix We expect these to be generally incompressible, so not worth

[jira] [Resolved] (IMPALA-3617) Incorrect reporting of runtime filters in scan node

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-3617. --- Resolution: Cannot Reproduce > Incorrect reporting of runtime filters in scan node >

[jira] [Resolved] (IMPALA-3636) Regression in DecimalOperators::EQ with codegen disabled

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-3636. --- Resolution: Won't Fix > Regression in DecimalOperators::EQ with codegen disabled >

[jira] [Resolved] (IMPALA-3617) Incorrect reporting of runtime filters in scan node

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-3617. --- Resolution: Cannot Reproduce > Incorrect reporting of runtime filters in scan node >

[jira] [Resolved] (IMPALA-3636) Regression in DecimalOperators::EQ with codegen disabled

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-3636. --- Resolution: Won't Fix > Regression in DecimalOperators::EQ with codegen disabled >

[jira] [Commented] (IMPALA-3101) AnalyticEvalNode should use codegened TupleRowComparator instead of PrevRowCompare

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134600#comment-17134600 ] Tim Armstrong commented on IMPALA-3101: --- IMPALA-4356 should guarantee that the full expr tree was

[jira] [Commented] (IMPALA-9847) JSON profiles are mostly space characters

2020-06-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134597#comment-17134597 ] ASF subversion and git services commented on IMPALA-9847: - Commit

[jira] [Commented] (IMPALA-9824) MetastoreClientPool should be singleton

2020-06-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134596#comment-17134596 ] ASF subversion and git services commented on IMPALA-9824: - Commit

[jira] [Commented] (IMPALA-9843) Add ability to run schematool against HMS in minicluster

2020-06-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134598#comment-17134598 ] ASF subversion and git services commented on IMPALA-9843: - Commit

[jira] [Commented] (IMPALA-9791) Support validWriteIdList in getPartialCatalogObject

2020-06-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134595#comment-17134595 ] ASF subversion and git services commented on IMPALA-9791: - Commit

[jira] [Assigned] (IMPALA-3101) AnalyticEvalNode should use codegened TupleRowComparator instead of PrevRowCompare

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-3101: - Assignee: (was: Michael Ho) > AnalyticEvalNode should use codegened

[jira] [Resolved] (IMPALA-2400) Unpredictable locality behavior for reading Parquet files

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-2400. --- Resolution: Cannot Reproduce > Unpredictable locality behavior for reading Parquet files >

[jira] [Resolved] (IMPALA-2400) Unpredictable locality behavior for reading Parquet files

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-2400. --- Resolution: Cannot Reproduce > Unpredictable locality behavior for reading Parquet files >

[jira] [Resolved] (IMPALA-2522) Improve the reliability and effectiveness of ETL

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-2522. --- Resolution: Fixed Will mark as fixed for now, since the vast majority of subtasks are

[jira] [Resolved] (IMPALA-2522) Improve the reliability and effectiveness of ETL

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-2522. --- Resolution: Fixed Will mark as fixed for now, since the vast majority of subtasks are

[jira] [Work started] (IMPALA-7020) Order by expressions in Analytical functions are not materialized causing slowdown

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on IMPALA-7020 started by Tim Armstrong. - > Order by expressions in Analytical functions are not materialized causing

[jira] [Commented] (IMPALA-9740) TSAN data race in hdfs-bulk-ops

2020-06-12 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134569#comment-17134569 ] Sahil Takiar commented on IMPALA-9740: --  

[jira] [Commented] (IMPALA-7020) Order by expressions in Analytical functions are not materialized causing slowdown

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134542#comment-17134542 ] Tim Armstrong commented on IMPALA-7020: --- One proposal: * Casts between integral and floating

[jira] [Assigned] (IMPALA-9213) Client logs should indicate if a query has been retried

2020-06-12 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-9213: Assignee: Quanlong Huang > Client logs should indicate if a query has been retried >

[jira] [Commented] (IMPALA-7020) Order by expressions in Analytical functions are not materialized causing slowdown

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134523#comment-17134523 ] Tim Armstrong commented on IMPALA-7020: --- This is sufficient to force it to be materialised:

[jira] [Commented] (IMPALA-7020) Order by expressions in Analytical functions are not materialized causing slowdown

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134508#comment-17134508 ] Tim Armstrong commented on IMPALA-7020: --- I think we're costing the cast expression wrong in this

[jira] [Assigned] (IMPALA-7020) Order by expressions in Analytical functions are not materialized causing slowdown

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned IMPALA-7020: - Assignee: Tim Armstrong > Order by expressions in Analytical functions are not

[jira] [Commented] (IMPALA-9824) MetastoreClientPool should be singleton

2020-06-12 Thread Vihang Karajgaonkar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134469#comment-17134469 ] Vihang Karajgaonkar commented on IMPALA-9824: - Spend sometime on this and almost made it to

[jira] [Closed] (IMPALA-8720) Impala frontend jar should not depend on Sentry jars when building against hive-3 profile

2020-06-12 Thread Vihang Karajgaonkar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar closed IMPALA-8720. --- Fix Version/s: Not Applicable Resolution: Not A Problem > Impala frontend

[jira] [Closed] (IMPALA-8720) Impala frontend jar should not depend on Sentry jars when building against hive-3 profile

2020-06-12 Thread Vihang Karajgaonkar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar closed IMPALA-8720. --- Fix Version/s: Not Applicable Resolution: Not A Problem > Impala frontend

[jira] [Resolved] (IMPALA-9843) Add ability to run schematool against HMS in minicluster

2020-06-12 Thread Vihang Karajgaonkar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar resolved IMPALA-9843. - Fix Version/s: Impala 4.0 Resolution: Fixed The patch was submitted on

[jira] [Resolved] (IMPALA-9843) Add ability to run schematool against HMS in minicluster

2020-06-12 Thread Vihang Karajgaonkar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar resolved IMPALA-9843. - Fix Version/s: Impala 4.0 Resolution: Fixed The patch was submitted on

[jira] [Created] (IMPALA-9855) TSAN lock-order-inversion warning in QueryDriver::RetryQueryFromThread

2020-06-12 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9855: Summary: TSAN lock-order-inversion warning in QueryDriver::RetryQueryFromThread Key: IMPALA-9855 URL: https://issues.apache.org/jira/browse/IMPALA-9855 Project:

[jira] [Created] (IMPALA-9855) TSAN lock-order-inversion warning in QueryDriver::RetryQueryFromThread

2020-06-12 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9855: Summary: TSAN lock-order-inversion warning in QueryDriver::RetryQueryFromThread Key: IMPALA-9855 URL: https://issues.apache.org/jira/browse/IMPALA-9855 Project:

[jira] [Created] (IMPALA-9854) TSAN data race in QueryDriver::CreateRetriedClientRequestState

2020-06-12 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9854: Summary: TSAN data race in QueryDriver::CreateRetriedClientRequestState Key: IMPALA-9854 URL: https://issues.apache.org/jira/browse/IMPALA-9854 Project: IMPALA

[jira] [Created] (IMPALA-9854) TSAN data race in QueryDriver::CreateRetriedClientRequestState

2020-06-12 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9854: Summary: TSAN data race in QueryDriver::CreateRetriedClientRequestState Key: IMPALA-9854 URL: https://issues.apache.org/jira/browse/IMPALA-9854 Project: IMPALA

[jira] [Commented] (IMPALA-9739) TSAN data races during impalad shutdown

2020-06-12 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134456#comment-17134456 ] Sahil Takiar commented on IMPALA-9739: -- [~bikramjeet.vig] the {{TestGracefulShutdown}} tests in

[jira] [Updated] (IMPALA-9853) Push rank() predicates into sort

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated IMPALA-9853: -- Labels: performance tpcds (was: ) > Push rank() predicates into sort >

[jira] [Created] (IMPALA-9853) Push rank() predicates into sort

2020-06-12 Thread Tim Armstrong (Jira)
Tim Armstrong created IMPALA-9853: - Summary: Push rank() predicates into sort Key: IMPALA-9853 URL: https://issues.apache.org/jira/browse/IMPALA-9853 Project: IMPALA Issue Type: Improvement

[jira] [Created] (IMPALA-9853) Push rank() predicates into sort

2020-06-12 Thread Tim Armstrong (Jira)
Tim Armstrong created IMPALA-9853: - Summary: Push rank() predicates into sort Key: IMPALA-9853 URL: https://issues.apache.org/jira/browse/IMPALA-9853 Project: IMPALA Issue Type: Improvement

[jira] [Resolved] (IMPALA-9847) JSON profiles are mostly space characters

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-9847. --- Fix Version/s: Impala 4.0 Resolution: Fixed > JSON profiles are mostly space

[jira] [Resolved] (IMPALA-9847) JSON profiles are mostly space characters

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong resolved IMPALA-9847. --- Fix Version/s: Impala 4.0 Resolution: Fixed > JSON profiles are mostly space

[jira] [Commented] (IMPALA-9852) UDA Check that function name, arguments, and return type are correct.

2020-06-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134317#comment-17134317 ] Tim Armstrong commented on IMPALA-9852: --- You can list out the symbols in the so with "nm -g

[jira] [Created] (IMPALA-9852) UDA Check that function name, arguments, and return type are correct.

2020-06-12 Thread Volnei (Jira)
Volnei created IMPALA-9852: -- Summary: UDA Check that function name, arguments, and return type are correct. Key: IMPALA-9852 URL: https://issues.apache.org/jira/browse/IMPALA-9852 Project: IMPALA

[jira] [Created] (IMPALA-9852) UDA Check that function name, arguments, and return type are correct.

2020-06-12 Thread Volnei (Jira)
Volnei created IMPALA-9852: -- Summary: UDA Check that function name, arguments, and return type are correct. Key: IMPALA-9852 URL: https://issues.apache.org/jira/browse/IMPALA-9852 Project: IMPALA

[jira] [Commented] (IMPALA-9747) More fine-grained codegen for text file scanners

2020-06-12 Thread Daniel Becker (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134199#comment-17134199 ] Daniel Becker commented on IMPALA-9747: --- [https://gerrit.cloudera.org/#/c/16059/] > More