[jira] [Commented] (HIVE-16876) RpcServer should be re-created when Rpc configs change

[ https://issues.apache.org/jira/browse/HIVE-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047315#comment-16047315 ] Rui Li commented on HIVE-16876: --- [~xuefuz], examples are the server side connect timeout, and number of

[jira] [Commented] (HIVE-16876) RpcServer should be re-created when Rpc configs change

[ https://issues.apache.org/jira/browse/HIVE-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046452#comment-16046452 ] Rui Li commented on HIVE-16876: --- At the moment RpcServer is a singleton. If we allow users to configure it

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046413#comment-16046413 ] Rui Li commented on HIVE-16600: --- Thanks for updating [~kellyzly]. Patch looks good overall. I've left some

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046396#comment-16046396 ] Rui Li commented on HIVE-6348: -- Hi [~vgarg], it turns out we do need the sub query being sorted in some cases.

[jira] [Commented] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046323#comment-16046323 ] Rui Li commented on HIVE-13308: --- Fixed via HIVE-16854. Close this one as dup. > HiveOnSpark sumbit query

[jira] [Resolved] (HIVE-13308) HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

[ https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li resolved HIVE-13308. --- Resolution: Duplicate > HiveOnSpark sumbit query very slow when hundred of beeline exectue at same > time >

[jira] [Updated] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16854: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Updated] (HIVE-16876) RpcServer should be re-created when Rpc configs change

[ https://issues.apache.org/jira/browse/HIVE-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16876: -- Component/s: Spark > RpcServer should be re-created when Rpc configs change >

[jira] [Assigned] (HIVE-16876) RpcServer should be re-created when Rpc configs change

[ https://issues.apache.org/jira/browse/HIVE-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16876: - > RpcServer should be re-created when Rpc configs change >

[jira] [Commented] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045451#comment-16045451 ] Rui Li commented on HIVE-16854: --- Thanks [~xuefuz] for providing the patch. I think RpcServer is already

[jira] [Updated] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16854: -- Attachment: HIVE-16854.2.patch > SparkClientFactory is locked too aggressively >

[jira] [Updated] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-6348: - Attachment: HIVE-6348.3.patch > Order by/Sort by in subquery > > >

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042415#comment-16042415 ] Rui Li commented on HIVE-6348: -- Hi [~ashutoshc], I didn't put it in calcite because it won't work if CBO is

[jira] [Commented] (HIVE-16659) Query plan should reflect hive.spark.use.groupby.shuffle

[ https://issues.apache.org/jira/browse/HIVE-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042389#comment-16042389 ] Rui Li commented on HIVE-16659: --- [~libing] sure, thanks for helping. Some suggestions: instead of enforcing

[jira] [Commented] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042140#comment-16042140 ] Rui Li commented on HIVE-16854: --- Thanks Xuefu for finding the issue. I'll take a look. > SparkClientFactory

[jira] [Assigned] (HIVE-16854) SparkClientFactory is locked too aggressively

[ https://issues.apache.org/jira/browse/HIVE-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16854: - Assignee: Rui Li > SparkClientFactory is locked too aggressively >

[jira] [Commented] (HIVE-16840) Investigate the performance of order by limit in HoS

[ https://issues.apache.org/jira/browse/HIVE-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042120#comment-16042120 ] Rui Li commented on HIVE-16840: --- In theory, RDD computation is done lazily and we're only retrieving the

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040710#comment-16040710 ] Rui Li commented on HIVE-6348: -- Hi [~xuefuz], [~vgarg], I also think it's easier to do this in AST. Once we

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040540#comment-16040540 ] Rui Li commented on HIVE-16600: --- If the order by in sub query is followed by limit, it won't be removed. But

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040512#comment-16040512 ] Rui Li commented on HIVE-16600: --- With HIVE-6348, we won't have such an order by in sub queries - multi

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040423#comment-16040423 ] Rui Li commented on HIVE-16600: --- Hi [~kellyzly], basically I meant we can fall back to v1 patch, combined

[jira] [Updated] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16573: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037930#comment-16037930 ] Rui Li commented on HIVE-6348: -- Thanks guys for the suggestions. Yeah I agree ignoring such order/sort by is

[jira] [Commented] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036805#comment-16036805 ] Rui Li commented on HIVE-16573: --- [~anishek], yeah spark only supports in-place update in CLI. In the current

[jira] [Commented] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036697#comment-16036697 ] Rui Li commented on HIVE-16573: --- +1. [~anishek] would you mind also have a look? Thanks > In-place update

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036612#comment-16036612 ] Rui Li commented on HIVE-6348: -- The latest failures are due to the sub-query order/sort by in our tests. I'd

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034529#comment-16034529 ] Rui Li commented on HIVE-6348: -- Fix some tests in v2 patch. The plan is to disallow order/sort by w/o limit in

[jira] [Updated] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-6348: - Attachment: HIVE-6348.2.patch > Order by/Sort by in subquery > > >

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034519#comment-16034519 ] Rui Li commented on HIVE-16600: --- [~kellyzly], sorry for the delay. bq. what i am confused is above case is

[jira] [Commented] (HIVE-16799) Control the max number of task for a stage in a spark job

[ https://issues.apache.org/jira/browse/HIVE-16799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034048#comment-16034048 ] Rui Li commented on HIVE-16799: --- +1, thanks Xuefu for working on it. > Control the max number of task for a

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031007#comment-16031007 ] Rui Li commented on HIVE-16600: --- Hi [~kellyzly], thanks for the example. As I said, I agree disabling

[jira] [Updated] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-6348: - Status: Patch Available (was: Open) > Order by/Sort by in subquery > > >

[jira] [Updated] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-6348: - Attachment: HIVE-6348.1.patch > Order by/Sort by in subquery > > >

[jira] [Assigned] (HIVE-6348) Order by/Sort by in subquery

[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-6348: Assignee: Rui Li > Order by/Sort by in subquery > > > Key:

[jira] [Resolved] (HIVE-16767) Update people website with recent changes

[ https://issues.apache.org/jira/browse/HIVE-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li resolved HIVE-16767. --- Resolution: Fixed Patch committed. Thanks guys. > Update people website with recent changes >

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027194#comment-16027194 ] Rui Li commented on HIVE-16600: --- [~kellyzly], one example of non multi insert having branches is dynamic

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026055#comment-16026055 ] Rui Li commented on HIVE-16600: --- Hi [~kellyzly], quick question, is the v9 patch logically different from

[jira] [Commented] (HIVE-16767) Update people website with recent changes

[ https://issues.apache.org/jira/browse/HIVE-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025942#comment-16025942 ] Rui Li commented on HIVE-16767: --- cc [~aihuaxu], [~ychena], [~vgumashta], [~ctang.ma], [~spena], [~jxiang],

[jira] [Updated] (HIVE-16767) Update people website with recent changes

[ https://issues.apache.org/jira/browse/HIVE-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16767: -- Attachment: HIVE-16767.1.patch > Update people website with recent changes >

[jira] [Assigned] (HIVE-16767) Update people website with recent changes

[ https://issues.apache.org/jira/browse/HIVE-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16767: - > Update people website with recent changes > - > >

[jira] [Updated] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16613: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Commented] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024095#comment-16024095 ] Rui Li commented on HIVE-16613: --- Pinging [~xuefuz] > SaslClientHandler.sendHello is eating exceptions >

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022736#comment-16022736 ] Rui Li commented on HIVE-16600: --- [~kellyzly], I think there's a bug in latest patch. Suppose we have OP tree

[jira] [Comment Edited] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020960#comment-16020960 ] Rui Li edited comment on HIVE-16600 at 5/23/17 9:45 AM: [~kellyzly], I tried some

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020960#comment-16020960 ] Rui Li commented on HIVE-16600: --- [~kellyzly], I tried some multi cases and they don't necessarily branch at

[jira] [Assigned] (HIVE-16739) HoS DPP generates malformed plan when hive.tez.dynamic.semijoin.reduction is on

[ https://issues.apache.org/jira/browse/HIVE-16739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16739: - > HoS DPP generates malformed plan when hive.tez.dynamic.semijoin.reduction is > on >

[jira] [Updated] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15104: -- Attachment: TPC-H 100G.xlsx Attaching TPC-H benchmark result. It shows the improvement is more obvious for

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017621#comment-16017621 ] Rui Li commented on HIVE-15104: --- Patch v3 compiles the registrators at runtime, so that we don't have to

[jira] [Updated] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15104: -- Attachment: HIVE-15104.3.patch > Hive on Spark generate more shuffle data than hive on mr >

[jira] [Commented] (HIVE-16395) ConcurrentModificationException on config object in HoS

[ https://issues.apache.org/jira/browse/HIVE-16395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017220#comment-16017220 ] Rui Li commented on HIVE-16395: --- Thanks [~stakiar] for the good research. Looking at

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016859#comment-16016859 ] Rui Li commented on HIVE-16600: --- Thanks [~xuefuz] for your input. That's inline with my understanding.

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013480#comment-16013480 ] Rui Li commented on HIVE-16600: --- Hi [~xuefuz], I'd like to confirm what the standard says about this case.

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013478#comment-16013478 ] Rui Li commented on HIVE-16600: --- [~kellyzly], thanks for the update. Just curious, have you tried adding

[jira] [Commented] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012461#comment-16012461 ] Rui Li commented on HIVE-16573: --- Thanks [~libing] for the help. Just feel free to take it. And you can

[jira] [Updated] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15104: -- Attachment: HIVE-15104.2.patch The CNF is due to how kryo is loaded in {{KryoMessageCodec}}. W/ relocation,

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009958#comment-16009958 ] Rui Li commented on HIVE-16600: --- [~kellyzly], my point is the behavior is different between multi insert and

[jira] [Updated] (HIVE-16658) TestTimestampTZ.java has missed the ASF header

[ https://issues.apache.org/jira/browse/HIVE-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16658: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009026#comment-16009026 ] Rui Li commented on HIVE-15104: --- [~xuefuz], kryo was relocated in HIVE-5915. So it's not intended for Spark.

[jira] [Updated] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15104: -- Attachment: HIVE-15104.1.patch Spark needs the hash code on reducer side for the groupBy shuffling. Since

[jira] [Updated] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15104: -- Status: Patch Available (was: Open) > Hive on Spark generate more shuffle data than hive on mr >

[jira] [Updated] (HIVE-16659) Query plan should reflect hive.spark.use.groupby.shuffle

[ https://issues.apache.org/jira/browse/HIVE-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16659: -- Component/s: Spark > Query plan should reflect hive.spark.use.groupby.shuffle >

[jira] [Assigned] (HIVE-16659) Query plan should reflect hive.spark.use.groupby.shuffle

[ https://issues.apache.org/jira/browse/HIVE-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16659: - > Query plan should reflect hive.spark.use.groupby.shuffle >

[jira] [Commented] (HIVE-16658) TestTimestampTZ.java has missed the ASF header

[ https://issues.apache.org/jira/browse/HIVE-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007607#comment-16007607 ] Rui Li commented on HIVE-16658: --- +1. Thanks for the fix, [~txhsj] > TestTimestampTZ.java has missed the ASF

[jira] [Updated] (HIVE-16418) Allow HiveKey to skip some bytes for comparison

[ https://issues.apache.org/jira/browse/HIVE-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16418: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) Close this one as we've decided not to

[jira] [Updated] (HIVE-14412) Add timestamp with time zone

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-14412: -- Labels: TODOC3.0 (was: ) > Add timestamp with time zone > > >

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006117#comment-16006117 ] Rui Li commented on HIVE-16600: --- [~kellyzly], it's not possible for Stage-2 to have extra reduce stage

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006065#comment-16006065 ] Rui Li commented on HIVE-16600: --- [~kellyzly], what does the {{Stage: Stage-4}} do in the file you uploaded?

[jira] [Updated] (HIVE-14412) Add timestamp with time zone

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-14412: -- Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Fix Version/s: 3.0.0 Release Note:

[jira] [Updated] (HIVE-14412) Add timestamp with time zone

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-14412: -- Summary: Add timestamp with time zone (was: Add a timezone-aware timestamp) > Add timestamp with time zone >

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004325#comment-16004325 ] Rui Li commented on HIVE-16600: --- Hi [~kellyzly], please check your patch, seems it doesn't build. Meanwhile,

[jira] [Commented] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004256#comment-16004256 ] Rui Li commented on HIVE-16613: --- [~xuefuz] could you take a look? It's trivial patch. Thanks! >

[jira] [Updated] (HIVE-16593) SparkClientFactory.stop may prevent JVM from exiting

[ https://issues.apache.org/jira/browse/HIVE-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16593: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Updated] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-14412: -- Attachment: HIVE-14412.13.patch Update to address [~ashutoshc]'s comments. The reason why I didn't add qtest

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003950#comment-16003950 ] Rui Li commented on HIVE-14412: --- [~ashutoshc], thanks for the review. bq. Is there any reason to use

[jira] [Commented] (HIVE-16593) SparkClientFactory.stop may prevent JVM from exiting

[ https://issues.apache.org/jira/browse/HIVE-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002515#comment-16002515 ] Rui Li commented on HIVE-16593: --- Failures not related. [~xuefuz], could you take a look? Thanks. >

[jira] [Updated] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16613: -- Status: Patch Available (was: Open) > SaslClientHandler.sendHello is eating exceptions >

[jira] [Updated] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16613: -- Attachment: HIVE-16613.1.patch > SaslClientHandler.sendHello is eating exceptions >

[jira] [Updated] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16613: -- Description: If we hit exceptions when sending hello to server, the method fails silently. Finally the remote

[jira] [Assigned] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16613: - > SaslClientHandler.sendHello is eating exceptions > > >

[jira] [Updated] (HIVE-16613) SaslClientHandler.sendHello is eating exceptions

[ https://issues.apache.org/jira/browse/HIVE-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16613: -- Component/s: Spark > SaslClientHandler.sendHello is eating exceptions >

[jira] [Updated] (HIVE-16593) SparkClientFactory.stop may prevent JVM from exiting

[ https://issues.apache.org/jira/browse/HIVE-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16593: -- Status: Patch Available (was: Open) > SparkClientFactory.stop may prevent JVM from exiting >

[jira] [Updated] (HIVE-16593) SparkClientFactory.stop may prevent JVM from exiting

[ https://issues.apache.org/jira/browse/HIVE-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16593: -- Attachment: HIVE-16593.1.patch I think stop and createClient shouldn't share the same lock. In

[jira] [Commented] (HIVE-16600) Refactor SetSparkReducerParallelism#needSetParallelism to enable parallel order by in multi_insert cases

[ https://issues.apache.org/jira/browse/HIVE-16600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001991#comment-16001991 ] Rui Li commented on HIVE-16600: --- Thanks [~kellyzly] for working on this. I don't think test failures are

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001925#comment-16001925 ] Rui Li commented on HIVE-14412: --- The latest failure are not related. [~cartershanklin], the Postgres

[jira] [Updated] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-14412: -- Attachment: HIVE-14412.12.patch Thanks [~xuefuz] and [~cartershanklin] for the review and testing. Update patch

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998437#comment-15998437 ] Rui Li commented on HIVE-15104: --- Tried disabling relocation locally. It does solve the AbstractMethodError.

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998177#comment-15998177 ] Rui Li commented on HIVE-15104: --- I looked at the shuffle writers of Spark and none of them seem to need the

[jira] [Updated] (HIVE-16593) SparkClientFactory.stop may prevent JVM from exiting

[ https://issues.apache.org/jira/browse/HIVE-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-16593: -- Description: When we receive SIGINT more than once, we call System.exit to terminate the JVM. System.exit runs

[jira] [Assigned] (HIVE-16593) SparkClientFactory.stop may prevent JVM from exiting

[ https://issues.apache.org/jira/browse/HIVE-16593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16593: - > SparkClientFactory.stop may prevent JVM from exiting >

[jira] [Commented] (HIVE-16456) Kill spark job when InterruptedException happens or driverContext.isShutdown is true.

[ https://issues.apache.org/jira/browse/HIVE-16456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998027#comment-15998027 ] Rui Li commented on HIVE-16456: --- +1 pending test > Kill spark job when InterruptedException happens or

[jira] [Commented] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996190#comment-15996190 ] Rui Li commented on HIVE-16552: --- +1 > Limit the number of tasks a Spark job may contain >

[jira] [Commented] (HIVE-16047) Shouldn't try to get KeyProvider unless encryption is enabled

[ https://issues.apache.org/jira/browse/HIVE-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996040#comment-15996040 ] Rui Li commented on HIVE-16047: --- [~spena] thanks for letting me know. Since we're rolling RCs for Hive-2.3,

[jira] [Commented] (HIVE-16552) Limit the number of tasks a Spark job may contain

[ https://issues.apache.org/jira/browse/HIVE-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996025#comment-15996025 ] Rui Li commented on HIVE-16552: --- [~xuefuz] thanks for the update. I think you can exclude the new test for

[jira] [Commented] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994683#comment-15994683 ] Rui Li commented on HIVE-16573: --- [~anishek], in that case, how about having separate methods checking for

[jira] [Commented] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994484#comment-15994484 ] Rui Li commented on HIVE-16573: --- [~anishek], thanks for the explanations. However, I 'm not sure why we have

[jira] [Commented] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994393#comment-15994393 ] Rui Li commented on HIVE-16573: --- In {{InPlaceUpdate.canRenderInPlace}}, we don't check the config for spark.

[jira] [Assigned] (HIVE-16573) In-place update for HoS can't be disabled

[ https://issues.apache.org/jira/browse/HIVE-16573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-16573: - > In-place update for HoS can't be disabled > - > >

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994346#comment-15994346 ] Rui Li commented on HIVE-14412: --- Latest failure are not related. I've updated the v11 patch on RB.

[jira] [Commented] (HIVE-16047) Shouldn't try to get KeyProvider unless encryption is enabled

[ https://issues.apache.org/jira/browse/HIVE-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994247#comment-15994247 ] Rui Li commented on HIVE-16047: --- Patch reverted in master and branch-2.3. > Shouldn't try to get

[jira] [Commented] (HIVE-16047) Shouldn't try to get KeyProvider unless encryption is enabled

[ https://issues.apache.org/jira/browse/HIVE-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994215#comment-15994215 ] Rui Li commented on HIVE-16047: --- Hi [~spena], I'm not aware the patch is not in branch-2.2. I'll revert the

<    1   2   3   4   5   6   7   8   9   10   >