[jira] [Commented] (HIVE-9370) Enable Hive on Spark for BigBench and run Query 8, the test failed [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279832#comment-14279832 ] Xuefu Zhang commented on HIVE-9370: --- [~sandyr] Could you take a look at about issue

[jira] [Commented] (HIVE-9370) Enable Hive on Spark for BigBench and run Query 8, the test failed [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279856#comment-14279856 ] Xuefu Zhang commented on HIVE-9370: --- Yeah. This seems interfering with Hive's way

[jira] [Comment Edited] (HIVE-9370) Enable Hive on Spark for BigBench and run Query 8, the test failed [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279856#comment-14279856 ] Xuefu Zhang edited comment on HIVE-9370 at 1/16/15 6:15 AM

[jira] [Commented] (HIVE-9378) Spark qfile tests should reuse RSC

[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277628#comment-14277628 ] Xuefu Zhang commented on HIVE-9378: --- [~jxiang], qfile test is supposed to run

[jira] [Commented] (HIVE-9367) CombineFileInputFormatShim#getDirIndices is expensive

[ https://issues.apache.org/jira/browse/HIVE-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277642#comment-14277642 ] Xuefu Zhang commented on HIVE-9367: --- Thanks for the explanation. This is a shim class, so

[jira] [Commented] (HIVE-9379) Fix tests with some versions of Spark + Snappy [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277875#comment-14277875 ] Xuefu Zhang commented on HIVE-9379: --- +1. Looks good to me, and good for mac users. Fix

[jira] [Commented] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode

[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277900#comment-14277900 ] Xuefu Zhang commented on HIVE-9342: --- +1 add num-executors / executor-cores / executor

[jira] [Updated] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9342: -- Summary: add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn

[jira] [Commented] (HIVE-9372) Parallel checking non-combinable paths in CombineHiveInputFormat

[ https://issues.apache.org/jira/browse/HIVE-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278053#comment-14278053 ] Xuefu Zhang commented on HIVE-9372: --- Your patch is for trunk, which has a longer test

[jira] [Updated] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9342: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-7292 add num-executors / executor-cores

[jira] [Commented] (HIVE-9367) CombineFileInputFormatShim#getDirIndices is expensive

[ https://issues.apache.org/jira/browse/HIVE-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277931#comment-14277931 ] Xuefu Zhang commented on HIVE-9367: --- +1 pending on test CombineFileInputFormatShim

[jira] [Commented] (HIVE-9372) Parallel checking non-combinable paths in CombineHiveInputFormat

[ https://issues.apache.org/jira/browse/HIVE-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277982#comment-14277982 ] Xuefu Zhang commented on HIVE-9372: --- Patch looks good to me. One minor comment, can we

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278179#comment-14278179 ] Xuefu Zhang commented on HIVE-9178: --- +1 Create a separate API for remote Spark Context

[jira] [Commented] (HIVE-9367) CombineFileInputFormatShim#getDirIndices is expensive

[ https://issues.apache.org/jira/browse/HIVE-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277070#comment-14277070 ] Xuefu Zhang commented on HIVE-9367: --- Nice improvement. However, I'm a little concerned

[jira] [Comment Edited] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14276485#comment-14276485 ] Xuefu Zhang edited comment on HIVE-9178 at 1/14/15 5:10 AM

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14276485#comment-14276485 ] Xuefu Zhang commented on HIVE-9178: --- The dummy patch produces 3 failures and the run

[jira] [Updated] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9178: -- Attachment: HIVE-9178.1-spark.patch Reattach the same patch to have another test run. Create

[jira] [Updated] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9178: -- Attachment: HIVE-9178.2-spark.patch Attached a dummy patch to test the test env. Create a separate API

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14276223#comment-14276223 ] Xuefu Zhang commented on HIVE-9178: --- It looks like that the patch somehow has increased

[jira] [Commented] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode

[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274074#comment-14274074 ] Xuefu Zhang commented on HIVE-9342: --- [~fangxi.yin], thanks for working

[jira] [Updated] (HIVE-9340) Address review of HIVE-9257 (ii) [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9340: -- Summary: Address review of HIVE-9257 (ii) [Spark Branch] (was: Address review of HIVE-9257 (ii

[jira] [Commented] (HIVE-9340) Address review of HIVE-9257 (ii)

[ https://issues.apache.org/jira/browse/HIVE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274303#comment-14274303 ] Xuefu Zhang commented on HIVE-9340: --- +1 pending on test Address review of HIVE-9257 (ii

Re: new hive udfs

Hi Alex, This should be a good starting point: https://cwiki.apache.org/confluence/display/Hive/HowToContribute. Thanks, Xuefu On Mon, Jan 12, 2015 at 2:37 PM, Alexander Pivovarov apivova...@gmail.com wrote: Hi Everyone I have several custom udfs I want to contribute to hive month_add

Re: new hive udfs

, 2015 at 2:48 PM, Xuefu Zhang xzh...@cloudera.com wrote: Hi Alex, This should be a good starting point: https://cwiki.apache.org/confluence/display/Hive/HowToContribute. Thanks, Xuefu On Mon, Jan 12, 2015 at 2:37 PM, Alexander Pivovarov apivova...@gmail.com wrote: Hi

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274678#comment-14274678 ] Xuefu Zhang commented on HIVE-9178: --- The patch looks good to me. [~chengxiang li], could

[jira] [Updated] (HIVE-9258) Explain query should share the same Spark application with regular queries [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9258: -- Description: Currently for Hive on Spark, query plan includes the number of reducers, which

[jira] [Updated] (HIVE-9258) Explain query should share the same Spark application with regular queries [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9258: -- Summary: Explain query should share the same Spark application with regular queries [Spark Branch

[jira] [Commented] (HIVE-9258) Explain query shouldn't launch a Spark application [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274528#comment-14274528 ] Xuefu Zhang commented on HIVE-9258: --- [~jxiang], thanks for looking into this. Looking

[jira] [Commented] (HIVE-9258) Explain query should share the same Spark application with regular queries [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274632#comment-14274632 ] Xuefu Zhang commented on HIVE-9258: --- Makes sense. Thanks for the explanation. Explain

[jira] [Commented] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274537#comment-14274537 ] Xuefu Zhang commented on HIVE-9135: --- +1 Cache Map and Reduce works in RSC [Spark Branch

[jira] [Updated] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9135: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Commented] (HIVE-9257) Merge from spark to trunk January 2015

[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273177#comment-14273177 ] Xuefu Zhang commented on HIVE-9257: --- Actually my comments on RB were not covered by HIVE

[jira] [Commented] (HIVE-9339) Optimize split grouping for CombineHiveInputFormat [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273185#comment-14273185 ] Xuefu Zhang commented on HIVE-9339: --- cc: [~lirui] Optimize split grouping

[jira] [Created] (HIVE-9339) Optimize split grouping for CombineHiveInputFormat [Spark Branch]

Xuefu Zhang created HIVE-9339: - Summary: Optimize split grouping for CombineHiveInputFormat [Spark Branch] Key: HIVE-9339 URL: https://issues.apache.org/jira/browse/HIVE-9339 Project: Hive

[jira] [Commented] (HIVE-9335) Address review items on HIVE-9257 [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273104#comment-14273104 ] Xuefu Zhang commented on HIVE-9335: --- +1 Address review items on HIVE-9257 [Spark Branch

[jira] [Updated] (HIVE-9119) ZooKeeperHiveLockManager does not use zookeeper in the proper way

[ https://issues.apache.org/jira/browse/HIVE-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9119: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9119) ZooKeeperHiveLockManager does not use zookeeper in the proper way

[ https://issues.apache.org/jira/browse/HIVE-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9119: -- Labels: TODOC15 (was: ) ZooKeeperHiveLockManager does not use zookeeper in the proper way

[jira] [Updated] (HIVE-9112) Query may generate different results depending on the number of reducers

[ https://issues.apache.org/jira/browse/HIVE-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9112: -- Status: Patch Available (was: Open) Query may generate different results depending on the number

Re: Review Request 29787: HIVE-9257 : Merge spark to trunk January 2015 (Modified files)

A followup to get rid of this? ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java https://reviews.apache.org/r/29787/#comment111662 We should restrain from using * in imports. - Xuefu Zhang On Jan. 9, 2015, 11:55 p.m., Szehon Ho wrote

[jira] [Updated] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9104: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9257) Merge from spark to trunk January 2015

[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272801#comment-14272801 ] Xuefu Zhang commented on HIVE-9257: --- I reviewed most of patches in Spark branch during

[jira] [Commented] (HIVE-9335) Address review items on HIVE-9257 [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272780#comment-14272780 ] Xuefu Zhang commented on HIVE-9335: --- Patch looks good, except it seems containing code

[jira] [Updated] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9104: -- Component/s: (was: Spark) windowing.q failed when mapred.reduce.tasks is set to larger than one

Re: Review Request 29494: HIVE-9119: ZooKeeperHiveLockManager does not use zookeeper in the proper way

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29494/#review67606 --- Ship it! Ship It! - Xuefu Zhang On Jan. 5, 2015, 6:43 p.m., Na

[jira] [Commented] (HIVE-9119) ZooKeeperHiveLockManager does not use zookeeper in the proper way

[ https://issues.apache.org/jira/browse/HIVE-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272806#comment-14272806 ] Xuefu Zhang commented on HIVE-9119: --- +1 patch looks good to me. Thanks for fixing

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272187#comment-14272187 ] Xuefu Zhang commented on HIVE-9104: --- +1. Code looks reasonable to me. However, it's great

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272299#comment-14272299 ] Xuefu Zhang commented on HIVE-9104: --- [~csun] Could you add a test case in which perhaps

[jira] [Updated] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9251: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9290) Make some test results deterministic

[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14271116#comment-14271116 ] Xuefu Zhang commented on HIVE-9290: --- I was aware of this but knew Rui was immediately

[jira] [Comment Edited] (HIVE-9290) Make some test results deterministic

[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14271116#comment-14271116 ] Xuefu Zhang edited comment on HIVE-9290 at 1/9/15 3:42 PM: --- I

[jira] [Updated] (HIVE-9326) BaseProtocol.Error failed to deserialization due to NPE.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9326: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9326) BaseProtocol.Error failed to deserialization due to NPE.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14271772#comment-14271772 ] Xuefu Zhang commented on HIVE-9326: --- +1 BaseProtocol.Error failed to deserialization

[jira] [Commented] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270202#comment-14270202 ] Xuefu Zhang commented on HIVE-9306: --- Test failure above

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9290) Make some test results deterministic

[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9290: -- Resolution: Fixed Fix Version/s: 0.15.0 spark-branch Status

Re: Review Request 29733: HIVE-9319 : Cleanup Modified Files [Spark Branch]

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29733/#review67348 --- Ship it! Ship It! - Xuefu Zhang On Jan. 9, 2015, 12:01 a.m

[jira] [Commented] (HIVE-9319) Cleanup Modified Files [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270303#comment-14270303 ] Xuefu Zhang commented on HIVE-9319: --- +1 pending on test Cleanup Modified Files [Spark

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9293) Cleanup SparkTask getMapWork to skip UnionWork check [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9293: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269409#comment-14269409 ] Xuefu Zhang commented on HIVE-9306: --- fs_default_name2.q output needs to be updated, which

[jira] [Updated] (HIVE-9301) Potential null dereference in MoveTask#createTargetPath()

[ https://issues.apache.org/jira/browse/HIVE-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9301: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9293) Cleanup SparkTask getMapWork to skip UnionWork check [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269352#comment-14269352 ] Xuefu Zhang commented on HIVE-9293: --- +1 Cleanup SparkTask getMapWork to skip UnionWork

[jira] [Commented] (HIVE-9290) Make some test results deterministic

[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269371#comment-14269371 ] Xuefu Zhang commented on HIVE-9290: --- +1 Make some test results deterministic

[jira] [Comment Edited] (HIVE-9290) Make some test results deterministic

[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269371#comment-14269371 ] Xuefu Zhang edited comment on HIVE-9290 at 1/8/15 2:37 PM: --- +1

[jira] [Assigned] (HIVE-9112) Query may generate different results depending on the number of reducers

[ https://issues.apache.org/jira/browse/HIVE-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-9112: - Assignee: Ted Xu (was: Chao) Hi [~tedxu], I'm assigning this to you for investigation/fix

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.2-spark.patch Let Context.isLocalOnlyExecutionMode() return false if execution

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.3-spark.patch Let Context.isLocalOnlyExecutionMode() return false if execution

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: (was: HIVE-9306.3-spark.patch) Let Context.isLocalOnlyExecutionMode() return false

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.3-spark.patch Let Context.isLocalOnlyExecutionMode() return false if execution

[jira] [Resolved] (HIVE-9219) Investigate differences for auto join tests in explain after merge from trunk [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9219. --- Resolution: Not a Problem Investigate differences for auto join tests in explain after merge from

[jira] [Created] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

Xuefu Zhang created HIVE-9306: - Summary: Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch] Key: HIVE-9306 URL: https://issues.apache.org/jira/browse/HIVE-9306

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Status: Patch Available (was: Open) Let Context.isLocalOnlyExecutionMode() return false if execution

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268841#comment-14268841 ] Xuefu Zhang commented on HIVE-9251: --- It should be okay. Limit is still pushed down

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.1-spark.patch Let Context.isLocalOnlyExecutionMode() return false if execution

[jira] [Commented] (HIVE-9290) Make some test results deterministic

[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268835#comment-14268835 ] Xuefu Zhang commented on HIVE-9290: --- It should be okay. Even though an extra stage

[jira] [Commented] (HIVE-9281) Code cleanup [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268466#comment-14268466 ] Xuefu Zhang commented on HIVE-9281: --- Could you load both versions to RB so that I can

[jira] [Updated] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9104: -- Affects Version/s: (was: spark-branch) windowing.q failed when mapred.reduce.tasks is set to larger

[jira] [Commented] (HIVE-9281) Code cleanup [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268443#comment-14268443 ] Xuefu Zhang commented on HIVE-9281: --- My eyes got sored after going thru the patch, but +1

[jira] [Commented] (HIVE-9281) Code cleanup [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268523#comment-14268523 ] Xuefu Zhang commented on HIVE-9281: --- +1 Code cleanup [Spark Branch

[jira] [Commented] (HIVE-9301) Potential null dereference in MoveTask#createTargetPath()

[ https://issues.apache.org/jira/browse/HIVE-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268564#comment-14268564 ] Xuefu Zhang commented on HIVE-9301: --- +1 Potential null dereference in MoveTask

[jira] [Commented] (HIVE-9289) TODO : Store user name in session [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268105#comment-14268105 ] Xuefu Zhang commented on HIVE-9289: --- Maybe I don't fully understand the code

Re: Review Request 29655: HIVE-9288 TODO cleanup task1[Spark Branch]

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29655/#review67024 --- Ship it! Ship It! - Xuefu Zhang On Jan. 7, 2015, 9:03 a.m

[jira] [Commented] (HIVE-9288) TODO cleanup task1.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267729#comment-14267729 ] Xuefu Zhang commented on HIVE-9288: --- +1 TODO cleanup task1.[Spark Branch

[jira] [Updated] (HIVE-9110) Performance of SELECT COUNT(*) FROM store_sales WHERE ss_item_sk IS NOT NULL [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9110: -- Assignee: Rui Li (was: Chao) Performance of SELECT COUNT(*) FROM store_sales WHERE ss_item_sk

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268017#comment-14268017 ] Xuefu Zhang commented on HIVE-9251: --- Besides HIVE-9290, it seems that golden files

[jira] [Updated] (HIVE-9288) TODO cleanup task1.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9288: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9288) TODO cleanup task1.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9288: -- Status: Patch Available (was: Open) TODO cleanup task1.[Spark Branch

[jira] [Commented] (HIVE-6173) Beeline doesn't accept --hiveconf option as Hive CLI does

[ https://issues.apache.org/jira/browse/HIVE-6173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14266711#comment-14266711 ] Xuefu Zhang commented on HIVE-6173: --- Aha. I see. These undocumented properties

[jira] [Created] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

Xuefu Zhang created HIVE-9267: - Summary: Ensure custom UDF works with Spark [Spark Branch] Key: HIVE-9267 URL: https://issues.apache.org/jira/browse/HIVE-9267 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Status: Patch Available (was: Open) Ensure custom UDF works with Spark [Spark Branch

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Attachment: HIVE-9267.1-spark.patch Ensure custom UDF works with Spark [Spark Branch

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267223#comment-14267223 ] Xuefu Zhang commented on HIVE-9251: --- Hi Rui, for our unit test, the input size

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267243#comment-14267243 ] Xuefu Zhang commented on HIVE-9251: --- The patch looks good. One question though: (-1, -1

[jira] [Updated] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9154: -- Resolution: Fixed Fix Version/s: (was: spark-branch) Status: Resolved (was: Patch

[jira] [Commented] (HIVE-9219) Investigate differences for auto join tests in explain after merge from trunk [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267299#comment-14267299 ] Xuefu Zhang commented on HIVE-9219: --- [~csun], anything to be done here? If not, we just

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267293#comment-14267293 ] Xuefu Zhang commented on HIVE-9251: --- I see it in the code now. Patch looks good. I just

[jira] [Updated] (HIVE-9243) Static Map in IOContext is not thread safe

[ https://issues.apache.org/jira/browse/HIVE-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9243: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-8578) Investigate test failures related to HIVE-8545 [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265287#comment-14265287 ] Xuefu Zhang commented on HIVE-8578: --- Hi [~jxiang], what's the latest status of this issue

[jira] [Resolved] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9135. --- Resolution: Won't Fix I'm closing this because of limited benefit. We have cached input path info via

[jira] [Commented] (HIVE-6173) Beeline doesn't accept --hiveconf option as Hive CLI does

[ https://issues.apache.org/jira/browse/HIVE-6173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265377#comment-14265377 ] Xuefu Zhang commented on HIVE-6173: --- Re #2: autocommit is still not applicable, even

<    2   3   4   5   6   7   8   9   10   11   >