[jira] [Updated] (HIVE-15093) For S3-to-S3 renames, files should be moved individually rather than at a directory level

2016-11-01 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15093: Attachment: HIVE-15093.6.patch > For S3-to-S3 renames, files should be moved individually rather

[jira] [Commented] (HIVE-14815) Implement Parquet vectorization reader

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627818#comment-15627818 ] Hive QA commented on HIVE-14815: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-01 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627812#comment-15627812 ] wangwenli commented on HIVE-15104: -- try select count(distinct col1), count (distinct col2) from table,

[jira] [Updated] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-01 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwenli updated HIVE-15104: - Priority: Major (was: Critical) > Hive on Spark generate more shuffle data than hive on mr >

[jira] [Commented] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627670#comment-15627670 ] Hive QA commented on HIVE-14990: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15054) Hive insertion query execution fails on Hive on Spark

2016-11-01 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627560#comment-15627560 ] Rui Li commented on HIVE-15054: --- Thanks for updating [~aihuaxu]. +1 > Hive insertion query execution fails

[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-11-01 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15039: -- Attachment: HIVE-15039.2.patch Thanks [~Ferd] and [~sseth]. Upload the same patch to try again. > A better job

[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-11-01 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15039: -- Attachment: (was: HIVE-15039.2.patch) > A better job monitor console output for HoS >

[jira] [Commented] (HIVE-15093) For S3-to-S3 renames, files should be moved individually rather than at a directory level

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627548#comment-15627548 ] Hive QA commented on HIVE-15093: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627522#comment-15627522 ] Lefty Leverenz commented on HIVE-15068: --- Doc note: This adds

[jira] [Updated] (HIVE-15109) Set MaxPermSize to 256M for maven tests

2016-11-01 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-15109: --- Status: Patch Available (was: Open) > Set MaxPermSize to 256M for maven tests >

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-15068: -- Labels: TODOC1.3 TODOC2.2 (was: ) > Run ClearDanglingScratchDir periodically inside HS2 >

[jira] [Updated] (HIVE-15109) Set MaxPermSize to 256M for maven tests

2016-11-01 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-15109: --- Attachment: HIVE-15109.patch > Set MaxPermSize to 256M for maven tests >

[jira] [Commented] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627447#comment-15627447 ] Hive QA commented on HIVE-14990: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-14990: Description: Expected failures (lack of support in MM tables for certain commands) 1) All

[jira] [Commented] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627391#comment-15627391 ] Sergey Shelukhin commented on HIVE-14990: - There's bug affecting all the bucketing tests when

[jira] [Updated] (HIVE-15108) allow Hive script to skip hadoop version check and HBase classpath

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15108: Description: Both will be performed by default, as before > allow Hive script to skip

[jira] [Updated] (HIVE-15108) allow Hive script to skip hadoop version check and HBase classpath

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15108: Attachment: HIVE-15108.patch This also changes the hive script to not rely on certain

[jira] [Updated] (HIVE-15108) allow Hive script to skip hadoop version check and HBase classpath

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15108: Status: Patch Available (was: Open) > allow Hive script to skip hadoop version check and

[jira] [Commented] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627305#comment-15627305 ] Hive QA commented on HIVE-14990: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 1.3.0

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: (was: HIVE-15068.4.patch) > Run ClearDanglingScratchDir periodically inside HS2 >

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: HIVE-15068.4.branch-1.patch > Run ClearDanglingScratchDir periodically inside HS2 >

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: HIVE-15068.4.patch The same patch for branch-1. > Run ClearDanglingScratchDir periodically

[jira] [Commented] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627195#comment-15627195 ] Hive QA commented on HIVE-15069: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-13974) ORC Schema Evolution doesn't support add columns to non-last STRUCT columns

2016-11-01 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627154#comment-15627154 ] Anthony Hsu commented on HIVE-13974: Has ORC-54 been ported to Hive / is there a ticket for updating

[jira] [Commented] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627145#comment-15627145 ] Daniel Dai commented on HIVE-15069: --- Oh, I was looking at HIVE-15069.2.patch. HIVE-15069.3.patch is much

[jira] [Updated] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-14990: Attachment: HIVE-14990.05.patch A test-patch-specific issue. > run all tests for MM tables

[jira] [Updated] (HIVE-15093) For S3-to-S3 renames, files should be moved individually rather than at a directory level

2016-11-01 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15093: Attachment: HIVE-15093.5.patch Addressed a few comments from [~spena]. > For S3-to-S3 renames,

[jira] [Commented] (HIVE-15107) HiveLexer can throw NPE in allowQuoteId

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627061#comment-15627061 ] Hive QA commented on HIVE-15107: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627055#comment-15627055 ] Hive QA commented on HIVE-15068: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-14990: Attachment: (was: HIVE-14990.05.patch) > run all tests for MM tables and fix the issues

[jira] [Updated] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-14990: Attachment: HIVE-14990.05.patch > run all tests for MM tables and fix the issues that are

[jira] [Commented] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-11-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626943#comment-15626943 ] Rajesh Balamohan commented on HIVE-15069: - Thanks [~sershe]. I have enqueued a jenkin test for the

[jira] [Commented] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626927#comment-15626927 ] Hive QA commented on HIVE-15068: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-14990: Attachment: HIVE-14990.05.patch Updated the patch with recent fixes. Not everything has

[jira] [Updated] (HIVE-15107) HiveLexer can throw NPE in allowQuoteId

2016-11-01 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-15107: --- Status: Patch Available (was: Open) > HiveLexer can throw NPE in allowQuoteId >

[jira] [Commented] (HIVE-15035) Clean up Hive licenses for binary distribution

2016-11-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626844#comment-15626844 ] Owen O'Malley commented on HIVE-15035: -- Comments: * We should remove the Jersey, Microsoft, and Dell

[jira] [Updated] (HIVE-15107) HiveLexer can throw NPE in allowQuoteId

2016-11-01 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-15107: --- Attachment: HIVE-15107.patch > HiveLexer can throw NPE in allowQuoteId >

[jira] [Commented] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626828#comment-15626828 ] Thejas M Nair commented on HIVE-15068: -- +1 to the update, pending tests. > Run

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: HIVE-15068.4.patch Another change suggested by Thejas to add a random initial wait. > Run

[jira] [Assigned] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu reassigned HIVE-14162: --- Assignee: Aihua Xu > Allow disabling of long running job on Hive On Spark On YARN >

[jira] [Commented] (HIVE-14162) Allow disabling of long running job on Hive On Spark On YARN

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626698#comment-15626698 ] Aihua Xu commented on HIVE-14162: - I will take a look. > Allow disabling of long running job on Hive On

[jira] [Commented] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626537#comment-15626537 ] Thejas M Nair commented on HIVE-15068: -- Thanks for the updates. +1 pending tests. > Run

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: HIVE-15068.3.patch > Run ClearDanglingScratchDir periodically inside HS2 >

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: (was: HIVE-15068.3.patch) > Run ClearDanglingScratchDir periodically inside HS2 >

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: HIVE-15068.3.patch I misunderstood the review comments in the test. Attach another patch.

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: (was: HIVE-15068.2.patch) > Run ClearDanglingScratchDir periodically inside HS2 >

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: HIVE-15068.2.patch > Run ClearDanglingScratchDir periodically inside HS2 >

[jira] [Resolved] (HIVE-14271) FileSinkOperator should not rename files to final paths when S3 is the default destination

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña resolved HIVE-14271. Resolution: Won't Fix A different approach will be used to improve S3 write performance. This jira

[jira] [Resolved] (HIVE-14272) ConditionalResolverMergeFiles should keep staging data on HDFS, then copy (no rename) to S3

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-14272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña resolved HIVE-14272. Resolution: Won't Fix A different approach will be used to improve S3 write performance. This jira

[jira] [Updated] (HIVE-15068) Run ClearDanglingScratchDir periodically inside HS2

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15068: -- Attachment: HIVE-15068.2.patch Address [~thejas]'s review comments. > Run ClearDanglingScratchDir

[jira] [Commented] (HIVE-15069) Optimize MetaStoreDirectSql:: aggrColStatsForPartitions during query compilation

2016-11-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626367#comment-15626367 ] Daniel Dai commented on HIVE-15069: --- partsFoundForPartitions can be removed. Just curious is the most

[jira] [Updated] (HIVE-15105) Hive shell runs out of memory on Tez

2016-11-01 Thread Premal Shah (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Premal Shah updated HIVE-15105: --- Description: Hive 2.0.1 Hadoop 2.7.2 Tex 0.8.4 We have a UDF in hive which take in some values and

[jira] [Updated] (HIVE-15105) Hive shell runs out of memory on Tez

2016-11-01 Thread Premal Shah (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Premal Shah updated HIVE-15105: --- Description: Hive 2.0.1 Hadoop 2.7.2 Tex 0.8.4 We have a UDF in hive which take in some values and

[jira] [Updated] (HIVE-15105) Hive shell runs out of memory on Tez

2016-11-01 Thread Premal Shah (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Premal Shah updated HIVE-15105: --- Description: Hive 2.0.1 Hadoop 2.7.2 Tex 0.8.4 We have a UDF in hive which take in some values and

[jira] [Updated] (HIVE-15105) Hive shell runs out of memory on Tez

2016-11-01 Thread Premal Shah (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Premal Shah updated HIVE-15105: --- Description: Hive 2.0.1 Hadoop 2.7.2 Tex 0.8.4 We have a UDF in hive which take in some values and

[jira] [Updated] (HIVE-15003) Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..' statement to support more data types

2016-11-01 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15003: --- Status: Patch Available (was: Open) > Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..'

[jira] [Commented] (HIVE-14863) Decimal to int conversion produces incorrect values

2016-11-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626191#comment-15626191 ] Sergey Shelukhin commented on HIVE-14863: - [~mmccline] ping? [~jdere] said he feels it's blocked

[jira] [Updated] (HIVE-15003) Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..' statement to support more data types

2016-11-01 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15003: --- Attachment: HIVE-15003.patch > Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..' statement to

[jira] [Updated] (HIVE-15003) Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..' statement to support more data types

2016-11-01 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15003: --- Attachment: (was: HIVE-15003.1.patch) > Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..'

[jira] [Updated] (HIVE-15003) Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..' statement to support more data types

2016-11-01 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15003: --- Status: Open (was: Patch Available) > Update 'ALTER TABLE...UPDATE STATISTICS FOR COLUMN..'

[jira] [Commented] (HIVE-15041) Specify GCE network name on Hive ptest

2016-11-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626098#comment-15626098 ] Siddharth Seth commented on HIVE-15041: --- Thoughts on temporarily re-creating the ContextProvider to

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626085#comment-15626085 ] Aihua Xu commented on HIVE-15104: - [~wenli] Can you give an example that I can run and compare? > Hive

[jira] [Updated] (HIVE-15094) Fix test failures for 2.1.1 regarding schema evolution with DECIMAL types

2016-11-01 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-15094: --- Attachment: HIVE-15094-branch-2.1.patch > Fix test failures for 2.1.1

[jira] [Commented] (HIVE-13947) HoS print wrong number for hash table size in map join scenario

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626076#comment-15626076 ] Aihua Xu commented on HIVE-13947: - Sure I will take a look at HIVE-15104 as well. > HoS print wrong

[jira] [Commented] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626080#comment-15626080 ] Siddharth Seth commented on HIVE-15102: --- Looks like performBackgroundWork is meant to clean up nodes

[jira] [Assigned] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu reassigned HIVE-15104: --- Assignee: Aihua Xu > Hive on Spark generate more shuffle data than hive on mr >

[jira] [Commented] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626046#comment-15626046 ] Szehon Ho commented on HIVE-15102: -- +1 I think Brock wrote this original code so he might know more, but

[jira] [Commented] (HIVE-15056) Support index shifting for struct fields

2016-11-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625955#comment-15625955 ] ASF GitHub Bot commented on HIVE-15056: --- Github user sunchao closed the pull request at:

[jira] [Commented] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625874#comment-15625874 ] Sergio Peña commented on HIVE-15102: [~brocknoland] [~szehon] Could you take a look at this patch? We

[jira] [Commented] (HIVE-15041) Specify GCE network name on Hive ptest

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625842#comment-15625842 ] Sergio Peña commented on HIVE-15041: When testing GCE with jclouds, I found out that

[jira] [Commented] (HIVE-13947) HoS print wrong number for hash table size in map join scenario

2016-11-01 Thread wangwenli (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625833#comment-15625833 ] wangwenli commented on HIVE-13947: -- thanks for you interest on this hos issue. long time no person

[jira] [Commented] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625821#comment-15625821 ] Sergio Peña commented on HIVE-15102: It could be. This is one of 2 issues found. The other is due to a

[jira] [Commented] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625799#comment-15625799 ] Ferdinand Xu commented on HIVE-15102: - Hi [~spena], thank you for working on this. Is this the root

[jira] [Updated] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-15102: --- Status: Patch Available (was: In Progress) [~sseth] Could you do a quick review? The patch

[jira] [Updated] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-15102: --- Attachment: HIVE-15102.1.patch > Hiveptest is killing nodes where IP is reused after previous node

[jira] [Updated] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-15102: --- Description: NO PRECOMMIT TESTS The Hiveptest framework has a background thread that runs every

[jira] [Work started] (HIVE-15102) Hiveptest is killing nodes where IP is reused after previous node termination

2016-11-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-15102 started by Sergio Peña. -- > Hiveptest is killing nodes where IP is reused after previous node termination >

[jira] [Moved] (HIVE-15103) Error when inserting into hive table with HBase storage handler

2016-11-01 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah moved TEZ-3506 to HIVE-15103: - Affects Version/s: (was: 0.7.0) Key: HIVE-15103 (was:

[jira] [Commented] (HIVE-15056) Support index shifting for struct fields

2016-11-01 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625704#comment-15625704 ] Chao Sun commented on HIVE-15056: - Sorry it was my mistake. Thanks [~leftylev] for noticing it and [~Ferd]

[jira] [Commented] (HIVE-13573) [Spark Branch] ClassNotFoundException occurs during query case with group by and UDF defined

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625658#comment-15625658 ] Aihua Xu commented on HIVE-13573: - Do we still have an issue with that? Seems it should have been fixed by

[jira] [Commented] (HIVE-13830) Hive on spark driver crash with Spark 1.6.1

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625642#comment-15625642 ] Aihua Xu commented on HIVE-13830: - Did you get HoS to work? {{java.lang.NoSuchFieldError:

[jira] [Updated] (HIVE-13947) HoS print wrong number for hash table size in map join scenario

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-13947: Status: Patch Available (was: Open) patch-1: simple fix to close the file stream before getting file

[jira] [Updated] (HIVE-13947) HoS print wrong number for hash table size in map join scenario

2016-11-01 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-13947: Attachment: HIVE-13947.1.patch > HoS print wrong number for hash table size in map join scenario >

[jira] [Updated] (HIVE-15096) hplsql registerUDF conflicts with pom.xml

2016-11-01 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HIVE-15096: --- Fix Version/s: (was: 2.2.0) > hplsql registerUDF conflicts with pom.xml >

[jira] [Updated] (HIVE-15056) Support index shifting for struct fields

2016-11-01 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-15056: Fix Version/s: (was: 2.1.1) 2.2.0 > Support index shifting for struct fields

[jira] [Commented] (HIVE-15056) Support index shifting for struct fields

2016-11-01 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625537#comment-15625537 ] Ferdinand Xu commented on HIVE-15056: - The fix version is not correct. It should be committed to

[jira] [Commented] (HIVE-15101) Spark client can be stuck in RUNNING state

2016-11-01 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625526#comment-15625526 ] Ferdinand Xu commented on HIVE-15101: - What's Spark version and Hive version you're using? Can you

[jira] [Updated] (HIVE-15101) Spark client can be stuck in RUNNING state

2016-11-01 Thread Satoshi Iijima (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satoshi Iijima updated HIVE-15101: -- Description: When a Hive-on-Spark job is executed on YARN environment where UNHEALTHY

[jira] [Assigned] (HIVE-1555) JDBC Storage Handler

2016-11-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-1555: - Assignee: Dmitry Zagorulkin (was: Teddy Choi) Assign to Dmitry who has shown interest in working

[jira] [Updated] (HIVE-15097) Error: java.lang.RuntimeException: Error in configuring object Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded

2016-11-01 Thread chen cong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen cong updated HIVE-15097: - Description: hive> CREATE TABLE user_tag_pre AS > SELECT A.userid , A.tag ,

[jira] [Commented] (HIVE-15096) hplsql registerUDF conflicts with pom.xml

2016-11-01 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624802#comment-15624802 ] Dmitry Tolpeko commented on HIVE-15096: --- +1 looks good, thanks. > hplsql registerUDF conflicts with

[jira] [Issue Comment Deleted] (HIVE-12157) Support unicode for table/column names

2016-11-01 Thread hefuhua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hefuhua updated HIVE-12157: --- Comment: was deleted (was: Hi,this feature is very important for me ,and will this be solved in future?) >

[jira] [Commented] (HIVE-12157) Support unicode for table/column names

2016-11-01 Thread hefuhua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624777#comment-15624777 ] hefuhua commented on HIVE-12157: Hi,this feature is very important for me ,and will this be solved in

[jira] [Commented] (HIVE-12157) Support unicode for table/column names

2016-11-01 Thread hefuhua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624778#comment-15624778 ] hefuhua commented on HIVE-12157: Hi,this feature is very important for me ,and will this be solved in

[jira] [Issue Comment Deleted] (HIVE-12157) Support unicode for table/column names

2016-11-01 Thread hefuhua (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hefuhua updated HIVE-12157: --- Comment: was deleted (was: Hi,this feature is very important for me ,and will this be solved in future?) >

[jira] [Updated] (HIVE-15100) HiveSQLException: Invalid OperationHandle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier

2016-11-01 Thread Will Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Will Chen updated HIVE-15100: - Description: I am using hue + hiveserver2. First I execute sql through Hue, this can be done correctly.