[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315850#comment-16315850 ] Hive QA commented on HIVE-18384: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Updated] (HIVE-18061) q.outs: be more selective with masking hdfs paths

2018-01-08 Thread Laszlo Bodor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laszlo Bodor updated HIVE-18061: Attachment: HIVE-18061.04.patch > q.outs: be more selective with masking hdfs paths > --

[jira] [Commented] (HIVE-18349) Misc metastore changes for debuggability, error on commit txn failures

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315909#comment-16315909 ] Hive QA commented on HIVE-18349: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-16489) HMS wastes 26.4% of memory due to dup strings in metastore.api.Partition.parameters

2018-01-08 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315918#comment-16315918 ] Adam Szita commented on HIVE-16489: --- Thanks! > HMS wastes 26.4% of memory due to dup st

[jira] [Commented] (HIVE-18384) ConcurrentModificationException in log4j2.x library

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315882#comment-16315882 ] Hive QA commented on HIVE-18384: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18352: --- Attachment: HIVE-18352.2.patch > introduce a METADATAONLY option while doing REPL DUMP to allow integrations

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315943#comment-16315943 ] anishek commented on HIVE-18352: [~thejas]/[~daijy]/[~sankarh] can you please review the p

[jira] [Updated] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18352: --- Attachment: (was: HIVE-18352.2.patch) > introduce a METADATAONLY option while doing REPL DUMP to allow int

[jira] [Updated] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18352: --- Attachment: HIVE-18352.2.patch > introduce a METADATAONLY option while doing REPL DUMP to allow integrations

[jira] [Updated] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18352: --- Attachment: (was: HIVE-18352.2.patch) > introduce a METADATAONLY option while doing REPL DUMP to allow int

[jira] [Updated] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18352: --- Attachment: HIVE-18352.2.patch > introduce a METADATAONLY option while doing REPL DUMP to allow integrations

[jira] [Commented] (HIVE-18349) Misc metastore changes for debuggability, error on commit txn failures

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315982#comment-16315982 ] Hive QA commented on HIVE-18349: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18061) q.outs: be more selective with masking hdfs paths

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315988#comment-16315988 ] Hive QA commented on HIVE-18061: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18352: --- Attachment: (was: HIVE-18352.2.patch) > introduce a METADATAONLY option while doing REPL DUMP to allow int

[jira] [Commented] (HIVE-16805) Utilities isEmptyPath Logging Too Chatty and Uses Bad Format

2018-01-08 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315992#comment-16315992 ] Peter Vary commented on HIVE-16805: --- [~belugabehr]: Since this patch is making the code

[jira] [Updated] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-18352: --- Attachment: HIVE-18352.2.patch > introduce a METADATAONLY option while doing REPL DUMP to allow integrations

[jira] [Commented] (HIVE-18372) Create testing infra to test different HMS instances

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316019#comment-16316019 ] Hive QA commented on HIVE-18372: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HIVE-18372) Create testing infra to test different HMS instances

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316120#comment-16316120 ] Hive QA commented on HIVE-18372: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316130#comment-16316130 ] Rui Li commented on HIVE-16484: --- Hi [~stakiar], got a higher level question: what's the main

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316146#comment-16316146 ] Hive QA commented on HIVE-18352: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-18372) Create testing infra to test different HMS instances

2018-01-08 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316189#comment-16316189 ] Peter Vary commented on HIVE-18372: --- [~alangates], [~vihangk1]: Could you review please?

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316198#comment-16316198 ] Hive QA commented on HIVE-18352: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-9854) OutofMemory while read ORCFile table

2018-01-08 Thread YulongZ (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316228#comment-16316228 ] YulongZ commented on HIVE-9854: --- I meet the same problem > OutofMemory while read ORCFile ta

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316244#comment-16316244 ] Hive QA commented on HIVE-18352: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Updated] (HIVE-18061) q.outs: be more selective with masking hdfs paths

2018-01-08 Thread Laszlo Bodor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laszlo Bodor updated HIVE-18061: Attachment: HIVE-18061.05.patch > q.outs: be more selective with masking hdfs paths > --

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316299#comment-16316299 ] Hive QA commented on HIVE-18352: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316357#comment-16316357 ] Hive QA commented on HIVE-18352: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Assigned] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongzhi Chen reassigned HIVE-11609: --- Assignee: Yongzhi Chen (was: Barna Zsombor Klara) > Capability to add a filter to hbase scan

[jira] [Updated] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongzhi Chen updated HIVE-11609: Attachment: HIVE-11609.11.patch Rebase and attach patch HIVE-11609.11.patch > Capability to add a f

[jira] [Assigned] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongzhi Chen reassigned HIVE-11609: --- Assignee: Barna Zsombor Klara (was: Yongzhi Chen) > Capability to add a filter to hbase scan

[jira] [Commented] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316413#comment-16316413 ] Yongzhi Chen commented on HIVE-11609: - The patch LGTM +1 [~zsombor.klara] and [~swa

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316414#comment-16316414 ] Hive QA commented on HIVE-18352: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18061) q.outs: be more selective with masking hdfs paths

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316416#comment-16316416 ] Hive QA commented on HIVE-18061: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316449#comment-16316449 ] Hive QA commented on HIVE-11609: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316525#comment-16316525 ] Hive QA commented on HIVE-11609: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table

2018-01-08 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316554#comment-16316554 ] Thejas M Nair commented on HIVE-18373: -- [~minions] What you are proposing is regex su

[jira] [Assigned] (HIVE-17238) DPP isn't trigger for partitioned to partitioned join within a subquery

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani reassigned HIVE-17238: -- Assignee: Janaki Lahorani > DPP isn't trigger for partitioned to partitioned join withi

[jira] [Assigned] (HIVE-17638) SparkDynamicPartitionPruner loads all partition metadata into memory

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani reassigned HIVE-17638: -- Assignee: Janaki Lahorani > SparkDynamicPartitionPruner loads all partition metadata in

[jira] [Assigned] (HIVE-17959) SparkPartitionPruningSinkOperator buffers all writes in memory

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani reassigned HIVE-17959: -- Assignee: Janaki Lahorani > SparkPartitionPruningSinkOperator buffers all writes in mem

[jira] [Assigned] (HIVE-16003) Blobstores should use fs.listFiles(path, recursive=true) rather than FileUtils.listStatusRecursively

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani reassigned HIVE-16003: -- Assignee: Janaki Lahorani (was: Sahil Takiar) > Blobstores should use fs.listFiles(pat

[jira] [Commented] (HIVE-17952) Fix license headers to avoid dangling javadoc warnings

2018-01-08 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316655#comment-16316655 ] Andrew Sherman commented on HIVE-17952: --- [~prasanth_j] any chance you could push thi

[jira] [Updated] (HIVE-18051) qfiles: dataset support

2018-01-08 Thread Laszlo Bodor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laszlo Bodor updated HIVE-18051: Attachment: HIVE-18051.01.patch > qfiles: dataset support > --- > >

[jira] [Updated] (HIVE-18051) qfiles: dataset support

2018-01-08 Thread Laszlo Bodor (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laszlo Bodor updated HIVE-18051: Status: Patch Available (was: Open) > qfiles: dataset support > --- > >

[jira] [Commented] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316680#comment-16316680 ] Yongzhi Chen commented on HIVE-11609: - The failures are not related. > Capability to

[jira] [Assigned] (HIVE-18393) Error returned when some other type is read as string from parquet tables

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani reassigned HIVE-18393: -- > Error returned when some other type is read as string from parquet tables > -

[jira] [Commented] (HIVE-18366) Update HBaseSerDe to use hbase.mapreduce.hfileoutputformat.table.name instead of hbase.table.name as the table name property

2018-01-08 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316727#comment-16316727 ] Yongzhi Chen commented on HIVE-18366: - [~aihuaxu], could you point me the code in Hive

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316747#comment-16316747 ] Sahil Takiar commented on HIVE-16484: - Hey [~lirui], thanks for taking a look. You bri

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316759#comment-16316759 ] Marcelo Vanzin commented on HIVE-16484: --- {{InProcessLauncher}} also uses the launche

[jira] [Commented] (HIVE-18366) Update HBaseSerDe to use hbase.mapreduce.hfileoutputformat.table.name instead of hbase.table.name as the table name property

2018-01-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316766#comment-16316766 ] Aihua Xu commented on HIVE-18366: - [~ychena] Thanks for reviewing. The code is changed in

[jira] [Updated] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17396: --- Attachment: HIVE-17396.5.patch Rebased. > Support DPP with map joins where the source and tar

[jira] [Commented] (HIVE-18051) qfiles: dataset support

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316801#comment-16316801 ] Hive QA commented on HIVE-18051: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Updated] (HIVE-18393) Error returned when some other type is read as string from parquet tables

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-18393: --- Fix Version/s: 3.0.0 Status: Patch Available (was: Open) > Error returned when som

[jira] [Updated] (HIVE-18393) Error returned when some other type is read as string from parquet tables

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-18393: --- Attachment: HIVE-18393.1.patch > Error returned when some other type is read as string from pa

[jira] [Commented] (HIVE-18051) qfiles: dataset support

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316843#comment-16316843 ] Hive QA commented on HIVE-18051: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18391: -- Attachment: HIVE-18391.2.patch Patch which applies. > load data should rename files consistent

[jira] [Updated] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17396: --- Attachment: HIVE-17396.6.patch Cleaned up comments > Support DPP with map joins where the sou

[jira] [Commented] (HIVE-11609) Capability to add a filter to hbase scan via composite key doesn't work

2018-01-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316851#comment-16316851 ] Aihua Xu commented on HIVE-11609: - The change looks good. +1. > Capability to add a filte

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316869#comment-16316869 ] Sahil Takiar commented on HIVE-16484: - [~vanzin] thanks for the info. What about just

[jira] [Updated] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-08 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Yeom updated HIVE-18379: -- Attachment: HIVE-18379.02.patch > ALTER TABLE authorization_part SET PROPERTIES > ("PARTITIONL_LEVEL_PR

[jira] [Updated] (HIVE-16970) General Improvements To org.apache.hadoop.hive.metastore.cache.CacheUtils

2018-01-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-16970: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Updated] (HIVE-16826) Improvements for SeparatedValuesOutputFormat

2018-01-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-16826: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Updated] (HIVE-17966) org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveArrayInspector - Review

2018-01-08 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-17966: Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to master. Thanks [~belugabehr] >

[jira] [Commented] (HIVE-18366) Update HBaseSerDe to use hbase.mapreduce.hfileoutputformat.table.name instead of hbase.table.name as the table name property

2018-01-08 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316879#comment-16316879 ] Yongzhi Chen commented on HIVE-18366: - Got it. +1 Please have the change well document

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316884#comment-16316884 ] Hive QA commented on HIVE-17396: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HIVE-18214) Flaky test: TestSparkClient

2018-01-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316891#comment-16316891 ] Sahil Takiar commented on HIVE-18214: - [~aihuaxu], [~pvary] updated - RB: https://revi

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316894#comment-16316894 ] Marcelo Vanzin commented on HIVE-16484: --- Yes, that's what the launcher does internal

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316919#comment-16316919 ] Siddharth Seth commented on HIVE-18326: --- {code} +DAG dag = (DAG) info; {code} is

[jira] [Updated] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18326: Status: Patch Available (was: Reopened) Forgot to submit patch... > LLAP Tez scheduler - o

[jira] [Commented] (HIVE-17937) llap_acid_fast test is flaky

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316976#comment-16316976 ] Sergey Shelukhin commented on HIVE-17937: - Seems like there are still diffs > lla

[jira] [Updated] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18391: -- Attachment: HIVE-18391.3.patch Implemented review comment. > load data should rename files cons

[jira] [Assigned] (HIVE-18231) validate resource plan - part 2 - validate action and trigger expressions

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-18231: --- Assignee: Harish Thilliyambur Krishnan > validate resource plan - part 2 - validate a

[jira] [Assigned] (HIVE-18231) validate resource plan - part 2 - validate action and trigger expressions

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-18231: --- Assignee: Sergey Shelukhin (was: Harish Thilliyambur Krishnan) > validate resource p

[jira] [Assigned] (HIVE-18231) validate resource plan - part 2 - validate action and trigger expressions

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-18231: --- Assignee: Harish Jaiprakash (was: Sergey Shelukhin) > validate resource plan - part

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317005#comment-16317005 ] Sergey Shelukhin commented on HIVE-18326: - [~sseth] I don't think it's the only pl

[jira] [Commented] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-01-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317007#comment-16317007 ] BELUGA BEHR commented on HIVE-16855: [~szita] :) > org.apache.hadoop.hive.ql.exec.mr.

[jira] [Commented] (HIVE-17982) Move metastore specific itests

2018-01-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317009#comment-16317009 ] Alan Gates commented on HIVE-17982: --- Peter, thanks for the review. bq. adding more code

[jira] [Commented] (HIVE-16855) org.apache.hadoop.hive.ql.exec.mr.HashTableLoader Improvements

2018-01-08 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317013#comment-16317013 ] BELUGA BEHR commented on HIVE-16855: Also applies to 2.x branch > org.apache.hadoop.h

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317014#comment-16317014 ] Hive QA commented on HIVE-17396: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18393) Error returned when some other type is read as string from parquet tables

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317028#comment-16317028 ] Hive QA commented on HIVE-18393: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317034#comment-16317034 ] Xuefu Zhang commented on HIVE-16484: I'd echo with [~lirui], wondering the benefits th

[jira] [Updated] (HIVE-17580) Remove dependency of get_fields_with_environment_context API to serde

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17580: --- Attachment: HIVE-17580-standalone-metastore.001.patch attaching the first version of t

[jira] [Updated] (HIVE-17580) Remove dependency of get_fields_with_environment_context API to serde

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17580: --- Status: Patch Available (was: In Progress) > Remove dependency of get_fields_with_env

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317066#comment-16317066 ] Sahil Takiar commented on HIVE-16484: - [~xuefuz] thanks for voicing your concern, I se

[jira] [Commented] (HIVE-18355) Add builder for metastore Thrift classes missed in the first pass - FunctionBuilder

2018-01-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317103#comment-16317103 ] Alan Gates commented on HIVE-18355: --- A couple of comments in the build method: # It shou

[jira] [Updated] (HIVE-18367) Describe Extended output is truncated on a table with an explicit row format containing tabs or newlines.

2018-01-08 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Sherman updated HIVE-18367: -- Attachment: HIVE-18367.3.patch Some test changes because the 'describe extended' output now alwa

[jira] [Commented] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317110#comment-16317110 ] Hive QA commented on HIVE-18391: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-18395) Using stats for aggregates on Acid/MM is off even with "hive.compute.query.using.stats" is true.

2018-01-08 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317130#comment-16317130 ] Steve Yeom commented on HIVE-18395: --- I talked with Ashutosh Chauhan. We turned off usin

[jira] [Commented] (HIVE-18349) Misc metastore changes for debuggability, error on commit txn failures

2018-01-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317133#comment-16317133 ] Alan Gates commented on HIVE-18349: --- HiveMetaStore.endFunction, lines 887 after your pat

[jira] [Comment Edited] (HIVE-18395) Using stats for aggregates on Acid/MM is off even with "hive.compute.query.using.stats" is true.

2018-01-08 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317130#comment-16317130 ] Steve Yeom edited comment on HIVE-18395 at 1/8/18 9:46 PM: --- I ta

[jira] [Commented] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317160#comment-16317160 ] Hive QA commented on HIVE-18391: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18349) Misc metastore changes for debuggability, error on commit txn failures

2018-01-08 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317173#comment-16317173 ] Prasanth Jayachandran commented on HIVE-18349: -- bq. Why should this method be

[jira] [Commented] (HIVE-18372) Create testing infra to test different HMS instances

2018-01-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317175#comment-16317175 ] Alan Gates commented on HIVE-18372: --- Peter, could you comment a bit on the goals behind

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317197#comment-16317197 ] Hive QA commented on HIVE-17396: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HIVE-18359) Extend grouping set limits from int to long

2018-01-08 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-18359: - Attachment: HIVE-18359.4.patch [~mmccline]/[~kgyrtkirk] vector_grouping_sets.q is

[jira] [Updated] (HIVE-18152) Idempotent state change for resource plan

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18152: Resolution: Done Status: Resolved (was: Patch Available) Looks like it's already fi

[jira] [Updated] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18269: Attachment: HIVE-18269.03.patch I cannot repro the new failures and they look like they are

[jira] [Commented] (HIVE-18323) Vectorization: add the support of timestamp in VectorizedPrimitiveColumnReader for parquet

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317297#comment-16317297 ] Vihang Karajgaonkar commented on HIVE-18323: Thanks [~aihuaxu] for taking this

[jira] [Updated] (HIVE-18390) IndexOutOfBoundsException when query a partitioned view in ColumnPruner

2018-01-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-18390: Status: Patch Available (was: Open) > IndexOutOfBoundsException when query a partitioned v

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317302#comment-16317302 ] Hive QA commented on HIVE-17396: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18330) Fix TestMsgBusConnection - doesn't test tests the original intention

2018-01-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317304#comment-16317304 ] Ashutosh Chauhan commented on HIVE-18330: - +1 lets get test fix in. > Fix TestMsg

  1   2   >