[jira] [Commented] (HIVE-16178) corr/covar_samp UDAF standard compliance

2017-03-21 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935783#comment-15935783 ] Lefty Leverenz commented on HIVE-16178: --- Doc note: The descriptions of corr() and covar_samp() need

[jira] [Updated] (HIVE-16178) corr/covar_samp UDAF standard compliance

2017-03-21 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-16178: -- Labels: TODOC2.2 (was: ) > corr/covar_samp UDAF standard compliance >

[jira] [Commented] (HIVE-16229) Wrong result for correlated scalar subquery with aggregate

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935772#comment-15935772 ] Hive QA commented on HIVE-16229: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935760#comment-15935760 ] Pengcheng Xiong commented on HIVE-16274: ccing [~ashutoshc] and [~jdere] > Support tuning of NDV

[jira] [Updated] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16274: --- Status: Patch Available (was: Open) > Support tuning of NDV of columns using lower/upper

[jira] [Updated] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16274: --- Attachment: HIVE-16274.01.patch > Support tuning of NDV of columns using lower/upper bounds >

[jira] [Updated] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16274: --- Summary: Support tuning of NDV of columns using lower/upper bounds (was: Improve column

[jira] [Updated] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16274: --- Description: (was: to take into consideration of row counts.) > Support tuning of NDV of

[jira] [Commented] (HIVE-16276) Add hadoop-aws as a dependency so Hive has out of the box support for running against S3

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935755#comment-15935755 ] Hive QA commented on HIVE-16276: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16275) Vectorization: Add ReduceSink support for TopN (in specialized native classes)

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935734#comment-15935734 ] Hive QA commented on HIVE-16275: Here are the results of testing the latest attachment:

[jira] [Resolved] (HIVE-14309) Fix naming of classes in orc module to not conflict with standalone orc

2017-03-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-14309. -- Resolution: Won't Fix Target Version/s: (was: 2.0.2, 2.1.2) I've found a way to use

[jira] [Updated] (HIVE-15691) Create StrictRegexWriter to work with RegexSerializer for Flume Hive Sink

2017-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15691: -- Attachment: HIVE-15691.5.patch HIVE-15691.5.patch is same as 4 - trying to get hive2 build

[jira] [Assigned] (HIVE-15691) Create StrictRegexWriter to work with RegexSerializer for Flume Hive Sink

2017-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-15691: - Assignee: Kalyan (was: Eugene Koifman) > Create StrictRegexWriter to work with

[jira] [Updated] (HIVE-15929) Fix HiveDecimalWritable to be compatible with Hive 2.1

2017-03-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-15929: - Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Assigned] (HIVE-15691) Create StrictRegexWriter to work with RegexSerializer for Flume Hive Sink

2017-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-15691: - Assignee: Eugene Koifman (was: Kalyan) > Create StrictRegexWriter to work with

[jira] [Resolved] (HIVE-5725) Separate out ql code from exec jar

2017-03-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-5725. - Resolution: Duplicate This has already been done. > Separate out ql code from exec jar >

[jira] [Updated] (HIVE-15841) Upgrade Hive to ORC 1.3.3

2017-03-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-15841: - Attachment: HIVE-15841.patch Updated the last test case output. > Upgrade Hive to ORC 1.3.3 >

[jira] [Commented] (HIVE-15691) Create StrictRegexWriter to work with RegexSerializer for Flume Hive Sink

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935690#comment-15935690 ] Hive QA commented on HIVE-15691: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16273: Status: In Progress (was: Patch Available) > Vectorization: Make non-column key expressions work

[jira] [Updated] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16273: Status: Patch Available (was: In Progress) > Vectorization: Make non-column key expressions work

[jira] [Updated] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16273: Attachment: HIVE-16273.02.patch > Vectorization: Make non-column key expressions work in

[jira] [Commented] (HIVE-14919) Improve the performance of Hive on Spark 2.0.0

2017-03-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935686#comment-15935686 ] Rui Li commented on HIVE-14919: --- [~stakiar], [~kellyzly] we're using RDD with type like

[jira] [Updated] (HIVE-16278) LLAP: metadata cache may incorrectly decrease memory usage in mem manager

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-16278: Status: Patch Available (was: Open) > LLAP: metadata cache may incorrectly decrease memory

[jira] [Updated] (HIVE-16278) LLAP: metadata cache may incorrectly decrease memory usage in mem manager

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-16278: Attachment: HIVE-16278.patch [~gopalv] can you take a look? metadata cache mistakengly

[jira] [Comment Edited] (HIVE-16278) LLAP: metadata cache may incorrectly decrease memory usage in mem manager

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935682#comment-15935682 ] Sergey Shelukhin edited comment on HIVE-16278 at 3/22/17 2:31 AM: --

[jira] [Updated] (HIVE-15221) Improvement for MapJoin checkMemoryStatus, adding gc before throwing Exception

2017-03-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HIVE-15221: --- Description: i see in the current master version

[jira] [Commented] (HIVE-16239) remove useless hiveserver

2017-03-21 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935680#comment-15935680 ] Fei Hui commented on HIVE-16239: CC [~vgumashta] > remove useless hiveserver > -

[jira] [Assigned] (HIVE-16278) LLAP: metadata cache may incorrectly decrease memory usage in mem manager

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-16278: --- > LLAP: metadata cache may incorrectly decrease memory usage in mem manager >

[jira] [Updated] (HIVE-15784) Vectorization: Turn on text vectorization by default

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-15784: Attachment: HIVE-15784.06.patch > Vectorization: Turn on text vectorization by default >

[jira] [Updated] (HIVE-15784) Vectorization: Turn on text vectorization by default

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-15784: Status: Patch Available (was: In Progress) > Vectorization: Turn on text vectorization by default

[jira] [Updated] (HIVE-15784) Vectorization: Turn on text vectorization by default

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-15784: Status: In Progress (was: Patch Available) > Vectorization: Turn on text vectorization by default

[jira] [Commented] (HIVE-15841) Upgrade Hive to ORC 1.3.3

2017-03-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935628#comment-15935628 ] Prasanth Jayachandran commented on HIVE-15841: -- union_fast_stats failure seems to be related.

[jira] [Commented] (HIVE-16222) add a setting to disable row.serde for specific formats; enable for others

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935626#comment-15935626 ] Hive QA commented on HIVE-16222: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16229) Wrong result for correlated scalar subquery with aggregate

2017-03-21 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16229: --- Status: Patch Available (was: Open) > Wrong result for correlated scalar subquery with aggregate >

[jira] [Updated] (HIVE-16229) Wrong result for correlated scalar subquery with aggregate

2017-03-21 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16229: --- Attachment: HIVE-16229.1.patch > Wrong result for correlated scalar subquery with aggregate >

[jira] [Assigned] (HIVE-16277) Exchange Partition between filesystems throws "IllegalArgumentException Wrong FS"

2017-03-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-16277: --- Assignee: Sahil Takiar > Exchange Partition between filesystems throws

[jira] [Updated] (HIVE-16276) Add hadoop-aws as a dependency so Hive has out of the box support for running against S3

2017-03-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16276: Status: Patch Available (was: Open) > Add hadoop-aws as a dependency so Hive has out of the box

[jira] [Updated] (HIVE-16276) Add hadoop-aws as a dependency so Hive has out of the box support for running against S3

2017-03-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16276: Attachment: HIVE-16276.1.patch > Add hadoop-aws as a dependency so Hive has out of the box support

[jira] [Updated] (HIVE-16276) Add hadoop-aws as a dependency so Hive has out of the box support for running against S3

2017-03-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16276: Summary: Add hadoop-aws as a dependency so Hive has out of the box support for running against S3

[jira] [Assigned] (HIVE-16276) Add hadoop-aws as a dependency

2017-03-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-16276: --- > Add hadoop-aws as a dependency > -- > > Key:

[jira] [Updated] (HIVE-16275) Vectorization: Add ReduceSink support for TopN (in specialized native classes)

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16275: Status: Patch Available (was: Open) > Vectorization: Add ReduceSink support for TopN (in

[jira] [Updated] (HIVE-16275) Vectorization: Add ReduceSink support for TopN (in specialized native classes)

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16275: Attachment: HIVE-16275.01.patch > Vectorization: Add ReduceSink support for TopN (in specialized

[jira] [Assigned] (HIVE-16275) Vectorization: Add ReduceSink support for TopN (in specialized native classes)

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline reassigned HIVE-16275: --- > Vectorization: Add ReduceSink support for TopN (in specialized native classes) >

[jira] [Commented] (HIVE-16260) Remove parallel edges of semijoin with map joins.

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935578#comment-15935578 ] Hive QA commented on HIVE-16260: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16107) JDBC: HttpClient should retry one more time on NoHttpResponseException

2017-03-21 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935575#comment-15935575 ] Thejas M Nair commented on HIVE-16107: -- +1 Thanks for adding the test as well. > JDBC: HttpClient

[jira] [Commented] (HIVE-15841) Upgrade Hive to ORC 1.3.3

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935544#comment-15935544 ] Hive QA commented on HIVE-15841: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15691) Create StrictRegexWriter to work with RegexSerializer for Flume Hive Sink

2017-03-21 Thread Kalyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935535#comment-15935535 ] Kalyan commented on HIVE-15691: --- Hi [~ekoifman], now i got the problem. given the patches as per comments.

[jira] [Updated] (HIVE-15691) Create StrictRegexWriter to work with RegexSerializer for Flume Hive Sink

2017-03-21 Thread Kalyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kalyan updated HIVE-15691: -- Attachment: HIVE-15691-branch-1.patch HIVE-15691.4.patch Hi [~ekoifman], now i got the problem.

[jira] [Updated] (HIVE-15665) LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15665: Attachment: HIVE-15665.03.patch Rebased the patch > LLAP: OrcFileMetadata objects in cache

[jira] [Updated] (HIVE-15665) LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15665: Attachment: (was: HIVE-15665.03.patch) > LLAP: OrcFileMetadata objects in cache can

[jira] [Updated] (HIVE-15665) LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15665: Attachment: HIVE-15665.03.patch The same patch > LLAP: OrcFileMetadata objects in cache

[jira] [Updated] (HIVE-16222) add a setting to disable row.serde for specific formats; enable for others

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-16222: Attachment: HIVE-16222.01.patch Renamed the list and moved it to config > add a setting to

[jira] [Updated] (HIVE-16260) Remove parallel edges of semijoin with map joins.

2017-03-21 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-16260: -- Attachment: HIVE-16260.3.patch Implemented recommendations on review board. > Remove parallel

[jira] [Updated] (HIVE-15841) Upgrade Hive to ORC 1.3.3

2017-03-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-15841: - Attachment: HIVE-15841.patch Updated to ORC 1.3.3. > Upgrade Hive to ORC 1.3.3 >

[jira] [Assigned] (HIVE-16274) Improve column stats computation using density function

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong reassigned HIVE-16274: -- > Improve column stats computation using density function >

[jira] [Commented] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935394#comment-15935394 ] Sergey Shelukhin commented on HIVE-14879: - left some comments, mostly improvements etc. My main

[jira] [Commented] (HIVE-15841) Upgrade Hive to ORC 1.3.3

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935380#comment-15935380 ] Hive QA commented on HIVE-15841: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935377#comment-15935377 ] Hive QA commented on HIVE-16273: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15841) Upgrade Hive to ORC 1.3.3

2017-03-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935369#comment-15935369 ] Owen O'Malley commented on HIVE-15841: -- Yes, I agree. Updating the patch now. > Upgrade Hive to ORC

[jira] [Updated] (HIVE-15841) Upgrade Hive to ORC 1.3.3

2017-03-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-15841: - Summary: Upgrade Hive to ORC 1.3.3 (was: Upgrade Hive to ORC 1.3.2) Description: Hive

[jira] [Updated] (HIVE-16225) Memory leak in Templeton service

2017-03-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-16225: -- Attachment: HIVE-16225.1.patch There are quite a few ugi related FileSystem cache leaks. Attach patch.

[jira] [Commented] (HIVE-15841) Upgrade Hive to ORC 1.3.2

2017-03-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935350#comment-15935350 ] Prasanth Jayachandran commented on HIVE-15841: -- Resubmitted for another test run. Should this

[jira] [Updated] (HIVE-16180) LLAP: Native memory leak in EncodedReader

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-16180: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-16061) When hive.async.log.enabled is set to true, some output is not printed to the beeline console

2017-03-21 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935321#comment-15935321 ] Aihua Xu commented on HIVE-16061: - Thanks [~prasanth_j] I will take a look. > When hive.async.log.enabled

[jira] [Updated] (HIVE-14879) integrate MM tables into ACID: replace MM metastore calls and structures with ACID ones

2017-03-21 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14879: - Attachment: HIVE-14879.3.patch patch 3 fixed issues in mm_conversions.q > integrate MM tables into ACID:

[jira] [Commented] (HIVE-16061) When hive.async.log.enabled is set to true, some output is not printed to the beeline console

2017-03-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935315#comment-15935315 ] Prasanth Jayachandran commented on HIVE-16061: -- *Configuration:*

[jira] [Commented] (HIVE-16061) When hive.async.log.enabled is set to true, some output is not printed to the beeline console

2017-03-21 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935272#comment-15935272 ] Aihua Xu commented on HIVE-16061: - Thanks [~prasanth_j] Agree. I was checking MDC related and

[jira] [Updated] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16273: Attachment: HIVE-16273.01.patch > Vectorization: Make non-column key expressions work in

[jira] [Updated] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16273: Status: Patch Available (was: Open) > Vectorization: Make non-column key expressions work in

[jira] [Commented] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935258#comment-15935258 ] Matt McCline commented on HIVE-16273: - HIVE-16245 disabled vectorized non-column key expressions for

[jira] [Commented] (HIVE-16061) When hive.async.log.enabled is set to true, some output is not printed to the beeline console

2017-03-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935256#comment-15935256 ] Prasanth Jayachandran commented on HIVE-16061: -- This was observed earlier in HIVE-14183.

[jira] [Assigned] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline reassigned HIVE-16273: --- Assignee: Matt McCline > Vectorization: Make non-column key expressions work in MERGEPARTIAL

[jira] [Commented] (HIVE-16271) add support for STRUCT in VectorSerializeRow/VectorDeserializeRow

2017-03-21 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935250#comment-15935250 ] Matt McCline commented on HIVE-16271: - It is a moderately large in-progress change. > add support for

[jira] [Commented] (HIVE-16180) LLAP: Native memory leak in EncodedReader

2017-03-21 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935232#comment-15935232 ] Prasanth Jayachandran commented on HIVE-16180: -- lgtm, +1 > LLAP: Native memory leak in

[jira] [Commented] (HIVE-16061) When hive.async.log.enabled is set to true, some output is not printed to the beeline console

2017-03-21 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935217#comment-15935217 ] Aihua Xu commented on HIVE-16061: - Please ignore the patches since technically we should not call

[jira] [Updated] (HIVE-16061) When hive.async.log.enabled is set to true, some output is not printed to the beeline console

2017-03-21 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-16061: Description: Run a hiveserver2 instance "hive --service hiveserver2". Then from another console, connect to

[jira] [Commented] (HIVE-16271) add support for STRUCT in VectorSerializeRow/VectorDeserializeRow

2017-03-21 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935190#comment-15935190 ] Zoltan Haindrich commented on HIVE-16271: - thank you [~gopalv], I'll look into it. > add support

[jira] [Updated] (HIVE-16061) When hive.async.log.enabled is set to true, some output is not printed to the beeline console

2017-03-21 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-16061: Summary: When hive.async.log.enabled is set to true, some output is not printed to the beeline console

[jira] [Commented] (HIVE-16252) Vectorization: Cannot vectorize: Aggregation Function UDF avg

2017-03-21 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935186#comment-15935186 ] Zoltan Haindrich commented on HIVE-16252: - okay the 'Bug' type mislead me a bit :) I'm trying to

[jira] [Commented] (HIVE-16206) Make Codahale metrics reporters pluggable

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935183#comment-15935183 ] Hive QA commented on HIVE-16206: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16180) LLAP: Native memory leak in EncodedReader

2017-03-21 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935180#comment-15935180 ] Sergey Shelukhin commented on HIVE-16180: - Failure is unrelated. [~prasanth_j] can you take a

[jira] [Commented] (HIVE-16231) Parquet timestamp may be stored differently since HIVE-12767

2017-03-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935091#comment-15935091 ] Hive QA commented on HIVE-16231: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16206) Make Codahale metrics reporters pluggable

2017-03-21 Thread Sunitha Beeram (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Beeram updated HIVE-16206: -- Status: Patch Available (was: Open) > Make Codahale metrics reporters pluggable >

[jira] [Commented] (HIVE-15691) Create StrictRegexWriter to work with RegexSerializer for Flume Hive Sink

2017-03-21 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934983#comment-15934983 ] Eugene Koifman commented on HIVE-15691: --- The link above shows the signatures with

[jira] [Updated] (HIVE-16246) Support auto gather column stats for columns with trailing white spaces

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16246: --- Affects Version/s: 2.1.0 > Support auto gather column stats for columns with trailing white

[jira] [Updated] (HIVE-16246) Support auto gather column stats for columns with trailing white spaces

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16246: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Support auto gather

[jira] [Commented] (HIVE-16246) Support auto gather column stats for columns with trailing white spaces

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934975#comment-15934975 ] Pengcheng Xiong commented on HIVE-16246: pushed to master. Thanks [~ashutoshc] for the review! >

[jira] [Updated] (HIVE-16246) Support auto gather column stats for columns with trailing white spaces

2017-03-21 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16246: --- Fix Version/s: 2.2.0 > Support auto gather column stats for columns with trailing white

[jira] [Commented] (HIVE-14919) Improve the performance of Hive on Spark 2.0.0

2017-03-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934965#comment-15934965 ] Sahil Takiar commented on HIVE-14919: - [~kellyzly] my guess is that any Hive table should benefit from

[jira] [Updated] (HIVE-16231) Parquet timestamp may be stored differently since HIVE-12767

2017-03-21 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-16231: --- Attachment: HIVE-16231.02.patch > Parquet timestamp may be stored differently since

[jira] [Updated] (HIVE-16231) Parquet timestamp may be stored differently since HIVE-12767

2017-03-21 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-16231: --- Status: Patch Available (was: Open) > Parquet timestamp may be stored differently

[jira] [Updated] (HIVE-16231) Parquet timestamp may be stored differently since HIVE-12767

2017-03-21 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-16231: --- Attachment: (was: HIVE-16231.02.patch) > Parquet timestamp may be stored

[jira] [Updated] (HIVE-16231) Parquet timestamp may be stored differently since HIVE-12767

2017-03-21 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-16231: --- Attachment: HIVE-16231.02.patch Refactored timezone check into a separate method. >

[jira] [Updated] (HIVE-16178) corr/covar_samp UDAF standard compliance

2017-03-21 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-16178: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-16252) Vectorization: Cannot vectorize: Aggregation Function UDF avg

2017-03-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934887#comment-15934887 ] Rajesh Balamohan commented on HIVE-16252: - Observed slow performance with this query as opposed to

[jira] [Commented] (HIVE-15766) DBNotificationlistener leaks JDOPersistenceManager

2017-03-21 Thread Mohit Sabharwal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934893#comment-15934893 ] Mohit Sabharwal commented on HIVE-15766: Thanks, [~vgumashta], latest patch LGTM. Sorry about the

[jira] [Updated] (HIVE-16007) When the query does not complie the LogRunnable never stops

2017-03-21 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-16007: -- Attachment: HIVE-16007.6.patch The BeeLine tests error were relevant. The last lines of the log was not

[jira] [Updated] (HIVE-16166) HS2 may still waste up to 15% of memory on duplicate strings

2017-03-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-16166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-16166: --- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16231) Parquet timestamp may be stored differently since HIVE-12767

2017-03-21 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-16231: --- Status: Open (was: Patch Available) > Parquet timestamp may be stored differently

[jira] [Commented] (HIVE-16166) HS2 may still waste up to 15% of memory on duplicate strings

2017-03-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-16166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934827#comment-15934827 ] Sergio Peña commented on HIVE-16166: I found this jira HIVE-15776 that mentions the vector_if_expr is

  1   2   >