[jira] [Commented] (HIVE-20756) Disable SARG leaf creation for date column until ORC-135

2018-10-17 Thread Hive QA (JIRA) 


[ 
https://issues.apache.org/jira/browse/HIVE-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654717#comment-16654717
 ] 

Hive QA commented on HIVE-20756:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12944388/HIVE-20756.01-branch-1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 99 failed/errored test(s), 9121 tests 
executed
*Failed tests:*
{noformat}
TestHs2HooksWithMiniKdc - did not produce a TEST-*.xml file (likely timed out) 
(batchId=452)
TestJdbcWithMiniKdc - did not produce a TEST-*.xml file (likely timed out) 
(batchId=449)
TestJdbcWithMiniKdcCookie - did not produce a TEST-*.xml file (likely timed 
out) (batchId=448)
TestJdbcWithMiniKdcSQLAuthBinary - did not produce a TEST-*.xml file (likely 
timed out) (batchId=446)
TestJdbcWithMiniKdcSQLAuthHttp - did not produce a TEST-*.xml file (likely 
timed out) (batchId=451)
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=202)

[multi_insert_mixed.q,smb_mapjoin_4.q,timestamp_comparison.q,join_cond_pushdown_3.q,insert1.q,union_remove_10.q,mapreduce2.q,bucketmapjoin_negative.q,udf_in_file.q,skewjoinopt5.q,auto_join12.q,skewjoin.q,vector_count_distinct.q,smb_mapjoin_3.q,stats10.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=205)

[auto_join30.q,union_remove_1.q,ppd_outer_join2.q,date_udf.q,join16.q,smb_mapjoin_13.q,bucketmapjoin7.q,smb_mapjoin_18.q,join19.q,metadata_only_queries.q,union6.q,cbo_subq_in.q,vectorization_part.q,groupby3_map_multi_distinct.q,vectorized_timestamp_funcs.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=206)

[bucketmapjoin12.q,auto_join10.q,ptf_rcfile.q,join20.q,vector_elt.q,multi_insert.q,groupby_rollup1.q,ppd_join5.q,join_filters_overlap.q,vector_string_concat.q,join_empty.q,smb_mapjoin_6.q,auto_sortmerge_join_12.q,groupby_bigdata.q,innerjoin.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=207)

[tez_joins_explain.q,input17.q,ppd_gby_join.q,vectorized_rcfile_columnar.q,ppd_join.q,join_cond_pushdown_1.q,union_remove_6_subq.q,timestamp_3.q,load_dyn_part6.q,load_dyn_part9.q,multi_insert_gby2.q,vectorization_11.q,avro_compression_enabled_native.q,stats_noscan_2.q,transform1.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=211)

[escape_distributeby1.q,join9.q,groupby2.q,vectorization_pushdown.q,union_date.q,join_cond_pushdown_unqual3.q,join8.q,sample10.q,ppd_outer_join3.q,cross_product_check_1.q,statsfs.q,auto_sortmerge_join_2.q,auto_join_stats.q,input_part2.q,groupby_multi_single_reducer3.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=215)

[ppd_join4.q,load_dyn_part2.q,smb_mapjoin_7.q,vectorization_5.q,smb_mapjoin_2.q,ppd_join_filter.q,column_access_stats.q,stats0.q,vector_between_in.q,vectorized_string_funcs.q,vectorization_1.q,bucket_map_join_2.q,temp_table_join1.q,vectorized_case.q,stats_noscan_1.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=217)

[stats12.q,groupby4.q,union_top_level.q,groupby10.q,subquery_in.q,mapjoin_filter_on_outerjoin.q,stats14.q,auto_sortmerge_join_4.q,limit_partition_metadataonly.q,load_dyn_part4.q,union3.q,smb_mapjoin_14.q,groupby3_noskew_multi_distinct.q,stats18.q,union_remove_21.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=221)

[table_access_keys_stats.q,bucketmapjoin11.q,union_remove_9.q,mergejoins_mixed.q,join_nullsafe.q,stats8.q,auto_join28.q,skewjoinopt14.q,union17.q,vectorized_shufflejoin.q,groupby8_noskew.q,auto_sortmerge_join_10.q,groupby11.q,skewjoinopt11.q,load_dyn_part11.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=222)

[script_pipe.q,auto_join24.q,ptf_seqfile.q,union_remove_23.q,filter_join_breaktask.q,parallel_join0.q,join_thrift.q,vectorized_mapjoin.q,groupby8.q,union4.q,auto_join5.q,smb_mapjoin_20.q,groupby_multi_insert_common_distinct.q,join6.q,union_remove_16.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=227)

[join36.q,union_remove_15.q,smb_mapjoin_10.q,bucket_map_join_tez1.q,temp_table.q,union_remove_13.q,auto_join8.q,auto_join6.q,auto_join0.q,vectorization_17.q,auto_join_stats2.q,skewjoin_union_remove_1.q,union16.q,auto_join32.q,union_remove_20.q]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_globallimit 
(batchId=45)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_mapjoin (batchId=16)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_table 
(batchId=32)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_drop_database_removes_partition_dirs
 (batchId=98)

[jira] [Commented] (HIVE-20756) Disable SARG leaf creation for date column until ORC-135

2018-10-17 Thread Hive QA (JIRA) 


[ 
https://issues.apache.org/jira/browse/HIVE-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653611#comment-16653611
 ] 

Hive QA commented on HIVE-20756:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12944233/HIVE-20756.01-branch-1.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-Build/14521/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/14521/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-14521/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit 
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2018-10-17 14:14:29.406
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-14521/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z branch-1 ]]
+ [[ -d apache-github-branch-1-source ]]
+ [[ ! -d apache-github-branch-1-source/.git ]]
+ [[ ! -d apache-github-branch-1-source ]]
+ date '+%Y-%m-%d %T.%3N'
2018-10-17 14:14:29.458
+ cd apache-github-branch-1-source
+ git fetch origin
>From https://github.com/apache/hive
   8b16ad0..a457012  branch-2   -> origin/branch-2
   b558131..1ce6c7c  branch-3   -> origin/branch-3
   bcc7df9..c39b5d1  branch-3.1 -> origin/branch-3.1
   50d5bbb..fa97c67  master -> origin/master
 * [new branch]  master-tez092 -> origin/master-tez092
+ git reset --hard HEAD
HEAD is now at db72a86 HIVE-18836 : backport HIVE-17600 to hive 1 (Sergey 
Shelukhin, reviewed by Prasanth Jayachandran)
+ git clean -f -d
+ git checkout branch-1
Already on 'branch-1'
Your branch is up-to-date with 'origin/branch-1'.
+ git reset --hard origin/branch-1
HEAD is now at db72a86 HIVE-18836 : backport HIVE-17600 to hive 1 (Sergey 
Shelukhin, reviewed by Prasanth Jayachandran)
+ git merge --ff-only origin/branch-1
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2018-10-17 14:14:40.669
+ rm -rf ../yetus_PreCommit-HIVE-Build-14521
+ mkdir ../yetus_PreCommit-HIVE-Build-14521
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-14521
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-14521/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh 
/data/hiveptest/working/scratch/build.patch
fatal: corrupt patch at line 18
fatal: corrupt patch at line 18
fatal: corrupt patch at line 18
The patch does not appear to apply with p0, p1, or p2
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-14521
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12944233 - PreCommit-HIVE-Build

> Disable SARG leaf creation for date column until ORC-135
> 
>
> Key: HIVE-20756
> URL: https://issues.apache.org/jira/browse/HIVE-20756
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 2.1.1
>Reporter: Chiran Ravani
>Assignee: Chiran Ravani
>Priority: Major
> Attachments: HIVE-20756.01-branch-1.patch, HIVE-20756.1.patch
>
>
> Until ORC-135 is committed and orc version is updated in hive, disable SARG 
> creation for date columns in hive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-20756) Disable SARG leaf creation for date column until ORC-135

2018-10-16 Thread Sergey Shelukhin (JIRA) 


[ 
https://issues.apache.org/jira/browse/HIVE-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652619#comment-16652619
 ] 

Sergey Shelukhin commented on HIVE-20756:
-

branch-1 tests are all screwed up anyway :)

> Disable SARG leaf creation for date column until ORC-135
> 
>
> Key: HIVE-20756
> URL: https://issues.apache.org/jira/browse/HIVE-20756
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 2.1.1
>Reporter: Chiran Ravani
>Assignee: Chiran Ravani
>Priority: Major
> Attachments: HIVE-20756.1.patch
>
>
> Until ORC-135 is committed and orc version is updated in hive, disable SARG 
> creation for date columns in hive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-20756) Disable SARG leaf creation for date column until ORC-135

2018-10-16 Thread Gopal V (JIRA) 


[ 
https://issues.apache.org/jira/browse/HIVE-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652458#comment-16652458
 ] 

Gopal V commented on HIVE-20756:


The patch will fail tests unless it is renamed to have branch-1.patch.

> Disable SARG leaf creation for date column until ORC-135
> 
>
> Key: HIVE-20756
> URL: https://issues.apache.org/jira/browse/HIVE-20756
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 2.1.1
>Reporter: Chiran Ravani
>Assignee: Chiran Ravani
>Priority: Major
> Attachments: HIVE-20756.1.patch
>
>
> Until ORC-135 is committed and orc version is updated in hive, disable SARG 
> creation for date columns in hive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-20756) Disable SARG leaf creation for date column until ORC-135

2018-10-16 Thread Prasanth Jayachandran (JIRA) 


[ 
https://issues.apache.org/jira/browse/HIVE-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652267#comment-16652267
 ] 

Prasanth Jayachandran commented on HIVE-20756:
--

branch-1 has different type conversions for PPD.. this may still be applicable. 
the DATE/timestamp ppd is subject to timezone issues anyway. so safer to 
disable it.

+1

> Disable SARG leaf creation for date column until ORC-135
> 
>
> Key: HIVE-20756
> URL: https://issues.apache.org/jira/browse/HIVE-20756
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 2.1.1
>Reporter: Chiran Ravani
>Assignee: Chiran Ravani
>Priority: Major
> Attachments: HIVE-20756.1.patch
>
>
> Until ORC-135 is committed and orc version is updated in hive, disable SARG 
> creation for date columns in hive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (HIVE-20756) Disable SARG leaf creation for date column until ORC-135

2018-10-16 Thread Sergey Shelukhin (JIRA) 


[ 
https://issues.apache.org/jira/browse/HIVE-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652253#comment-16652253
 ] 

Sergey Shelukhin commented on HIVE-20756:
-

Makes sense to me +1
This is applicable to branch-1 only, ORC is separate after that.
[~prasanth_j] does this make sense?

> Disable SARG leaf creation for date column until ORC-135
> 
>
> Key: HIVE-20756
> URL: https://issues.apache.org/jira/browse/HIVE-20756
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 2.1.1
>Reporter: Chiran Ravani
>Assignee: Chiran Ravani
>Priority: Major
> Attachments: HIVE-20756.1.patch
>
>
> Until ORC-135 is committed and orc version is updated in hive, disable SARG 
> creation for date columns in hive.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)