[jira] [Commented] (HIVE-15270) ExprNode/Sarg changes to support values supplied during query runtime

2016-11-28 Thread Jason Dere (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703437#comment-15703437
 ] 

Jason Dere commented on HIVE-15270:
---

Failures not related (created HIVE-15298 for the sample* failures).
[~ashutoshc] [~prasanth_j] can you take a look?

> ExprNode/Sarg changes to support values supplied during query runtime
> -
>
> Key: HIVE-15270
> URL: https://issues.apache.org/jira/browse/HIVE-15270
> Project: Hive
>  Issue Type: Improvement
>Reporter: Jason Dere
>Assignee: Jason Dere
> Attachments: HIVE-15270.1.patch, HIVE-15270.2.patch, 
> HIVE-15270.3.patch
>
>
> Infrastructure changes to support retrieval of query-runtime supplied values, 
> needed for dynamic min/max (HIVE-15269) and bloomfilter join optimizations.
> - Some concept of available runtime values that can be retrieved for a 
> MapWork/ReduceWork
> - ExprNode/Sarg changes to pass a Conf during initialization - this allows 
> the expression to retrieve the MapWork at query time (using 
> Utilities.getMapWork(Configuration)) to access runtime-supplied values.
> - Ability to populate the runtime values in Tez mode via incoming Tez edges



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-15270) ExprNode/Sarg changes to support values supplied during query runtime

2016-11-28 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702994#comment-15702994
 ] 

Hive QA commented on HIVE-15270:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12840693/HIVE-15270.3.patch

{color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 10733 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample2] (batchId=5)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample4] (batchId=15)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample6] (batchId=60)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample7] (batchId=59)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample9] (batchId=38)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[transform_ppr2] 
(batchId=133)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_5] 
(batchId=90)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/2301/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/2301/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-2301/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12840693 - PreCommit-HIVE-Build

> ExprNode/Sarg changes to support values supplied during query runtime
> -
>
> Key: HIVE-15270
> URL: https://issues.apache.org/jira/browse/HIVE-15270
> Project: Hive
>  Issue Type: Improvement
>Reporter: Jason Dere
>Assignee: Jason Dere
> Attachments: HIVE-15270.1.patch, HIVE-15270.2.patch, 
> HIVE-15270.3.patch
>
>
> Infrastructure changes to support retrieval of query-runtime supplied values, 
> needed for dynamic min/max (HIVE-15269) and bloomfilter join optimizations.
> - Some concept of available runtime values that can be retrieved for a 
> MapWork/ReduceWork
> - ExprNode/Sarg changes to pass a Conf during initialization - this allows 
> the expression to retrieve the MapWork at query time (using 
> Utilities.getMapWork(Configuration)) to access runtime-supplied values.
> - Ability to populate the runtime values in Tez mode via incoming Tez edges



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-15270) ExprNode/Sarg changes to support values supplied during query runtime

2016-11-23 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691853#comment-15691853
 ] 

Hive QA commented on HIVE-15270:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12840340/HIVE-15270.2.patch

{color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 10718 tests 
executed
*Failed tests:*
{noformat}
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=111)

[bucketmapjoin3.q,union_date.q,cbo_gby.q,auto_join31.q,auto_sortmerge_join_1.q,join_cond_pushdown_unqual1.q,ppd_outer_join3.q,bucket_map_join_spark3.q,union28.q,statsfs.q,escape_sortby1.q,leftsemijoin.q,groupby_multi_single_reducer3.q,union_remove_6.q,join29.q]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[transform_ppr2] 
(batchId=133)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[join_acid_non_acid]
 (batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats]
 (batchId=145)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteVarchar 
(batchId=170)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/2272/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/2272/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-2272/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12840340 - PreCommit-HIVE-Build

> ExprNode/Sarg changes to support values supplied during query runtime
> -
>
> Key: HIVE-15270
> URL: https://issues.apache.org/jira/browse/HIVE-15270
> Project: Hive
>  Issue Type: Improvement
>Reporter: Jason Dere
>Assignee: Jason Dere
> Attachments: HIVE-15270.1.patch, HIVE-15270.2.patch
>
>
> Infrastructure changes to support retrieval of query-runtime supplied values, 
> needed for dynamic min/max (HIVE-15269) and bloomfilter join optimizations.
> - Some concept of available runtime values that can be retrieved for a 
> MapWork/ReduceWork
> - ExprNode/Sarg changes to pass a Conf during initialization - this allows 
> the expression to retrieve the MapWork at query time (using 
> Utilities.getMapWork(Configuration)) to access runtime-supplied values.
> - Ability to populate the runtime values in Tez mode via incoming Tez edges



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-15270) ExprNode/Sarg changes to support values supplied during query runtime

2016-11-23 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689462#comment-15689462
 ] 

Hive QA commented on HIVE-15270:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12840212/HIVE-15270.1.patch

{color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 9 failed/errored test(s), 10702 tests 
executed
*Failed tests:*
{noformat}
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=120)

[groupby3_map.q,union11.q,union26.q,mapreduce1.q,mapjoin_addjar.q,bucket_map_join_spark1.q,udf_example_add.q,multi_insert_with_join.q,sample7.q,auto_join_nulls.q,ppd_outer_join4.q,load_dyn_part8.q,sample6.q,bucket_map_join_1.q,auto_sortmerge_join_9.q]
TestSparkCliDriver - did not produce a TEST-*.xml file (likely timed out) 
(batchId=125)

[ppd_transform.q,auto_join9.q,auto_join1.q,vector_data_types.q,input14.q,union30.q,input12.q,union_remove_22.q,vectorization_3.q,groupby1_map_nomap.q,cbo_union.q,disable_merge_for_bucketing.q,reduce_deduplicate_exclude_join.q,filter_join_breaktask2.q,join30.q]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[transform_ppr2] 
(batchId=133)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[join_acid_non_acid]
 (batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats]
 (batchId=145)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_1] 
(batchId=90)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_4] 
(batchId=91)
org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression1 
(batchId=245)
org.apache.hadoop.hive.ql.io.sarg.TestConvertAstToSearchArg.testExpression3 
(batchId=245)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/2256/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/2256/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-2256/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 9 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12840212 - PreCommit-HIVE-Build

> ExprNode/Sarg changes to support values supplied during query runtime
> -
>
> Key: HIVE-15270
> URL: https://issues.apache.org/jira/browse/HIVE-15270
> Project: Hive
>  Issue Type: Improvement
>Reporter: Jason Dere
>Assignee: Jason Dere
> Attachments: HIVE-15270.1.patch
>
>
> Infrastructure changes to support retrieval of query-runtime supplied values, 
> needed for dynamic min/max (HIVE-15269) and bloomfilter join optimizations.
> - Some concept of available runtime values that can be retrieved for a 
> MapWork/ReduceWork
> - ExprNode/Sarg changes to pass a Conf during initialization - this allows 
> the expression to retrieve the MapWork at query time (using 
> Utilities.getMapWork(Configuration)) to access runtime-supplied values.
> - Ability to populate the runtime values in Tez mode via incoming Tez edges



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)