[jira] [Updated] (HIVE-12992) Hive on tez: Bucket map join plan is incorrect

[Vikram Dixit K (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vikram Dixit K updated HIVE-12992:
--
   Resolution: Fixed
Fix Version/s: 2.0.1
   2.1.0
   1.2.2
   Status: Resolved  (was: Patch Available)

> Hive on tez: Bucket map join plan is incorrect
> --
>
> Key: HIVE-12992
> URL: https://issues.apache.org/jira/browse/HIVE-12992
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 1.2.1, 2.0.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
>  Labels: tez
> Fix For: 1.2.2, 2.1.0, 2.0.1
>
> Attachments: HIVE-12992.1.patch, HIVE-12992.2.patch
>
>
> TPCH Query 9 fails when bucket map join is enabled:
> {code}
> FAILED: Execution Error, return code 2 from 
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 
> 5, vertexId=vertex_1450634494433_0007_2_06, diagnostics=[Exception in 
> EdgeManager, vertex=vertex_1450634494433_0007_2_06 [Reducer 5], Fail to 
> sendTezEventToDestinationTasks, event:DataMovementEvent [sourceIndex=0, 
> targetIndex=-1, version=0], sourceInfo:{ producerConsumerType=OUTPUT, 
> taskVertexName=Map 1, edgeVertexName=Reducer 5, 
> taskAttemptId=attempt_1450634494433_0007_2_05_00_0 }, 
> destinationInfo:null, EdgeInfo: sourceVertexName=Map 1, 
> destinationVertexName=Reducer 5, java.lang.NullPointerException
>   at 
> org.apache.hadoop.hive.ql.exec.tez.CustomPartitionEdge.routeDataMovementEventToDestination(CustomPartitionEdge.java:88)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:458)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.handleCompositeDataMovementEvent(Edge.java:386)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:439)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4382)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:202)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4172)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4164)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-12992) Hive on tez: Bucket map join plan is incorrect

[Vikram Dixit K (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vikram Dixit K updated HIVE-12992:
--
Attachment: HIVE-12992.2.patch

> Hive on tez: Bucket map join plan is incorrect
> --
>
> Key: HIVE-12992
> URL: https://issues.apache.org/jira/browse/HIVE-12992
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 1.2.1, 2.0.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
>  Labels: tez
> Attachments: HIVE-12992.1.patch, HIVE-12992.2.patch
>
>
> TPCH Query 9 fails when bucket map join is enabled:
> {code}
> FAILED: Execution Error, return code 2 from 
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 
> 5, vertexId=vertex_1450634494433_0007_2_06, diagnostics=[Exception in 
> EdgeManager, vertex=vertex_1450634494433_0007_2_06 [Reducer 5], Fail to 
> sendTezEventToDestinationTasks, event:DataMovementEvent [sourceIndex=0, 
> targetIndex=-1, version=0], sourceInfo:{ producerConsumerType=OUTPUT, 
> taskVertexName=Map 1, edgeVertexName=Reducer 5, 
> taskAttemptId=attempt_1450634494433_0007_2_05_00_0 }, 
> destinationInfo:null, EdgeInfo: sourceVertexName=Map 1, 
> destinationVertexName=Reducer 5, java.lang.NullPointerException
>   at 
> org.apache.hadoop.hive.ql.exec.tez.CustomPartitionEdge.routeDataMovementEventToDestination(CustomPartitionEdge.java:88)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:458)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.handleCompositeDataMovementEvent(Edge.java:386)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:439)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4382)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:202)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4172)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4164)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-12992) Hive on tez: Bucket map join plan is incorrect

[Vikram Dixit K (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vikram Dixit K updated HIVE-12992:
--
Attachment: HIVE-12992.1.patch

> Hive on tez: Bucket map join plan is incorrect
> --
>
> Key: HIVE-12992
> URL: https://issues.apache.org/jira/browse/HIVE-12992
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 1.2.1, 2.0.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
>  Labels: tez
> Attachments: HIVE-12992.1.patch
>
>
> TPCH Query 9 fails when bucket map join is enabled:
> {code}
> FAILED: Execution Error, return code 2 from 
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 
> 5, vertexId=vertex_1450634494433_0007_2_06, diagnostics=[Exception in 
> EdgeManager, vertex=vertex_1450634494433_0007_2_06 [Reducer 5], Fail to 
> sendTezEventToDestinationTasks, event:DataMovementEvent [sourceIndex=0, 
> targetIndex=-1, version=0], sourceInfo:{ producerConsumerType=OUTPUT, 
> taskVertexName=Map 1, edgeVertexName=Reducer 5, 
> taskAttemptId=attempt_1450634494433_0007_2_05_00_0 }, 
> destinationInfo:null, EdgeInfo: sourceVertexName=Map 1, 
> destinationVertexName=Reducer 5, java.lang.NullPointerException
>   at 
> org.apache.hadoop.hive.ql.exec.tez.CustomPartitionEdge.routeDataMovementEventToDestination(CustomPartitionEdge.java:88)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:458)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.handleCompositeDataMovementEvent(Edge.java:386)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:439)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4382)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:202)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4172)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4164)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-12992) Hive on tez: Bucket map join plan is incorrect

[Vikram Dixit K (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vikram Dixit K updated HIVE-12992:
--
Status: Patch Available  (was: Open)

> Hive on tez: Bucket map join plan is incorrect
> --
>
> Key: HIVE-12992
> URL: https://issues.apache.org/jira/browse/HIVE-12992
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 2.0.0, 1.2.1
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
>  Labels: tez
> Attachments: HIVE-12992.1.patch
>
>
> TPCH Query 9 fails when bucket map join is enabled:
> {code}
> FAILED: Execution Error, return code 2 from 
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 
> 5, vertexId=vertex_1450634494433_0007_2_06, diagnostics=[Exception in 
> EdgeManager, vertex=vertex_1450634494433_0007_2_06 [Reducer 5], Fail to 
> sendTezEventToDestinationTasks, event:DataMovementEvent [sourceIndex=0, 
> targetIndex=-1, version=0], sourceInfo:{ producerConsumerType=OUTPUT, 
> taskVertexName=Map 1, edgeVertexName=Reducer 5, 
> taskAttemptId=attempt_1450634494433_0007_2_05_00_0 }, 
> destinationInfo:null, EdgeInfo: sourceVertexName=Map 1, 
> destinationVertexName=Reducer 5, java.lang.NullPointerException
>   at 
> org.apache.hadoop.hive.ql.exec.tez.CustomPartitionEdge.routeDataMovementEventToDestination(CustomPartitionEdge.java:88)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:458)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.handleCompositeDataMovementEvent(Edge.java:386)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:439)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4382)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:202)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4172)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4164)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-12992) Hive on tez: Bucket map join plan is incorrect

[Vikram Dixit K (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vikram Dixit K updated HIVE-12992:
--
Component/s: Tez

> Hive on tez: Bucket map join plan is incorrect
> --
>
> Key: HIVE-12992
> URL: https://issues.apache.org/jira/browse/HIVE-12992
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 1.2.1, 2.0.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
>  Labels: tez
>
> TPCH Query 9 fails when bucket map join is enabled:
> {code}
> FAILED: Execution Error, return code 2 from 
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 
> 5, vertexId=vertex_1450634494433_0007_2_06, diagnostics=[Exception in 
> EdgeManager, vertex=vertex_1450634494433_0007_2_06 [Reducer 5], Fail to 
> sendTezEventToDestinationTasks, event:DataMovementEvent [sourceIndex=0, 
> targetIndex=-1, version=0], sourceInfo:{ producerConsumerType=OUTPUT, 
> taskVertexName=Map 1, edgeVertexName=Reducer 5, 
> taskAttemptId=attempt_1450634494433_0007_2_05_00_0 }, 
> destinationInfo:null, EdgeInfo: sourceVertexName=Map 1, 
> destinationVertexName=Reducer 5, java.lang.NullPointerException
>   at 
> org.apache.hadoop.hive.ql.exec.tez.CustomPartitionEdge.routeDataMovementEventToDestination(CustomPartitionEdge.java:88)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:458)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.handleCompositeDataMovementEvent(Edge.java:386)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:439)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4382)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:202)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4172)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4164)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-12992) Hive on tez: Bucket map join plan is incorrect

[Vikram Dixit K (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vikram Dixit K updated HIVE-12992:
--
Labels: tez  (was: )

> Hive on tez: Bucket map join plan is incorrect
> --
>
> Key: HIVE-12992
> URL: https://issues.apache.org/jira/browse/HIVE-12992
> Project: Hive
>  Issue Type: Bug
>  Components: Tez
>Affects Versions: 1.2.1, 2.0.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
>  Labels: tez
>
> TPCH Query 9 fails when bucket map join is enabled:
> {code}
> FAILED: Execution Error, return code 2 from 
> org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 
> 5, vertexId=vertex_1450634494433_0007_2_06, diagnostics=[Exception in 
> EdgeManager, vertex=vertex_1450634494433_0007_2_06 [Reducer 5], Fail to 
> sendTezEventToDestinationTasks, event:DataMovementEvent [sourceIndex=0, 
> targetIndex=-1, version=0], sourceInfo:{ producerConsumerType=OUTPUT, 
> taskVertexName=Map 1, edgeVertexName=Reducer 5, 
> taskAttemptId=attempt_1450634494433_0007_2_05_00_0 }, 
> destinationInfo:null, EdgeInfo: sourceVertexName=Map 1, 
> destinationVertexName=Reducer 5, java.lang.NullPointerException
>   at 
> org.apache.hadoop.hive.ql.exec.tez.CustomPartitionEdge.routeDataMovementEventToDestination(CustomPartitionEdge.java:88)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:458)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.handleCompositeDataMovementEvent(Edge.java:386)
>   at 
> org.apache.tez.dag.app.dag.impl.Edge.sendTezEventToDestinationTasks(Edge.java:439)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4382)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:202)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4172)
>   at 
> org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:4164)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)