[jira] [Closed] (MRQL-81) Fix the coercion of persistent collections to in-memory bags

[Leonidas Fegaras (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MRQL-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Leonidas Fegaras closed MRQL-81.

Resolution: Fixed

> Fix the coercion of persistent collections to in-memory bags 
> -
>
> Key: MRQL-81
> URL: https://issues.apache.org/jira/browse/MRQL-81
> Project: MRQL
>  Issue Type: Bug
>  Components: Run-Time/Flink, Run-Time/MapReduce, Run-Time/Spark
>Affects Versions: 0.9.6
>Reporter: Leonidas Fegaras
>Assignee: Leonidas Fegaras
>Priority: Critical
>
> Currently, query results that are persistent bags (such as Spark RDDs or 
> Flink DataSets) are coerced to in-memory bags before they are printed. This 
> needs to be done at any place in the query result. This came out when we used 
> matrix factorization (query/factorization.mrql) because its output are the 
> two matrix factors (datasets) in a tuple. It was reported by Ahmed Ulde. It 
> will be fixed by adding a new case for tuple projection in the query 
> evaluator that coerces persistent datasets to bags when they appear in the 
> query output.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Closed] (MRQL-82) Fix the split size calculation in map-reduce mode

[Leonidas Fegaras (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MRQL-82?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Leonidas Fegaras closed MRQL-82.

Resolution: Fixed

> Fix the split size calculation in map-reduce mode
> -
>
> Key: MRQL-82
> URL: https://issues.apache.org/jira/browse/MRQL-82
> Project: MRQL
>  Issue Type: Bug
>  Components: Run-Time/MapReduce
>Affects Versions: 0.9.6
>Reporter: Leonidas Fegaras
>Assignee: Leonidas Fegaras
>Priority: Critical
>
> The MapReducePlan.setupSplits method that sets the mapper's min and max split 
> size based on number of requested nodes in map-reduce does not terminate if 
> the input is a number generator (created by the MRQL n...m syntax). Easy fix.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)