[jira] [Commented] (SPARK-23742) Filter out redundant AssociationRules

2018-08-01 Thread yuhao yang (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-23742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566326#comment-16566326
 ] 

yuhao yang commented on SPARK-23742:


[~maropu] Can you be more specific about the suggestion? E.g. how would it work 
with the example in the description. Thanks

> Filter out redundant AssociationRules
> -
>
> Key: SPARK-23742
> URL: https://issues.apache.org/jira/browse/SPARK-23742
> Project: Spark
>  Issue Type: Improvement
>  Components: ML
>Affects Versions: 2.3.0
>Reporter: Joseph K. Bradley
>Priority: Major
>
> AssociationRules can generate redundant rules such as:
> * (A) => C
> * (A,B) => C  (redundant)
> It should optionally filter out redundant rules.  It'd be nice to have it 
> optional (but maybe defaulting to filtering) so that users could compare the 
> confidences of more general vs. more specific rules.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-23742) Filter out redundant AssociationRules

2018-08-01 Thread Takeshi Yamamuro (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-23742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566266#comment-16566266
 ] 

Takeshi Yamamuro commented on SPARK-23742:
--

Can't we control this case by a new config implemented in SPARK-24802?

> Filter out redundant AssociationRules
> -
>
> Key: SPARK-23742
> URL: https://issues.apache.org/jira/browse/SPARK-23742
> Project: Spark
>  Issue Type: Improvement
>  Components: ML
>Affects Versions: 2.3.0
>Reporter: Joseph K. Bradley
>Priority: Major
>
> AssociationRules can generate redundant rules such as:
> * (A) => C
> * (A,B) => C  (redundant)
> It should optionally filter out redundant rules.  It'd be nice to have it 
> optional (but maybe defaulting to filtering) so that users could compare the 
> confidences of more general vs. more specific rules.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-23742) Filter out redundant AssociationRules

2018-08-01 Thread yuhao yang (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-23742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564858#comment-16564858
 ] 

yuhao yang commented on SPARK-23742:


The redundant rule may have different confidence and support.

> Filter out redundant AssociationRules
> -
>
> Key: SPARK-23742
> URL: https://issues.apache.org/jira/browse/SPARK-23742
> Project: Spark
>  Issue Type: Improvement
>  Components: ML
>Affects Versions: 2.3.0
>Reporter: Joseph K. Bradley
>Priority: Major
>
> AssociationRules can generate redundant rules such as:
> * (A) => C
> * (A,B) => C  (redundant)
> It should optionally filter out redundant rules.  It'd be nice to have it 
> optional (but maybe defaulting to filtering) so that users could compare the 
> confidences of more general vs. more specific rules.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org