[jira] [Commented] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-03 Thread sam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986722#comment-16986722 ] sam commented on SPARK-30101: - [~cloud_fan] [~kabhwan] Well this is at least a documentation

[jira] [Commented] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986645#comment-16986645 ] Jungtaek Lim commented on SPARK-30101: -- Spark SQL has a configuration for the numbe

[jira] [Commented] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986619#comment-16986619 ] Aman Omer commented on SPARK-30101: --- {code:java} scala> ds.distinct.explain == Physic

[jira] [Commented] (SPARK-30101) Dataset distinct does not respect spark.default.parallelism

2019-12-02 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986594#comment-16986594 ] Aman Omer commented on SPARK-30101: --- I am checking this. > Dataset distinct does not