[jira] [Created] (SPARK-13735) Log for parquet relation reading files is too verbose

Zhong Wang created SPARK-13735: -- Summary: Log for parquet relation reading files is too verbose Key: SPARK-13735 URL: https://issues.apache.org/jira/browse/SPARK-13735 Project: Spark Issue

[jira] [Created] (SPARK-13704) TaskSchedulerImpl.createTaskSetManager can be expensive, and result in lost executors due to blocked heartbeats

Zhong Wang created SPARK-13704: -- Summary: TaskSchedulerImpl.createTaskSetManager can be expensive, and result in lost executors due to blocked heartbeats Key: SPARK-13704 URL:

[jira] [Commented] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179339#comment-15179339 ] Zhong Wang commented on SPARK-13337: The current join method with usingColumns argument generates

[jira] [Comment Edited] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175154#comment-15175154 ] Zhong Wang edited comment on SPARK-13337 at 3/2/16 6:50 AM: suppose we are

[jira] [Commented] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175154#comment-15175154 ] Zhong Wang commented on SPARK-13337: suppose we have two tables: -- TableA ||key1||key2||value1||

[jira] [Comment Edited] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175154#comment-15175154 ] Zhong Wang edited comment on SPARK-13337 at 3/2/16 6:50 AM: suppose we have

[jira] [Comment Edited] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172881#comment-15172881 ] Zhong Wang edited comment on SPARK-13337 at 2/29/16 11:40 PM: -- It doesn't

[jira] [Commented] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172881#comment-15172881 ] Zhong Wang commented on SPARK-13337: It doesn't help in my case, because it doesn't support null-safe

[jira] [Comment Edited] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172709#comment-15172709 ] Zhong Wang edited comment on SPARK-13337 at 2/29/16 10:05 PM: -- For an outer

[jira] [Commented] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156579#comment-15156579 ] Zhong Wang commented on SPARK-13337: Unfortunately no... I use the join-on-columns function to

[jira] [Updated] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong Wang updated SPARK-13337: --- Description: Currently, the join-on-columns function: {code} def join(right: DataFrame,

[jira] [Created] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

Zhong Wang created SPARK-13337: -- Summary: DataFrame join-on-columns function should support null-safe equal Key: SPARK-13337 URL: https://issues.apache.org/jira/browse/SPARK-13337 Project: Spark